-- Logs begin at Wed 2022-08-03 03:22:32 UTC, end at Wed 2022-08-03 06:22:04 UTC. -- Aug 03 04:19:49.214756 n-d-826756-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 04:19:49.224592 n-d-826756-5 devstack@n-api.service[104684]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 04:19:49 2022] *** Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: nodename: n-d-826756-5 Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: machine: x86_64 Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: clock source: unix Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: pcre jit disabled Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: detected number of CPU cores: 4 Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: current working directory: / Aug 03 04:19:49.225953 n-d-826756-5 devstack@n-api.service[104684]: detected binary path: /usr/bin/uwsgi-core Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: your processes number limit is 47680 Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: your memory page size is 4096 bytes Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: detected max file descriptor number: 2048 Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: lock engine: pthread robust mutexes Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: thunder lock: enabled Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 04:19:49.226780 n-d-826756-5 devstack@n-api.service[104684]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 04:19:49.265636 n-d-826756-5 devstack@n-api.service[104684]: Python main interpreter initialized at 0x559d3762b9c0 Aug 03 04:19:49.265636 n-d-826756-5 devstack@n-api.service[104684]: python threads support enabled Aug 03 04:19:49.265636 n-d-826756-5 devstack@n-api.service[104684]: your server socket listen backlog is limited to 100 connections Aug 03 04:19:49.265636 n-d-826756-5 devstack@n-api.service[104684]: your mercy for graceful operations on workers is 90 seconds Aug 03 04:19:49.266017 n-d-826756-5 devstack@n-api.service[104684]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 04:19:49.266097 n-d-826756-5 devstack@n-api.service[104684]: *** Operational MODE: preforking *** Aug 03 04:19:49.266305 n-d-826756-5 devstack@n-api.service[104684]: *** uWSGI is running in multiple interpreter mode *** Aug 03 04:19:49.266305 n-d-826756-5 devstack@n-api.service[104684]: spawned uWSGI master process (pid: 104684) Aug 03 04:19:49.266502 n-d-826756-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 03 04:19:49.268327 n-d-826756-5 devstack@n-api.service[104684]: spawned uWSGI worker 1 (pid: 104685, cores: 1) Aug 03 04:19:49.268327 n-d-826756-5 devstack@n-api.service[104684]: spawned uWSGI worker 2 (pid: 104686, cores: 1) Aug 03 04:19:49.268327 n-d-826756-5 devstack@n-api.service[104684]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 04:19:49.926775 n-d-826756-5 devstack@n-api.service[104686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 04:19:49.935710 n-d-826756-5 devstack@n-api.service[104685]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 04:19:51.011626 n-d-826756-5 devstack@n-api.service[104686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:19:51.011626 n-d-826756-5 devstack@n-api.service[104686]: from cryptography.utils import int_from_bytes Aug 03 04:19:51.012212 n-d-826756-5 devstack@n-api.service[104686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:19:51.012212 n-d-826756-5 devstack@n-api.service[104686]: from cryptography.utils import int_from_bytes Aug 03 04:19:51.018264 n-d-826756-5 devstack@n-api.service[104685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:19:51.018264 n-d-826756-5 devstack@n-api.service[104685]: from cryptography.utils import int_from_bytes Aug 03 04:19:51.018754 n-d-826756-5 devstack@n-api.service[104685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:19:51.018754 n-d-826756-5 devstack@n-api.service[104685]: from cryptography.utils import int_from_bytes Aug 03 04:19:53.480669 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 04:19:53.481234 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 04:19:53.481422 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 04:19:53.481776 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 04:19:53.482026 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 04:19:53.482404 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.482720 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.482944 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 04:19:53.483395 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.483480 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 04:19:53.483565 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.483801 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.483928 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 04:19:53.484013 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.484227 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 04:19:53.484357 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.484508 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 04:19:53.484607 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.484892 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.484979 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485151 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485243 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485458 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485554 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485784 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.485922 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486098 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486202 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486397 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486497 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486697 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.486801 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487005 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487122 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487301 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487407 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487592 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487688 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.487900 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488004 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488221 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488408 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488563 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488845 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.488955 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489146 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489240 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489448 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489551 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489752 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.489850 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490066 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490168 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490381 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490532 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490672 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490862 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.490975 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491173 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491268 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491476 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491569 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491790 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.491936 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492127 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492233 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492523 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492649 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492825 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.492916 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493147 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493317 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493454 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493622 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493777 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.493923 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494084 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494239 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494484 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494608 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494788 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.494894 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495098 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495205 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495407 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495516 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495746 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.495834 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496060 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496161 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496376 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496484 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496680 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496775 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.496983 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497095 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497295 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497392 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497595 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497692 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497893 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.497989 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.498136 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.498225 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.498436 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.498546 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.498750 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.499400 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.499720 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.499818 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500012 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500110 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500283 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500420 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500562 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500734 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.500890 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501029 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501168 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501321 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501465 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501602 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501752 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.501889 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502032 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502178 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502315 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502489 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502626 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502769 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.502920 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503056 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503190 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503326 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503472 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503608 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503753 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.503894 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504027 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504169 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504332 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504485 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504634 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504776 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.504920 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505057 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505264 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505415 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505551 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505686 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505821 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.505977 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506117 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506211 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506408 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506522 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506708 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.506842 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507017 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507150 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507328 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507470 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507628 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.507870 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508017 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508134 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508217 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508433 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508535 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508772 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.508868 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509091 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509185 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509352 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509445 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509644 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509740 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.509941 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510040 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510256 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510348 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510556 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510653 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510853 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.510940 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511151 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511246 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511442 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511543 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511739 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.511826 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512018 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512117 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512338 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512440 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512638 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512725 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.512936 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513034 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513232 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513328 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513530 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513617 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513825 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.513912 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.514122 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.514209 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.514450 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515094 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515344 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515442 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515646 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515743 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.515946 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516033 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516243 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516395 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516568 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516657 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516883 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.516978 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517181 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517276 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517480 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517570 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517792 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.517887 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518089 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518183 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518384 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518473 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518695 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518783 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.518995 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519092 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519293 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519393 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519602 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519696 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.519898 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520001 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520197 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520335 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520534 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520633 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520835 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.520930 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521136 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521225 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521430 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521525 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521727 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.521827 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522022 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522118 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522319 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522407 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522612 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522712 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.522910 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523009 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523202 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523289 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523508 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523602 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523811 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.523898 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524109 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524196 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524432 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524532 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524729 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.524816 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.525030 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.525122 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.525330 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.525425 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.525629 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.525716 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.525926 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.526013 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.526241 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.526329 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.526560 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.526647 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.526865 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.526963 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.527169 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.527256 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.527472 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.527567 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.527780 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.527875 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:19:53.528098 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.528196 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.528427 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.528517 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.528731 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.528828 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529034 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529130 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529347 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529435 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529657 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529757 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.529980 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.530084 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.530810 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.530923 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531121 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531324 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531432 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531660 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531767 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.531975 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532064 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532305 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532398 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532622 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532711 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.532944 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533090 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533264 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533359 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533595 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533684 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533900 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.533998 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534217 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534304 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534526 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534612 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534830 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.534926 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535133 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535232 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535435 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535523 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535749 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.535853 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536062 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536148 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536397 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536488 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536711 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.536801 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537015 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537103 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537317 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537412 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537619 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537708 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.537922 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538010 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538224 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538312 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538547 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538635 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538854 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.538942 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539163 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539258 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539469 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539560 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539779 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.539867 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540089 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540220 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540415 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540510 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540723 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.540821 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541020 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541117 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541323 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541424 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541620 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541709 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.541922 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542020 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542219 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542322 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542533 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542627 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542843 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.542939 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543141 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543237 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543447 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543540 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543750 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.543846 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544051 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544139 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544374 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544477 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544677 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544770 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.544973 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545060 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545276 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545371 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545575 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545674 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.545927 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546029 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546247 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546349 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546549 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546647 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546846 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.546935 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547160 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547249 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547459 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547556 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547756 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.547843 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548061 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548158 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548386 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548477 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548692 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548780 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.548991 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549087 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549293 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549389 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549604 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549691 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.549906 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550003 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550209 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550303 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550516 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550606 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550819 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.550921 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551131 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551218 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551447 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551547 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551751 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.551840 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552058 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552145 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552378 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552471 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552683 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552773 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.552980 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553069 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553277 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553365 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553576 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553677 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553878 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.553967 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554184 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554280 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554470 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554559 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554764 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.554861 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555059 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555155 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555356 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555444 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555670 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555760 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.555972 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556072 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556296 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556402 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556584 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556685 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556880 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.556983 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557178 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557272 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557480 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557577 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557781 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.557878 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558083 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558171 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558385 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558473 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558706 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.558795 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559013 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559109 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559316 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559404 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559616 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559705 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.559915 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560017 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560216 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560328 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560557 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560647 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560872 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.560960 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.561176 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.561271 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562089 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562219 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562478 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562588 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562718 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.562845 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563013 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563161 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563328 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563473 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563629 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563786 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.563939 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564095 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564312 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564434 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564624 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564755 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.564936 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565108 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565254 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565368 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565561 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565672 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565870 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.565987 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566173 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566298 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566476 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566616 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566780 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.566922 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567084 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567237 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567397 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567574 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567699 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567909 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.567996 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568226 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568416 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568572 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568661 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568881 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.568968 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569194 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569298 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569496 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569583 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569804 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.569935 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570126 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570286 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570452 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570542 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570761 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.570850 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571066 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571155 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571380 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571469 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571685 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571772 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.571987 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572077 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572309 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572402 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572613 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572703 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.572912 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573002 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573214 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573315 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573521 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573611 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573823 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.573920 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574126 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574214 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574422 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574518 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574729 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.574817 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575031 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575119 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575327 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575422 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575622 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575730 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.575926 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576015 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576240 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576373 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576563 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576651 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.576875 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577044 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577267 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577450 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577535 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577704 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.577834 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578007 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578147 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578325 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578457 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578630 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578762 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.578927 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579066 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579225 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579377 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579520 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579700 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.579855 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580011 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580157 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580363 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580483 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580690 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580792 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.580996 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581095 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581300 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581405 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581627 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581725 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.581937 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582053 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582239 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582335 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582539 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582644 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582841 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.582938 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583140 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583243 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583447 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583568 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583755 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.583870 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584061 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584150 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584390 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584495 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584700 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.584789 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585003 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585097 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585308 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585406 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585612 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585707 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585910 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.585997 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.586231 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.586328 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.586536 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.586629 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.586844 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587146 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587248 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587453 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587547 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587760 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.587849 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588071 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588167 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588408 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588509 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588716 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.588817 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589022 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589119 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589323 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589412 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589631 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589718 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.589942 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590042 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590249 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590504 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590613 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590839 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.590937 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591140 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591238 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591437 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591534 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591734 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.591832 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.592031 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.592128 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.592366 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.592467 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.593219 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.593317 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.593615 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.593752 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.593896 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594062 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594198 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594375 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594505 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594681 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594804 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.594986 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595107 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595296 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595406 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595600 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595720 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.595902 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596022 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596205 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596326 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596540 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596629 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596845 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.596932 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597148 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597247 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597450 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597538 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597753 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.597841 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598065 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598165 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598367 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598455 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598677 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598772 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.598980 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599075 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599299 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599387 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599606 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599693 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.599903 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.600010 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.600197 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.600583 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.600784 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.600884 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601081 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601170 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601382 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601477 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601685 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601774 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.601986 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602076 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602288 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602437 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602588 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602676 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602882 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.602972 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603184 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603272 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603481 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603578 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603788 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.603880 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604090 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604180 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604410 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604519 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604709 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.604798 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605012 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605099 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605310 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605407 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605607 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605696 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.605909 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606001 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606202 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606300 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606502 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606589 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606796 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.606882 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607093 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607190 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607387 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607476 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607691 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607786 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.607990 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.608077 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.608394 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.608496 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.608726 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.609063 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.609251 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.609488 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.609627 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.609799 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620349 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620447 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620447 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620621 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620710 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620844 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.620937 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621019 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621108 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621189 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621268 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621355 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621435 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621523 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621605 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621693 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621774 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621853 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.621932 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622019 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622101 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622181 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622267 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622348 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622427 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622514 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622594 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622662 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622737 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622816 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622897 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.622990 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623087 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623174 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623262 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623343 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623434 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623523 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623610 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623698 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.623779 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624431 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624531 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624614 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624701 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624783 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624851 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.624937 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625027 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625108 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625187 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625265 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625344 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625430 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625519 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625600 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625687 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625768 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625847 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.625934 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626016 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626095 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626174 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626253 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626359 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626492 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626587 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626672 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626752 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626837 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626908 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.626990 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627082 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627192 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627298 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627448 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627534 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627690 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627773 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627854 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.627933 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628013 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628101 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628182 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628262 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628392 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628476 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628556 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628643 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628724 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628804 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628890 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.628978 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629059 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629151 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629232 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629312 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629391 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629469 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629547 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629547 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629708 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629788 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629874 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.629954 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630041 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630129 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630209 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630287 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630374 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630517 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630612 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630694 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630775 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.630917 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631003 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631083 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631172 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631255 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631342 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631423 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631502 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631581 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631669 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631750 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631830 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631909 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.631988 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632076 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632165 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632257 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632361 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632441 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632521 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632613 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632702 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632773 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632840 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632919 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.632998 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633090 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633178 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633259 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633346 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633427 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633506 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633597 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633678 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633770 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633858 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.633946 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634195 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634195 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634354 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634354 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634495 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634627 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634723 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634812 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634893 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.634980 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635074 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635156 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635248 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635329 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635408 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635495 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635576 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635655 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635743 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635825 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.635905 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636045 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636319 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636435 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636633 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636723 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.636943 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637039 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637252 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637349 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637558 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637651 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637861 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.637949 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638169 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638329 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638499 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638635 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638795 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.638938 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.639096 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.639254 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.639397 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.640257 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.640442 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.640653 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.640842 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.640936 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641007 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641190 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641351 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641495 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641662 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641817 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.641967 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.642137 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.642389 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.642478 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.642702 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.642800 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643012 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643117 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643329 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643426 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643647 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643736 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.643954 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644044 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644254 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644367 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644647 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644737 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.644965 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645054 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645279 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645375 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645592 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645690 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645900 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.645989 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646198 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646286 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646498 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646596 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646803 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.646893 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647102 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647192 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647399 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647496 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647717 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.647814 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648017 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648128 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648347 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648478 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648655 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648790 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.648958 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649111 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649257 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649435 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649555 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649742 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.649871 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650046 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650169 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650355 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650485 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650659 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650793 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.650961 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651106 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651282 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651420 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651586 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651718 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.651895 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652036 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652208 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652358 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652539 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652639 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652842 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.652975 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653146 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653237 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653469 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653556 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653772 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.653862 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654094 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654202 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654408 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654500 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654729 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.654819 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655064 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655179 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655389 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655550 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655718 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.655877 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656007 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656105 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656340 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656448 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656663 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656760 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.656963 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657061 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657262 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657360 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657566 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657698 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657865 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.657954 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658163 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658262 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658464 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658580 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658765 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.658897 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659062 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659231 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659359 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659558 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659647 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659876 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.659978 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660193 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660339 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660543 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660644 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660850 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.660996 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661149 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661270 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661447 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661542 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661744 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.661854 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662044 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662132 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662351 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662440 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662660 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662758 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.662963 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663067 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663265 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663371 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663565 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663655 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663870 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.663958 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664174 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664260 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664508 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664597 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664817 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.664967 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665103 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665244 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665393 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665532 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665697 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.665834 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666037 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666187 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666336 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666474 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666612 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666749 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.666893 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667038 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667176 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667313 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667450 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667594 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.667856 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668065 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668218 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668332 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668506 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668608 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668823 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.668922 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669140 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669229 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669455 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669545 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669769 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.669867 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.670072 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.670160 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.670376 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.670465 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671207 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671360 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671515 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671665 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671818 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.671977 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.672140 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.672238 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.672569 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.672699 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.672901 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673027 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673214 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673337 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673524 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673624 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673831 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.673939 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674139 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674237 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674491 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674599 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674800 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.674928 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675100 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675198 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675404 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675500 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675724 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.675898 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676014 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676120 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676342 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676442 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676647 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676746 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.676953 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677057 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677262 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677369 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677569 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677675 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677872 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.677970 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678178 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678275 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678484 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678583 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678801 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.678898 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679113 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679218 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679427 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679525 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679728 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.679823 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680031 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680140 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680358 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680456 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680666 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680871 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.680972 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681184 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681274 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681518 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681610 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681847 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.681956 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682160 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682247 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682469 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682565 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682781 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.682877 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683104 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683200 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683407 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683495 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683708 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.683797 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684013 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684109 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684337 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684431 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684641 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.684928 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685016 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685246 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685351 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685538 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685633 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685852 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.685948 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.686154 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.686242 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.687075 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.687349 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.687439 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.687699 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.687796 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688000 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688100 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688324 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688417 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688638 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688727 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.688947 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689049 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689247 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689334 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689564 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689652 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689864 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.689963 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690162 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690249 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690467 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690549 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690776 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.690901 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691073 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691315 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691541 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691659 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691777 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.691965 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692079 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692279 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692505 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692637 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692756 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692871 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.692979 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693181 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693296 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693483 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693620 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693782 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.693897 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694082 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694205 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694387 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694514 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694684 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694806 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.694983 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695098 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695284 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695398 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695578 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695698 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695882 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.695981 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696180 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696300 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696509 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696638 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696807 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.696921 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697113 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697229 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697413 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697536 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697715 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.697828 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698082 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698210 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698328 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698436 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698616 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698744 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.698918 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699034 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699221 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699363 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699523 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699663 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699828 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.699961 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700129 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700258 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700458 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700597 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700758 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.700888 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.701065 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.701193 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.701367 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.701613 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702409 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702502 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702573 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702640 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702721 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702806 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702886 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.702965 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703044 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703256 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703348 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703563 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703652 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703879 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.703966 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704186 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704307 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704519 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704609 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704829 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.704917 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.705135 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.705226 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.705440 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.705687 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.705781 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706024 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706114 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706325 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706413 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706627 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706717 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.706932 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707021 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707234 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707323 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707537 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707626 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707841 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.707930 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708149 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708300 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708479 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708597 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708785 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.708876 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709095 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709185 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709405 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709503 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709714 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.709805 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710022 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710111 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710330 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710426 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710635 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710723 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.710939 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711028 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711241 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711342 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711544 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711632 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711856 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.711964 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712160 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712252 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712490 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712580 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712786 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.712887 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713127 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713222 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713444 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713534 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713761 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.713849 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714074 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714172 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714380 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714476 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714686 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714784 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.714996 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715086 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715297 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715385 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715602 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715701 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715907 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.715999 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716232 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716359 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716567 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716666 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716873 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.716963 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717206 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717301 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717509 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717607 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717891 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.717997 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718192 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718298 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718495 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718593 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718808 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.718904 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719112 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719202 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719413 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719503 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719710 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.719806 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720019 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720185 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720449 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720635 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720764 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.720915 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721058 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721222 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721374 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721522 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721670 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.721916 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722067 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722234 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722380 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722538 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722701 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722841 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.722982 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723124 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723270 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723417 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723572 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723723 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.723893 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724053 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724200 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724389 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724537 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724703 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724861 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.724989 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.725121 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.725528 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.725679 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.725811 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726041 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726159 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726274 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726404 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726535 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726535 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726711 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726795 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.726963 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.727262 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.727578 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.727892 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.728203 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.728534 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.728860 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.729164 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.729468 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.729775 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730080 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730227 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730385 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730575 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730722 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.730911 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731003 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731240 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731336 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731572 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731661 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731897 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.731988 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732208 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732342 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732546 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732650 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732859 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.732948 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.733674 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.733776 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734040 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734231 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734382 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734511 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734719 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.734811 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735028 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735131 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735338 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735426 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735645 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735734 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.735959 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736101 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736289 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736382 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736592 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736683 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.736904 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737002 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737214 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737304 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737539 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737627 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737861 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.737950 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738166 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738257 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738491 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738669 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738807 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.738900 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739122 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739212 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739435 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739532 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739764 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.739854 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740087 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740182 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740422 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740530 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740730 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.740828 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.741031 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.741136 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.741271 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 04:19:53.741369 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.741667 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.741982 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.742319 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.742631 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.742943 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.743674 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.743993 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.744327 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.744652 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.744967 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.745285 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.745612 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.745933 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.746266 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.746595 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.746908 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.747237 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.747568 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.747916 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.748231 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.748597 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.749008 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.749325 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.749640 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.749947 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:19:53.750193 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 04:19:53.895764 n-d-826756-5 devstack@n-api.service[104686]: INFO dbcounter [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Registered counter for database nova_api Aug 03 04:19:53.904005 n-d-826756-5 devstack@n-api.service[104685]: INFO dbcounter [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Registered counter for database nova_api Aug 03 04:19:53.917116 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_db.sqlalchemy.engines [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:53.923767 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:53.923917 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writer thread running {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:53.930242 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writer thread running {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:53.978625 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.context [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=104686) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 04:19:53.982675 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:19:53.984874 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:19:53.985654 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:19:53.986008 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.context [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=104685) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 04:19:53.987621 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:19:53.989624 n-d-826756-5 devstack@n-api.service[104686]: INFO dbcounter [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Registered counter for database nova_cell0 Aug 03 04:19:53.989926 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_concurrency.lockutils [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:19:53.991494 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_concurrency.lockutils [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:19:53.992309 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_concurrency.lockutils [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:19:53.994294 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_concurrency.lockutils [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104685) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:19:53.994903 n-d-826756-5 devstack@n-api.service[104686]: INFO dbcounter [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Registered counter for database nova_cell1 Aug 03 04:19:53.996300 n-d-826756-5 devstack@n-api.service[104685]: INFO dbcounter [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Registered counter for database nova_cell0 Aug 03 04:19:54.002356 n-d-826756-5 devstack@n-api.service[104685]: INFO dbcounter [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Registered counter for database nova_cell1 Aug 03 04:19:54.002741 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_db.sqlalchemy.engines [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.004402 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_db.sqlalchemy.engines [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.009722 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.010155 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writer thread running {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.011707 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.012433 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writer thread running {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.016828 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writer thread running {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.152862 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writer thread running {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.153984 n-d-826756-5 devstack@n-api.service[104686]: INFO dbcounter [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Registered counter for database nova_cell0 Aug 03 04:19:54.162006 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_db.sqlalchemy.engines [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.163665 n-d-826756-5 devstack@n-api.service[104685]: INFO dbcounter [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Registered counter for database nova_cell0 Aug 03 04:19:54.166730 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writer thread running {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.170158 n-d-826756-5 devstack@n-api.service[104685]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:19:54.175434 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writer thread running {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:19:54.579403 n-d-826756-5 devstack@n-api.service[104686]: WARNING keystonemiddleware.auth_token [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:19:54.586758 n-d-826756-5 devstack@n-api.service[104686]: WARNING keystonemiddleware.auth_token [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:19:54.604169 n-d-826756-5 devstack@n-api.service[104685]: WARNING keystonemiddleware.auth_token [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:19:54.611983 n-d-826756-5 devstack@n-api.service[104685]: WARNING keystonemiddleware.auth_token [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:19:54.930271 n-d-826756-5 devstack@n-api.service[104686]: WARNING keystonemiddleware.auth_token [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:19:54.936635 n-d-826756-5 devstack@n-api.service[104686]: WARNING keystonemiddleware.auth_token [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:19:54.941955 n-d-826756-5 devstack@n-api.service[104686]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559d3762b9c0 pid: 104686 (default app) Aug 03 04:19:54.944015 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:19:54.945229 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 03 04:19:54.945651 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Wed Aug 3 04:19:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:19:54.956297 n-d-826756-5 devstack@n-api.service[104685]: WARNING keystonemiddleware.auth_token [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:19:54.962228 n-d-826756-5 devstack@n-api.service[104685]: WARNING keystonemiddleware.auth_token [None req-e0ffd7df-ded1-4891-b295-70323f9cfa48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:19:54.967999 n-d-826756-5 devstack@n-api.service[104685]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559d3762b9c0 pid: 104685 (default app) Aug 03 04:21:14.850376 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:14.852084 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002335 Aug 03 04:21:14.852586 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:14.865434 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_api:SELECT=3 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:14.866590 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_cell0:SELECT=3 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:14.867466 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_cell1:SELECT=3 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:14.869055 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:15.745445 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-85153931-23bf-41c4-a04a-00c3c4b566a9 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:15.778640 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-85153931-23bf-41c4-a04a-00c3c4b566a9 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918450 Aug 03 04:21:15.779393 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Aug 3 04:21:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:18.021887 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:18.023209 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-acdc22c8-3143-4b54-83d0-cf4774861a95 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 Aug 03 04:21:18.023740 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:18.486616 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-bd367fca-79b3-4793-be74-80a5f2f106f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "swap": 0}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:18.508414 n-d-826756-5 devstack@n-api.service[104685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:21:18.508414 n-d-826756-5 devstack@n-api.service[104685]: warnings.warn(msg) Aug 03 04:21:18.606859 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-bd367fca-79b3-4793-be74-80a5f2f106f5 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.576626 Aug 03 04:21:18.607435 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:18.827341 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-cf13f06e-15c6-4602-b597-820d60f6371d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:18.831650 n-d-826756-5 devstack@n-api.service[104686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:21:18.831650 n-d-826756-5 devstack@n-api.service[104686]: warnings.warn(msg) Aug 03 04:21:18.834442 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_api:SELECT=3 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:18.835259 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_cell0:SELECT=3 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:18.836195 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_cell1:SELECT=3 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:18.836957 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:18.971685 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-cf13f06e-15c6-4602-b597-820d60f6371d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.355779 Aug 03 04:21:18.972612 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Aug 3 04:21:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:21.275066 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-bd367fca-79b3-4793-be74-80a5f2f106f5 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:21.276096 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-bd367fca-79b3-4793-be74-80a5f2f106f5 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 03 04:21:21.276709 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:22.090906 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-cbbd3463-d233-48e1-9231-a2cf0d6e9f3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:22.110813 n-d-826756-5 devstack@n-api.service[104686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:21:22.110813 n-d-826756-5 devstack@n-api.service[104686]: warnings.warn(msg) Aug 03 04:21:22.222328 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-cbbd3463-d233-48e1-9231-a2cf0d6e9f3d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.939116 Aug 03 04:21:22.223071 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:22.235180 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-10686a44-a537-4693-8c62-11e67b7953e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:22.238039 n-d-826756-5 devstack@n-api.service[104685]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:21:22.238039 n-d-826756-5 devstack@n-api.service[104685]: warnings.warn(msg) Aug 03 04:21:22.356618 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-10686a44-a537-4693-8c62-11e67b7953e9 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124810 Aug 03 04:21:22.357429 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Aug 3 04:21:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:21:25.028880 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-cbbd3463-d233-48e1-9231-a2cf0d6e9f3d admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:25.029565 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-cbbd3463-d233-48e1-9231-a2cf0d6e9f3d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 03 04:21:25.030438 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:25.518984 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a79c777f-5337-4353-9bfb-878e4e1e8b49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:25.627086 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a79c777f-5337-4353-9bfb-878e4e1e8b49 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.588501 Aug 03 04:21:25.628527 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:25.640234 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-1ad05064-3a00-430a-a1e8-7645a7ad84f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:25.751731 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-1ad05064-3a00-430a-a1e8-7645a7ad84f5 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115084 Aug 03 04:21:25.760987 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Aug 3 04:21:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:28.197747 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a79c777f-5337-4353-9bfb-878e4e1e8b49 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:28.202463 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a79c777f-5337-4353-9bfb-878e4e1e8b49 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 03 04:21:28.202463 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:28.809970 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-205e45c1-563a-4a4b-b733-2993c58028dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "ram": 2048}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:28.894770 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-205e45c1-563a-4a4b-b733-2993c58028dd admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689456 Aug 03 04:21:28.895514 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:28.907802 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-410f071f-4891-4829-b3e4-1c435c5efcb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:29.007388 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-410f071f-4891-4829-b3e4-1c435c5efcb4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103125 Aug 03 04:21:29.010553 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Aug 3 04:21:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:31.269224 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-205e45c1-563a-4a4b-b733-2993c58028dd admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:31.270936 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-205e45c1-563a-4a4b-b733-2993c58028dd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Aug 03 04:21:31.271800 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:31.817549 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:31.958106 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.679805 Aug 03 04:21:31.959140 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:21:31.971975 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-832669bb-b10f-471f-b3ee-a11b4a70abce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:32.065987 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-832669bb-b10f-471f-b3ee-a11b4a70abce admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097244 Aug 03 04:21:32.086599 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Wed Aug 3 04:21:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:34.411832 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:34.413867 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002458 Aug 03 04:21:34.419473 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:34.879285 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-b33bb131-b55d-4606-8a48-316c1bb85c0a admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:34.904539 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-b33bb131-b55d-4606-8a48-316c1bb85c0a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.483822 Aug 03 04:21:34.905095 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Aug 3 04:21:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:21:37.169134 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:37.170139 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a072e37e-f1db-4a49-a13f-3fea09105121 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 03 04:21:37.170541 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:37.622967 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-1fb14aa1-ba51-4dbe-bd30-4d5aceade4c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:37.715788 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-1fb14aa1-ba51-4dbe-bd30-4d5aceade4c6 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.539071 Aug 03 04:21:37.716397 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:37.731383 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-44e3f3dd-2c24-4b60-bf5f-abf6e6ab6149 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:37.834801 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-44e3f3dd-2c24-4b60-bf5f-abf6e6ab6149 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109108 Aug 03 04:21:37.835550 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Aug 3 04:21:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:40.105933 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-1fb14aa1-ba51-4dbe-bd30-4d5aceade4c6 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:40.107035 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-1fb14aa1-ba51-4dbe-bd30-4d5aceade4c6 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 03 04:21:40.107403 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:40.554997 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-4b634adf-0f05-4e8c-8095-769e8839cd33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:40.674178 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-4b634adf-0f05-4e8c-8095-769e8839cd33 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.560412 Aug 03 04:21:40.684337 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:40.690288 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-39307555-c984-4f80-a92f-647f82f713ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:40.887666 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-39307555-c984-4f80-a92f-647f82f713ed admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.201210 Aug 03 04:21:40.888263 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Aug 3 04:21:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:21:43.222051 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-4b634adf-0f05-4e8c-8095-769e8839cd33 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:43.223710 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-4b634adf-0f05-4e8c-8095-769e8839cd33 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Aug 03 04:21:43.224141 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:43.631513 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-39c5a87a-050e-4f9a-bb58-e4723e7d99ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:43.723653 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-39c5a87a-050e-4f9a-bb58-e4723e7d99ab admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.492497 Aug 03 04:21:43.724687 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:43.737389 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-a60647cb-2d4c-49a2-8427-7886a51bac8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:43.844842 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-a60647cb-2d4c-49a2-8427-7886a51bac8e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111152 Aug 03 04:21:43.845545 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Aug 3 04:21:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:46.077914 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-39c5a87a-050e-4f9a-bb58-e4723e7d99ab admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:46.078919 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-39c5a87a-050e-4f9a-bb58-e4723e7d99ab admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 03 04:21:46.079319 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:46.445625 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-57e887ef-f31c-461d-8f4e-eba8c3fbfc87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "disk": 80}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:46.451444 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:46.579132 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-57e887ef-f31c-461d-8f4e-eba8c3fbfc87 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.493707 Aug 03 04:21:46.579688 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:46.592100 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-a5c2fb2a-9f51-4b10-b52f-d5433bea6c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:46.691798 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-a5c2fb2a-9f51-4b10-b52f-d5433bea6c86 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103689 Aug 03 04:21:46.692331 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Aug 3 04:21:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:21:48.991954 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-57e887ef-f31c-461d-8f4e-eba8c3fbfc87 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:21:48.993007 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-57e887ef-f31c-461d-8f4e-eba8c3fbfc87 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 03 04:21:48.993411 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:21:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:21:49.471161 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:49.479866 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:21:49.589576 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.589260 Aug 03 04:21:49.597133 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Wed Aug 3 04:21:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:21:49.602345 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-599a5fcc-d7c8-4480-9738-9fee788ab3fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:21:49.722658 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-599a5fcc-d7c8-4480-9738-9fee788ab3fb admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124177 Aug 03 04:21:49.723534 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Wed Aug 3 04:21:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:22:14.293775 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:14.294835 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Aug 03 04:22:14.295254 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:14.686423 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-d9afcc82-6fba-46cd-acae-e946a25b2bc3 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:14.704839 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-d9afcc82-6fba-46cd-acae-e946a25b2bc3 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403563 Aug 03 04:22:14.705426 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Aug 3 04:22:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:15.778097 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:15.779162 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-fef47311-6731-410d-94d4-bca70a714a38 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Aug 03 04:22:15.779572 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:16.325709 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-f6538d0c-e39b-4fde-b60d-bb95b51f95ff admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:16.331215 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.wsgi [None req-f6538d0c-e39b-4fde-b60d-bb95b51f95ff admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-f6538d0c-e39b-4fde-b60d-bb95b51f95ff admin admin] Request method failure captured: Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Accept: application/json Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Accept-Encoding: gzip, deflate Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Connection: keep-alive Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Content-Length: 0 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Host: 10.222.0.72 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: Openstack-System-Scope: None Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: User-Agent: python-novaclient Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Auth-Token: gAAAAABi6ff3q2PNrYrpnqbW1JGvUhruYxdA5i4YL18Lvcf3j-GhwTlShnosYdAMGSQTnjttqJvTackneYYt1_Ouaw6l6RvdKbdaadjFy6aXPsGLsQ7MoLhYELQDFQ__J_zcN6h4GWyI9_uKRYmUgEym4vHFScajPttnUfPu7rjawPsW4SmPaGw Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Id: None Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Name: None Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Identity-Status: Confirmed Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Is-Admin-Project: True Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Id: default Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Name: Default Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Name: admin Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Role: reader,admin,member Aug 03 04:22:16.334620 n-d-826756-5 devstack@n-api.service[104685]: X-Roles: reader,admin,member Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant: admin Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Name: admin Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-User: admin Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Id: default Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Name: Default Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: X-User-Name: admin Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: method: > Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: exception: Flavor 42 could not be found. Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: action_args: {'id': '42'} Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:16.336348 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:16.337661 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.339084 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-f6538d0c-e39b-4fde-b60d-bb95b51f95ff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:16.340503 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-f6538d0c-e39b-4fde-b60d-bb95b51f95ff admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390371 Aug 03 04:22:16.340503 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 3 04:22:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:22:16.345866 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-fcb59c95-9963-473b-9409-ea4e07041471 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:16.369283 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-fcb59c95-9963-473b-9409-ea4e07041471 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026963 Aug 03 04:22:16.380036 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:16.386696 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-1472fa4f-4eff-47d9-8d72-edb01db5fbb7 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:16.410522 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-1472fa4f-4eff-47d9-8d72-edb01db5fbb7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027400 Aug 03 04:22:16.411062 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:16.421373 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-8e1062f0-6070-4fbd-9f20-6ab3d5eec870 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:16.427038 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.wsgi [None req-8e1062f0-6070-4fbd-9f20-6ab3d5eec870 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-8e1062f0-6070-4fbd-9f20-6ab3d5eec870 admin admin] Request method failure captured: Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Accept: application/json Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Accept-Encoding: gzip, deflate Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Connection: keep-alive Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Content-Length: 0 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Host: 10.222.0.72 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: Openstack-System-Scope: None Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: User-Agent: python-novaclient Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Auth-Token: gAAAAABi6ff3q2PNrYrpnqbW1JGvUhruYxdA5i4YL18Lvcf3j-GhwTlShnosYdAMGSQTnjttqJvTackneYYt1_Ouaw6l6RvdKbdaadjFy6aXPsGLsQ7MoLhYELQDFQ__J_zcN6h4GWyI9_uKRYmUgEym4vHFScajPttnUfPu7rjawPsW4SmPaGw Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Id: None Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Name: None Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Identity-Status: Confirmed Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Is-Admin-Project: True Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Id: default Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Name: Default Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Name: admin Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Role: reader,admin,member Aug 03 04:22:16.430635 n-d-826756-5 devstack@n-api.service[104686]: X-Roles: reader,admin,member Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant: admin Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Name: admin Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-User: admin Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Id: default Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Name: Default Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: X-User-Name: admin Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: method: > Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: exception: Flavor 42 could not be found. Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: action_args: {'id': '42'} Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:16.438323 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:16.439197 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:16.440306 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-8e1062f0-6070-4fbd-9f20-6ab3d5eec870 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:16.441661 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-8e1062f0-6070-4fbd-9f20-6ab3d5eec870 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015271 Aug 03 04:22:16.441661 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 3 04:22:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:22:17.411175 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-1472fa4f-4eff-47d9-8d72-edb01db5fbb7 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:17.412219 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-1472fa4f-4eff-47d9-8d72-edb01db5fbb7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 03 04:22:17.412668 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:22:17.944235 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-2fc39d5f-12f1-42b9-9436-cb2679fe03b5 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:17.950197 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.wsgi [None req-2fc39d5f-12f1-42b9-9436-cb2679fe03b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-2fc39d5f-12f1-42b9-9436-cb2679fe03b5 admin admin] Request method failure captured: Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Accept: application/json Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Accept-Encoding: gzip, deflate Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Connection: keep-alive Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Content-Length: 0 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Host: 10.222.0.72 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: Openstack-System-Scope: None Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: User-Agent: python-novaclient Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Auth-Token: gAAAAABi6ff5PocRLBASu2Fn2wIbXv4YgF5xJ90cmalelbQpF3cKlHcyxHI_dAB1nDzMRKGk6EIJxaJSfVaRdkm75ehFnKZRaIoClnSLw4W4n3kZq6_CYrQ8ALO6RhAM6n2nOb04oXFU-uqAyl0kLA5ozpS3JyCOMT-NBlVNBWj2F_3S_fYgGr4 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Id: None Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Name: None Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Identity-Status: Confirmed Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Is-Admin-Project: True Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Id: default Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Name: Default Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Name: admin Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Role: reader,admin,member Aug 03 04:22:17.951708 n-d-826756-5 devstack@n-api.service[104686]: X-Roles: reader,admin,member Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant: admin Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Name: admin Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-User: admin Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Id: default Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Name: Default Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: X-User-Name: admin Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: method: > Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: exception: Flavor 84 could not be found. Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: action_args: {'id': '84'} Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:17.958380 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:17.959192 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:17.960256 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-2fc39d5f-12f1-42b9-9436-cb2679fe03b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:17.961572 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-2fc39d5f-12f1-42b9-9436-cb2679fe03b5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.402600 Aug 03 04:22:17.961572 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 3 04:22:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:22:17.963066 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-6fb4d619-7955-4e0d-8e37-9f201b372bd6 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:17.978537 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-6fb4d619-7955-4e0d-8e37-9f201b372bd6 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019109 Aug 03 04:22:17.979058 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:17.989048 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-911e94b9-33d8-4bbd-a293-78ba59eb0b00 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:18.005942 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-911e94b9-33d8-4bbd-a293-78ba59eb0b00 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020396 Aug 03 04:22:18.006477 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:22:18.016673 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-e39b3621-3661-47d8-8145-299f148bca6a admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:18.022040 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.wsgi [None req-e39b3621-3661-47d8-8145-299f148bca6a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-e39b3621-3661-47d8-8145-299f148bca6a admin admin] Request method failure captured: Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Accept: application/json Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Accept-Encoding: gzip, deflate Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Connection: keep-alive Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Content-Length: 0 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Host: 10.222.0.72 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: Openstack-System-Scope: None Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: User-Agent: python-novaclient Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Auth-Token: gAAAAABi6ff5PocRLBASu2Fn2wIbXv4YgF5xJ90cmalelbQpF3cKlHcyxHI_dAB1nDzMRKGk6EIJxaJSfVaRdkm75ehFnKZRaIoClnSLw4W4n3kZq6_CYrQ8ALO6RhAM6n2nOb04oXFU-uqAyl0kLA5ozpS3JyCOMT-NBlVNBWj2F_3S_fYgGr4 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Id: None Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Name: None Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Identity-Status: Confirmed Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Is-Admin-Project: True Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Id: default Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Name: Default Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Name: admin Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Role: reader,admin,member Aug 03 04:22:18.023542 n-d-826756-5 devstack@n-api.service[104685]: X-Roles: reader,admin,member Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant: admin Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Name: admin Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-User: admin Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Id: default Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Name: Default Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: X-User-Name: admin Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: method: > Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: exception: Flavor 84 could not be found. Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: action_args: {'id': '84'} Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:18.025124 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:18.026027 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:18.027371 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-e39b3621-3661-47d8-8145-299f148bca6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:18.032026 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-e39b3621-3661-47d8-8145-299f148bca6a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012001 Aug 03 04:22:18.032026 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 3 04:22:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 04:22:18.997937 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-911e94b9-33d8-4bbd-a293-78ba59eb0b00 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:18.998938 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-911e94b9-33d8-4bbd-a293-78ba59eb0b00 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 03 04:22:18.999334 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:19.533694 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-8c18c5e3-905f-48b0-8e1e-881a3ed0b812 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:19.539348 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.wsgi [None req-8c18c5e3-905f-48b0-8e1e-881a3ed0b812 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-8c18c5e3-905f-48b0-8e1e-881a3ed0b812 admin admin] Request method failure captured: Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Accept: application/json Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Accept-Encoding: gzip, deflate Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Connection: keep-alive Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Content-Length: 0 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Host: 10.222.0.72 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: Openstack-System-Scope: None Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: User-Agent: python-novaclient Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Auth-Token: gAAAAABi6ff68tKgXxazUWJTtdC9AIkAQwIkohPCXVKrKjaWOsTEECzb_50L_1szRGmpLuNG4KzXcG-bb43dozKSdv1Hsj1l4bsQxzbHiN-KbrEVg7rcUixvZhDsbnF3G7G1rmC5NL_r_vO8u-QrmBNXHcWrDLACblW8MvSutZgllf9kfx8LVS4 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Id: None Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Domain-Name: None Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Identity-Status: Confirmed Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Is-Admin-Project: True Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Id: default Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Domain-Name: Default Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Project-Name: admin Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Role: reader,admin,member Aug 03 04:22:19.540894 n-d-826756-5 devstack@n-api.service[104685]: X-Roles: reader,admin,member Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant: admin Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-Tenant-Name: admin Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-User: admin Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Id: default Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-User-Domain-Name: Default Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: X-User-Name: admin Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: method: > Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: exception: Flavor 451 could not be found. Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: action_args: {'id': '451'} Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:19.542517 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:19.543411 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.544685 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-8c18c5e3-905f-48b0-8e1e-881a3ed0b812 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104685) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:19.546160 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-8c18c5e3-905f-48b0-8e1e-881a3ed0b812 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397913 Aug 03 04:22:19.546160 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:22:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:22:19.552483 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-b7e2aafc-ca94-45e0-b800-34ab8e7b1bd3 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:19.568233 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-b7e2aafc-ca94-45e0-b800-34ab8e7b1bd3 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019259 Aug 03 04:22:19.568799 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:19.579224 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:19.594570 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019773 Aug 03 04:22:19.595094 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Wed Aug 3 04:22:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:22:19.604553 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-d66646cc-ca59-488b-9d3e-b0ed4a3c01c0 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:19.609894 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.wsgi [None req-d66646cc-ca59-488b-9d3e-b0ed4a3c01c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-d66646cc-ca59-488b-9d3e-b0ed4a3c01c0 admin admin] Request method failure captured: Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Accept: application/json Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Accept-Encoding: gzip, deflate Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Connection: keep-alive Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Content-Length: 0 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Host: 10.222.0.72 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Openstack-Api-Version: compute 2.90 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: Openstack-System-Scope: None Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: User-Agent: python-novaclient Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Auth-Token: gAAAAABi6ff68tKgXxazUWJTtdC9AIkAQwIkohPCXVKrKjaWOsTEECzb_50L_1szRGmpLuNG4KzXcG-bb43dozKSdv1Hsj1l4bsQxzbHiN-KbrEVg7rcUixvZhDsbnF3G7G1rmC5NL_r_vO8u-QrmBNXHcWrDLACblW8MvSutZgllf9kfx8LVS4 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Id: None Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Domain-Name: None Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Identity-Status: Confirmed Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Is-Admin-Project: True Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Id: default Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Domain-Name: Default Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Project-Name: admin Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Role: reader,admin,member Aug 03 04:22:19.611364 n-d-826756-5 devstack@n-api.service[104686]: X-Roles: reader,admin,member Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf962ae0b057454f812182640c6a1be2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf962ae0b057454f812182640c6a1be2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant: admin Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Id: cf962ae0b057454f812182640c6a1be2 Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-Tenant-Name: admin Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-User: admin Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Id: default Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-User-Domain-Name: Default Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-User-Id: bcbde3a4d08549f080095b61a2d33019 Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: X-User-Name: admin Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: method: > Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: exception: Flavor 451 could not be found. Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: action_args: {'id': '451'} Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:22:19.613025 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:19.613898 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: ERROR nova.api.openstack.wsgi Aug 03 04:22:19.615010 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-d66646cc-ca59-488b-9d3e-b0ed4a3c01c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:22:19.616024 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-d66646cc-ca59-488b-9d3e-b0ed4a3c01c0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011699 Aug 03 04:22:19.616024 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:22:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 04:22:20.594942 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:20.595951 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 03 04:22:20.596372 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:21.120108 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-7b1368f6-cbab-49b5-95ce-e8e9bcdac542 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:22:21.223438 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-7b1368f6-cbab-49b5-95ce-e8e9bcdac542 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.487568 Aug 03 04:22:21.224239 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 3 04:22:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:22:22.192207 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:22.193256 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 03 04:22:22.193658 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:22.713052 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-15037be4-a750-4c1e-983a-710eda594a48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:22:22.794804 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-15037be4-a750-4c1e-983a-710eda594a48 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.461822 Aug 03 04:22:22.795354 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 3 04:22:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:22:23.762269 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:23.763328 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001774 Aug 03 04:22:23.763928 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:24.286489 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-95b8a93a-ca6c-4859-adfb-e586f74887d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:22:24.352991 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-95b8a93a-ca6c-4859-adfb-e586f74887d2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448523 Aug 03 04:22:24.353540 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 3 04:22:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:22:25.336051 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:25.337098 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 03 04:22:25.337646 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:25.861688 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-49f54608-f39b-48dc-9a86-554b3dac7614 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:22:25.948071 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-49f54608-f39b-48dc-9a86-554b3dac7614 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470644 Aug 03 04:22:25.949267 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Wed Aug 3 04:22:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:22:26.908536 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:26.909541 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 03 04:22:26.909937 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:22:27.429585 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-253e8124-930f-4b10-8256-5dad4e52477e admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:22:27.450555 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-253e8124-930f-4b10-8256-5dad4e52477e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402305 Aug 03 04:22:27.451026 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Aug 3 04:22:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:23:19.769105 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:19.770121 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c1d88145-a191-4fe2-8215-138bebd986a1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 03 04:23:19.770528 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Wed Aug 3 04:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:23:19.781818 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:23:20.160848 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-9a2b980c-f957-4ef0-aef2-3981c69d8c97 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:20.181548 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-9a2b980c-f957-4ef0-aef2-3981c69d8c97 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404179 Aug 03 04:23:20.182024 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Wed Aug 3 04:23:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:23:20.202740 n-d-826756-5 devstack@n-api.service[104685]: DEBUG dbcounter [-] [104685] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:23:20.206395 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-5cba6705-62dc-422d-867e-a6c9ffc8dabb admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:20.214354 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-5cba6705-62dc-422d-867e-a6c9ffc8dabb admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013110 Aug 03 04:23:20.216188 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Wed Aug 3 04:23:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:23:20.226514 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-d14f5d6e-43db-4ca9-9436-3417ef592830 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:20.234762 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-d14f5d6e-43db-4ca9-9436-3417ef592830 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012013 Aug 03 04:23:20.235308 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Wed Aug 3 04:23:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:23:20.246878 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:20.254959 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011848 Aug 03 04:23:20.255481 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Wed Aug 3 04:23:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:23:20.266639 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-a467427f-51ce-4de8-bc6f-46fef92584b0 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:23:20.274026 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-a467427f-51ce-4de8-bc6f-46fef92584b0 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010932 Aug 03 04:23:20.275129 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Wed Aug 3 04:23:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:29:25.053300 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:29:25.054316 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Aug 03 04:29:25.054710 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:29:25.199758 n-d-826756-5 devstack@n-api.service[104686]: DEBUG dbcounter [-] [104686] Writing DB stats nova_api:SELECT=6 {{(pid=104686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:29:25.339086 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:29:25.341435 n-d-826756-5 devstack@n-api.service[104686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:29:25.341435 n-d-826756-5 devstack@n-api.service[104686]: warnings.warn(msg) Aug 03 04:29:25.342642 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:29:25.343086 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:29:25.343868 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:29:25.344321 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:29:25.385854 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-435780c5-d1d3-4536-b4d0-d796b10ac70c admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.190905 Aug 03 04:29:25.386422 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:29:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:29:26.204979 n-d-826756-5 devstack@n-api.service[104685]: DEBUG nova.api.openstack.wsgi [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] Calling method '>' {{(pid=104685) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:29:26.205996 n-d-826756-5 devstack@n-api.service[104685]: INFO nova.api.openstack.requestlog [None req-c0107c9f-3040-4be1-9e1f-b022d379bfb7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 03 04:29:26.206399 n-d-826756-5 devstack@n-api.service[104685]: [pid: 104685|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Wed Aug 3 04:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:29:26.399776 n-d-826756-5 devstack@n-api.service[104686]: DEBUG nova.api.openstack.wsgi [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] Calling method '>' {{(pid=104686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:29:26.402220 n-d-826756-5 devstack@n-api.service[104686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:29:26.402220 n-d-826756-5 devstack@n-api.service[104686]: warnings.warn(msg) Aug 03 04:29:26.403444 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:29:26.403920 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:29:26.405244 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:29:26.405686 n-d-826756-5 devstack@n-api.service[104686]: DEBUG oslo_concurrency.lockutils [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:29:26.429455 n-d-826756-5 devstack@n-api.service[104686]: INFO nova.api.openstack.requestlog [None req-7a891c1d-c497-4c20-834a-7ea89b5bb2f3 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.082333 Aug 03 04:29:26.429937 n-d-826756-5 devstack@n-api.service[104686]: [pid: 104686|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:29:26 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:30:12.073521 n-d-826756-5 devstack@n-api.service[104684]: Wed Aug 3 04:30:12 2022 - graceful shutdown triggered... Aug 03 04:30:12.074079 n-d-826756-5 devstack@n-api.service[104685]: Gracefully killing worker 1 (pid: 104685)... Aug 03 04:30:12.074045 n-d-826756-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 04:30:12.074621 n-d-826756-5 devstack@n-api.service[104686]: Gracefully killing worker 2 (pid: 104686)... Aug 03 04:30:13.074752 n-d-826756-5 devstack@n-api.service[104684]: worker 1 buried after 1 seconds Aug 03 04:30:13.074752 n-d-826756-5 devstack@n-api.service[104684]: worker 2 buried after 1 seconds Aug 03 04:30:13.074752 n-d-826756-5 devstack@n-api.service[104684]: goodbye to uWSGI. Aug 03 04:30:13.076126 n-d-826756-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 03 04:30:13.076737 n-d-826756-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 04:30:13.079523 n-d-826756-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 04:30:13.098981 n-d-826756-5 devstack@n-api.service[120826]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 04:30:13 2022] *** Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: nodename: n-d-826756-5 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: machine: x86_64 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: clock source: unix Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: pcre jit disabled Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: detected number of CPU cores: 4 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: current working directory: / Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: detected binary path: /usr/bin/uwsgi-core Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: your processes number limit is 47680 Aug 03 04:30:13.111737 n-d-826756-5 devstack@n-api.service[120826]: your memory page size is 4096 bytes Aug 03 04:30:13.112743 n-d-826756-5 devstack@n-api.service[120826]: detected max file descriptor number: 2048 Aug 03 04:30:13.112743 n-d-826756-5 devstack@n-api.service[120826]: lock engine: pthread robust mutexes Aug 03 04:30:13.112743 n-d-826756-5 devstack@n-api.service[120826]: thunder lock: enabled Aug 03 04:30:13.112743 n-d-826756-5 devstack@n-api.service[120826]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 04:30:13.112743 n-d-826756-5 devstack@n-api.service[120826]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 04:30:13.154122 n-d-826756-5 devstack@n-api.service[120826]: Python main interpreter initialized at 0x55e22dff99c0 Aug 03 04:30:13.154122 n-d-826756-5 devstack@n-api.service[120826]: python threads support enabled Aug 03 04:30:13.154122 n-d-826756-5 devstack@n-api.service[120826]: your server socket listen backlog is limited to 100 connections Aug 03 04:30:13.154122 n-d-826756-5 devstack@n-api.service[120826]: your mercy for graceful operations on workers is 90 seconds Aug 03 04:30:13.154609 n-d-826756-5 devstack@n-api.service[120826]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 04:30:13.154609 n-d-826756-5 devstack@n-api.service[120826]: *** Operational MODE: preforking *** Aug 03 04:30:13.154842 n-d-826756-5 devstack@n-api.service[120826]: *** uWSGI is running in multiple interpreter mode *** Aug 03 04:30:13.154842 n-d-826756-5 devstack@n-api.service[120826]: spawned uWSGI master process (pid: 120826) Aug 03 04:30:13.155049 n-d-826756-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 03 04:30:13.158616 n-d-826756-5 devstack@n-api.service[120826]: spawned uWSGI worker 1 (pid: 120831, cores: 1) Aug 03 04:30:13.158616 n-d-826756-5 devstack@n-api.service[120826]: spawned uWSGI worker 2 (pid: 120832, cores: 1) Aug 03 04:30:13.158616 n-d-826756-5 devstack@n-api.service[120826]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 04:30:13.836437 n-d-826756-5 devstack@n-api.service[120831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 04:30:13.841959 n-d-826756-5 devstack@n-api.service[120832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 04:30:15.009568 n-d-826756-5 devstack@n-api.service[120832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:30:15.009568 n-d-826756-5 devstack@n-api.service[120832]: from cryptography.utils import int_from_bytes Aug 03 04:30:15.010258 n-d-826756-5 devstack@n-api.service[120832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:30:15.010258 n-d-826756-5 devstack@n-api.service[120832]: from cryptography.utils import int_from_bytes Aug 03 04:30:15.011400 n-d-826756-5 devstack@n-api.service[120831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:30:15.011400 n-d-826756-5 devstack@n-api.service[120831]: from cryptography.utils import int_from_bytes Aug 03 04:30:15.011918 n-d-826756-5 devstack@n-api.service[120831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 04:30:15.011918 n-d-826756-5 devstack@n-api.service[120831]: from cryptography.utils import int_from_bytes Aug 03 04:30:17.542574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 04:30:17.543135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 04:30:17.543360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 04:30:17.543727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 04:30:17.543989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 04:30:17.544410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.544805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.545056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.545373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.545701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.546005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.546330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.546586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 04:30:17.547037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.547137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 04:30:17.547215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.547215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.547392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 04:30:17.547578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.547797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 04:30:17.547904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.547989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 04:30:17.548152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.548442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.548636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.548736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.548953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.549914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.550966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.551184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.551500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.551966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.552901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.553857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.554025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.554190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.554465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.554678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.554817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.555947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.556281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.556601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.556940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.557264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.557583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.557988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.558946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.559980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.560165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.560355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.560504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.560644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.560892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.561999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.562978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.563162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.563337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.563512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.563685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.563943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.564114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.564319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.564572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.565201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.565495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.565682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.565848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.565999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.566248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.566492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.566763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.567851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.568011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.568296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.568468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.568643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.568880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.569992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.570910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.571849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.572220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.572409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.572576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.572732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.572879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.573959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.574105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.574265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.574422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.574594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.574834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.575979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.576204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.576415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.576586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.576734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.576888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.577883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.578996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.579960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.580901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.581054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.581211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.581369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.581534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.581691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.582441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.582597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.582757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.582990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.583928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.584985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.585238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.585403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.585654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.585817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.585974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.586926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.587853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.588042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.588201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.588455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.588673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.588839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.589872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.590939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.591870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.592949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.593098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.593298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.593458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.593621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.594018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.594179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.594334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.594487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.594635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.594796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.594962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.595207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.595438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.595610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.595876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.596115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.596286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.596467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.596711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.596877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.597042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.597198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.597354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 04:30:17.598122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.598372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.598618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.598908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.599967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.600940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.601864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.602868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.603946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.604093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.604299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.604502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.604687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.604885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.605078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.605339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.605587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.605741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.605913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.606941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.607905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.608723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.609890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.610754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.611954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.612136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.612366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.612536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.612694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.612862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.613991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.614323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.614482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.614639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.614795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.614949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.615095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.615242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.615487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.615735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.615890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.616961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.617894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.618880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.619033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.619275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.619443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.619620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.619845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.620993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.621916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.622987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.623231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.623396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.623545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.623727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.623888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.624850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.625005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.625238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.625402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.625640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.625881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.626961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.627964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.628113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.628331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.628500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.628679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.628842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.629002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.629157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.629559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.629774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.630986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.631934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.632182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.632500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.632684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.632844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.632999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.633147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.633385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.633541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.633705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.633872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.634335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.634491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.634648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.634805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.634967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.635116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.635271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.635427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.635583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.636997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.637974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.638985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.639936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.640937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.641875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.642003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.642126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.642254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.642398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.642553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.643811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.644061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.644200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.644951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.645859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.646938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.647914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.648937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.649983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.650999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.651963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.652986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.653966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.654936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.655994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.656963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.657868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.658794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.659005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.659098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.659392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.659591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.659977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.660667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.660874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.660973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.661945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.662912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.663960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.664927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.665916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.666842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.667951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.668956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.669972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.670923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.671871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.672869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.673974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.674911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.675978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.676196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.676455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.676568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.676776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.676896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.677821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.678966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.679991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.680964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.681855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.682795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.683929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.684927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.685983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.686936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.687885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.688800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.689956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.690050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.690269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.690407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.690696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.691012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.691198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.691966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.692996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.693948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.694921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.695255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.695575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.695893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.696223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.696581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.696919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.697890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.930372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.931944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.932900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.933994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.934972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.935912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.936927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.937943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.938962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.939937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.940965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.941837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.942964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.943969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.944893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.945924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.946903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.947998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.948981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.949977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.950901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.951961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.952946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.953982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.954896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.955975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.956113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.956241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.956413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.956541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.956690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.957505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.957657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.957805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.957939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.958067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.958193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.958326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.958483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.959430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.959430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.960379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.960538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.960699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.960829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.960956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.961878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.962004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.962138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.962275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.962401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.962527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.964981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.965901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.966873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.967944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.968135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.968383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.968383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.968383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.968751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.969879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.970994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.971980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.972156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.972458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.972604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.972745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.972874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.973769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.974969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.975964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.976913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.977920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.978955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.979870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.980851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.981794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.982949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.983917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.984973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.985872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.986916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.987995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.988193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.988342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.988484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.988614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.988742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.989102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.989250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.989561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.989901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.990039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.990307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.990446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.990644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.990786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.991872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.992009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.992370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.992510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.992714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.992850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.993041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.993367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.993500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.993692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.993827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.994867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.995859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.996009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.996200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.996355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.996638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.996818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.997968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.998988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.999188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.999337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.999514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.999730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:17.999936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.000910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.001997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.002201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.002417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.002637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.002820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.002954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.003179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.003326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.003589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.004350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.004716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.004852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.005117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.005388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.005526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.005730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.005865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.006053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.006196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.006387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.006716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.006850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.007983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.008980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.009114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.009313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.009453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.009617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.009787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.010827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.011956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.012927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.013073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.013238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.013415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.013550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.013850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.014939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.015912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.016048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.016233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.016409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.016618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.016756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.017909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.018078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.018404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.018540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.018736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.018870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.019072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.019215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.019451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.020439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.020730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.020874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.021901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.022037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.022236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.022414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.022576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.022908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.023151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.023263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.023470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.023577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.023798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.024901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.039924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.040743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.041973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.042867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.043955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.044991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 04:30:18.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 04:30:18.096835 n-d-826756-5 devstack@n-api.service[120831]: INFO dbcounter [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Registered counter for database nova_api Aug 03 04:30:18.101878 n-d-826756-5 devstack@n-api.service[120832]: INFO dbcounter [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Registered counter for database nova_api Aug 03 04:30:18.118251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_db.sqlalchemy.engines [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.122744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_db.sqlalchemy.engines [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.127106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writer thread running {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.132593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writer thread running {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.185047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.context [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120831) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 04:30:18.189204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:30:18.190954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:30:18.191087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.context [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120832) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 04:30:18.192343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:30:18.194354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:30:18.196037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:30:18.196381 n-d-826756-5 devstack@n-api.service[120831]: INFO dbcounter [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Registered counter for database nova_cell0 Aug 03 04:30:18.197642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:30:18.198510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:30:18.200459 n-d-826756-5 devstack@n-api.service[120831]: INFO dbcounter [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Registered counter for database nova_cell1 Aug 03 04:30:18.200571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:30:18.202501 n-d-826756-5 devstack@n-api.service[120832]: INFO dbcounter [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Registered counter for database nova_cell0 Aug 03 04:30:18.206605 n-d-826756-5 devstack@n-api.service[120832]: INFO dbcounter [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Registered counter for database nova_cell1 Aug 03 04:30:18.207896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_db.sqlalchemy.engines [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.209695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_db.sqlalchemy.engines [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.215413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writer thread running {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.216462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_db.sqlalchemy.engines [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.217974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writer thread running {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.224032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_db.sqlalchemy.engines [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.229909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writer thread running {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.235279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writer thread running {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.366251 n-d-826756-5 devstack@n-api.service[120831]: INFO dbcounter [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Registered counter for database nova_cell0 Aug 03 04:30:18.373400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_db.sqlalchemy.engines [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.378373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writer thread running {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.385531 n-d-826756-5 devstack@n-api.service[120832]: INFO dbcounter [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Registered counter for database nova_cell0 Aug 03 04:30:18.396695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_db.sqlalchemy.engines [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 04:30:18.401357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writer thread running {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 04:30:18.725088 n-d-826756-5 devstack@n-api.service[120831]: WARNING keystonemiddleware.auth_token [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:30:18.733306 n-d-826756-5 devstack@n-api.service[120831]: WARNING keystonemiddleware.auth_token [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:30:18.734924 n-d-826756-5 devstack@n-api.service[120832]: WARNING keystonemiddleware.auth_token [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:30:18.743371 n-d-826756-5 devstack@n-api.service[120832]: WARNING keystonemiddleware.auth_token [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:30:19.089218 n-d-826756-5 devstack@n-api.service[120831]: WARNING keystonemiddleware.auth_token [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:30:19.095539 n-d-826756-5 devstack@n-api.service[120831]: WARNING keystonemiddleware.auth_token [None req-b65ec7e3-40cd-49d7-aad2-9a1b671349a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:30:19.097016 n-d-826756-5 devstack@n-api.service[120832]: WARNING keystonemiddleware.auth_token [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 04:30:19.101319 n-d-826756-5 devstack@n-api.service[120831]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e22dff99c0 pid: 120831 (default app) Aug 03 04:30:19.103477 n-d-826756-5 devstack@n-api.service[120832]: WARNING keystonemiddleware.auth_token [None req-3830df5c-855b-47d6-9d79-a95dfcfd657d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 04:30:19.109048 n-d-826756-5 devstack@n-api.service[120832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e22dff99c0 pid: 120832 (default app) Aug 03 04:31:06.363068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.364697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.365867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.366686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.467417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.469249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.471424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:06.472370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:07.829812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-14cfc6de-b152-4466-9b16-d4cd2f827d65 tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1467141982", "id": 1223159828, "os-flavor-access:is_public": "True"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:07.857333 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:07.857333 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:07.988716 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-14cfc6de-b152-4466-9b16-d4cd2f827d65 tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.637195 Aug 03 04:31:07.990028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1/1] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:31:06 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:31:08.001449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '.version_select at 0x7fdd57581940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.001449 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.001449 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.003155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120832) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 03 04:31:08.003991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.004478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.037369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.037862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.062057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.062823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.073740 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8be86a3-1b21-4d08-977f-fd37e5d5bded tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.611844 Aug 03 04:31:08.076065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1/2] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:31:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:08.148572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52e34f3f-c9ae-4e1c-98b6-6cab15b3c7a4 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-333847678", "id": 771216205, "os-flavor-access:is_public": "True"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:08.234448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Calling method '.version_select at 0x7fdd5745c670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.239312 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.239312 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.240974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.241513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.259101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.259882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.270780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.271332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.294532 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c4f80dc-62c5-4055-b20f-3f06b9103cbe tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.199636 Aug 03 04:31:08.294532 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2/3] 10.222.0.72 () {60 vars in 1208 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:08.294879 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52e34f3f-c9ae-4e1c-98b6-6cab15b3c7a4 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.293775 Aug 03 04:31:08.294879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2/4] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:07 2022] POST /compute/v2.1/flavors => generated 426 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:08.356382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.358100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.358724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.359508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.359940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.402392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-121dc389-0ab8-45a5-bdae-5c65bb1d1497 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] 10.222.0.72 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.114804 Aug 03 04:31:08.402971 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3/5] 10.222.0.72 () {58 vars in 1164 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:08.407687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e5b7fa3-6315-4705-b5cf-f54d534cf50a tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:08.410454 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.410454 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:08.442343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00022a7a-4f45-433c-ab81-fa97661922cc tempest-AZAdminNegativeTestJSON-419405221 tempest-AZAdminNegativeTestJSON-419405221-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.443344 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.443344 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.444117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00022a7a-4f45-433c-ab81-fa97661922cc tempest-AZAdminNegativeTestJSON-419405221 tempest-AZAdminNegativeTestJSON-419405221-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '87d48a538ecd4583bbb084dab91ea898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3208d940468f4e67a5f4f455fd642297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00022a7a-4f45-433c-ab81-fa97661922cc tempest-AZAdminNegativeTestJSON-419405221 tempest-AZAdminNegativeTestJSON-419405221-project] Request method failure captured: Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foIe-v7yn5m_jT3TUDHbeAR0b7JkLNL6Y6Xg9RD1uLjXY2pq-qwxdzrOgGbgsdCx0vSuK4z1mPjYfOKuJPqYvtUGY9n-PwAt-W5Eana8of1B5tkf9C6Ff9izNAfEpnrK7anNnPigXQ7XdJsY_Tg0yFC3X-z9gi1J6aqiymAoLNODIA Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3208d940468f4e67a5f4f455fd642297 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AZAdminNegativeTestJSON-419405221 Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:31:08.448843 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3208d940468f4e67a5f4f455fd642297"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3208d940468f4e67a5f4f455fd642297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3208d940468f4e67a5f4f455fd642297"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3208d940468f4e67a5f4f455fd642297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AZAdminNegativeTestJSON-419405221 Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3208d940468f4e67a5f4f455fd642297 Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-419405221 Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AZAdminNegativeTestJSON-419405221-project Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 87d48a538ecd4583bbb084dab91ea898 Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AZAdminNegativeTestJSON-419405221-project Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 04:31:08.450118 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:08.451009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:08.451992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00022a7a-4f45-433c-ab81-fa97661922cc tempest-AZAdminNegativeTestJSON-419405221 tempest-AZAdminNegativeTestJSON-419405221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:08.452884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00022a7a-4f45-433c-ab81-fa97661922cc tempest-AZAdminNegativeTestJSON-419405221 tempest-AZAdminNegativeTestJSON-419405221-project] 10.222.0.72 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.172062 Aug 03 04:31:08.463848 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3/6] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 182 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:08.471472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02569cda-85cd-4c11-a584-724c802d6666 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-626551463", "name": "tempest-test_aggregate-225367135"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:08.519497 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.519497 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.520792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-02569cda-85cd-4c11-a584-724c802d6666 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid f54494a5-e696-493d-910b-b835d87c638d for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:31:08.672345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e5b7fa3-6315-4705-b5cf-f54d534cf50a tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/1223159828/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.267869 Aug 03 04:31:08.673925 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4/7] 10.222.0.72 () {62 vars in 1265 bytes} [Wed Aug 3 04:31:08 2022] POST /compute/v2.1/flavors/1223159828/os-extra_specs => generated 62 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:08.684814 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02569cda-85cd-4c11-a584-724c802d6666 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.219693 Aug 03 04:31:08.685807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4/8] 10.222.0.72 () {60 vars in 1165 bytes} [Wed Aug 3 04:31:08 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:08.687308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95fafe80-cd26-471d-95ea-bd6968090286 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.688956 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.688956 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:08.694110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.695037 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.695037 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.697966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.698514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.699380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.699949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:08.767058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bebba928-28f8-467b-a297-6679dd705496 tempest-AZAdminV2TestJSON-1082650579 tempest-AZAdminV2TestJSON-1082650579-project-admin] 10.222.0.72 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.079750 Aug 03 04:31:08.772350 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 5/9] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:08.773847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c069155-1c9a-46a3-b7b8-e1e8c94bd04f tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.774829 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.774829 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.794633 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95fafe80-cd26-471d-95ea-bd6968090286 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/771216205" status: 202 len: 0 microversion: 2.1 time: 0.118978 Aug 03 04:31:08.801268 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 5/10] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:08 2022] DELETE /compute/v2.1/flavors/771216205 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:08.801268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-065a4380-5f99-4db4-a193-485e04c0d12a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.802041 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.802041 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:08.816949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-065a4380-5f99-4db4-a193-485e04c0d12a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.019928 Aug 03 04:31:08.817520 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 6/11] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:08.829710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4cceba91-d43a-4526-9cc3-804231b2b71a tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:08.856024 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4cceba91-d43a-4526-9cc3-804231b2b71a tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.037298 Aug 03 04:31:08.868440 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 7/12] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:08 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:08.875332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34b86ed5-79fd-461a-a01f-62e99cf20e72 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:08.878597 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.878597 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:08.897429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c069155-1c9a-46a3-b7b8-e1e8c94bd04f tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1223159828" status: 202 len: 0 microversion: 2.86 time: 0.127913 Aug 03 04:31:08.898285 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 6/13] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Aug 3 04:31:08 2022] DELETE /compute/v2.1/flavors/1223159828 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:31:08.903923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-729e9d54-b911-4299-a209-81879fc6d859 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1731353969", "id": 332498364, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:08.908536 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:08.908536 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:08.946083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34b86ed5-79fd-461a-a01f-62e99cf20e72 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:08.946770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34b86ed5-79fd-461a-a01f-62e99cf20e72 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:09.030842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-729e9d54-b911-4299-a209-81879fc6d859 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.131003 Aug 03 04:31:09.031785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 7/14] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:08 2022] POST /compute/v2.1/flavors => generated 414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:09.038037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd8337f4-b863-48a0-833e-9f589fc6b7b0 tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.082625 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd8337f4-b863-48a0-833e-9f589fc6b7b0 tempest-FlavorMetadataValidation-467397386 tempest-FlavorMetadataValidation-467397386-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.86 time: 0.049220 Aug 03 04:31:09.101517 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 8/15] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:31:09 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:09.105864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-887f6315-ab35-4c8c-9067-38585197e03d tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.150042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-887f6315-ab35-4c8c-9067-38585197e03d tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.051323 Aug 03 04:31:09.151585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 9/16] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:09 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:09.170588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9938fc25-223a-4dbb-b52a-4d2bbe0dd673 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.285447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9938fc25-223a-4dbb-b52a-4d2bbe0dd673 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/332498364" status: 202 len: 0 microversion: 2.1 time: 0.118759 Aug 03 04:31:09.289633 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 10/17] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:09 2022] DELETE /compute/v2.1/flavors/332498364 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:31:09.294471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec7584ba-4879-4107-b7c0-3786dbaf480b tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.320540 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec7584ba-4879-4107-b7c0-3786dbaf480b tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029623 Aug 03 04:31:09.322856 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 11/18] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:09.356239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f474e21-66f4-4566-8241-65ae23f03005 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2026770757", "id": 139273039, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:09.452033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f474e21-66f4-4566-8241-65ae23f03005 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.110091 Aug 03 04:31:09.460040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 12/19] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:09 2022] POST /compute/v2.1/flavors => generated 426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:09.466783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c816abcd-ded7-4247-b24b-aea260d052d5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.612747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c816abcd-ded7-4247-b24b-aea260d052d5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/139273039" status: 202 len: 0 microversion: 2.1 time: 0.150435 Aug 03 04:31:09.613495 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 13/20] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:09 2022] DELETE /compute/v2.1/flavors/139273039 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:09.621635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2bd8ccc2-2485-47f5-a685-83f75818353e tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.644055 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2bd8ccc2-2485-47f5-a685-83f75818353e tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025882 Aug 03 04:31:09.644779 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 14/21] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:09.665571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd7cd9b1-9cf2-46b7-9cc9-39e3d9043105 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-818571680", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:09.807728 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd7cd9b1-9cf2-46b7-9cc9-39e3d9043105 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.145644 Aug 03 04:31:09.815891 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 15/22] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:09 2022] POST /compute/v2.1/flavors => generated 506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:09.821695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c29c1bca-ab39-4c65-bd81-9ae71d7f21cd tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.947910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c29c1bca-ab39-4c65-bd81-9ae71d7f21cd tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/11314fe9-789e-4fbe-9bd4-092b7e3c35e5" status: 202 len: 0 microversion: 2.1 time: 0.124899 Aug 03 04:31:09.947910 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 16/23] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:31:09 2022] DELETE /compute/v2.1/flavors/11314fe9-789e-4fbe-9bd4-092b7e3c35e5 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:09.951201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6b11621-c532-40fe-87e0-8cee15fd8d93 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:09.973793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6b11621-c532-40fe-87e0-8cee15fd8d93 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026074 Aug 03 04:31:09.974389 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 17/24] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:09.992910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd8abc9f-c5b0-450f-8d97-21e23996f0bf tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-684197366", "id": "c69fc8e3-a0dc-463d-afa5-3be9e0212905", "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:10.100381 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd8abc9f-c5b0-450f-8d97-21e23996f0bf tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.111510 Aug 03 04:31:10.101911 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 18/25] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:09 2022] POST /compute/v2.1/flavors => generated 506 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:10.115250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5375be2e-6971-493e-ad4e-dcae30d3cafc tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:10.201766 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5375be2e-6971-493e-ad4e-dcae30d3cafc tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/c69fc8e3-a0dc-463d-afa5-3be9e0212905" status: 202 len: 0 microversion: 2.1 time: 0.092391 Aug 03 04:31:10.202376 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 19/26] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:31:10 2022] DELETE /compute/v2.1/flavors/c69fc8e3-a0dc-463d-afa5-3be9e0212905 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:31:10.211688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-70a110c4-3573-41de-9a4f-65c0e4b6aaf5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:10.269659 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-70a110c4-3573-41de-9a4f-65c0e4b6aaf5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061838 Aug 03 04:31:10.271020 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 20/27] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:10.290929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3258b30-a743-43d4-ba30-a5934f2c875f tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1866213287", "id": 163671023, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:10.435073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3258b30-a743-43d4-ba30-a5934f2c875f tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.149869 Aug 03 04:31:10.442474 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 21/28] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:10 2022] POST /compute/v2.1/flavors => generated 411 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:10.452077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4cbc095e-381e-4f14-a32b-093610342a79 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:10.492431 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4cbc095e-381e-4f14-a32b-093610342a79 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/163671023" status: 200 len: 411 microversion: 2.1 time: 0.046169 Aug 03 04:31:10.493054 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 22/29] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:31:10 2022] GET /compute/v2.1/flavors/163671023 => generated 411 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:10.868160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c348c00-2d47-40da-8b43-e8010551176d tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:10.963947 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c348c00-2d47-40da-8b43-e8010551176d tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.457539 Aug 03 04:31:10.976315 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 23/30] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:10 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:10.990653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-407a1127-fec8-4241-96db-74a4a6684a0c tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.012088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7,nova_api:DELETE=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:11.051574 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-407a1127-fec8-4241-96db-74a4a6684a0c tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/163671023" status: 202 len: 0 microversion: 2.1 time: 0.065105 Aug 03 04:31:11.052161 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 24/31] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:10 2022] DELETE /compute/v2.1/flavors/163671023 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:31:11.060135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc0c8f1a-ce6a-4d11-a7ba-1322c17c2fcc tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.090097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc0c8f1a-ce6a-4d11-a7ba-1322c17c2fcc tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033576 Aug 03 04:31:11.090695 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 25/32] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:11.110091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a3f70b2-c7dd-4800-b89d-60b36a921c2b tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-159137019", "id": 1202424998, "os-flavor-access:is_public": "False"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:11.191091 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a3f70b2-c7dd-4800-b89d-60b36a921c2b tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.084627 Aug 03 04:31:11.198683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 26/33] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:11 2022] POST /compute/v2.1/flavors => generated 429 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:11.198866 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34b86ed5-79fd-461a-a01f-62e99cf20e72 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 2.327382 Aug 03 04:31:11.207091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b1b96e6-1554-4dd1-84d7-ee35ab641e35 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "1202424998"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:11.211597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 8/34] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:31:08 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.233861 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6b1b96e6-1554-4dd1-84d7-ee35ab641e35 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] HTTP exception thrown: Flavor 1202424998 could not be found. Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b1b96e6-1554-4dd1-84d7-ee35ab641e35 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Request method failure captured: Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 107 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foH4hIFkWwGwmfFBwSCVfCayT7g0oeqGkFPD1Trmb8ZbvGCx5uaRxM1rCRntKYg9adsraZ1HLPbVdWpw7emYUhp03KwITeaVl_I3rGk0RtCZzKOZZrbHywHX268UXord2-m11z93Ev6OB3kZcge5f1XCe5I2Jlq697KQX3K15clTHQ Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: e643163cd2d0455ea44806c1cc867a59 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsAdminTestJSON-1342164240 Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:31:11.238200 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e643163cd2d0455ea44806c1cc867a59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/e643163cd2d0455ea44806c1cc867a59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_e643163cd2d0455ea44806c1cc867a59"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/e643163cd2d0455ea44806c1cc867a59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsAdminTestJSON-1342164240 Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: e643163cd2d0455ea44806c1cc867a59 Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1342164240 Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsAdminTestJSON-1342164240-project Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e6bc21059e764841b3bdc38922a526b5 Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsAdminTestJSON-1342164240-project Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "test", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "1202424998"}} Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:31:11.239398 n-d-826756-5 devstack@n-api.service[120832]: exception: Flavor 1202424998 could not be found. Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '1202424998'}}} Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1202424998 could not be found. Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:11.240095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1202424998 could not be found. Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:11.242019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1202424998 could not be found. Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b1b96e6-1554-4dd1-84d7-ee35ab641e35 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Returning 400 to user: Flavor 1202424998 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b1b96e6-1554-4dd1-84d7-ee35ab641e35 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.040017 Aug 03 04:31:11.243192 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 27/35] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:11 2022] POST /compute/v2.1/servers => generated 81 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:31:11.250365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a0a3590-e074-40c3-9419-f4a24c11a1c5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.251572 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:11.251572 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:11.326750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a0a3590-e074-40c3-9419-f4a24c11a1c5 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1202424998" status: 202 len: 0 microversion: 2.1 time: 0.080261 Aug 03 04:31:11.327349 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 9/36] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:11 2022] DELETE /compute/v2.1/flavors/1202424998 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:11.337872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a7b7388-4dae-4d91-9216-8cfbb0509176 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.361284 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a7b7388-4dae-4d91-9216-8cfbb0509176 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028045 Aug 03 04:31:11.363358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 28/37] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:11.382296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-089e05f2-aea4-45a4-a8cb-b52581d39229 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-153801048", "id": 1424925848, "os-flavor-access:is_public": "False"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:11.404604 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:11.404604 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:11.475569 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-089e05f2-aea4-45a4-a8cb-b52581d39229 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.097356 Aug 03 04:31:11.476428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 10/38] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:11 2022] POST /compute/v2.1/flavors => generated 414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.489126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-724049f5-a780-4048-b626-e6a33f320260 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-861072046", "id": 2137470834, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:11.578364 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-724049f5-a780-4048-b626-e6a33f320260 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.093963 Aug 03 04:31:11.586290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 29/39] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.592292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2de60d4-7715-404d-8d3e-860db85b9c6d tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.622522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2de60d4-7715-404d-8d3e-860db85b9c6d tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.034687 Aug 03 04:31:11.623109 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 11/40] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.642966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68761fbb-1b91-4ee6-bad1-5c91e15f3ad3 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.664699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68761fbb-1b91-4ee6-bad1-5c91e15f3ad3 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.027771 Aug 03 04:31:11.668682 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 30/41] 10.222.0.72 () {58 vars in 1177 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.679759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d282e9a-8fb5-4933-b740-06e4cffe7ae0 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.705145 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d282e9a-8fb5-4933-b740-06e4cffe7ae0 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.028882 Aug 03 04:31:11.705897 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 12/42] 10.222.0.72 () {58 vars in 1171 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.725551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1dff4c8-8b9e-4b59-b9ea-469000509601 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.738717 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1dff4c8-8b9e-4b59-b9ea-469000509601 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.016746 Aug 03 04:31:11.751197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 31/43] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:11.760521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-36cf91af-2dcd-4355-9029-b0ad19269181 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.801558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-36cf91af-2dcd-4355-9029-b0ad19269181 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.045684 Aug 03 04:31:11.802711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 13/44] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:11.822635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d57c1a2-be56-41f1-96d6-ef7269756114 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.849977 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d57c1a2-be56-41f1-96d6-ef7269756114 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.032277 Aug 03 04:31:11.851270 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 32/45] 10.222.0.72 () {58 vars in 1175 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:11.869162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f81757ed-52f5-478d-967d-819ec19496a7 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.898359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f81757ed-52f5-478d-967d-819ec19496a7 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.032846 Aug 03 04:31:11.898959 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 14/46] 10.222.0.72 () {58 vars in 1173 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:11.916788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4da7bc86-cde2-4dfa-a5e0-3262b1f4a579 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:11.942963 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4da7bc86-cde2-4dfa-a5e0-3262b1f4a579 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.029965 Aug 03 04:31:11.949802 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 15/47] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Aug 3 04:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:11.967336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf7018f6-5832-4453-a86b-689d5908ccde tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.103802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf7018f6-5832-4453-a86b-689d5908ccde tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/2137470834" status: 202 len: 0 microversion: 2.1 time: 0.141044 Aug 03 04:31:12.104841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 16/48] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:11 2022] DELETE /compute/v2.1/flavors/2137470834 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:12.114037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c91a3e64-11c4-4c8b-a102-86a2e6e8fb36 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.140056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c91a3e64-11c4-4c8b-a102-86a2e6e8fb36 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030819 Aug 03 04:31:12.140696 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 17/49] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:12.159009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ce85aca-bea1-45bf-a641-3d26b4ebb0f6 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.321841 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ce85aca-bea1-45bf-a641-3d26b4ebb0f6 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1424925848" status: 202 len: 0 microversion: 2.1 time: 0.166553 Aug 03 04:31:12.325979 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 18/50] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:12 2022] DELETE /compute/v2.1/flavors/1424925848 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:31:12.331016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8180668a-830e-4bdc-9036-32a4160663be tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.352346 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8180668a-830e-4bdc-9036-32a4160663be tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025031 Aug 03 04:31:12.365150 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 19/51] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:12.375797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bff3bfbb-f311-488c-bd0c-c23c97b5df55 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-204609783", "id": 1062419518, "os-flavor-access:is_public": "False"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:12.477214 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bff3bfbb-f311-488c-bd0c-c23c97b5df55 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.105461 Aug 03 04:31:12.478551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 20/52] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:12.490733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f0a2db6-8a8f-42e3-adce-00d17cbda92e tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.530715 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f0a2db6-8a8f-42e3-adce-00d17cbda92e tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043585 Aug 03 04:31:12.532750 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 21/53] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:12.551365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3320eca3-01e6-4f62-937a-583ec7bbcccb tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.611139 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3320eca3-01e6-4f62-937a-583ec7bbcccb tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063962 Aug 03 04:31:12.628136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 22/54] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:12.637271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c314fbad-855f-4e6b-bc29-f48169a64ece tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.668146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=15 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:12.748949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c314fbad-855f-4e6b-bc29-f48169a64ece tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1062419518" status: 202 len: 0 microversion: 2.1 time: 0.115097 Aug 03 04:31:12.749640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 23/55] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:12 2022] DELETE /compute/v2.1/flavors/1062419518 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:12.758078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99dc153e-c7f6-4ab7-9156-f78524eacd80 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:12.809737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99dc153e-c7f6-4ab7-9156-f78524eacd80 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055597 Aug 03 04:31:12.828446 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 24/56] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:12.840511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db2185f6-74d2-421b-9a21-1e1038b09496 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1553490739", "id": 1673388470, "os-flavor-access:is_public": "True"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:12.961848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db2185f6-74d2-421b-9a21-1e1038b09496 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.130123 Aug 03 04:31:12.962570 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 25/57] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:12.978516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e84742f4-900a-4c8d-8c4e-c6877dcfb8c5 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:13.044235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e84742f4-900a-4c8d-8c4e-c6877dcfb8c5 tempest-FlavorsAdminTestJSON-1342164240 tempest-FlavorsAdminTestJSON-1342164240-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.073448 Aug 03 04:31:13.044875 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 26/58] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:12 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:13.068776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64bfe2e0-54b4-4cad-b43c-f47aa99f3946 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:13.200380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64bfe2e0-54b4-4cad-b43c-f47aa99f3946 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1673388470" status: 202 len: 0 microversion: 2.1 time: 0.138315 Aug 03 04:31:13.201973 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 27/59] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:13 2022] DELETE /compute/v2.1/flavors/1673388470 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:13.215231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f15a7376-2945-4678-9a0c-d8b25ec877f6 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:13.255955 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f15a7376-2945-4678-9a0c-d8b25ec877f6 tempest-FlavorsAdminTestJSON-1130271491 tempest-FlavorsAdminTestJSON-1130271491-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045188 Aug 03 04:31:13.256990 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 28/60] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:13.260473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-640493150", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "availability_zone": "tempest-test_az-626551463"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:13.287627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:13.288087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:13.292639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:13.294490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:15.201557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:31:15.490107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:31:15.490528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:31:15.491009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:31:15.491418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:31:15.491833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:31:15.507190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:15.507961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:15.509009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:15.509786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:15.551276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Getting quotas for project ffa550409ef640b8a9fbb717c6659f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:15.556726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Getting quotas for user 247703c83c7d40cda8db648050e7a79e and project ffa550409ef640b8a9fbb717c6659f3a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:15.569861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:31:15.573172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:31:15.687643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2b5f8446-497d-4117-9152-833a1be409db tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1405827244", "id": 542509599, "os-flavor-access:is_public": "False"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:15.745816 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c31dd70-0830-432b-9b4c-bcb0cc3277d6 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.858151 Aug 03 04:31:15.753075 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 33/61] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:31:15.760250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46283d8b-55ff-4a8c-bcc1-e57d292e8f81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:15.760904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46283d8b-55ff-4a8c-bcc1-e57d292e8f81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:15.778881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2b5f8446-497d-4117-9152-833a1be409db tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.488079 Aug 03 04:31:15.781036 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 29/62] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:15 2022] POST /compute/v2.1/flavors => generated 428 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:15.793829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-686dd8f4-eb64-4c1c-a930-585fabcbf613 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6795051acebd4f518d31e0a9499e179c"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:15.798455 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:15.798455 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:15.850621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46283d8b-55ff-4a8c-bcc1-e57d292e8f81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:15.865945 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46283d8b-55ff-4a8c-bcc1-e57d292e8f81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1241 microversion: 2.1 time: 0.111417 Aug 03 04:31:15.866939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 34/63] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:15 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:16.887289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f870d57-e33f-4328-89e5-5b656f20ad12 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:16.888052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f870d57-e33f-4328-89e5-5b656f20ad12 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:16.903240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-686dd8f4-eb64-4c1c-a930-585fabcbf613 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/542509599/action" status: 200 len: 96 microversion: 2.1 time: 1.113057 Aug 03 04:31:16.904182 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 30/64] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:31:15 2022] POST /compute/v2.1/flavors/542509599/action => generated 96 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:31:17.016023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f870d57-e33f-4328-89e5-5b656f20ad12 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:17.023897 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f870d57-e33f-4328-89e5-5b656f20ad12 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1241 microversion: 2.1 time: 0.140644 Aug 03 04:31:17.026326 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 35/65] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:16 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:17.435608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37b10c89-0171-4831-89d6-4f5bf4f300fd tempest-FlavorsAccessTestJSON-649419236 tempest-FlavorsAccessTestJSON-649419236-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:17.487728 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37b10c89-0171-4831-89d6-4f5bf4f300fd tempest-FlavorsAccessTestJSON-649419236 tempest-FlavorsAccessTestJSON-649419236-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.576220 Aug 03 04:31:17.491336 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 31/66] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:16 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:17.511818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8bea787-313f-4b76-a9c0-cfaf65ca9538 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6795051acebd4f518d31e0a9499e179c"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:17.514480 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:17.514480 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:18.049960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0960e945-5c89-4013-82dd-20bb71c66ee2 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.051481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0960e945-5c89-4013-82dd-20bb71c66ee2 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:18.348616 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8bea787-313f-4b76-a9c0-cfaf65ca9538 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/542509599/action" status: 200 len: 21 microversion: 2.1 time: 0.842956 Aug 03 04:31:18.354488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 36/67] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:31:17 2022] POST /compute/v2.1/flavors/542509599/action => generated 21 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:18.359265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3427ac48-513b-4520-b977-db23d4ffcb5d tempest-FlavorsAccessTestJSON-649419236 tempest-FlavorsAccessTestJSON-649419236-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.368106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:18.383823 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3427ac48-513b-4520-b977-db23d4ffcb5d tempest-FlavorsAccessTestJSON-649419236 tempest-FlavorsAccessTestJSON-649419236-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028187 Aug 03 04:31:18.397408 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 37/68] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:18.402229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35ac1ae9-38af-4740-a25b-31358e97fcf0 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.403138 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:18.403138 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:18.542737 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35ac1ae9-38af-4740-a25b-31358e97fcf0 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/542509599" status: 202 len: 0 microversion: 2.1 time: 0.144085 Aug 03 04:31:18.543337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 38/69] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:18 2022] DELETE /compute/v2.1/flavors/542509599 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:18.555547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6828a040-185f-44a3-8667-5cfa283fc9a7 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.586027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6828a040-185f-44a3-8667-5cfa283fc9a7 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035728 Aug 03 04:31:18.587816 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 39/70] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:18.608000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e69318c0-54a6-463d-89dc-bf0a22b4a4df tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-873343591", "id": 1074151257, "os-flavor-access:is_public": "False"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:18.613824 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:18.613824 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:18.729427 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e69318c0-54a6-463d-89dc-bf0a22b4a4df tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.125137 Aug 03 04:31:18.731603 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 40/71] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:18 2022] POST /compute/v2.1/flavors => generated 430 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:18.742868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8aa9a779-4685-48b7-8807-c4c6d3d0d02e tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.744718 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:18.744718 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:18.756834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8aa9a779-4685-48b7-8807-c4c6d3d0d02e tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/1074151257/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018196 Aug 03 04:31:18.758049 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 41/72] 10.222.0.72 () {58 vars in 1209 bytes} [Wed Aug 3 04:31:18 2022] GET /compute/v2.1/flavors/1074151257/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:31:18.768218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3bde52b5-ecb5-46d4-8e5e-982d5576730c tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.897030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3bde52b5-ecb5-46d4-8e5e-982d5576730c tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1074151257" status: 202 len: 0 microversion: 2.1 time: 0.132889 Aug 03 04:31:18.901503 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 42/73] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:18 2022] DELETE /compute/v2.1/flavors/1074151257 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:31:18.907197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-045ebeee-f45f-49ad-902d-17c646e249d3 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:18.973423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-045ebeee-f45f-49ad-902d-17c646e249d3 tempest-FlavorsAccessTestJSON-689893150 tempest-FlavorsAccessTestJSON-689893150-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070551 Aug 03 04:31:18.991060 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 43/74] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:19.113381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:19.855575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0960e945-5c89-4013-82dd-20bb71c66ee2 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:19.882544 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0960e945-5c89-4013-82dd-20bb71c66ee2 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1241 microversion: 2.1 time: 1.838422 Aug 03 04:31:19.883144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 32/75] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:18 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1241 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:20.828867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f11355a-c213-4bee-ad9b-d9eca27b501b tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1864369775", "ram": 512, "vcpus": 1, "disk": 10, "id": 672499612, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:20.896081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-539796611", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:20.934801 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f11355a-c213-4bee-ad9b-d9eca27b501b tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.282434 Aug 03 04:31:20.935571 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 44/76] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:20.947994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:20.950797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:20.971283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:20.971661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:20.976674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:20.980551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:21.044979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:31:21.703942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:21.716252 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa07282c-8c84-4bbe-ad7f-6bf3260bb124 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1295 microversion: 2.1 time: 0.779382 Aug 03 04:31:21.717385 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 45/77] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:20 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1295 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:21.722710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1076cdf9-f3ed-4f36-94d0-c0fbc095c551 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:21.726455 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:21.726455 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:21.877021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:21.887570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1076cdf9-f3ed-4f36-94d0-c0fbc095c551 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.167758 Aug 03 04:31:21.889715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 46/78] 10.222.0.72 () {60 vars in 1221 bytes} [Wed Aug 3 04:31:21 2022] POST /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:21.916220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:31:21.917680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:31:21.919239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:31:21.919663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:31:21.920163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:31:21.942885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:21.943851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:21.944676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:21.945997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:22.010354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Getting quotas for project 6cf7cad2bd5a466caec230bbdef00681. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:22.048748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Getting quotas for user c2b2dfc0b09f4e1c8fe556d731f82a3a and project 6cf7cad2bd5a466caec230bbdef00681. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:22.084700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:31:22.091585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:31:22.292370 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b8906e4-432c-43b2-9a94-8437d3d24308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630792 Aug 03 04:31:22.304397 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 33/79] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:31:22.311125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b260850a-26eb-46e7-9a14-86772f076f97 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:22.311879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b260850a-26eb-46e7-9a14-86772f076f97 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:22.602981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b260850a-26eb-46e7-9a14-86772f076f97 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:22.613149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b260850a-26eb-46e7-9a14-86772f076f97 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1218 microversion: 2.1 time: 0.307346 Aug 03 04:31:22.616215 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 34/80] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:22 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:22.747636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:22.748708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:22.761910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:22.762721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:22.763853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:22.767393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:23.045558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ac5d5c6-d4d5-41e3-9762-af4c0025c3ac tempest-FlavorsExtraSpecsTestJSON-670669599 tempest-FlavorsExtraSpecsTestJSON-670669599-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.075747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ac5d5c6-d4d5-41e3-9762-af4c0025c3ac tempest-FlavorsExtraSpecsTestJSON-670669599 tempest-FlavorsExtraSpecsTestJSON-670669599-project] 10.222.0.72 "GET /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 1.180087 Aug 03 04:31:23.077161 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 47/81] 10.222.0.72 () {58 vars in 1200 bytes} [Wed Aug 3 04:31:21 2022] GET /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:23.087950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4733b223-2287-4e64-a9cc-248d53bac8b0 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:23.149262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4733b223-2287-4e64-a9cc-248d53bac8b0 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065828 Aug 03 04:31:23.152728 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 48/82] 10.222.0.72 () {60 vars in 1221 bytes} [Wed Aug 3 04:31:23 2022] POST /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:23.166211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b9be2c9-cfc2-4f36-9e20-19d417a34a5b tempest-FlavorsExtraSpecsTestJSON-670669599 tempest-FlavorsExtraSpecsTestJSON-670669599-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.195441 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b9be2c9-cfc2-4f36-9e20-19d417a34a5b tempest-FlavorsExtraSpecsTestJSON-670669599 tempest-FlavorsExtraSpecsTestJSON-670669599-project] 10.222.0.72 "GET /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.039713 Aug 03 04:31:23.199883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 49/83] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:31:23 2022] GET /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes => generated 22 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:31:23.219887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffd32ba1-eb2c-4360-acd3-8af03328da45 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:23.325858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffd32ba1-eb2c-4360-acd3-8af03328da45 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.115929 Aug 03 04:31:23.327974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 50/84] 10.222.0.72 () {60 vars in 1221 bytes} [Wed Aug 3 04:31:23 2022] POST /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:23.350462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3acf26b7-240b-40f0-a9a9-7ac442676747 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.374006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3acf26b7-240b-40f0-a9a9-7ac442676747 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041226 Aug 03 04:31:23.374611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 51/85] 10.222.0.72 () {58 vars in 1200 bytes} [Wed Aug 3 04:31:23 2022] GET /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:23.402683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-164650c0-853b-408f-8830-4a99fe1ed341 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:23.416140 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:23.416140 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:23.611066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-164650c0-853b-408f-8830-4a99fe1ed341 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "PUT /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.227992 Aug 03 04:31:23.618290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 52/86] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:31:23 2022] PUT /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes => generated 22 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:23.630170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-871f83ba-2c03-4618-a0a4-426e9f7fa925 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.659089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-871f83ba-2c03-4618-a0a4-426e9f7fa925 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037493 Aug 03 04:31:23.663508 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 53/87] 10.222.0.72 () {58 vars in 1200 bytes} [Wed Aug 3 04:31:23 2022] GET /compute/v2.1/flavors/672499612/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:31:23.713879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:23.717820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51f72db7-fead-45aa-9127-9ec98544bbec tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.722562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-51f72db7-fead-45aa-9127-9ec98544bbec tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:23.743001 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75aedffb-4ba1-467c-b7f1-6bea8d2104cd tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1295 microversion: 2.1 time: 1.003379 Aug 03 04:31:23.752152 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 35/88] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:22 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1295 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:23.774457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-776576fa-e4c3-4246-92db-0cbcfefe24c5 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:23.775832 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:23.775832 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:24.028995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-51f72db7-fead-45aa-9127-9ec98544bbec tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:24.052359 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-51f72db7-fead-45aa-9127-9ec98544bbec tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1218 microversion: 2.1 time: 0.376747 Aug 03 04:31:24.058113 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 54/89] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:23 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1218 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:24.264814 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-776576fa-e4c3-4246-92db-0cbcfefe24c5 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.510800 Aug 03 04:31:24.265947 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 36/90] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:31:23 2022] DELETE /compute/v2.1/flavors/672499612/os-extra_specs/hw:numa_nodes => generated 0 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:31:24.273499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7000ce6b-151b-4bd1-96b3-89b07349e480 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.274615 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:24.274615 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:24.400437 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7000ce6b-151b-4bd1-96b3-89b07349e480 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/672499612/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.130452 Aug 03 04:31:24.411591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0bbed536-6ec9-4620-952f-085cea37c762 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.415823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 55/91] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:31:24 2022] DELETE /compute/v2.1/flavors/672499612/os-extra_specs/hw:cpu_policy => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:31:24.430544 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0bbed536-6ec9-4620-952f-085cea37c762 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/672499612/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023337 Aug 03 04:31:24.450483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1a9b4db-2565-4a6e-b7f2-98bb76a790db tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.451450 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:24.451450 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:24.453890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 37/92] 10.222.0.72 () {58 vars in 1200 bytes} [Wed Aug 3 04:31:24 2022] GET /compute/v2.1/flavors/672499612/os-extra_specs => generated 19 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:24.463806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0bbed536-6ec9-4620-952f-085cea37c762 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.465060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0bbed536-6ec9-4620-952f-085cea37c762 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001601 Aug 03 04:31:24.465859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 38/93] 10.222.0.72 () {56 vars in 886 bytes} [Wed Aug 3 04:31:24 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 04:31:24.577587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1a9b4db-2565-4a6e-b7f2-98bb76a790db tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/672499612" status: 202 len: 0 microversion: 2.1 time: 0.132542 Aug 03 04:31:24.579971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 56/94] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:31:24 2022] DELETE /compute/v2.1/flavors/672499612 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:31:24.588179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34a1651a-ef8d-4473-a648-44f358bcafe1 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.649211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34a1651a-ef8d-4473-a648-44f358bcafe1 tempest-FlavorsExtraSpecsTestJSON-625445821 tempest-FlavorsExtraSpecsTestJSON-625445821-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064911 Aug 03 04:31:24.654559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 39/95] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:24.778955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:24.782816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:24.791871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:24.795052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:24.812122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:24.814188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:25.097438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1b351910-1041-420f-bc39-462aa8847fe7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:25.098388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b351910-1041-420f-bc39-462aa8847fe7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:25.431157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1b351910-1041-420f-bc39-462aa8847fe7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:25.449097 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1b351910-1041-420f-bc39-462aa8847fe7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1218 microversion: 2.1 time: 0.350929 Aug 03 04:31:25.450205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 40/96] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:25 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1218 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:25.530671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:26.294641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:26.304667 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73c7deb4-96b0-497d-95a5-2646e4e07b1a tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 1.531316 Aug 03 04:31:26.313161 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 57/97] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:24 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:26.476160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:26.477375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:26.489219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:26.489974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:26.491935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:26.494998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:26.663839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:26.673810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b83b5ed7-83f1-4aad-aa8b-55474b7aaf39 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1270 microversion: 2.1 time: 0.200642 Aug 03 04:31:26.714579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 41/98] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:26 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1270 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:27.327482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:27.333350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:27.337245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:27.337888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:27.347479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:27.348053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:27.703392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:27.704234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:27.722399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:27.726698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:27.733648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:27.735079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:28.326008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:28.335355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e117241f-2c61-4bcb-8905-3be06c2dc911 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1288 microversion: 2.1 time: 0.636796 Aug 03 04:31:28.341325 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 42/99] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:27 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1288 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:28.426371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:28.447169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-849af0e0-3122-4466-bae1-57241eeac3b8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 1.122800 Aug 03 04:31:28.460433 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 58/100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:27 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:29.366450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:29.368375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:29.384201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:29.386976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:29.390528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:29.391306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:29.472254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:29.473117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:29.487207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:29.487695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:29.495327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:29.495882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:29.783171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:29.797388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c5b0740-afe8-4146-9cde-443efd7ccbee tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1276 microversion: 2.1 time: 0.431889 Aug 03 04:31:29.800960 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 43/101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:29 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1276 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:30.357424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:30.381253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a93abaec-7878-4b1e-b0ad-6c7d815cfc9b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.908952 Aug 03 04:31:30.384768 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 59/102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:29 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:30.944987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0afc3968-3338-446b-b2d0-b1542926feab tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1680855979", "id": 1287319811, "os-flavor-access:is_public": "True"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:30.949676 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:30.949676 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:31.050964 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0afc3968-3338-446b-b2d0-b1542926feab tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.969514 Aug 03 04:31:31.050964 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 44/103] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:31:30 2022] POST /compute/v2.1/flavors => generated 468 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:31:31.060300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:31.061101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:31.082549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.083323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.084234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.084794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.088178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9d69d33b-a904-48c5-b857-904dffc37170 req-e3020cab-d19b-42ab-88fc-836460b8a9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd", "tag": "47e32e08-e326-4295-87b9-be4adef70fee"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:31.112794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9d69d33b-a904-48c5-b857-904dffc37170 req-e3020cab-d19b-42ab-88fc-836460b8a9e3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.113288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9d69d33b-a904-48c5-b857-904dffc37170 req-e3020cab-d19b-42ab-88fc-836460b8a9e3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.169815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9d69d33b-a904-48c5-b857-904dffc37170 req-e3020cab-d19b-42ab-88fc-836460b8a9e3 service nova] Creating event network-changed:47e32e08-e326-4295-87b9-be4adef70fee for instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd on n-h1-826756-5 Aug 03 04:31:31.170661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9d69d33b-a904-48c5-b857-904dffc37170 req-e3020cab-d19b-42ab-88fc-836460b8a9e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:31:31.172900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.175901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.177033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.179943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.199465 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.rpcapi [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 04:31:31.212521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] Releasing lock "compute-rpcapi-router" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:31:31.243757 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1c65103-c01d-4ec0-8e80-e64f3a73a4ba None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.723542 Aug 03 04:31:31.244939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 60/104] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:31.246396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:31.255299 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c2f506c-4e06-4edf-a966-58764547e0a1 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1276 microversion: 2.1 time: 0.204204 Aug 03 04:31:31.276375 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 45/105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:31 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:31.407910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:31.408945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:31.432128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.432867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.433879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:31.436379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:31.631797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e19b07e4-2c93-4dc0-a226-8da3d2a63309 tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:31.659293 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e19b07e4-2c93-4dc0-a226-8da3d2a63309 tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] 10.222.0.72 "GET /compute/v2.1/flavors/1287319811" status: 200 len: 468 microversion: 2.61 time: 0.411622 Aug 03 04:31:31.661391 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 61/106] 10.222.0.72 () {60 vars in 1199 bytes} [Wed Aug 3 04:31:31 2022] GET /compute/v2.1/flavors/1287319811 => generated 468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:31:31.674726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c32486b-508e-4ea9-b0c6-72e4c3d3e5e1 tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] Action: 'update', calling method: .version_select at 0x7fdd57966670>, body: {"flavor": {"description": "new"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:31.722120 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:31.722120 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:31.837600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c32486b-508e-4ea9-b0c6-72e4c3d3e5e1 tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] 10.222.0.72 "PUT /compute/v2.1/flavors/1287319811" status: 200 len: 469 microversion: 2.61 time: 0.167398 Aug 03 04:31:31.839433 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 62/107] 10.222.0.72 () {62 vars in 1219 bytes} [Wed Aug 3 04:31:31 2022] PUT /compute/v2.1/flavors/1287319811 => generated 469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:31:31.893240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:31.909569 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-581931ca-2e11-42de-b2c2-098d660a81ec tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.506133 Aug 03 04:31:31.925254 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 46/108] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:31 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:31.950382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dbf2fe1c-f203-4779-957c-5537d1c0723e tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:31.972884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:32.016753 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dbf2fe1c-f203-4779-957c-5537d1c0723e tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.089993 Aug 03 04:31:32.026720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 47/109] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:31:31 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:32.052452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-869c0c56-7300-4b27-b7e3-5527d060bdb2 tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.096221 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-869c0c56-7300-4b27-b7e3-5527d060bdb2 tempest-FlavorsV261TestJSON-615736472 tempest-FlavorsV261TestJSON-615736472-project] 10.222.0.72 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.047755 Aug 03 04:31:32.119222 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 48/110] 10.222.0.72 () {60 vars in 1166 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:31:32.127242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed473057-398b-48ab-8a75-373cbce58a41 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.137590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37a9dbfc-d338-4173-99d0-e6e391d3408b tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.138590 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:32.138590 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:32.148660 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed473057-398b-48ab-8a75-373cbce58a41 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.307244 Aug 03 04:31:32.149939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 63/111] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:32.263815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-865bf225-737f-4246-bebc-696b59714b1b tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1189188500", "id": 68407449, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:32.271351 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:32.271351 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:32.302196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37a9dbfc-d338-4173-99d0-e6e391d3408b tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1287319811" status: 202 len: 0 microversion: 2.61 time: 0.168413 Aug 03 04:31:32.303411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 49/112] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Aug 3 04:31:32 2022] DELETE /compute/v2.1/flavors/1287319811 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:31:32.308851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.309796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:32.330620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:32.332710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:32.341082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:32.342277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:32.346004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:32.374519 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-865bf225-737f-4246-bebc-696b59714b1b tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.214496 Aug 03 04:31:32.378103 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 64/113] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:32 2022] POST /compute/v2.1/flavors => generated 419 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:32.396392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-669032fa-2a9f-449c-ae02-25d94a9f500e tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.467604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-669032fa-2a9f-449c-ae02-25d94a9f500e tempest-FlavorsV261TestJSON-711929842 tempest-FlavorsV261TestJSON-711929842-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 6240 microversion: 2.61 time: 0.088198 Aug 03 04:31:32.471604 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 65/114] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/flavors/detail => generated 6240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:32.485044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a035bd1-812e-42bc-8a02-99838978bf58 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.543486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:32.551036 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a035bd1-812e-42bc-8a02-99838978bf58 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.077978 Aug 03 04:31:32.556453 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 66/115] 10.222.0.72 () {58 vars in 1182 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:32.557388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b76907a2-2e98-4545-bbec-730670617f23 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1276 microversion: 2.1 time: 0.246496 Aug 03 04:31:32.569975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-075c3403-bf2b-4dce-ac0d-0a6df3a1658a tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1652659358", "id": 184638485, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:32.570400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 50/116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:32.685370 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-075c3403-bf2b-4dce-ac0d-0a6df3a1658a tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.126653 Aug 03 04:31:32.691264 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 67/117] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:32 2022] POST /compute/v2.1/flavors => generated 422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:32.704676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ac0d0bc-612d-4d0f-b287-b6d45509f90f tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.720122 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ac0d0bc-612d-4d0f-b287-b6d45509f90f tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021161 Aug 03 04:31:32.736089 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 51/118] 10.222.0.72 () {58 vars in 1182 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:31:32.756478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33eef66d-2a3d-4499-915e-42f80f45bbc1 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Action: 'create', calling method: .version_select at 0x7fdd5589eb80>, body: {"keypair": {"name": "tempest-keypair-1496059845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGmRkF5PfD4H/AW6cGF7V6k7/rc5CW5sE/Ut20FdB8izk3BE/Oz4BL+uWjfk2coX6Mpdrde9r1ZqTerx0/RQHO2Eh1blxpYOP3aiCdo60c1uGjUgAMDxGFpHgSjTFVJ/g=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:32.832252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-33eef66d-2a3d-4499-915e-42f80f45bbc1 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for project 3c3b6b7574d544aab263dcd99930197d. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:32.844912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-33eef66d-2a3d-4499-915e-42f80f45bbc1 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for user 8091cc486ba443e7a99732617e82ee5d and project 3c3b6b7574d544aab263dcd99930197d. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:32.935701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:32.936380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:32.947673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:32.948127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:32.948946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:32.949382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:32.989773 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33eef66d-2a3d-4499-915e-42f80f45bbc1 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251786 Aug 03 04:31:32.990680 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 68/119] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:31:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:33.587591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:33.587591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:33.604401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=79,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:33.607677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:33.611173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:33.616399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:33.616399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:34.075090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:34.079014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd86d433-36e9-4bc7-b183-192097c68324 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 1.147014 Aug 03 04:31:34.080497 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 52/120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:32 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:34.443346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:34.456425 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d096c36b-90c0-450e-b522-2da978088954 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.874813 Aug 03 04:31:34.458369 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 69/121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:33 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:35.109117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:35.110524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:35.130977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:35.130977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:35.130977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:35.130977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:35.436356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:35.480132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:35.481524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:35.503708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:35.513407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:35.515331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:35.529588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:36.514188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:36.541009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c62887ce-4cba-4de8-9fe4-dc7f748065ee tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 1.442588 Aug 03 04:31:36.541678 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 53/122] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:35 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:36.628894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:36.638532 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76116304-6086-4bff-a818-9e12479bdae4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 1.162975 Aug 03 04:31:36.659818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 70/123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:35 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:37.566154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:37.567493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:37.596869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:37.599770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:37.600898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:37.601507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:37.668534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:37.670021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:37.715022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:37.719810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:37.722231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:37.722728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:37.755942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=59 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:39.069568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:39.088418 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e8628b0-3416-4e6d-8beb-bff15264c916 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 1.424893 Aug 03 04:31:39.090491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 71/124] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:37 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:39.187330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:39.254788 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-faada2f6-d5e3-42f0-b37a-9caab4a0ba65 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 1.692785 Aug 03 04:31:39.296366 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 54/125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:37 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:40.120190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.121906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:40.136716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.137724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.138868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.141716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.386866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd559189d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.393923 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.393923 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.395465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.396262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.411844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:40.413717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.414173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.420437 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc7f08a6-2933-40dc-b312-5971479290fb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.305775 Aug 03 04:31:40.421731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 55/126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:40.427330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.428146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:40.436346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.437354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.439168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.439795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.441080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.445020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.451229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41156dd1-9772-49dd-951d-1346bee094dd tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.434150 Aug 03 04:31:40.451841 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 72/127] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:40.464501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55918f70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.465413 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.465413 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.466570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.467014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.482136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.482585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.496024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.496498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.504070 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af609279-ecf1-4939-9edb-f236cf632c1d tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.043023 Aug 03 04:31:40.505823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 73/128] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:40.520937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55858c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.521742 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.521742 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.522920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.523377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.541817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.542283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.557648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.560810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.572412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-caf6be66-5e6d-4072-9968-4083f6212af0 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054975 Aug 03 04:31:40.573264 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 74/129] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:40.590344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55918550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.593313 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.593313 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.595723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.596390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.615085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.615569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.621749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:40.622389 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f79a3653-79fb-4a78-8197-e986c0fd2080 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039086 Aug 03 04:31:40.629064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 75/130] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:40.670828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54af2ebc-fd82-4519-88b6-7ee5498f731c tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.216003 Aug 03 04:31:40.670828 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 56/131] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:40.671159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73d21e3d-b224-4cfa-96e6-6477b00bebb2 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd5589e820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.671159 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.671159 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.671159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73d21e3d-b224-4cfa-96e6-6477b00bebb2 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.671159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73d21e3d-b224-4cfa-96e6-6477b00bebb2 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.672790 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73d21e3d-b224-4cfa-96e6-6477b00bebb2 tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.036274 Aug 03 04:31:40.673664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 76/132] 10.222.0.72 () {58 vars in 1179 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:40.685881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55919790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.686830 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.686830 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:40.711700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120831) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 03 04:31:40.713059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.713059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.731335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.731799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.747992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.749461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.756409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4fe19594-96d2-49d6-8b5b-0fa6b0fabbde tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074015 Aug 03 04:31:40.757354 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 57/133] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:40.768036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55918e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.768871 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.768871 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.770065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.770523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.786047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.786622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.804619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd2ddabd-5ab9-453b-bdd7-f56348171e7b tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.030269 Aug 03 04:31:40.804619 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 77/134] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:40.815534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd57d7a4c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.816634 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.816634 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:40.818377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.818822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.850565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.851181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.867786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ebc01af-7837-4e2a-91c1-8800e2603a5a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.056791 Aug 03 04:31:40.869781 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 58/135] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:40.902598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Calling method '.version_select at 0x7fdd55918820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:40.906559 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:40.906559 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:40.909066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.909717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.943424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5805af47-e57a-401a-b73c-ce58c065d868 req-866c962f-ef52-468b-8681-194dfb57f298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b7aed72-19cd-41a4-9e6b-544c4cf98047", "tag": "fdfeffe6-e51a-4378-a9cf-2a692aa271b5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:40.962000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5805af47-e57a-401a-b73c-ce58c065d868 req-866c962f-ef52-468b-8681-194dfb57f298 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.962000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5805af47-e57a-401a-b73c-ce58c065d868 req-866c962f-ef52-468b-8681-194dfb57f298 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:40.965690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:40.977052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.004184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.004920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.014835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5805af47-e57a-401a-b73c-ce58c065d868 req-866c962f-ef52-468b-8681-194dfb57f298 service nova] Creating event network-changed:fdfeffe6-e51a-4378-a9cf-2a692aa271b5 for instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 on n-h2-826756-5 Aug 03 04:31:41.027950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5805af47-e57a-401a-b73c-ce58c065d868 req-866c962f-ef52-468b-8681-194dfb57f298 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:31:41.032175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.032931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.036780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.039179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.075929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.compute.rpcapi [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 04:31:41.079207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] Releasing lock "compute-rpcapi-router" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:31:41.087030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61e547f0-77d5-4541-a78f-8dadbbfb906a tempest-HypervisorAdminTestJSON-1240765083 tempest-HypervisorAdminTestJSON-1240765083-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.189226 Aug 03 04:31:41.089819 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 78/136] 10.222.0.72 () {58 vars in 1173 bytes} [Wed Aug 3 04:31:40 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:41.128984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d6b76a3-6520-46d1-b3ce-c6f1989fe12d None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191933 Aug 03 04:31:41.128984 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 59/137] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:41.443242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:41.456338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:41.457022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:41.478032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.478738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.479711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.480341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.695845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:41.698514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:41.732404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.735086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.740468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:41.740468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:41.835133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:41.845643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7cb74113-3a88-482f-bcc4-2d5fbd2d67ae tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.403662 Aug 03 04:31:41.849194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 79/138] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:41 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:42.384883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:42.393583 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02c3ca82-b945-4bfb-b392-8dae7c28e973 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.704213 Aug 03 04:31:42.395183 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 60/139] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:41 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:42.871117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:42.872344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:42.877629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:42.923284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-22265235", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "184638485", "adminPass": "***", "networks": [{"uuid": "5ea0b700-d5ec-4f21-8466-4e93ff23ef8d"}], "security_groups": [{"name": "tempest-securitygroup--263558803"}], "key_name": "tempest-keypair-1496059845", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:42.938786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:42.946536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:42.946536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:42.946536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:43.311059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] validate_networks() for [('5ea0b700-d5ec-4f21-8466-4e93ff23ef8d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:31:43.700393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:43.736539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-174b2f95-f6c8-4a68-83fd-0530dd6046af tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.851002 Aug 03 04:31:43.736539 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 80/140] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:42 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:43.736539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:43.736539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:43.746408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:43.751193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:43.751193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:43.751193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:44.185059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:44.199069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9210b28-b400-484d-bc19-bcbb287397b5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.476456 Aug 03 04:31:44.199686 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 81/141] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:43 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:44.610429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:31:44.610884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:31:44.611316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:31:44.611853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:31:44.612298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:31:44.624316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:44.625411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:44.627624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:44.628513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:44.663178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for project 3c3b6b7574d544aab263dcd99930197d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:44.668859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for user 8091cc486ba443e7a99732617e82ee5d and project 3c3b6b7574d544aab263dcd99930197d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:44.684340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:31:44.687786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:31:44.743191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:44.744511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:44.752437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:44.752875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:44.753658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:44.754085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:44.830572 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd58f541-3490-49af-80f0-a98df7013f68 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.913188 Aug 03 04:31:44.832459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 61/142] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:31:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:31:45.109693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Calling method '.version_select at 0x7fdd558be5e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:45.113393 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:45.113393 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:45.113626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:45.117574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.118131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.121439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54290019-4c0a-4802-96dc-1e3dc673610b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.382147 Aug 03 04:31:45.129405 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 82/143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:44 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:45.134930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2447fce1-d4d7-44d5-bf99-46737306ded8 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:45.135632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2447fce1-d4d7-44d5-bf99-46737306ded8 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:45.153949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.154493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.171296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:45.194476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.195047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.206134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.206724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.207219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2447fce1-d4d7-44d5-bf99-46737306ded8 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:45.228459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2447fce1-d4d7-44d5-bf99-46737306ded8 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1261 microversion: 2.1 time: 0.088943 Aug 03 04:31:45.228459 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 83/144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:45 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:45.228459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:45.228459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:45.232440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.232440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.238861 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-204da193-db15-4c12-a6c4-a9cf175f96ac tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.397334 Aug 03 04:31:45.239989 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 62/145] 10.222.0.72 () {60 vars in 1243 bytes} [Wed Aug 3 04:31:44 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:45.261740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Calling method '.version_select at 0x7fdd55919790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:45.265588 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:45.265588 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:45.268906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.269445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.270261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.270694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.276400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.276996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.321040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.321730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.352096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.352749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.382488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.383058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.448626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.449105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.468644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7568e19e-475a-4fff-a268-36e1c677d71e tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.212445 Aug 03 04:31:45.469309 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 63/146] 10.222.0.72 () {60 vars in 1222 bytes} [Wed Aug 3 04:31:45 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:31:45.481853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Calling method '.version_select at 0x7fdd558be040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:45.491163 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:45.491163 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:45.493330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.496945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.530714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:45.533028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:45.538931 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a89df2ae-359b-4424-95ca-f000f2975bdd tempest-HypervisorAdminV253TestBase-76596198 tempest-HypervisorAdminV253TestBase-76596198-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/5c04c8d7-52f3-4de0-b990-49cbd79a575c" status: 200 len: 792 microversion: 2.53 time: 0.061412 Aug 03 04:31:45.559020 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 64/147] 10.222.0.72 () {60 vars in 1298 bytes} [Wed Aug 3 04:31:45 2022] GET /compute/v2.1/os-hypervisors/5c04c8d7-52f3-4de0-b990-49cbd79a575c => generated 792 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:31:45.647045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:45.655929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0b617bf-7308-46a3-a4df-d42ac0f1d4e8 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.433626 Aug 03 04:31:45.661976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 84/148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:45 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:46.144552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:46.145483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:46.168625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:46.169122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:46.174126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:46.175502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:46.246481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c604b0fe-9287-4877-adf6-f98bac698e92 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:46.248145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c604b0fe-9287-4877-adf6-f98bac698e92 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:46.364105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c604b0fe-9287-4877-adf6-f98bac698e92 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:46.372046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c604b0fe-9287-4877-adf6-f98bac698e92 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1261 microversion: 2.1 time: 0.131633 Aug 03 04:31:46.372675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 85/149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:46 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:46.679385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:46.680253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:46.708969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:46.711614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:46.712712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:46.713298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:46.973933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:47.024561 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93b13882-1960-4799-b222-fbb5c4f0f90b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.872513 Aug 03 04:31:47.024561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 65/150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:46 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:47.191540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:47.203628 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3634a6fd-8dfc-42bc-bf7f-62758113c3fa tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.528371 Aug 03 04:31:47.204798 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 86/151] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:46 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:47.396619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:47.397890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:47.412672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:47.412672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:47.412672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:47.412932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:47.547662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:47.561904 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af69874c-1100-4716-8390-d10f7dcab310 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1313 microversion: 2.1 time: 0.168526 Aug 03 04:31:47.568877 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 66/152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:47 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:48.035287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:48.036582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:48.051059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:48.069980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:48.069980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:48.071027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:48.229540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:48.230399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:48.249191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:48.253534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:48.253534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:48.253534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:49.112716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:49.122118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:49.141116 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d151d05-f3cb-4a0c-9364-79c05c626ef1 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.906934 Aug 03 04:31:49.141606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b86d9747-5151-407d-a283-f1da510672f9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 1.107702 Aug 03 04:31:49.142977 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 67/153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:48 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:49.144636 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 87/154] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:48 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:49.156145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:49.157447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:49.209994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:49.213697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:49.216053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:49.219167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:49.547718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37857b77-aa64-4911-97a5-c0ac7149a1fd tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Action: 'create', calling method: .version_select at 0x7fdd55830af0>, body: {"keypair": {"name": "tempest-keypair-165528472", "type": "ssh", "user_id": "a8211b001ebd4eb2ac7ad2c1f2b696e7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvE18Q7kx9x0oI93aIA60eZmlPDZHfqXkxz5x90Nk2sgIYHL3PX4JJEoWDWGQ9VK4yFw2bzbymibplJzw7qe/sf9eMvew9cbQ6aw7PwOJl3QPbLtCB5cCfKv/ctHNRkIQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:49.561842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:49.580369 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6fa504f-de62-4f41-a984-fe1eaa460372 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1319 microversion: 2.1 time: 0.431641 Aug 03 04:31:49.583525 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 88/155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:49 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:49.587047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-37857b77-aa64-4911-97a5-c0ac7149a1fd tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:49.594719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-37857b77-aa64-4911-97a5-c0ac7149a1fd tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for user 9c77885108774fc1a25f6fbcb9dd254d and project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:49.727463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37857b77-aa64-4911-97a5-c0ac7149a1fd tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.581058 Aug 03 04:31:49.728946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 68/156] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:31:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 584 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:31:49.750558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89487b80-5cb4-4caf-9745-a2a540157269 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Action: 'create', calling method: .version_select at 0x7fdd558cd5e0>, body: {"keypair": {"name": "tempest-keypair-107703684", "type": "ssh", "user_id": "a8211b001ebd4eb2ac7ad2c1f2b696e7", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6Bb8eHp0KK/uWNr8tMGy28aCIr8lXESHqIs8TzWZPE2Kx+tVTrRs7zjWRLfoHqOFtWSrpL3KWQLKN2rWEb77tuV+vMc+1L+Gbe8H6JGyBES+IEBDBNJJ3upFxdPoKSHA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:49.801398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-89487b80-5cb4-4caf-9745-a2a540157269 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:49.808787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-89487b80-5cb4-4caf-9745-a2a540157269 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for user 9c77885108774fc1a25f6fbcb9dd254d and project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:49.938383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89487b80-5cb4-4caf-9745-a2a540157269 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.199200 Aug 03 04:31:49.939099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 89/157] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:31:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 03 04:31:49.949801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e626536-b318-432b-a8e1-ca10a4499dd9 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Calling method '.version_select at 0x7fdd557dd550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:49.970554 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e626536-b318-432b-a8e1-ca10a4499dd9 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "GET /compute/v2.1/os-keypairs/tempest-keypair-165528472?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7" status: 200 len: 511 microversion: 2.10 time: 0.024432 Aug 03 04:31:49.971160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 69/158] 10.222.0.72 () {60 vars in 1337 bytes} [Wed Aug 3 04:31:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-165528472?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7 => generated 511 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:31:49.986596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0d883f42-1271-4628-bcb5-d9e18ca21143 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Action: 'create', calling method: .version_select at 0x7fdd557caf70>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1741829814", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9whNSpFr0WDeojf4WtAYfv1QK2vq6q5pcZmjYAlbuiEIdFvB6ZmRL9a3Nw0+GRUSx3toMQA14VrvxYTiMlUtDx081dKhaGQrnb//GS7ENHG/BlvcSfjRgiGiuNvdKYuA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:50.031989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0d883f42-1271-4628-bcb5-d9e18ca21143 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:50.043198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0d883f42-1271-4628-bcb5-d9e18ca21143 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Getting quotas for user 9c77885108774fc1a25f6fbcb9dd254d and project dde639ddd7974bada2ddfb4f12a5a5d2. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:50.122230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-319c9124-bfb8-4983-b9ce-515b7585347a req-da3a7f24-95e8-4cdd-8eda-95740171c3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd", "name": "network-vif-plugged", "status": "completed", "tag": "47e32e08-e326-4295-87b9-be4adef70fee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:50.138716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-319c9124-bfb8-4983-b9ce-515b7585347a req-da3a7f24-95e8-4cdd-8eda-95740171c3d1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.139996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-319c9124-bfb8-4983-b9ce-515b7585347a req-da3a7f24-95e8-4cdd-8eda-95740171c3d1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.168701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-319c9124-bfb8-4983-b9ce-515b7585347a req-da3a7f24-95e8-4cdd-8eda-95740171c3d1 service nova] Creating event network-vif-plugged:47e32e08-e326-4295-87b9-be4adef70fee for instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd on n-h1-826756-5 Aug 03 04:31:50.178727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-319c9124-bfb8-4983-b9ce-515b7585347a req-da3a7f24-95e8-4cdd-8eda-95740171c3d1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171376 Aug 03 04:31:50.179638 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 70/159] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:50.186776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0d883f42-1271-4628-bcb5-d9e18ca21143 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.203179 Aug 03 04:31:50.188694 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 90/160] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:31:49 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:31:50.198459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:50.199005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:50.203304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:50.207673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:50.210361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.210817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.225977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.229082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.240544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.254451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.256525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.257294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.722097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:50.730004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5de1f6a4-2078-4d49-81b2-275ef3434302 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.540209 Aug 03 04:31:50.730600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 91/161] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:50 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:50.747289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0a64524-524c-4892-9f57-e6f094119718 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Calling method '.version_select at 0x7fdd573d4160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:50.753637 n-d-826756-5 devstack@n-api.service[120832]: WARNING oslo_db.sqlalchemy.utils [None req-e0a64524-524c-4892-9f57-e6f094119718 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:31:50.776622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0a64524-524c-4892-9f57-e6f094119718 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "GET /compute/v2.1/os-keypairs?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7" status: 200 len: 724 microversion: 2.10 time: 0.044526 Aug 03 04:31:50.777597 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 92/162] 10.222.0.72 () {60 vars in 1259 bytes} [Wed Aug 3 04:31:50 2022] GET /compute/v2.1/os-keypairs?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7 => generated 724 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:31:50.786149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:50.792223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:50.799687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:50.814071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.814526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.815314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:50.815753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:50.830778 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-10653361-68aa-412c-8412-f994376f7b6b tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.645291 Aug 03 04:31:50.834040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 71/163] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:50 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:50.851224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56f209d5-eddb-4a63-a98c-7e4a378eab67 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Calling method '.version_select at 0x7fdd557ddaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:51.013645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56f209d5-eddb-4a63-a98c-7e4a378eab67 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1741829814" status: 204 len: 0 microversion: 2.10 time: 0.177637 Aug 03 04:31:51.014584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 72/164] 10.222.0.72 () {60 vars in 1325 bytes} [Wed Aug 3 04:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1741829814 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:31:51.025859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-199d563a-ab79-45ac-9563-c69421920e97 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Calling method '.version_select at 0x7fdd557d9d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:51.138166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:51.146395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-199d563a-ab79-45ac-9563-c69421920e97 tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107703684?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7" status: 204 len: 0 microversion: 2.10 time: 0.124199 Aug 03 04:31:51.152519 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d98372ae-8b73-4ae9-a723-d8809f07556a tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.365577 Aug 03 04:31:51.152519 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 93/165] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:50 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:51.153313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 73/166] 10.222.0.72 () {60 vars in 1340 bytes} [Wed Aug 3 04:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107703684?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:31:51.168707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb64fb1f-ccad-4eb9-828f-10789d79a3fa tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] Calling method '.version_select at 0x7fdd5577cd30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:51.361820 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb64fb1f-ccad-4eb9-828f-10789d79a3fa tempest-KeyPairsV210TestJSON-881169087 tempest-KeyPairsV210TestJSON-881169087-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165528472?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7" status: 204 len: 0 microversion: 2.10 time: 0.202269 Aug 03 04:31:51.368780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 94/167] 10.222.0.72 () {60 vars in 1340 bytes} [Wed Aug 3 04:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165528472?user_id=a8211b001ebd4eb2ac7ad2c1f2b696e7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:31:51.751056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:51.751667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:51.765347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:51.766018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:51.766969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:51.767557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:51.859203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:51.860064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:51.872991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:51.873711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:51.874854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:51.875439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:51.879952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:52.372092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:52.383429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:52.385040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-679394e4-244d-45f0-be30-cfc388b1ee81 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.637782 Aug 03 04:31:52.385972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 74/168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:51 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:52.391837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-619ae35c-308c-41ab-89d6-47d3646b3f3a tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.536594 Aug 03 04:31:52.395106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 95/169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:51 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:52.395959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:52.396613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:52.415077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:52.415520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:52.418099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:52.418099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:52.714881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:52.725773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc58e47c-9588-4f6f-9f27-d1a522ce3eb7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.338668 Aug 03 04:31:52.741646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 75/170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:52 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:53.093738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-67f485dc-ce75-4196-933e-3c69758b67c8 req-bd2d812b-6bd3-47db-b1b3-3364c22b7c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e21669-2e7e-486a-a0cc-366c34a986b8", "tag": "5153e1fe-1415-4303-9583-ebfa21f93a5c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:53.179917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-67f485dc-ce75-4196-933e-3c69758b67c8 req-bd2d812b-6bd3-47db-b1b3-3364c22b7c9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:53.183028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-67f485dc-ce75-4196-933e-3c69758b67c8 req-bd2d812b-6bd3-47db-b1b3-3364c22b7c9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:53.237879 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-67f485dc-ce75-4196-933e-3c69758b67c8 req-bd2d812b-6bd3-47db-b1b3-3364c22b7c9c service nova] Creating event network-changed:5153e1fe-1415-4303-9583-ebfa21f93a5c for instance d1e21669-2e7e-486a-a0cc-366c34a986b8 on n-h2-826756-5 Aug 03 04:31:53.256139 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-67f485dc-ce75-4196-933e-3c69758b67c8 req-bd2d812b-6bd3-47db-b1b3-3364c22b7c9c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195962 Aug 03 04:31:53.259197 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 76/171] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:53.281094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9b662028-9908-44aa-af26-73d6557d0a49 req-ad5a1453-4742-467a-8334-d65f0e92ecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7aed72-19cd-41a4-9e6b-544c4cf98047", "name": "network-vif-plugged", "status": "completed", "tag": "fdfeffe6-e51a-4378-a9cf-2a692aa271b5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:53.302492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:53.304989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9b662028-9908-44aa-af26-73d6557d0a49 req-ad5a1453-4742-467a-8334-d65f0e92ecd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:53.349279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9b662028-9908-44aa-af26-73d6557d0a49 req-ad5a1453-4742-467a-8334-d65f0e92ecd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:53.349279 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9b662028-9908-44aa-af26-73d6557d0a49 req-ad5a1453-4742-467a-8334-d65f0e92ecd9 service nova] Creating event network-vif-plugged:fdfeffe6-e51a-4378-a9cf-2a692aa271b5 for instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 on n-h2-826756-5 Aug 03 04:31:53.349279 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9b662028-9908-44aa-af26-73d6557d0a49 req-ad5a1453-4742-467a-8334-d65f0e92ecd9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062082 Aug 03 04:31:53.349279 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 77/172] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:53.425499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:53.428902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:53.450187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:53.452742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:53.458560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:53.460009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:53.810353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-120451397", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:53.930362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] validate_networks() for [('8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:31:53.960617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:53.971736 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-564f8775-eda4-47bc-87e4-c00421994d3e tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1337 microversion: 2.1 time: 0.552386 Aug 03 04:31:53.978005 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 78/173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:53 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1337 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:53.983706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:53.994329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:54.009168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:54.009667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:54.010391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:54.010998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:54.640143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:54.707847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:54.715676 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2e71cc0-6ff3-4003-a1ea-11d258f69cbc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.736259 Aug 03 04:31:54.716419 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 79/174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:53 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:54.730573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:54.734620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:54.746962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:54.747578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:54.748632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:54.749451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.003019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:55.014669 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fc7f2e7-00c9-4d2e-909d-5c6734a381d7 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.294664 Aug 03 04:31:55.032508 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 80/175] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:54 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:55.270979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b06d590-250a-4081-80c0-3fd9b94b80d9 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Calling method '.version_select at 0x7fdd557dd8b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:55.272228 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:55.272228 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:55.274892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b06d590-250a-4081-80c0-3fd9b94b80d9 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '241e2bc81e284a3e876c29a3a99b5029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54014c23b1e3433597a452162f2130cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b06d590-250a-4081-80c0-3fd9b94b80d9 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Request method failure captured: Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fo5wzkB-bHtW8JpxgZJe1P4PA_E_FXYjXLhhwgCODnvIyXkKybmMxQc6cXAnx-FhzRDEOk47b4RwsUckBO7qznw7uxdJc-Nz65Pf_-bsdIpMYzrOYKw0fcrhmooUyyTWJiIoL0M5Ykf7lR1P5tNMkd0JWh40q5_f6MRQKLhe3gJOrs Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:31:55.283100 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/54014c23b1e3433597a452162f2130cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 241e2bc81e284a3e876c29a3a99b5029 Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:31:55.284308 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:55.285040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 03 04:31:55.286029 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.287055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b06d590-250a-4081-80c0-3fd9b94b80d9 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:55.287055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b06d590-250a-4081-80c0-3fd9b94b80d9 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.251971 Aug 03 04:31:55.288778 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 81/176] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:31:55 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:55.311115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:55.313797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:55.339427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.340044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.341171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.341593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.817098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:55.830286 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-928d6082-30d8-4276-90a4-845435d7d125 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1487 microversion: 2.1 time: 0.540160 Aug 03 04:31:55.851880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 82/177] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:55 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1487 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:55.862941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d81f3a76-b604-4efe-b835-89d2a5b98ff0 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Calling method '.version_select at 0x7fdd55778430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:55.864248 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:55.864248 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:55.870038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d81f3a76-b604-4efe-b835-89d2a5b98ff0 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '241e2bc81e284a3e876c29a3a99b5029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54014c23b1e3433597a452162f2130cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d81f3a76-b604-4efe-b835-89d2a5b98ff0 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Request method failure captured: Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fo5wzkB-bHtW8JpxgZJe1P4PA_E_FXYjXLhhwgCODnvIyXkKybmMxQc6cXAnx-FhzRDEOk47b4RwsUckBO7qznw7uxdJc-Nz65Pf_-bsdIpMYzrOYKw0fcrhmooUyyTWJiIoL0M5Ykf7lR1P5tNMkd0JWh40q5_f6MRQKLhe3gJOrs Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:31:55.878003 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/54014c23b1e3433597a452162f2130cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 241e2bc81e284a3e876c29a3a99b5029 Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:31:55.879223 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:55.879930 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 03 04:31:55.880943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:55.884186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d81f3a76-b604-4efe-b835-89d2a5b98ff0 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:55.886107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d81f3a76-b604-4efe-b835-89d2a5b98ff0 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.032086 Aug 03 04:31:55.887449 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 83/178] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:55 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:55.895534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:55.896614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:55.905833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:31:55.906318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:31:55.906739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:31:55.907157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:31:55.907573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:31:55.908496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.909061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.910020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.910918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.926295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.926752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:55.931288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:55.931922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.009744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:31:56.014847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for user 4cb1b66854244b8197c4b1f0ccae0b0e and project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:31:56.029914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:31:56.033383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:31:56.064405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:56.116674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.120351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:56.127560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11f665be-3ce9-475d-9b5d-2942aed9dce0 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.238512 Aug 03 04:31:56.138690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 84/179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:55 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:56.143286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.143898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:56.152231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.156095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.156095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.156095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.173257 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c87d0494-7757-452a-a0ea-561300f28dcc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.133460 Aug 03 04:31:56.180178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 96/180] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:31:56.191062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90d0bb9d-3890-45ce-9d22-8f2ab2ff1ea6 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Calling method '.version_select at 0x7fdd557e3550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.192153 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:56.192153 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:56.193607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-90d0bb9d-3890-45ce-9d22-8f2ab2ff1ea6 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '241e2bc81e284a3e876c29a3a99b5029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54014c23b1e3433597a452162f2130cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90d0bb9d-3890-45ce-9d22-8f2ab2ff1ea6 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Request method failure captured: Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fo5wzkB-bHtW8JpxgZJe1P4PA_E_FXYjXLhhwgCODnvIyXkKybmMxQc6cXAnx-FhzRDEOk47b4RwsUckBO7qznw7uxdJc-Nz65Pf_-bsdIpMYzrOYKw0fcrhmooUyyTWJiIoL0M5Ykf7lR1P5tNMkd0JWh40q5_f6MRQKLhe3gJOrs Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:31:56.202955 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/54014c23b1e3433597a452162f2130cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 241e2bc81e284a3e876c29a3a99b5029 Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:31:56.204339 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:56.212945 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 03 04:31:56.214153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:56.215208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90d0bb9d-3890-45ce-9d22-8f2ab2ff1ea6 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:56.215208 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-90d0bb9d-3890-45ce-9d22-8f2ab2ff1ea6 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.024426 Aug 03 04:31:56.215208 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 97/181] 10.222.0.72 () {58 vars in 1179 bytes} [Wed Aug 3 04:31:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:56.227900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.232022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:56.252688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.256990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.260063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.262074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.619733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.630482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-adadab0b-4c63-47f9-968b-060611cabd55 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.407544 Aug 03 04:31:56.633140 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 98/182] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:56 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:56.639725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.640635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:56.702272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.713433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.714964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:56.716407 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef4cf4b6-b4c5-44af-a419-91dd5dfc5000 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1261 microversion: 2.25 time: 0.081853 Aug 03 04:31:56.717298 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 99/183] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:31:56 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1261 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:56.764545 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6d89c7f-aa13-4a25-b08f-5aec5436f2a8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1638 microversion: 2.1 time: 0.625983 Aug 03 04:31:56.765298 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 85/184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:56 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1638 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:56.784735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.785456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:56.791470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.792097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.792937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.797626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:56.830043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:31:56.972798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Calling method '.version_select at 0x7fdd557b9c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:56.976596 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:56.976596 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:56.977866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:56.978323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.022847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.023492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.045433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.046422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.053154 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-056ef95d-63c6-4ba2-90f5-bbc2e0c45260 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.332986 Aug 03 04:31:57.059678 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 100/185] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-baa04c74-6e33-4b73-940d-913b8de1d57a tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Calling method '.version_select at 0x7fdd557ca430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-baa04c74-6e33-4b73-940d-913b8de1d57a tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '241e2bc81e284a3e876c29a3a99b5029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54014c23b1e3433597a452162f2130cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-baa04c74-6e33-4b73-940d-913b8de1d57a tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Request method failure captured: Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:57.071470 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fo5wzkB-bHtW8JpxgZJe1P4PA_E_FXYjXLhhwgCODnvIyXkKybmMxQc6cXAnx-FhzRDEOk47b4RwsUckBO7qznw7uxdJc-Nz65Pf_-bsdIpMYzrOYKw0fcrhmooUyyTWJiIoL0M5Ykf7lR1P5tNMkd0JWh40q5_f6MRQKLhe3gJOrs Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/54014c23b1e3433597a452162f2130cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:57.072232 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 241e2bc81e284a3e876c29a3a99b5029 Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1'} Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:57.073300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.074783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-baa04c74-6e33-4b73-940d-913b8de1d57a tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-baa04c74-6e33-4b73-940d-913b8de1d57a tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008826 Aug 03 04:31:57.076068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 101/186] 10.222.0.72 () {58 vars in 1173 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:57.081288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acbb553a-2665-43c6-bb3b-dba4f5236221 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Calling method '.version_select at 0x7fdd559d43a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.083148 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-acbb553a-2665-43c6-bb3b-dba4f5236221 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] HTTP exception thrown: Hypervisor with ID 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' could not be found. Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acbb553a-2665-43c6-bb3b-dba4f5236221 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Request method failure captured: Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hypervisors/ce5fca64-d6ad-46d7-8cbf-992f69d1c80c/uptime HTTP/1.1 Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fo6Nt4h9EXl0QQ7BwQquJu-K_ZUzxDh-xvsBhqvXnY-pchy3m2i3w93BXSiA4L_rQLfCj-Te976Cb3mDM0_RnIdvx_W6rJnZRkUMoV-agZONXYb0PcWg69tLadvYFRb6Bav9otify5Apvchf2UF9PDPmAcRBhvd56lVo84vu9Pu76c Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 0e92645888fc4e7e92ef425154df9fed Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:31:57.106148 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 0e92645888fc4e7e92ef425154df9fed Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 471fc45e61624113adb0128f0534a8c3 Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: exception: Hypervisor with ID 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' could not be found. Aug 03 04:31:57.107884 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c'} Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 03 04:31:57.108565 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' could not be found. Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.109753 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' could not be found. Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acbb553a-2665-43c6-bb3b-dba4f5236221 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Returning 404 to user: Hypervisor with ID 'ce5fca64-d6ad-46d7-8cbf-992f69d1c80c' could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-acbb553a-2665-43c6-bb3b-dba4f5236221 tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/ce5fca64-d6ad-46d7-8cbf-992f69d1c80c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031326 Aug 03 04:31:57.110845 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 102/187] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/os-hypervisors/ce5fca64-d6ad-46d7-8cbf-992f69d1c80c/uptime => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:57.122094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Calling method '.version_select at 0x7fdd557ca430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.122953 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:57.122953 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:57.134471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.134471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.140700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.141696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.178558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.179238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.188171 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2967fe3-f1ca-4ee5-ad7d-b94611701d1c tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071281 Aug 03 04:31:57.189482 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 103/188] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:57.194372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.195163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:57.227303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.227883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.229076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.229675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.468482 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69fa77e5-9a7a-43bf-9a32-f4242380d99b tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 204 len: 0 microversion: 2.1 time: 0.686360 Aug 03 04:31:57.478360 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 86/189] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:31:56 2022] DELETE /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:31:57.483634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c7e7ce0-8fc5-4a11-9676-ebbf3684c5f3 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Calling method '.version_select at 0x7fdd558be550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.486095 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:57.486095 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:31:57.489517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c7e7ce0-8fc5-4a11-9676-ebbf3684c5f3 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '241e2bc81e284a3e876c29a3a99b5029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54014c23b1e3433597a452162f2130cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c7e7ce0-8fc5-4a11-9676-ebbf3684c5f3 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Request method failure captured: Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fo5wzkB-bHtW8JpxgZJe1P4PA_E_FXYjXLhhwgCODnvIyXkKybmMxQc6cXAnx-FhzRDEOk47b4RwsUckBO7qznw7uxdJc-Nz65Pf_-bsdIpMYzrOYKw0fcrhmooUyyTWJiIoL0M5Ykf7lR1P5tNMkd0JWh40q5_f6MRQKLhe3gJOrs Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:31:57.494404 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_54014c23b1e3433597a452162f2130cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/54014c23b1e3433597a452162f2130cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 54014c23b1e3433597a452162f2130cb Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-866531993 Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 241e2bc81e284a3e876c29a3a99b5029 Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-866531993-project Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1'} Aug 03 04:31:57.495608 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:31:57.497301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 03 04:31:57.499285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.509180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c7e7ce0-8fc5-4a11-9676-ebbf3684c5f3 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:57.514625 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c7e7ce0-8fc5-4a11-9676-ebbf3684c5f3 tempest-HypervisorAdminNegativeTestJSON-866531993 tempest-HypervisorAdminNegativeTestJSON-866531993-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.040447 Aug 03 04:31:57.523120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 87/190] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:57.562334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.567277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:57.585063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:57.589191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.598466 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e13273ff-189e-4dff-bf11-aa16b8984852 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1318 microversion: 2.1 time: 0.407758 Aug 03 04:31:57.603148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.604856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.605489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.611314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 104/191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:57.620748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d51af60a-8d22-4064-8531-ed83f3d1c39a tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Calling method '.version_select at 0x7fdd557a3b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.622073 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:31:57.622073 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:31:57.630146 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d51af60a-8d22-4064-8531-ed83f3d1c39a tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] HTTP exception thrown: Hypervisor with ID '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' could not be found. Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d51af60a-8d22-4064-8531-ed83f3d1c39a tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Request method failure captured: Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hypervisors/1b3a404b-6878-4e27-bf5d-eeb6f58140fd HTTP/1.1 Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fo6Nt4h9EXl0QQ7BwQquJu-K_ZUzxDh-xvsBhqvXnY-pchy3m2i3w93BXSiA4L_rQLfCj-Te976Cb3mDM0_RnIdvx_W6rJnZRkUMoV-agZONXYb0PcWg69tLadvYFRb6Bav9otify5Apvchf2UF9PDPmAcRBhvd56lVo84vu9Pu76c Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 0e92645888fc4e7e92ef425154df9fed Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:31:57.634793 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0e92645888fc4e7e92ef425154df9fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 0e92645888fc4e7e92ef425154df9fed Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-505956002 Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 471fc45e61624113adb0128f0534a8c3 Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: exception: Hypervisor with ID '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' could not be found. Aug 03 04:31:57.640197 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1b3a404b-6878-4e27-bf5d-eeb6f58140fd'} Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 03 04:31:57.640993 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:31:57.642131 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' could not be found. Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' could not be found. Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:31:57.643128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d51af60a-8d22-4064-8531-ed83f3d1c39a tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] Returning 404 to user: Hypervisor with ID '1b3a404b-6878-4e27-bf5d-eeb6f58140fd' could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:57.645035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d51af60a-8d22-4064-8531-ed83f3d1c39a tempest-HypervisorAdminNegativeTestJSON-505956002 tempest-HypervisorAdminNegativeTestJSON-505956002-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1b3a404b-6878-4e27-bf5d-eeb6f58140fd" status: 404 len: 123 microversion: 2.1 time: 0.024368 Aug 03 04:31:57.647022 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 105/192] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/os-hypervisors/1b3a404b-6878-4e27-bf5d-eeb6f58140fd => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:31:57.661286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:57.662703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:57.679864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.681155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:57.682083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:57.683764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:58.057859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:58.070976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30cadb6a-ef3d-4bf3-9d38-47fea648e35e tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.419414 Aug 03 04:31:58.071906 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 106/193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:58.084632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.085106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:58.096252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:58.100481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:58.100481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:58.100481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:58.268608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:58.282927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:58.284478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:58.285587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2fac37a6-01ad-4d44-9b73-8a448f4597bf tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1286 microversion: 2.25 time: 0.208118 Aug 03 04:31:58.288226 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 107/194] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:58.422493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:58.438357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a125006-48a3-470f-9dd5-f075c59d7399 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1493 microversion: 2.1 time: 0.913517 Aug 03 04:31:58.443586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 88/195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:57 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1493 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:58.637807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.639023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:58.654858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5f7dfba-538a-4e55-99a5-c368cb4a58b4 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.657528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:58.658122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:58.659471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:58.660684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:58.664989 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5f7dfba-538a-4e55-99a5-c368cb4a58b4 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.371020 Aug 03 04:31:58.666541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 108/196] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:58.680966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-878cca92-f4a5-45dd-ad70-dd947aa8f984 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.707855 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-878cca92-f4a5-45dd-ad70-dd947aa8f984 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors" status: 200 len: 3073 microversion: 2.1 time: 0.031247 Aug 03 04:31:58.709825 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 109/197] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors => generated 3073 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:58.739364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ca57ac95-3130-4022-babf-e12d96313b68 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.750888 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ca57ac95-3130-4022-babf-e12d96313b68 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019257 Aug 03 04:31:58.751614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 110/198] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:58.766094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d96a93fc-4d92-49bb-b00e-697fad8b3310 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.776566 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d96a93fc-4d92-49bb-b00e-697fad8b3310 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015763 Aug 03 04:31:58.779064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 111/199] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:58.793702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5da855f-fc07-4905-8919-ca67e5092de5 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.826029 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5da855f-fc07-4905-8919-ca67e5092de5 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.038855 Aug 03 04:31:58.827065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 112/200] 10.222.0.72 () {58 vars in 1165 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:58.844882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dde3cc0e-0cf7-4f1b-baf5-83a44451a8e0 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.855320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dde3cc0e-0cf7-4f1b-baf5-83a44451a8e0 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015838 Aug 03 04:31:58.856451 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 113/201] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:58.875916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8813da6-01c5-41e9-8283-ba4a760bf4a6 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.934607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8813da6-01c5-41e9-8283-ba4a760bf4a6 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.069303 Aug 03 04:31:58.944660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 114/202] 10.222.0.72 () {58 vars in 1169 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:58.952259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fa96959-000c-4084-9d14-d4275ea555c8 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:58.985821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fa96959-000c-4084-9d14-d4275ea555c8 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038335 Aug 03 04:31:58.987587 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 115/203] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:59.003197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0c476dc-01e0-46fd-ba9c-d4268f38b8a3 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.023901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0c476dc-01e0-46fd-ba9c-d4268f38b8a3 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026643 Aug 03 04:31:59.029143 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 116/204] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:31:59.029274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:59.036695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-79c7a2de-147c-4e32-b822-38d60ba04a1d tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.039147 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9285d3a4-ef59-4e06-a99d-07189957ed75 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1467 microversion: 2.1 time: 0.406402 Aug 03 04:31:59.039738 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 89/205] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:58 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1467 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:31:59.122540 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-79c7a2de-147c-4e32-b822-38d60ba04a1d tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2909 microversion: 2.1 time: 0.089785 Aug 03 04:31:59.125079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 117/206] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2909 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:59.145014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.146163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:59.153752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.154937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.156102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.156765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.269041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-952996870", "block_migration": true, "disk_over_commit": false}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:31:59.276534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:59.287160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.287614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.288696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.289298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.373845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:59.385303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-902315cf-150a-48dd-ac00-e50a14ef7dbb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.258844 Aug 03 04:31:59.396429 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 118/207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:59.401754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37fb6bbe-7876-48a4-8f07-c8a23e7c6e00 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.411311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lazy-loading 'flavor' on Instance uuid 2b7aed72-19cd-41a4-9e6b-544c4cf98047 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:31:59.421178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37fb6bbe-7876-48a4-8f07-c8a23e7c6e00 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023301 Aug 03 04:31:59.422115 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 119/208] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:31:59.427010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.437380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:59.445768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.446155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.447046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.447490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.498116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Going to try to live migrate instance to tempest-host-952996870 {{(pid=120831) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:31:59.509182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] HTTP exception thrown: Compute host tempest-host-952996870 could not be found. Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Request method failure captured: Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047/action HTTP/1.1 Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 106 Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foYLb0OYRO5vn3DZucQuN4vphMpCAWpg4OuibdFpdtNq5Yfvr-9a6fqXwhLc_VQ0wY82QhN0yaoNPRITRWh4_NnlIyK3OX-FYQ7VaDcAmm1qpJIob5mZdcXO9_b0om06vkkwlnQxZR1mLztLDy5LF-WbroqA2unZn7wkarWs9oPi5o Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8b35ddc6bb894fe7bebf660d27c9b60a Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:31:59.518296 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8b35ddc6bb894fe7bebf660d27c9b60a Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-LiveMigrationNegativeTest-690633689-project-admin Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 52c027170a2d4972b21ef77ffdfb54bf Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-LiveMigrationNegativeTest-690633689-project-admin Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: {"os-migrateLive": {"host": "tempest-host-952996870", "block_migration": true, "disk_over_commit": false}} Aug 03 04:31:59.519547 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: exception: Compute host tempest-host-952996870 could not be found. Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b7aed72-19cd-41a4-9e6b-544c4cf98047', 'body': {'os-migrateLive': {'host': 'tempest-host-952996870', 'block_migration': True, 'disk_over_commit': False}}} Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:31:59.520194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5436, in live_migrate Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-952996870 could not be found. Aug 03 04:31:59.521199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-952996870 could not be found. Aug 03 04:31:59.522925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-952996870 could not be found. Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Returning 400 to user: Compute host tempest-host-952996870 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b4a38da-0dc4-4da7-906a-7fa835395d5b tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047/action" status: 400 len: 99 microversion: 2.1 time: 0.454976 Aug 03 04:31:59.523934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 90/209] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Aug 3 04:31:59 2022] POST /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047/action => generated 99 bytes in 456 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:31:59.531453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-483fe3c3-336f-4eb5-8c80-64b6fbf0166d tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.566161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-483fe3c3-336f-4eb5-8c80-64b6fbf0166d tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.042767 Aug 03 04:31:59.567404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 91/210] 10.222.0.72 () {58 vars in 1144 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:31:59.584490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.588426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:59.601960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.602415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.606857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.607547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.617955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:31:59.689580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:59.713074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:59.720855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:31:59.724578 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b67162d4-5d57-4a67-9b98-56afe7403dd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1334 microversion: 2.25 time: 0.301074 Aug 03 04:31:59.725308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 120/211] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1334 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:31:59.731833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:31:59.733172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:31:59.745727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.746985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:31:59.748784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:31:59.753002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:00.003504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:00.019365 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc4f62ef-1960-443e-befd-aeedae4b62a4 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1493 microversion: 2.1 time: 0.449066 Aug 03 04:32:00.021360 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 92/212] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1493 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:00.050271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49451029-81ee-4608-b5c4-88360db1c0d3 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.065286 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49451029-81ee-4608-b5c4-88360db1c0d3 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041126 Aug 03 04:32:00.070787 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 93/213] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:00.108323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6936b00a-45bf-481b-962f-e2409b0c86ff tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.153460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6936b00a-45bf-481b-962f-e2409b0c86ff tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.075768 Aug 03 04:32:00.155142 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 94/214] 10.222.0.72 () {58 vars in 1148 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:00.174596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad7f35aa-5f44-4e49-9441-ec1eb59213c1 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.208444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad7f35aa-5f44-4e49-9441-ec1eb59213c1 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.041818 Aug 03 04:32:00.215048 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 95/215] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:00.229814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aee8ad9a-3534-42a2-81d5-15e0733b9982 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.240178 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aee8ad9a-3534-42a2-81d5-15e0733b9982 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014250 Aug 03 04:32:00.243674 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 96/216] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:00.258395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:00.275262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a41b5f99-3d8e-4404-af58-ba9f04929db6 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.285792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0bb1b756-6788-40f4-b927-3a24366a510f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1467 microversion: 2.1 time: 0.555374 Aug 03 04:32:00.292581 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 121/217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:31:59 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1467 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:00.399364 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a41b5f99-3d8e-4404-af58-ba9f04929db6 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1538 microversion: 2.1 time: 0.147724 Aug 03 04:32:00.402137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 97/218] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors?marker=452 => generated 1538 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:00.420460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.421100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:00.446803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:00.447225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:00.448800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95fa1323-14bf-4ccb-a03b-20ee6a445246 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:00.451837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:00.458381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:00.534514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95fa1323-14bf-4ccb-a03b-20ee6a445246 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.110981 Aug 03 04:32:00.544885 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 98/219] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:00.560717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fade0b61-36b1-4ec0-9227-2bdd7c3668f0 req-ff4ae99a-7a5b-4fbb-afb9-da1f806419ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd", "name": "network-vif-deleted", "tag": "47e32e08-e326-4295-87b9-be4adef70fee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:00.589660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fade0b61-36b1-4ec0-9227-2bdd7c3668f0 req-ff4ae99a-7a5b-4fbb-afb9-da1f806419ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:00.590197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fade0b61-36b1-4ec0-9227-2bdd7c3668f0 req-ff4ae99a-7a5b-4fbb-afb9-da1f806419ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:00.619051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fade0b61-36b1-4ec0-9227-2bdd7c3668f0 req-ff4ae99a-7a5b-4fbb-afb9-da1f806419ed service nova] Creating event network-vif-deleted:47e32e08-e326-4295-87b9-be4adef70fee for instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd on n-h1-826756-5 Aug 03 04:32:00.625504 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fade0b61-36b1-4ec0-9227-2bdd7c3668f0 req-ff4ae99a-7a5b-4fbb-afb9-da1f806419ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079300 Aug 03 04:32:00.626896 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 99/220] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:00.633472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2064142605", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:00.738356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:01.020665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.031140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f07f81a-8b29-41d6-9925-0a5b093fdbd3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.615680 Aug 03 04:32:01.031954 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 122/221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:00 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:01.040495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56b42232-9f63-4c81-b6a3-fdaf87c2af17 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:01.058940 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56b42232-9f63-4c81-b6a3-fdaf87c2af17 tempest-FlavorsV2TestJSON-247967763 tempest-FlavorsV2TestJSON-247967763-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022027 Aug 03 04:32:01.064928 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 123/222] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:32:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:01.084843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:01.085471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:01.106657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.107940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.109009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.123165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.312714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.337099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.340289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.343226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd467668-52c6-4860-a24a-cbd53d6269b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1340 microversion: 2.25 time: 0.275542 Aug 03 04:32:01.344156 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 124/223] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:01 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1340 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:01.364183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:01.364767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:01.365252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:01.365897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:01.366552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:01.373353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:01.374136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:01.378473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.379186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.380199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.380822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.382852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.383474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.384424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.385521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.404738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Getting quotas for project 6cf7cad2bd5a466caec230bbdef00681. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:01.409941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Getting quotas for user c2b2dfc0b09f4e1c8fe556d731f82a3a and project 6cf7cad2bd5a466caec230bbdef00681. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:01.425199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:01.428204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:01.442267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:01.442916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:01.443637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lazy-loading 'fault' on Instance uuid 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:01.538452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247703c83c7d40cda8db648050e7a79e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa550409ef640b8a9fbb717c6659f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.558297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e92bdd1-03cb-4b84-870a-cbd5569e188d tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 200 len: 1327 microversion: 2.1 time: 0.194141 Aug 03 04:32:01.572889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 125/224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:01 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 1327 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:01.633382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90fc8f3b-b2ae-4467-af09-9a4d1ea6dc64 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005558 Aug 03 04:32:01.636631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 100/225] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:01.649587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b58c6c4-649f-48fb-ac31-a684e91f05d5 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:01.650221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b58c6c4-649f-48fb-ac31-a684e91f05d5 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:01.863737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b58c6c4-649f-48fb-ac31-a684e91f05d5 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:01.879436 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b58c6c4-649f-48fb-ac31-a684e91f05d5 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1219 microversion: 2.1 time: 0.233621 Aug 03 04:32:01.885241 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 126/226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:01 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1219 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:02.055887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:02.056542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:02.071658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:02.077044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:02.079788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:02.090693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:02.389275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:02.390076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:02.413490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:02.413941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:02.446118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:02.446629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.203534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:03.228956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26b1c293-1c6a-4792-b45c-a6efbb5b5b26 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 1.175245 Aug 03 04:32:03.237289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 101/227] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:02 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:03.255475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:03.256104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:03.274811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.274811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.274811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.275202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.292709 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] HTTP exception thrown: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Request method failure captured: Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd HTTP/1.1 Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foHLrVY_eoYTS34gUNYa63FszkKZw51mf8WN_VhY_Vxub5lI9lGqoByUYkBv_TNisu5Tz7TH8H5xNCd1wS3Ne7WzbjU7zkd0uYLFJeruWt47S0gK8C5BWWPLgSTESxElXKWSC7lJ1wRvYmRp8vE_GcKdFulCqGsDQn4b3BkuoeDI1g Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:03.296684 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 247703c83c7d40cda8db648050e7a79e Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:03.297875 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd'} Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:03.298519 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:03.299620 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:03.302315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Returning 404 to user: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:03.303713 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19ecec4c-fc40-4ce8-9781-c9886e54b857 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 404 len: 111 microversion: 2.1 time: 0.065174 Aug 03 04:32:03.305953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 102/228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:03 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:03.313374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:03.314310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:03.320982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.342205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.342205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.342205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.463361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:03.479987 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c80b95b5-3836-4a85-9bb7-0a9002553099 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1244 microversion: 2.1 time: 0.167988 Aug 03 04:32:03.479987 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 103/229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:03 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1244 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:03.487407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d560b059-d984-46a3-8166-9f77f704eb02 req-9ef637d3-03d1-4957-8837-8fcf078a06d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e21669-2e7e-486a-a0cc-366c34a986b8", "name": "network-vif-plugged", "status": "completed", "tag": "5153e1fe-1415-4303-9583-ebfa21f93a5c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:03.502836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d560b059-d984-46a3-8166-9f77f704eb02 req-9ef637d3-03d1-4957-8837-8fcf078a06d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.503527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d560b059-d984-46a3-8166-9f77f704eb02 req-9ef637d3-03d1-4957-8837-8fcf078a06d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:03.555359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d560b059-d984-46a3-8166-9f77f704eb02 req-9ef637d3-03d1-4957-8837-8fcf078a06d2 service nova] Creating event network-vif-plugged:5153e1fe-1415-4303-9583-ebfa21f93a5c for instance d1e21669-2e7e-486a-a0cc-366c34a986b8 on n-h2-826756-5 Aug 03 04:32:03.568975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d560b059-d984-46a3-8166-9f77f704eb02 req-9ef637d3-03d1-4957-8837-8fcf078a06d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088130 Aug 03 04:32:03.575847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 104/230] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:03.587028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:03.608235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bfb2ae85-a331-4848-ae9b-ed56cf38f717 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:03.608387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:03.613517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:03.614744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-abd739b8-79ea-4b7c-b9af-6efc5c4ee62a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1382 microversion: 2.25 time: 1.234601 Aug 03 04:32:03.616938 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:03.616938 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:03.619642 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 127/231] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:02 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1382 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:32:03.635607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfb2ae85-a331-4848-ae9b-ed56cf38f717 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:03.636071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfb2ae85-a331-4848-ae9b-ed56cf38f717 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:04.024737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bfb2ae85-a331-4848-ae9b-ed56cf38f717 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.443509 Aug 03 04:32:04.025644 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 105/232] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:04.037701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a3a5131-fa48-46d3-a176-f854e9249687 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:04.038461 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:04.038461 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:04.279624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a3a5131-fa48-46d3-a176-f854e9249687 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.245157 Aug 03 04:32:04.283158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:04.284076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:04.288545 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 128/233] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:04 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:04.314171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39b09e24-6f71-4406-931b-f7da512fea9a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-377930927"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:04.327496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:04.328104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:04.328968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:04.331158 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:04.331158 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:04.332501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-39b09e24-6f71-4406-931b-f7da512fea9a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid 2815d12b-c449-4e53-8e7a-6a8f87b2a67c for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:04.333543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:04.480926 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39b09e24-6f71-4406-931b-f7da512fea9a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.180303 Aug 03 04:32:04.484039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 129/234] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:04.499307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3596ab52-6e16-4efc-8790-0a329728818e tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:04.504117 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:04.504117 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:04.563377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3596ab52-6e16-4efc-8790-0a329728818e tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:04.565120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3596ab52-6e16-4efc-8790-0a329728818e tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.146156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:05.163943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4fcbb2e6-ad49-464f-b1e2-9213f18031ff tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1386 microversion: 2.1 time: 0.904736 Aug 03 04:32:05.171475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 106/235] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:04 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1386 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:05.193283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:05.193899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:05.216451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:05.217093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.218327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:05.218962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.410881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:05.440183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9bc6df91-743b-4d32-9f19-e26009b9afc4 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1289 microversion: 2.1 time: 0.250153 Aug 03 04:32:05.443934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 107/236] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:05 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:05.460492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:05.470012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:05.480973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:05.481509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.484223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:05.484856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.818617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3596ab52-6e16-4efc-8790-0a329728818e tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 1.326157 Aug 03 04:32:05.818617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 130/237] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:04 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:05.834321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:05.848776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:05.850505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:05.851835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01ae01ae-d4c8-4664-bdda-5138a193598e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.404356 Aug 03 04:32:05.853049 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 108/238] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:05 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:05.859933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6337e0b5-883d-4387-8680-6b1af67e9202 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:05.861380 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:05.861380 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:05.871306 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6337e0b5-883d-4387-8680-6b1af67e9202 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.016986 Aug 03 04:32:05.873586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 109/239] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:32:05 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:05.891704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f162c11e-4e72-402f-86b9-f9f66383f8c6 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:05.908721 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:05.908721 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:05.923877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f162c11e-4e72-402f-86b9-f9f66383f8c6 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:05.924641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f162c11e-4e72-402f-86b9-f9f66383f8c6 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:05.985341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:06.018146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-97aa3977-7627-480b-b779-777aef41b334 req-dd26acab-71ad-4a33-9f79-feb2eac3e3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146eb574-1303-4419-8af0-786d2e30d27a", "tag": "fac16e13-d03b-4b3d-a9e5-086317c05d62"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:06.027228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-97aa3977-7627-480b-b779-777aef41b334 req-dd26acab-71ad-4a33-9f79-feb2eac3e3d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.027679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-97aa3977-7627-480b-b779-777aef41b334 req-dd26acab-71ad-4a33-9f79-feb2eac3e3d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.041203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-97aa3977-7627-480b-b779-777aef41b334 req-dd26acab-71ad-4a33-9f79-feb2eac3e3d0 service nova] Creating event network-changed:fac16e13-d03b-4b3d-a9e5-086317c05d62 for instance 146eb574-1303-4419-8af0-786d2e30d27a on n-h1-826756-5 Aug 03 04:32:06.051938 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-97aa3977-7627-480b-b779-777aef41b334 req-dd26acab-71ad-4a33-9f79-feb2eac3e3d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232440 Aug 03 04:32:06.053593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 131/240] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:06.296838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f162c11e-4e72-402f-86b9-f9f66383f8c6 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.412175 Aug 03 04:32:06.299701 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 110/241] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:06.304338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbb704b0-0974-4ba4-9ec6-6e741a648f6d tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.304338 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:06.304338 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:06.308324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.310461 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-cbb704b0-0974-4ba4-9ec6-6e741a648f6d tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 03 04:32:06.313097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbb704b0-0974-4ba4-9ec6-6e741a648f6d tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin] Request method failure captured: Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpFcedug44xgpk4QS_SB3KAm-UCSr57vPCCXcGZpA1dmMFzPvBWX96aSWSskUZSAJlIl-rtetjxqWsV27mq_0l_ONOFzJt2BZqZKr--B-ZLG1sxdFxqC5h_PhDEC8x9jaOvOId9yuEmeF_da9SZGdYZoJGqSCUBhEDb6n4GOJAFH0k Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 0fddf6d8771d4f4dbc4a666e939e485d Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:06.318520 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0fddf6d8771d4f4dbc4a666e939e485d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0fddf6d8771d4f4dbc4a666e939e485d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0fddf6d8771d4f4dbc4a666e939e485d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0fddf6d8771d4f4dbc4a666e939e485d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 0fddf6d8771d4f4dbc4a666e939e485d Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 16c7d36deee94543aa2254e3c368f5b2 Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:06.319846 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid timestamp for date invalid_time Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'invalid_time'} Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:06.320534 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 03 04:32:06.321696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.324082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbb704b0-0974-4ba4-9ec6-6e741a648f6d tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:06.326173 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbb704b0-0974-4ba4-9ec6-6e741a648f6d tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936 tempest-InstanceUsageAuditLogNegativeTestJSON-1001283936-project-admin] 10.222.0.72 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.271018 Aug 03 04:32:06.326741 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 132/242] 10.222.0.72 () {58 vars in 1224 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:32:06.339183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.343242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.345453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.347245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.434744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43ba3fe5-8f37-420c-8db0-186592a6f254 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.464201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43ba3fe5-8f37-420c-8db0-186592a6f254 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.131078 Aug 03 04:32:06.465105 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 133/243] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:06.477742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5be7a950-912a-4102-9394-8a633682ecba tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.491888 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:06.491888 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:06.542983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:06.550283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:06.553882 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-244c1799-ce85-4386-84b8-ef12bcc43384 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1586 microversion: 2.1 time: 0.252405 Aug 03 04:32:06.555399 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 111/244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1586 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:06.598269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5be7a950-912a-4102-9394-8a633682ecba tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.125601 Aug 03 04:32:06.599516 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 134/245] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:06 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:06.606002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.606996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:06.614044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.615080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.615875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.616339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.721516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80dcfc67-9ac6-41ca-9153-d2608524e4ae tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.722882 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:06.722882 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:06.724180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80dcfc67-9ac6-41ca-9153-d2608524e4ae tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '7362965c98e041f6b65657782294abbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98730053130a4fc985a5c89375c2da81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80dcfc67-9ac6-41ca-9153-d2608524e4ae tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Request method failure captured: Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpDIetf7D9kpzGGri-2OjqoOxAtrqE2cMb1zzdWexSqlcniZ3sZIcItbQ1jrfKgyiKLrmFzMHj6JPxeVhvKZLz1rTBFXmHIvf2hQa8rNzvEcyIm8z6CKY8RTebL999KOzE_VLvy4SvT7xTMINdPiQqZe0gS4kzNXsc9lMSGghc_uJo Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 98730053130a4fc985a5c89375c2da81 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:06.726619 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/98730053130a4fc985a5c89375c2da81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/98730053130a4fc985a5c89375c2da81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_98730053130a4fc985a5c89375c2da81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/98730053130a4fc985a5c89375c2da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 98730053130a4fc985a5c89375c2da81 Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 7362965c98e041f6b65657782294abbe Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project Aug 03 04:32:06.727781 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:06.728394 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 03 04:32:06.729482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:06.730363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80dcfc67-9ac6-41ca-9153-d2608524e4ae tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:06.730363 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80dcfc67-9ac6-41ca-9153-d2608524e4ae tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] 10.222.0.72 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.171278 Aug 03 04:32:06.734145 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 112/246] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:06.739309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.739811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:06.746621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:06.749369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.750079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.751729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:06.752410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:06.771813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:06.779510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d1a2a9f-e7d6-4f52-b9df-4a6e2ef44a1c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1277 microversion: 2.1 time: 0.178420 Aug 03 04:32:06.788738 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 135/247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:06.798601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50b6b4c7-bed0-40f3-bd42-4da067b39331 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1639940357"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:06.802218 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:06.802218 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:06.830321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-50b6b4c7-bed0-40f3-bd42-4da067b39331 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid bc596a13-206a-437c-9c16-0eb7dd1fd708 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:06.862169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:DELETE=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:06.953605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50b6b4c7-bed0-40f3-bd42-4da067b39331 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.161596 Aug 03 04:32:06.965487 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 136/248] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:06.987419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-679355c8-5885-48ac-b42a-31f70bc8d903 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:06.990298 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:06.990298 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:06.992714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-679355c8-5885-48ac-b42a-31f70bc8d903 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '7362965c98e041f6b65657782294abbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98730053130a4fc985a5c89375c2da81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-679355c8-5885-48ac-b42a-31f70bc8d903 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Request method failure captured: Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2004:32:06 HTTP/1.1 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpDIetf7D9kpzGGri-2OjqoOxAtrqE2cMb1zzdWexSqlcniZ3sZIcItbQ1jrfKgyiKLrmFzMHj6JPxeVhvKZLz1rTBFXmHIvf2hQa8rNzvEcyIm8z6CKY8RTebL999KOzE_VLvy4SvT7xTMINdPiQqZe0gS4kzNXsc9lMSGghc_uJo Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 98730053130a4fc985a5c89375c2da81 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:07.005236 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/98730053130a4fc985a5c89375c2da81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/98730053130a4fc985a5c89375c2da81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_98730053130a4fc985a5c89375c2da81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/98730053130a4fc985a5c89375c2da81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 98730053130a4fc985a5c89375c2da81 Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 7362965c98e041f6b65657782294abbe Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project Aug 03 04:32:07.006449 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2022-08-03 04:32:06'} Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:07.007300 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 03 04:32:07.013616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:07.015432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-679355c8-5885-48ac-b42a-31f70bc8d903 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:07.015432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-679355c8-5885-48ac-b42a-31f70bc8d903 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028 tempest-InstanceUsageAuditLogNegativeTestJSON-961345028-project] 10.222.0.72 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03 04:32:06" status: 403 len: 128 microversion: 2.1 time: 0.044470 Aug 03 04:32:07.031900 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 137/249] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2004%3A32%3A06 => generated 128 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:07.053933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:07.062304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:07.107226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:07.109098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:07.112299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:07.118384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:07.190609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:07.630175 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0441a02f-452c-4c23-870e-2f6187426831 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.894729 Aug 03 04:32:07.630781 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 113/250] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:32:06 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8/os-interface => generated 285 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:07.635625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-643834b2-4bdf-467f-a718-878a47007e04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:07.639268 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:07.639268 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:07.659876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-643834b2-4bdf-467f-a718-878a47007e04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:07.660362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-643834b2-4bdf-467f-a718-878a47007e04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:07.760325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:07.772522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:07.779591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:07.781594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88875d59-cea4-4906-9c06-fd74aa838588 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.746095 Aug 03 04:32:07.782403 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 138/251] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:07 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:07.812609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:07.813531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:07.826706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:07.844647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:07.852575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:07.853030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:08.084405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-643834b2-4bdf-467f-a718-878a47007e04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.451282 Aug 03 04:32:08.084632 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 114/252] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:08.097099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41233009-41d8-4e28-a083-3b09143973ca tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:08.098831 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:08.098831 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:08.120731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41233009-41d8-4e28-a083-3b09143973ca tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.027940 Aug 03 04:32:08.123908 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 115/253] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:32:08 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:08.144313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29e0c3e8-95f8-4522-a5c7-fdb4d4393b57 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:08.148103 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:08.148103 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:08.163663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29e0c3e8-95f8-4522-a5c7-fdb4d4393b57 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:08.164376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29e0c3e8-95f8-4522-a5c7-fdb4d4393b57 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:08.402002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:08.412724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49ae03cc-8d63-4268-94f6-68d4d46f990c tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.605950 Aug 03 04:32:08.413880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 139/254] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:07 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:08.435420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1701094894", "imageRef": "75c6ea73-16e6-42fe-8cf3-ef65fc2e9654", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:08.496073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:08.514752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29e0c3e8-95f8-4522-a5c7-fdb4d4393b57 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.374455 Aug 03 04:32:08.515740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 116/255] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:08.526015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-293c20c1-1b48-4563-9ad5-487d182f9550 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:08.527078 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:08.527078 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:08.665516 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-293c20c1-1b48-4563-9ad5-487d182f9550 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.142867 Aug 03 04:32:08.673302 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 117/256] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:08.681056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e66e689-5f25-4008-8831-8e66ec685f43 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-483383842"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:08.690475 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:08.690475 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:08.693687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-8e66e689-5f25-4008-8831-8e66ec685f43 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid 44f9dc79-237f-46b0-925e-edee1e394db0 for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:08.825534 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e66e689-5f25-4008-8831-8e66ec685f43 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.150882 Aug 03 04:32:08.826831 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 118/257] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:08.839938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:08.840824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:08.855536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:08.856227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:08.861320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:08.861821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:08.887829 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] Request method failure captured: Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 143 Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpGZmZ_p-2y3iB4g6IX-Ari-RGGIBIukpL4_PKb-am4-ywU1IsBjd_rtDfc_U-C2s5Wqzkbk85U9X6uqEOE1KYBBgg_W7tbirBIGrgQpR9wTyrW0ofYRMEoAyLyRoAOcUEX_7BouKqNeAzOwdwzDzMzyzuSRwOeHBnk0_Y-J2l5RIY Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 68d4c99340634a0696968513c577c56a Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsV2NegativeTest-490898506 Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:08.892176 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/68d4c99340634a0696968513c577c56a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/68d4c99340634a0696968513c577c56a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_68d4c99340634a0696968513c577c56a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/68d4c99340634a0696968513c577c56a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsV2NegativeTest-490898506 Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 68d4c99340634a0696968513c577c56a Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-490898506 Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsV2NegativeTest-490898506-project Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ff56d0bb03154a55a60b2bf07aee56e3 Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsV2NegativeTest-490898506-project Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1701094894", "imageRef": "75c6ea73-16e6-42fe-8cf3-ef65fc2e9654", "flavorRef": "452"}} Aug 03 04:32:08.893612 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: exception: Flavor's memory is too small for requested image. Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1701094894', 'imageRef': '75c6ea73-16e6-42fe-8cf3-ef65fc2e9654', 'flavorRef': '452'}}} Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:08.894441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:08.895668 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:08.896890 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7191db30-bd5c-4de6-b23f-0d32dc5b83c6 tempest-FlavorsV2NegativeTest-490898506 tempest-FlavorsV2NegativeTest-490898506-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.478688 Aug 03 04:32:08.898225 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 140/258] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:08 2022] POST /compute/v2.1/servers => generated 93 bytes in 483 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:32:08.907723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16d66dc0-a681-4559-8081-5c9ef7bd7c04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:08.914475 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:08.914475 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:08.929283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16d66dc0-a681-4559-8081-5c9ef7bd7c04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:08.932384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16d66dc0-a681-4559-8081-5c9ef7bd7c04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:09.255352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:09.270562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:09.273389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:09.275409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1164bc9-d4cd-4ce4-9007-69630f1937af tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.447245 Aug 03 04:32:09.291871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 119/259] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:08 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:09.324996 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16d66dc0-a681-4559-8081-5c9ef7bd7c04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.425321 Aug 03 04:32:09.325681 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 141/260] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:08 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:09.338624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4aa1730-c81a-4840-81b1-e0ec8e4bdd91 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:09.345036 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:09.345036 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:09.364120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4aa1730-c81a-4840-81b1-e0ec8e4bdd91 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:09.369143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4aa1730-c81a-4840-81b1-e0ec8e4bdd91 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:09.436995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:09.437744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:09.447351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:09.448547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:09.449679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:09.450676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:09.655566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:09.674049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b51acf7-540c-4c3c-89db-1271239ff761 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.241291 Aug 03 04:32:09.677890 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 142/261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:09 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:09.786861 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4aa1730-c81a-4840-81b1-e0ec8e4bdd91 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.453254 Aug 03 04:32:09.789019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 120/262] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:09.805633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1431dc1-51ab-48cf-b1b4-b1d6eff79e52 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:09.811841 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:09.811841 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:09.864776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-57cb1116-e28d-422c-973d-fa9e90449c36 req-f99c3fdd-0ec1-4582-8190-86a7d4464ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d614b993-782e-4a9e-9bb7-bc012fe1ae31", "tag": "302a8799-b373-4f71-b5ca-fc71024695cb"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:09.879994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57cb1116-e28d-422c-973d-fa9e90449c36 req-f99c3fdd-0ec1-4582-8190-86a7d4464ff8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:09.880777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57cb1116-e28d-422c-973d-fa9e90449c36 req-f99c3fdd-0ec1-4582-8190-86a7d4464ff8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:09.894332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-57cb1116-e28d-422c-973d-fa9e90449c36 req-f99c3fdd-0ec1-4582-8190-86a7d4464ff8 service nova] Creating event network-changed:302a8799-b373-4f71-b5ca-fc71024695cb for instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 on n-h1-826756-5 Aug 03 04:32:09.900189 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-57cb1116-e28d-422c-973d-fa9e90449c36 req-f99c3fdd-0ec1-4582-8190-86a7d4464ff8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039689 Aug 03 04:32:09.901587 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 121/263] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:09.923325 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1431dc1-51ab-48cf-b1b4-b1d6eff79e52 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.127267 Aug 03 04:32:09.924798 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 143/264] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:09 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 04:32:09.943861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a01a65ad-782a-4d93-921c-750b81cf3834 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-775704448"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:09.948989 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:09.948989 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:09.952740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-a01a65ad-782a-4d93-921c-750b81cf3834 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid 75e3e5a8-e1cb-4800-a175-0baf015a2e42 for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:10.022260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2bdf18f8-c76f-4bb9-b573-20a2bf69af9f tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2132832486"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:10.025825 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.025825 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.030198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-2bdf18f8-c76f-4bb9-b573-20a2bf69af9f tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Generated uuid ebe56841-4128-4875-876d-57ba4717c148 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:10.060836 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a01a65ad-782a-4d93-921c-750b81cf3834 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.129760 Aug 03 04:32:10.061574 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 122/265] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:10.077309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0b5bd982-4258-4338-ac4d-3e659c016637 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.078072 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.078072 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:10.241968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2bdf18f8-c76f-4bb9-b573-20a2bf69af9f tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.226931 Aug 03 04:32:10.243311 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 144/266] 10.222.0.72 () {62 vars in 1205 bytes} [Wed Aug 3 04:32:10 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:32:10.255283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdfbdd55-b2ad-438d-8417-741b8f580a48 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1075880516"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:10.267336 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0b5bd982-4258-4338-ac4d-3e659c016637 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.189828 Aug 03 04:32:10.268066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 123/267] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 04:32:10.280001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2777678-ebad-4040-8355-68451c6dc393 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.281865 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.281865 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:10.292140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b2777678-ebad-4040-8355-68451c6dc393 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2777678-ebad-4040-8355-68451c6dc393 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Request method failure captured: Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foKgQ9XrdC3DhobZV3U-mnPPE_3FEISUiYj74a9FRzZp-RRm3Ki2n6W40uynZl6uhTdZ7MLRpq3UmetaJQUBd1C6jhMI6LZVxtDqbbwSa_I9oRt9KBLz9CWJcV3-xMTHWFD3o7k9wEaxXh9zgkX7az8e9BtF7FgugSjAb-bpYYrVjU Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:10.308127 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 3ee46c867db842adaa404b1bcc9edda2 Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: exception: Aggregate 5 could not be found. Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5'} Aug 03 04:32:10.310271 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.311135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 03 04:32:10.312522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.313666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2777678-ebad-4040-8355-68451c6dc393 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:10.313666 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2777678-ebad-4040-8355-68451c6dc393 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.037664 Aug 03 04:32:10.315096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 124/268] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:32:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:10.324512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.327731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:10.341517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:10.344393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:10.347263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:10.347912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:10.351903 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.351903 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.504931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdfbdd55-b2ad-438d-8417-741b8f580a48 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.253337 Aug 03 04:32:10.512001 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 145/269] 10.222.0.72 () {62 vars in 1210 bytes} [Wed Aug 3 04:32:10 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:10.517282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-caa034c2-8d6c-46d3-a3cd-dd75a32f6142 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.519458 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.519458 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.547427 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-caa034c2-8d6c-46d3-a3cd-dd75a32f6142 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-caa034c2-8d6c-46d3-a3cd-dd75a32f6142 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Request method failure captured: Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foKgQ9XrdC3DhobZV3U-mnPPE_3FEISUiYj74a9FRzZp-RRm3Ki2n6W40uynZl6uhTdZ7MLRpq3UmetaJQUBd1C6jhMI6LZVxtDqbbwSa_I9oRt9KBLz9CWJcV3-xMTHWFD3o7k9wEaxXh9zgkX7az8e9BtF7FgugSjAb-bpYYrVjU Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:10.553378 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 3ee46c867db842adaa404b1bcc9edda2 Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: exception: Aggregate 5 could not be found. Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '5'} Aug 03 04:32:10.554708 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:10.555414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:10.556663 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-caa034c2-8d6c-46d3-a3cd-dd75a32f6142 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-caa034c2-8d6c-46d3-a3cd-dd75a32f6142 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041813 Aug 03 04:32:10.558009 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 146/270] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:10.563427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-696fcecd-86fa-4075-8eb8-044952316015 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.564465 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.564465 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.576993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-696fcecd-86fa-4075-8eb8-044952316015 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.020019 Aug 03 04:32:10.578498 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 147/271] 10.222.0.72 () {60 vars in 1190 bytes} [Wed Aug 3 04:32:10 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:10.584537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c39a6c22-1ad9-4f24-aea3-555a5b3db651 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-958402250", "name": "tempest-test_aggregate-1744748019"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:10.588079 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.588079 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.589376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-c39a6c22-1ad9-4f24-aea3-555a5b3db651 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid bb0d99d5-c440-4915-94f3-d363fbacc4a3 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:10.711473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:10.714854 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c39a6c22-1ad9-4f24-aea3-555a5b3db651 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.135165 Aug 03 04:32:10.716874 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 148/272] 10.222.0.72 () {60 vars in 1165 bytes} [Wed Aug 3 04:32:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:10.722690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af1a679f-d1b2-441f-a5c5-a49484b9c440 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:10.724376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:10.725904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:10.726071 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:10.726071 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:10.727080 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4eaa03e2-6fa4-4da4-99d2-9289233adc06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.407791 Aug 03 04:32:10.740304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af1a679f-d1b2-441f-a5c5-a49484b9c440 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:10.740304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af1a679f-d1b2-441f-a5c5-a49484b9c440 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:10.749608 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 125/273] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:10 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:10.760526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:10.761413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:10.768261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:10.770431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:10.771542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:10.772138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.125227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af1a679f-d1b2-441f-a5c5-a49484b9c440 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.406651 Aug 03 04:32:11.127114 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 149/274] 10.222.0.72 () {62 vars in 1232 bytes} [Wed Aug 3 04:32:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:11.132723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22f8211d-b059-4741-a48e-018f15d94250 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:11.137127 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:11.137127 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:11.236969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:11.236969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e926819-41f6-4349-a444-cc46fa31e12d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.470368 Aug 03 04:32:11.236969 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 126/275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:10 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:11.241114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d44e5a28-d452-4bb4-b074-f68da3e85a53 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:11.244468 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:11.244468 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:11.291709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d44e5a28-d452-4bb4-b074-f68da3e85a53 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.293000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d44e5a28-d452-4bb4-b074-f68da3e85a53 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.392612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:11.419750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:11.484770 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22f8211d-b059-4741-a48e-018f15d94250 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.356127 Aug 03 04:32:11.488491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 150/276] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:11.491256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dcd462df-a960-408e-bfee-b1b1e5519e91 req-1e40596b-6f81-4c48-9027-69bebec49963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb574-1303-4419-8af0-786d2e30d27a", "name": "network-vif-plugged", "status": "completed", "tag": "fac16e13-d03b-4b3d-a9e5-086317c05d62"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:11.502142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcd462df-a960-408e-bfee-b1b1e5519e91 req-1e40596b-6f81-4c48-9027-69bebec49963 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.502589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcd462df-a960-408e-bfee-b1b1e5519e91 req-1e40596b-6f81-4c48-9027-69bebec49963 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.515009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dcd462df-a960-408e-bfee-b1b1e5519e91 req-1e40596b-6f81-4c48-9027-69bebec49963 service nova] Creating event network-vif-plugged:fac16e13-d03b-4b3d-a9e5-086317c05d62 for instance 146eb574-1303-4419-8af0-786d2e30d27a on n-h1-826756-5 Aug 03 04:32:11.520254 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dcd462df-a960-408e-bfee-b1b1e5519e91 req-1e40596b-6f81-4c48-9027-69bebec49963 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Aug 03 04:32:11.521258 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 151/277] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:11.526308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:11.526997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:11.534675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.535133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.535909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.536558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.822489 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d44e5a28-d452-4bb4-b074-f68da3e85a53 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.596745 Aug 03 04:32:11.832646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 127/278] 10.222.0.72 () {62 vars in 1232 bytes} [Wed Aug 3 04:32:11 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:11.834636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7999815-4927-4915-8146-599883c270cc tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:11.836679 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:11.836679 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:11.853161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d7999815-4927-4915-8146-599883c270cc tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7999815-4927-4915-8146-599883c270cc tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Request method failure captured: Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foKgQ9XrdC3DhobZV3U-mnPPE_3FEISUiYj74a9FRzZp-RRm3Ki2n6W40uynZl6uhTdZ7MLRpq3UmetaJQUBd1C6jhMI6LZVxtDqbbwSa_I9oRt9KBLz9CWJcV3-xMTHWFD3o7k9wEaxXh9zgkX7az8e9BtF7FgugSjAb-bpYYrVjU Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:11.854790 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 3ee46c867db842adaa404b1bcc9edda2 Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: exception: Aggregate 7 could not be found. Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '7'} Aug 03 04:32:11.856167 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:11.857880 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 03 04:32:11.859248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:11.860255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7999815-4927-4915-8146-599883c270cc tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:11.860255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7999815-4927-4915-8146-599883c270cc tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.032182 Aug 03 04:32:11.868474 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 128/279] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:32:11 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:11.869358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:11.874676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:11.878561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:11.896571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.898519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:11.902160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:11.902628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:12.117694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:12.151295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8398eab8-9f5a-454e-aff1-bae5ac6565b0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 200 len: 1586 microversion: 2.1 time: 0.628768 Aug 03 04:32:12.170579 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 152/280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:11 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 1586 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:12.180681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ff701e3-3ba1-4eb2-aaa8-7c5440fa2a71 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.181883 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.181883 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:12.283004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ff701e3-3ba1-4eb2-aaa8-7c5440fa2a71 tempest-AggregatesAdminTestV241-475295217 tempest-AggregatesAdminTestV241-475295217-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.109813 Aug 03 04:32:12.283829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 153/281] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:12.297524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91df1df7-21ef-452a-a75e-26d21148d649 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.298919 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.298919 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:12.307303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:12.321446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:12.322117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-91df1df7-21ef-452a-a75e-26d21148d649 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 03 04:32:12.324152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:12.326223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16806e49-f84e-4262-8c07-71dc926602b7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.456427 Aug 03 04:32:12.327463 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 129/282] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:11 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91df1df7-21ef-452a-a75e-26d21148d649 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Request method failure captured: Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foKgQ9XrdC3DhobZV3U-mnPPE_3FEISUiYj74a9FRzZp-RRm3Ki2n6W40uynZl6uhTdZ7MLRpq3UmetaJQUBd1C6jhMI6LZVxtDqbbwSa_I9oRt9KBLz9CWJcV3-xMTHWFD3o7k9wEaxXh9zgkX7az8e9BtF7FgugSjAb-bpYYrVjU Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:12.327877 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a2a70cfe519344a4a8c9ad7dd4b33a1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a2a70cfe519344a4a8c9ad7dd4b33a1a Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1999780649 Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 3ee46c867db842adaa404b1bcc9edda2 Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminTestJSON-1999780649-project-admin Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: exception: Aggregate 7 could not be found. Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '7'} Aug 03 04:32:12.329291 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:12.330144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:12.331501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91df1df7-21ef-452a-a75e-26d21148d649 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91df1df7-21ef-452a-a75e-26d21148d649 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.048992 Aug 03 04:32:12.341730 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 154/283] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:12.348656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.352924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-49bdebd1-6e0f-4d43-a7cf-55e6ff00fcca req-15bb5033-a2e1-4b16-8e0a-8e9e248f583e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e21669-2e7e-486a-a0cc-366c34a986b8", "tag": "5153e1fe-1415-4303-9583-ebfa21f93a5c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:12.353771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:12.367116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:12.369531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:12.369531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:12.369531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:12.380252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-49bdebd1-6e0f-4d43-a7cf-55e6ff00fcca req-15bb5033-a2e1-4b16-8e0a-8e9e248f583e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:12.382210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-49bdebd1-6e0f-4d43-a7cf-55e6ff00fcca req-15bb5033-a2e1-4b16-8e0a-8e9e248f583e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:12.408865 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-49bdebd1-6e0f-4d43-a7cf-55e6ff00fcca req-15bb5033-a2e1-4b16-8e0a-8e9e248f583e service nova] Creating event network-changed:5153e1fe-1415-4303-9583-ebfa21f93a5c for instance d1e21669-2e7e-486a-a0cc-366c34a986b8 on n-h2-826756-5 Aug 03 04:32:12.426168 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-49bdebd1-6e0f-4d43-a7cf-55e6ff00fcca req-15bb5033-a2e1-4b16-8e0a-8e9e248f583e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095613 Aug 03 04:32:12.446281 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 130/284] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:12.454871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd8465c1-2bff-4a10-b361-43b806d2687b tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1531796630"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:12.459140 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.459140 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:12.460459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-dd8465c1-2bff-4a10-b361-43b806d2687b tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid a97caeb7-00e2-462f-8fb2-63081084e4de for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:12.588622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd8465c1-2bff-4a10-b361-43b806d2687b tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.140651 Aug 03 04:32:12.593149 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 131/285] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:12.608657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-303e5917-aacf-450c-8531-14936b48ad04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.615294 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.615294 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:12.636654 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-303e5917-aacf-450c-8531-14936b48ad04 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.035558 Aug 03 04:32:12.637921 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 132/286] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:32:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:12.649727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81bd8d2e-1c11-4381-8356-a19c3c9d6031 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:12.660153 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.660153 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:12.818480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:12.829327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7ec9898-0090-4a6b-a217-f6f1e85b8308 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.486659 Aug 03 04:32:12.830253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 155/287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:12 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:12.850324 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81bd8d2e-1c11-4381-8356-a19c3c9d6031 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.204387 Aug 03 04:32:12.851217 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 133/288] 10.222.0.72 () {60 vars in 1191 bytes} [Wed Aug 3 04:32:12 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:12.869681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a168bfc7-213b-41e6-afa7-1e76481c47e8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.870458 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.870458 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:12.914701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a168bfc7-213b-41e6-afa7-1e76481c47e8 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.049455 Aug 03 04:32:12.924525 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 156/289] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:32:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:12.926672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bedf92db-2bfa-4996-b399-d70d1e21751b tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:12.929646 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:12.929646 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:13.121569 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bedf92db-2bfa-4996-b399-d70d1e21751b tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.198251 Aug 03 04:32:13.134601 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 134/290] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:12 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 04:32:13.138879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d434b574-9f2d-492c-8700-379aa33eb793 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2115110264", "availability_zone": "tempest-test_az-1441906008"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:13.142339 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:13.142339 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:13.143410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-d434b574-9f2d-492c-8700-379aa33eb793 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid 73e84a76-e69b-4421-8040-943dcf8e8b1d for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:13.287907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d434b574-9f2d-492c-8700-379aa33eb793 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.157805 Aug 03 04:32:13.289208 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 157/291] 10.222.0.72 () {60 vars in 1165 bytes} [Wed Aug 3 04:32:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:13.302391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ef691ca-cc1e-4cc3-98eb-723bc2bd27ea tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2115110264_new", "availability_zone": "tempest-test_az-1441906008_new"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:13.351678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:13.352328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:13.365886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:13.366345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:13.367147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:13.367595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:13.645118 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:13.645118 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:13.819435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:13.828229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ef691ca-cc1e-4cc3-98eb-723bc2bd27ea tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:13.828229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ef691ca-cc1e-4cc3-98eb-723bc2bd27ea tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.025359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ef691ca-cc1e-4cc3-98eb-723bc2bd27ea tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.727196 Aug 03 04:32:14.030479 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 135/292] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:32:13 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:14.036722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.040359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:14.066829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.068138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.068987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.069446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.127797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:14.139635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:14.143851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:14.148070 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21f74202-8fa5-4d7b-b28f-f66e92663a22 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1361 microversion: 2.25 time: 0.800607 Aug 03 04:32:14.158002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 158/293] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:13 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1361 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:14.171407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffb24e78-3b54-4b4b-bdec-59d51a14cba7 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.174169 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:14.174169 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:14.206100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffb24e78-3b54-4b4b-bdec-59d51a14cba7 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.045983 Aug 03 04:32:14.211668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 159/294] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:32:14 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:14.225370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72e93898-47a1-4a23-8201-302ed07414e7 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.226340 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:14.226340 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:14.336885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72e93898-47a1-4a23-8201-302ed07414e7 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.118265 Aug 03 04:32:14.337690 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 160/295] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:14 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 04:32:14.349073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-199a1962-dc40-402a-a706-27eaa78458c9 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1992287865"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:14.357556 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:14.357556 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:14.360631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-199a1962-dc40-402a-a706-27eaa78458c9 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Generated uuid d735bbbd-a700-4b15-8501-5ccc88fa57fe for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:14.369742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:14.491912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-199a1962-dc40-402a-a706-27eaa78458c9 tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.147774 Aug 03 04:32:14.493660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 161/296] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:14.506864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-087c7757-e035-4501-842e-a00dd960c77c tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.510000 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:14.510000 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:14.541102 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-087c7757-e035-4501-842e-a00dd960c77c tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.029899 Aug 03 04:32:14.541102 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 162/297] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:32:14 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:14.549470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f15929c-02ca-4a3d-8235-997c2b41336a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.562379 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:14.562379 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:14.712169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f15929c-02ca-4a3d-8235-997c2b41336a tempest-AggregatesAdminTestJSON-1999780649 tempest-AggregatesAdminTestJSON-1999780649-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.165987 Aug 03 04:32:14.713152 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 163/298] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:14 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:14.722258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.722773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:14.724566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:14.738265 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56c9a6db-63f3-4701-b31b-2b6318956cef tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.707911 Aug 03 04:32:14.738474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.738751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.739556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.740000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.740565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 136/299] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:14 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:14.814482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] HTTP exception thrown: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Request method failure captured: Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd HTTP/1.1 Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foHLrVY_eoYTS34gUNYa63FszkKZw51mf8WN_VhY_Vxub5lI9lGqoByUYkBv_TNisu5Tz7TH8H5xNCd1wS3Ne7WzbjU7zkd0uYLFJeruWt47S0gK8C5BWWPLgSTESxElXKWSC7lJ1wRvYmRp8vE_GcKdFulCqGsDQn4b3BkuoeDI1g Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:14.849541 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 247703c83c7d40cda8db648050e7a79e Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.850995 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd'} Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:14.851667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.853219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.854506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Returning 404 to user: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:14.854506 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d059cdd-1c0f-4663-9bff-09490c796c37 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 404 len: 111 microversion: 2.1 time: 0.136477 Aug 03 04:32:14.857857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 164/300] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:32:14 2022] DELETE /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:32:14.864803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:14.865801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] [instance: 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:14.883388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.884842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.888591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:14.890949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:14.939921 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] HTTP exception thrown: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Request method failure captured: Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd HTTP/1.1 Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foHLrVY_eoYTS34gUNYa63FszkKZw51mf8WN_VhY_Vxub5lI9lGqoByUYkBv_TNisu5Tz7TH8H5xNCd1wS3Ne7WzbjU7zkd0uYLFJeruWt47S0gK8C5BWWPLgSTESxElXKWSC7lJ1wRvYmRp8vE_GcKdFulCqGsDQn4b3BkuoeDI1g Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:14.955078 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ffa550409ef640b8a9fbb717c6659f3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ffa550409ef640b8a9fbb717c6659f3a Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-203330210 Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 247703c83c7d40cda8db648050e7a79e Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminTestJSON-203330210-project Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.956338 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd'} Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:14.956977 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. Aug 03 04:32:14.958014 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:14.960421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] Returning 404 to user: Instance 0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:14.963837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63e8257b-d678-4065-8540-a03d3d8bdba5 tempest-AggregatesAdminTestJSON-203330210 tempest-AggregatesAdminTestJSON-203330210-project] 10.222.0.72 "GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd" status: 404 len: 111 microversion: 2.1 time: 0.104849 Aug 03 04:32:14.967158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 137/301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:14 2022] GET /compute/v2.1/servers/0b053d33-e4ac-4a7b-ab2e-9d8e15ab12fd => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:15.185016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:15.188626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:15.193129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:15.193588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:15.194500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:15.194947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:15.380993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:15.391636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:15.393187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:15.394374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9c88ea5-c8e5-47d1-9c64-a3d1f7da76aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1557 microversion: 2.25 time: 0.215564 Aug 03 04:32:15.394957 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 165/302] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:15 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1557 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:15.761931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:15.769657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:15.784968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:15.795583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:15.799748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:15.800428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.025710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:16.052772 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cae125c8-b8af-4ffd-a7ac-1008c56d6e98 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.283275 Aug 03 04:32:16.052772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 166/303] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:15 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:16.069734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:16.071608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:16.078825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.088813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.088813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.088813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.270464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 146eb574-1303-4419-8af0-786d2e30d27a {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:16.326315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-591cdcbb-96ae-47e2-b7e4-dccd5f986110 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 2049 microversion: 2.25 time: 0.909843 Aug 03 04:32:16.326944 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 138/304] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:15 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 2049 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:32:16.349516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:16.350371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:16.358383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.359049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.359998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.360750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.823376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 146eb574-1303-4419-8af0-786d2e30d27a {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:16.917305 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f92fb524-a0eb-45c6-add1-8597505fa407 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 2049 microversion: 2.25 time: 0.571539 Aug 03 04:32:16.918764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 167/305] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:16 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 2049 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:16.942088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:16.945236 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:16.945236 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:16.948665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.949327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:16.950424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:16.953562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.005982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e0a041d-2206-49e0-83d2-1bc75ad7db6d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.068614 Aug 03 04:32:17.006999 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 139/306] 10.222.0.72 () {60 vars in 1217 bytes} [Wed Aug 3 04:32:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:17.020184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": "auto"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:17.031520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:17.031520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:17.031520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.031520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:17.032251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.081035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:17.081699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:17.099923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:17.104349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.106662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:17.107678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.134810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'flavor' on Instance uuid 146eb574-1303-4419-8af0-786d2e30d27a {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:17.254352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120832) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:32:17.665832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:17.676259 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43fb5308-b5f5-4501-b598-82659547b020 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1319 microversion: 2.1 time: 0.614041 Aug 03 04:32:17.677429 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 140/307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:17 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:17.689749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6a83d60f-963e-41d3-bca4-296ad692346d req-9d36e358-6dc5-41fc-a76f-1d37ee72f97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d614b993-782e-4a9e-9bb7-bc012fe1ae31", "name": "network-vif-plugged", "status": "completed", "tag": "302a8799-b373-4f71-b5ca-fc71024695cb"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:17.712409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6a83d60f-963e-41d3-bca4-296ad692346d req-9d36e358-6dc5-41fc-a76f-1d37ee72f97c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:17.712865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6a83d60f-963e-41d3-bca4-296ad692346d req-9d36e358-6dc5-41fc-a76f-1d37ee72f97c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:17.735922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6a83d60f-963e-41d3-bca4-296ad692346d req-9d36e358-6dc5-41fc-a76f-1d37ee72f97c service nova] Creating event network-vif-plugged:302a8799-b373-4f71-b5ca-fc71024695cb for instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 on n-h1-826756-5 Aug 03 04:32:17.741138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6a83d60f-963e-41d3-bca4-296ad692346d req-9d36e358-6dc5-41fc-a76f-1d37ee72f97c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061209 Aug 03 04:32:17.742507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 141/308] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:18.129709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48701c97-58f8-4e34-93c5-a0d675a27225 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] Calling method '.version_select at 0x7fdd5548a550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:18.132304 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:18.132304 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:18.145926 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-48701c97-58f8-4e34-93c5-a0d675a27225 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.402030 Aug 03 04:32:18.146590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 142/309] 10.222.0.72 () {60 vars in 1226 bytes} [Wed Aug 3 04:32:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:18.157290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8207200-598f-47aa-bdaf-6e64876ce896 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] Action: 'update', calling method: .version_select at 0x7fdd55302790>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:18.163717 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:18.163717 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:19.159592 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8207200-598f-47aa-bdaf-6e64876ce896 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.005985 Aug 03 04:32:19.171615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 143/310] 10.222.0.72 () {62 vars in 1247 bytes} [Wed Aug 3 04:32:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:19.183694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:19.186922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:19.201741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:19.202166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:19.203163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:19.205540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:19.443520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:19.467727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-240b9576-c20d-4a6d-89eb-0956a748801f tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1468 microversion: 2.1 time: 0.290257 Aug 03 04:32:19.468848 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 144/311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:19 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1468 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:19.491028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4c659c3-be26-4a0c-b6b8-6b598d2a2d98 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] Calling method '.version_select at 0x7fdd5527e940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:19.493667 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:19.493667 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:19.534340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4c659c3-be26-4a0c-b6b8-6b598d2a2d98 tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.054719 Aug 03 04:32:19.535030 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 145/312] 10.222.0.72 () {60 vars in 1226 bytes} [Wed Aug 3 04:32:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:19.548855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:19.549811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:19.573850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:19.577395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:19.578631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:19.580228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:19.760633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lazy-loading 'flavor' on Instance uuid d614b993-782e-4a9e-9bb7-bc012fe1ae31 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:20.205319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15a0244a-deb8-490d-9c64-8097fde61218 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31/action" status: 202 len: 0 microversion: 2.1 time: 0.666880 Aug 03 04:32:20.206790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 146/313] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:32:19 2022] POST /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:20.211703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d5a40319-1e7e-434a-942d-07a7334b15ee tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] Action: 'update', calling method: .version_select at 0x7fdd553b03a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:20.228061 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:20.228061 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:21.127307 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d5a40319-1e7e-434a-942d-07a7334b15ee tempest-QuotaClassesAdmin257Test-1552561612 tempest-QuotaClassesAdmin257Test-1552561612-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.914536 Aug 03 04:32:21.128445 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 147/314] 10.222.0.72 () {62 vars in 1247 bytes} [Wed Aug 3 04:32:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:21.142132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:21.148894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:21.155880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:21.157412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:21.159362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:21.160042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:21.165060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:21.363236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:21.372576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52c9d96e-2475-4803-ad71-594927e04212 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1459 microversion: 2.1 time: 0.239282 Aug 03 04:32:21.373691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 148/315] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:21 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1459 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:21.393547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:21.394481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:21.402500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:21.403914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:21.405298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:21.406700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.614585 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bbe278a-0e18-437f-b67c-1693c1f986d7 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1610 microversion: 2.1 time: 1.224604 Aug 03 04:32:22.621959 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 149/316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:21 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1610 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:22.646361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:22.653463 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:22.653463 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:22.660237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.668002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.671653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.673760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.731796 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ba002a0-4d9c-4e94-b37a-1d42d94a2c1a tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092743 Aug 03 04:32:22.732634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 150/317] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:32:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:22.747406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:22.751150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:22.760515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:22.765479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.767755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.769086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.769688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.806856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Lazy-loading 'flavor' on Instance uuid d614b993-782e-4a9e-9bb7-bc012fe1ae31 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:22.822352 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 while it is in vm_state suspended Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Request method failure captured: Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31/action HTTP/1.1 Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 97 Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foYLb0OYRO5vn3DZucQuN4vphMpCAWpg4OuibdFpdtNq5Yfvr-9a6fqXwhLc_VQ0wY82QhN0yaoNPRITRWh4_NnlIyK3OX-FYQ7VaDcAmm1qpJIob5mZdcXO9_b0om06vkkwlnQxZR1mLztLDy5LF-WbroqA2unZn7wkarWs9oPi5o Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8b35ddc6bb894fe7bebf660d27c9b60a Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:22.825580 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8b35ddc6bb894fe7bebf660d27c9b60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8b35ddc6bb894fe7bebf660d27c9b60a Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-690633689 Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-LiveMigrationNegativeTest-690633689-project-admin Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 52c027170a2d4972b21ef77ffdfb54bf Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-LiveMigrationNegativeTest-690633689-project-admin Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": true, "disk_over_commit": false}} Aug 03 04:32:22.827002 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'os-migrateLive' instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 while it is in vm_state suspended Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd614b993-782e-4a9e-9bb7-bc012fe1ae31', 'body': {'os-migrateLive': {'host': 'n-h2-826756-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 04:32:22.827818 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:22.828942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 while it is in vm_state suspended Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 while it is in vm_state suspended Aug 03 04:32:22.830300 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:22.833090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 while it is in vm_state suspended {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:22.834303 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edafc3b5-4846-410a-b1b2-0846a838e5f8 tempest-LiveMigrationNegativeTest-690633689 tempest-LiveMigrationNegativeTest-690633689-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31/action" status: 409 len: 155 microversion: 2.1 time: 0.093714 Aug 03 04:32:22.835659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 151/318] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:32:22 2022] POST /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31/action => generated 155 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:22.851606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:22.852339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:22.869258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.870054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.871023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:22.872990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:22.927183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:32:23.346560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80a43adf-0115-44e3-a229-a2c2aeb52bfa tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 204 len: 0 microversion: 2.1 time: 0.504526 Aug 03 04:32:23.356425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 152/319] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:32:22 2022] DELETE /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:32:23.487035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f9e56c4-cfc1-4a68-a0ab-3215988d4e67 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a/action" status: 202 len: 0 microversion: 2.25 time: 6.471663 Aug 03 04:32:23.487745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 168/320] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:32:17 2022] POST /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a/action => generated 0 bytes in 6473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:32:23.495792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:23.497059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:23.504442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:23.504897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:23.505671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:23.506341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:23.795100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:23.798231 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:23.798231 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:23.799504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:23.799969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:23.801589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:23.805454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:23.852801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74c015c2-ea68-4125-9865-9c6c3770ebea tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.497643 Aug 03 04:32:23.862423 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 153/321] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:32:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:24.036379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:24.048135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3dcd2c6-4d5b-4a02-a63a-87d83256c148 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1465 microversion: 2.1 time: 0.557164 Aug 03 04:32:24.048769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 169/322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:23 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1465 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:24.070045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:24.070672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:24.098578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:24.099036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:24.099838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:24.100303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:24.310720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f3a7e73d-6537-4a33-b32a-08b5e00e6798 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-675913757", "id": 942836567, "os-flavor-access:is_public": "False"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:24.313930 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:24.313930 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:24.439783 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f3a7e73d-6537-4a33-b32a-08b5e00e6798 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.567198 Aug 03 04:32:24.439783 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 154/323] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:23 2022] POST /compute/v2.1/flavors => generated 435 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:24.451916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e0254b5-0e1a-4f53-a27e-b950af814438 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1817739653"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:24.455109 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:24.455109 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:24.459949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-5e0254b5-0e1a-4f53-a27e-b950af814438 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid b375fdef-4511-436e-bf08-20e50e84b5fd for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:24.594053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:24.596508 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e0254b5-0e1a-4f53-a27e-b950af814438 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.161044 Aug 03 04:32:24.602983 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 155/324] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:24.608312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-38c26da3-281e-43ea-8a3d-d19085a6b506 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:24.610932 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:24.610932 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:24.612179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:24.614367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:24.616017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ddc5491-5eb0-436c-971b-375f0bbc94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.563483 Aug 03 04:32:24.617532 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 170/325] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:24 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:24.634827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbfd8e9d-a28f-40d2-9912-667ec848a7af tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:24.639987 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:24.639987 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:24.668839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbfd8e9d-a28f-40d2-9912-667ec848a7af tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:24.681388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbfd8e9d-a28f-40d2-9912-667ec848a7af tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:24.796246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:24.963315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-38c26da3-281e-43ea-8a3d-d19085a6b506 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/942836567/action" status: 200 len: 96 microversion: 2.1 time: 0.364881 Aug 03 04:32:24.963921 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 156/326] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:24 2022] POST /compute/v2.1/flavors/942836567/action => generated 96 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:32:24.982730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-765e6066-6888-448c-a99c-d84562b4c83e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:24.995773 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbfd8e9d-a28f-40d2-9912-667ec848a7af tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.372286 Aug 03 04:32:24.995773 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 171/327] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:25.020046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:25.026966 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:25.026966 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:25.073678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.075582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.189057 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-826756-5. Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 39 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:25.214758 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: {"add_host": {"host": "n-h1-826756-5"}} Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:25.216671 n-d-826756-5 devstack@n-api.service[120832]: exception: Aggregate 11 already has host n-h1-826756-5. Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-826756-5'}}} Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:32:25.218427 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-826756-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 04:32:25.219639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 04:32:25.221387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:32:25.222674 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-826756-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 4, 32, 25, 139901), 'updated_at': None, 'host': 'n-h1-826756-5', 'aggregate_id': 11}] Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.224078 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6594, in add_host_to_aggregate Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-826756-5. Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.229384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-826756-5. Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:25.232379 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:25.234969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-826756-5. Aug 03 04:32:25.234969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.234969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-826756-5. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:25.234969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ebd16bf5-116d-44bb-ba19-e54eb601c2d0 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.228405 Aug 03 04:32:25.235695 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 172/328] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 234 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Aug 03 04:32:25.248168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:25.248168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:25.272000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.276170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.277098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.278678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.310934 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-765e6066-6888-448c-a99c-d84562b4c83e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-765e6066-6888-448c-a99c-d84562b4c83e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Request method failure captured: Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/flavors/942836567/action HTTP/1.1 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 67 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpV7yDhPIrAipYKVaUXURv7Uscpvm_Yw1h43WpB1NIFy20XgQn72ByEAJVtNSIOWryBbcaIr42Zw6P4f2djIB0dKBNSzlkQBUho-CifqJOcSjkObvckjcTbZ-5l6bVmRVUHyeaHDR50N8_f9tUQ5f2SFDcSDuryU0Y6bJvu2qzQNhY Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:25.338209 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: dbc9f7029a444cbfa6c112ee31cbb42f Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} Aug 03 04:32:25.339720 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '942836567', 'body': {'addTenantAccess': {'tenant': '8e5b4616a6a54331a88e90a714abd603'}}} Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:32:25.341510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '33-8e5b4616a6a54331a88e90a714abd603' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 04:32:25.343882 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 04:32:25.346115 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:32:25.348116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '33-8e5b4616a6a54331a88e90a714abd603' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 4, 32, 25, 261925), 'updated_at': None, 'flavor_id': 33, 'project_id': '8e5b4616a6a54331a88e90a714abd603'}] Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.352116 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.353086 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:25.354119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:25.355504 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. Aug 03 04:32:25.355504 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:25.355504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-765e6066-6888-448c-a99c-d84562b4c83e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 8e5b4616a6a54331a88e90a714abd603 combination. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:25.357751 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-765e6066-6888-448c-a99c-d84562b4c83e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/942836567/action" status: 409 len: 152 microversion: 2.1 time: 0.379704 Aug 03 04:32:25.364173 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 157/329] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:24 2022] POST /compute/v2.1/flavors/942836567/action => generated 152 bytes in 392 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:25.373403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-238ba80e-c067-431a-bf77-7cfb88b70309 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:25.377075 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:25.377075 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:25.392641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238ba80e-c067-431a-bf77-7cfb88b70309 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.393101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238ba80e-c067-431a-bf77-7cfb88b70309 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.553447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:25.562552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-400e327b-1cac-43f9-a5b5-fb32e71cc577 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1465 microversion: 2.1 time: 0.326139 Aug 03 04:32:25.563331 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 173/330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:25 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1465 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:25.569097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e1182d1-5c63-4330-87f1-fa0b1abbb69e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:25.573323 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:25.573323 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:25.732777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-238ba80e-c067-431a-bf77-7cfb88b70309 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.366236 Aug 03 04:32:25.733995 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 158/331] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:25.744236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:25.747850 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e1182d1-5c63-4330-87f1-fa0b1abbb69e tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/942836567/action" status: 200 len: 21 microversion: 2.1 time: 0.183431 Aug 03 04:32:25.753382 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 174/332] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:25 2022] POST /compute/v2.1/flavors/942836567/action => generated 21 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:32:25.753533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:25.757059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5f8d19c-bbd6-4d33-89c3-24637737b8ff tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:25.757816 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:25.757816 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:25.774151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.775953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.778175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:25.781228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:25.923389 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5f8d19c-bbd6-4d33-89c3-24637737b8ff tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.173014 Aug 03 04:32:25.923967 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 175/333] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:25 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:25.928913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f4d2d82-2baf-4f6c-964c-1475799fe4c0 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:25.929674 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:25.929674 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:26.025564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:26.036252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:26.038759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:26.040429 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-238c6646-9de7-4f89-8b41-1c582293ddd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.305182 Aug 03 04:32:26.041573 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 159/334] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:25 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:26.056832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eaa1d0ad-da9c-4c9b-869b-111cc25812c2 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1855279837"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:26.062728 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.062728 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:26.073047 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f4d2d82-2baf-4f6c-964c-1475799fe4c0 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/942836567" status: 202 len: 0 microversion: 2.1 time: 0.147687 Aug 03 04:32:26.079352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 176/335] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:32:25 2022] DELETE /compute/v2.1/flavors/942836567 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:26.079527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-eaa1d0ad-da9c-4c9b-869b-111cc25812c2 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid c99c78e1-72cf-4fa4-9f33-7daf4765fb72 for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:26.085421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae4f3be2-5fe4-4d3b-85d7-ad6c2a686ab6 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.115309 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae4f3be2-5fe4-4d3b-85d7-ad6c2a686ab6 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.034430 Aug 03 04:32:26.116469 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 177/336] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:26 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:26.148991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98a2eb9c-0aad-4f7c-ba47-23946658ad9f tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-880901748", "id": 345917160, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:26.152178 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.152178 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:26.249195 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eaa1d0ad-da9c-4c9b-869b-111cc25812c2 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.206237 Aug 03 04:32:26.250075 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 160/337] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:26.286634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98a2eb9c-0aad-4f7c-ba47-23946658ad9f tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.147702 Aug 03 04:32:26.287242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 178/338] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/flavors => generated 434 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:26.300252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7cfa2fd4-31ff-4da7-affb-a001faa779cf tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.301224 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.301224 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7cfa2fd4-31ff-4da7-affb-a001faa779cf tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7cfa2fd4-31ff-4da7-affb-a001faa779cf tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Request method failure captured: Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/flavors/345917160/os-flavor-access HTTP/1.1 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpV7yDhPIrAipYKVaUXURv7Uscpvm_Yw1h43WpB1NIFy20XgQn72ByEAJVtNSIOWryBbcaIr42Zw6P4f2djIB0dKBNSzlkQBUho-CifqJOcSjkObvckjcTbZ-5l6bVmRVUHyeaHDR50N8_f9tUQ5f2SFDcSDuryU0Y6bJvu2qzQNhY Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:26.324588 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: dbc9f7029a444cbfa6c112ee31cbb42f Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: exception: Access list not available for public flavors. Aug 03 04:32:26.326603 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'flavor_id': '345917160'} Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 03 04:32:26.327289 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.328426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7cfa2fd4-31ff-4da7-affb-a001faa779cf tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:26.328426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7cfa2fd4-31ff-4da7-affb-a001faa779cf tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/345917160/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027538 Aug 03 04:32:26.328426 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 179/339] 10.222.0.72 () {58 vars in 1206 bytes} [Wed Aug 3 04:32:26 2022] GET /compute/v2.1/flavors/345917160/os-flavor-access => generated 91 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:32:26.338088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49cb6b9d-4025-456f-a3cf-127a9a745cf8 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.426885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49cb6b9d-4025-456f-a3cf-127a9a745cf8 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/345917160" status: 202 len: 0 microversion: 2.1 time: 0.096557 Aug 03 04:32:26.427149 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 180/340] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:32:26 2022] DELETE /compute/v2.1/flavors/345917160 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:26.436427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cd5e913-0fec-4cf4-ba3a-937996de1d68 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.481724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cd5e913-0fec-4cf4-ba3a-937996de1d68 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.049917 Aug 03 04:32:26.493104 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 181/341] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:26 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:26.509791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99562bea-5ae6-42b3-a0aa-fe413f0328ff tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-576648897", "id": 1034735733, "os-flavor-access:is_public": "False"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:26.565586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f470cb1-d1f8-4058-a722-ee921b796e62 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:26.568472 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.568472 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:26.569364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8f470cb1-d1f8-4058-a722-ee921b796e62 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f470cb1-d1f8-4058-a722-ee921b796e62 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 39 Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:26.570956 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: {"add_host": {"host": "n-h1-826756-5"}} Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:26.572222 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-826756-5'}}} Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:26.572993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 03 04:32:26.574194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:26.576202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f470cb1-d1f8-4058-a722-ee921b796e62 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:26.576202 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f470cb1-d1f8-4058-a722-ee921b796e62 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.315130 Aug 03 04:32:26.576202 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 161/342] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 316 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:32:26.586454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61fbf91f-043b-49b9-989d-dbe641a27854 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.587208 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.587208 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:26.620642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99562bea-5ae6-42b3-a0aa-fe413f0328ff tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.116562 Aug 03 04:32:26.621452 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 182/343] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/flavors => generated 438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:26.626790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:26.627495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:26.633996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:26.634459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:26.635237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:26.635679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:26.714141 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61fbf91f-043b-49b9-989d-dbe641a27854 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.132006 Aug 03 04:32:26.715898 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 162/344] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:26 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:26.861902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:26.870749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8aec0e50-9e0a-409f-bdcc-343df2911237 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1465 microversion: 2.1 time: 0.247962 Aug 03 04:32:26.871920 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 183/345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:26 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1465 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:26.877182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9d0740e-41fd-4463-90f3-ba03bbcff78c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-356264811"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:26.880035 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:26.880035 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:26.881208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-b9d0740e-41fd-4463-90f3-ba03bbcff78c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid 2db64bd5-2a5d-4200-8b89-4a779b6b823b for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:26.901572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=83,nova_api:DELETE=11 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:26.996033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9d0740e-41fd-4463-90f3-ba03bbcff78c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.121955 Aug 03 04:32:26.997351 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 184/346] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:27.009667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-737443997"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.014388 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.014388 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:27.026300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:27.027622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:27.037235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:27.037921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:27.047665 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-737443997 could not be found. Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 57 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:27.050372 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: {"add_host": {"host": "tempest-nonexist_host-737443997"}} Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:27.051566 n-d-826756-5 devstack@n-api.service[120832]: exception: Compute host tempest-nonexist_host-737443997 could not be found. Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-737443997'}}} Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-737443997' is not mapped to any cell Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.053414 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6574, in add_host_to_aggregate Aug 03 04:32:27.054910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-737443997 could not be found. Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-737443997 could not be found. Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.062569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-737443997 could not be found. Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-737443997 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9c96c5e-0b62-4f62-8472-6d60ebab6e92 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.046387 Aug 03 04:32:27.064360 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 185/347] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:27.064928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da848dd8-dad8-48b7-b786-4d0dcb6f2f51 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:27.065802 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.065802 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:27.073825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc4b32eb-30ef-4a15-ac7f-3f11e52ceef1 tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.078129 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.078129 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:27.079446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc4b32eb-30ef-4a15-ac7f-3f11e52ceef1 tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd02753c0aa8644a29ff2fc5104e4b279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5b4616a6a54331a88e90a714abd603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc4b32eb-30ef-4a15-ac7f-3f11e52ceef1 tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Request method failure captured: Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/flavors/1034735733/action HTTP/1.1 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 67 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpTiXA_H3vM5DWrtbIp-5hUrvPEXCQyByoneiM36eOijXKm5s9q0sHDtnVhcnx-zpX75z_48CK6uKtzJvz9QeJ5orb57krpq0hW-MrGYnXW5dxSjSxGmMmPrGSnabRiEIu4LmO00ZVTauMaVw468lcsuhFcug9QZi-PCD9VB98SJt4 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8e5b4616a6a54331a88e90a714abd603 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:27.083552 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8e5b4616a6a54331a88e90a714abd603 Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsAccessNegativeTestJSON-1914011033-project Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d02753c0aa8644a29ff2fc5104e4b279 Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033-project Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} Aug 03 04:32:27.085123 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1034735733', 'body': {'addTenantAccess': {'tenant': '8e5b4616a6a54331a88e90a714abd603'}}} Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:27.085952 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 03 04:32:27.087159 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.089128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc4b32eb-30ef-4a15-ac7f-3f11e52ceef1 tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.090684 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc4b32eb-30ef-4a15-ac7f-3f11e52ceef1 tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] 10.222.0.72 "POST /compute/v2.1/flavors/1034735733/action" status: 403 len: 130 microversion: 2.1 time: 0.371411 Aug 03 04:32:27.092630 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 163/348] 10.222.0.72 () {60 vars in 1200 bytes} [Wed Aug 3 04:32:26 2022] POST /compute/v2.1/flavors/1034735733/action => generated 130 bytes in 375 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:27.106934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:27.107818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:27.118380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:27.133340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:27.136161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:27.138044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:27.198439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da848dd8-dad8-48b7-b786-4d0dcb6f2f51 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.140743 Aug 03 04:32:27.200255 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 186/349] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:27.206700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41cbb331-099d-47f2-abce-58dc544bc962 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:27.207798 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.207798 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:27.301313 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41cbb331-099d-47f2-abce-58dc544bc962 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1034735733" status: 202 len: 0 microversion: 2.1 time: 0.098211 Aug 03 04:32:27.301313 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 187/350] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:32:27 2022] DELETE /compute/v2.1/flavors/1034735733 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:27.312384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d46a7fec-aa63-486a-9c09-08aadadeb9a7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d46a7fec-aa63-486a-9c09-08aadadeb9a7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 283 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:27.386070 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.388410 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:32:27.389295 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.389971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.391080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.392039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:32:27.392039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:32:27.392039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:32:27.392039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.392039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d46a7fec-aa63-486a-9c09-08aadadeb9a7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.392470 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d46a7fec-aa63-486a-9c09-08aadadeb9a7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.083297 Aug 03 04:32:27.392470 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 188/351] 10.222.0.72 () {60 vars in 1165 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:32:27.397711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1b95368-4003-4ded-916e-c15e94a3af5b tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:27.438294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1b95368-4003-4ded-916e-c15e94a3af5b tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.046340 Aug 03 04:32:27.447668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 189/352] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:27 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:27.455471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-37fdf506-200a-41bd-8845-1da44f04e612 req-56df9bba-680b-44ec-a68a-d7fe29e52876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d614b993-782e-4a9e-9bb7-bc012fe1ae31", "name": "network-vif-deleted", "tag": "302a8799-b373-4f71-b5ca-fc71024695cb"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.473922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-37fdf506-200a-41bd-8845-1da44f04e612 req-56df9bba-680b-44ec-a68a-d7fe29e52876 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:27.475069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-37fdf506-200a-41bd-8845-1da44f04e612 req-56df9bba-680b-44ec-a68a-d7fe29e52876 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:27.497355 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-37fdf506-200a-41bd-8845-1da44f04e612 req-56df9bba-680b-44ec-a68a-d7fe29e52876 service nova] Creating event network-vif-deleted:302a8799-b373-4f71-b5ca-fc71024695cb for instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 on n-h1-826756-5 Aug 03 04:32:27.504989 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-37fdf506-200a-41bd-8845-1da44f04e612 req-56df9bba-680b-44ec-a68a-d7fe29e52876 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055479 Aug 03 04:32:27.513223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 190/353] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:27.520097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1189f568-e83e-4748-9d03-8d96f9212f4d tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1189f568-e83e-4748-9d03-8d96f9212f4d tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 27 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:27.525822 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: {"aggregate": {"name": ""}} Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:27.527188 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '' Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.528613 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:32:27.529831 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.532899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1189f568-e83e-4748-9d03-8d96f9212f4d tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.533897 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1189f568-e83e-4748-9d03-8d96f9212f4d tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019138 Aug 03 04:32:27.535476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 191/354] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:32:27.545222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f44a5b58-a8ca-4541-ab51-fcdbbcd2cde8 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1433744089", "id": 437961413, "os-flavor-access:is_public": "False"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.547232 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.547232 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:27.617422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:27.636140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:27.642279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:27.646443 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9cda0e9d-df2d-417b-a847-d138970398e0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.551758 Aug 03 04:32:27.649073 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 164/355] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:27 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:27.660829 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f44a5b58-a8ca-4541-ab51-fcdbbcd2cde8 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.124049 Aug 03 04:32:27.661865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 192/356] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/flavors => generated 436 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:27.665478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b40bb7d0-d7e1-45b3-8dcf-16a6e68c9414 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-164814271"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.676899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e363df32-82ba-4c87-bfeb-09dacc444302 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.677497 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.677497 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:27.678992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b40bb7d0-d7e1-45b3-8dcf-16a6e68c9414 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b40bb7d0-d7e1-45b3-8dcf-16a6e68c9414 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 59 Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:27.681793 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: {"aggregate": {"name": "tempest-test_aggregate-164814271"}} Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:27.685332 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-164814271'}}} Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:27.686065 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:27.687091 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 03 04:32:27.688140 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.688924 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.688924 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:27.689213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b40bb7d0-d7e1-45b3-8dcf-16a6e68c9414 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.689905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b40bb7d0-d7e1-45b3-8dcf-16a6e68c9414 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.034216 Aug 03 04:32:27.690797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 165/357] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:27.703558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1222196c-df49-47ef-90fd-46d1f27adda9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1724990724"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.710764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-1222196c-df49-47ef-90fd-46d1f27adda9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid 0214f5eb-770b-4e16-89eb-3061af8a2f0f for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:27.819741 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1222196c-df49-47ef-90fd-46d1f27adda9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.122198 Aug 03 04:32:27.821902 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 166/358] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:27.834358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1724990724"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:27.846566 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.846566 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:27.848824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid f8e50a31-8460-42cc-a945-660515bb4b9e for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:27.873246 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1724990724 already exists. Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 60 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:27.875758 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: {"aggregate": {"name": "tempest-test_aggregate-1724990724"}} Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:27.879814 n-d-826756-5 devstack@n-api.service[120831]: exception: Aggregate tempest-test_aggregate-1724990724 already exists. Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1724990724'}}} Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6411, in create_aggregate Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 03 04:32:27.881092 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1724990724 already exists. Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:27.883332 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1724990724 already exists. Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1724990724 already exists. Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1724990724 already exists. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:27.884670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24ad90ac-f792-4b53-a4b1-503116a256d9 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.047852 Aug 03 04:32:27.888317 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 167/359] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:27.894973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dfb6f24f-6fcd-48f3-8885-0a16f666d54e tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:27.897019 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:27.897019 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:27.998354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dfb6f24f-6fcd-48f3-8885-0a16f666d54e tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.107224 Aug 03 04:32:27.999547 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 168/360] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:28.344696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1655542853", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:28.415520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] validate_networks() for [('dfce1ef6-7388-4fd6-b6ff-60d5a043bace', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:28.422374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e363df32-82ba-4c87-bfeb-09dacc444302 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/437961413/action" status: 200 len: 96 microversion: 2.1 time: 0.750038 Aug 03 04:32:28.422993 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 193/361] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/flavors/437961413/action => generated 96 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:32:28.458529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:28.459534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:28.470748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:28.472922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:28.474192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:28.476617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:28.575183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:28.575645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:28.576132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lazy-loading 'fault' on Instance uuid d614b993-782e-4a9e-9bb7-bc012fe1ae31 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:28.659077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:28.678758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0928a8a-6643-4063-9f74-840b3aa92af7 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 200 len: 1309 microversion: 2.1 time: 0.252121 Aug 03 04:32:28.679483 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 194/362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:28 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 1309 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:28.686459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d4660d3-87c7-4c56-a00d-206f01378bd7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1243702405"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:28.690056 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:28.690056 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:28.691673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-3d4660d3-87c7-4c56-a00d-206f01378bd7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid d8a7f168-081b-4b9a-a95b-aa75176592d5 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:28.824014 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d4660d3-87c7-4c56-a00d-206f01378bd7 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.141609 Aug 03 04:32:28.826401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 195/363] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:28.832768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-feca5a28-56c5-47ac-b218-76c8651997ad tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:28.835414 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:28.835414 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:28.836680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-feca5a28-56c5-47ac-b218-76c8651997ad tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'd02753c0aa8644a29ff2fc5104e4b279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e5b4616a6a54331a88e90a714abd603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-feca5a28-56c5-47ac-b218-76c8651997ad tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Request method failure captured: Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/flavors/437961413/action HTTP/1.1 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 70 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpTiXA_H3vM5DWrtbIp-5hUrvPEXCQyByoneiM36eOijXKm5s9q0sHDtnVhcnx-zpX75z_48CK6uKtzJvz9QeJ5orb57krpq0hW-MrGYnXW5dxSjSxGmMmPrGSnabRiEIu4LmO00ZVTauMaVw468lcsuhFcug9QZi-PCD9VB98SJt4 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8e5b4616a6a54331a88e90a714abd603 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:28.839375 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8e5b4616a6a54331a88e90a714abd603"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8e5b4616a6a54331a88e90a714abd603 Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033 Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsAccessNegativeTestJSON-1914011033-project Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d02753c0aa8644a29ff2fc5104e4b279 Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1914011033-project Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: {"removeTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} Aug 03 04:32:28.841594 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '437961413', 'body': {'removeTenantAccess': {'tenant': '8e5b4616a6a54331a88e90a714abd603'}}} Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can( Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:28.842244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 03 04:32:28.843631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:28.861141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-feca5a28-56c5-47ac-b218-76c8651997ad tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:28.862011 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-feca5a28-56c5-47ac-b218-76c8651997ad tempest-FlavorsAccessNegativeTestJSON-1914011033 tempest-FlavorsAccessNegativeTestJSON-1914011033-project] 10.222.0.72 "POST /compute/v2.1/flavors/437961413/action" status: 403 len: 133 microversion: 2.1 time: 0.033587 Aug 03 04:32:28.866777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 196/364] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:28 2022] POST /compute/v2.1/flavors/437961413/action => generated 133 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:28.872598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:28.873220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:28.891951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:28.892561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:28.893561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:28.894459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:29.091059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:29.091592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:29.092094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:29.092780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:29.093195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:29.109486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:29.109941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:29.114644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:29.115102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:29.140105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Getting quotas for project 7047317821904de5a740f4732994a9b0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:29.145044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Getting quotas for user db179c437f284920b453883cc24ecbf5 and project 7047317821904de5a740f4732994a9b0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:29.153909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:29.161845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:29.164828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:29.165404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:29.167099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:29.169776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac3c97a8-d6eb-4b7e-90ce-751de5009a5b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.302315 Aug 03 04:32:29.182762 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 197/365] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:28 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:29.192009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47ceae6b-4520-47b1-a4aa-c2c454429130 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:29.193863 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:29.193863 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:29.195370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ceae6b-4520-47b1-a4aa-c2c454429130 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47ceae6b-4520-47b1-a4aa-c2c454429130 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:29.197273 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 04:32:29.198490 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '15'} Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:29.199832 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 03 04:32:29.201366 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.203731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47ceae6b-4520-47b1-a4aa-c2c454429130 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:29.204823 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47ceae6b-4520-47b1-a4aa-c2c454429130 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.020627 Aug 03 04:32:29.209120 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 198/366] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:29.215311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ede22498-957d-4a18-b931-1f8382368bef tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8e5b4616a6a54331a88e90a714abd603"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:29.218548 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:29.218548 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:29.352502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2b445218-73a5-421a-865e-d484190dff07 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351716 Aug 03 04:32:29.360568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 169/367] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:29.377420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33992b0d-fed1-4613-9dd7-b8cc6ce5d2fd tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:29.384827 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:29.384827 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:29.494049 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33992b0d-fed1-4613-9dd7-b8cc6ce5d2fd tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.128397 Aug 03 04:32:29.494640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 170/368] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:29.519630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cd5f45cd-0d02-4926-83a0-b4cbafe5c2a0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:29.520355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cd5f45cd-0d02-4926-83a0-b4cbafe5c2a0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:29.583845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd5f45cd-0d02-4926-83a0-b4cbafe5c2a0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:29.592956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cd5f45cd-0d02-4926-83a0-b4cbafe5c2a0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1224 microversion: 2.1 time: 0.095930 Aug 03 04:32:29.595925 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 171/369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:29 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:29.609243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a27e464-472b-4735-abba-e98059082d13 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:29.610025 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:29.610025 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:29.626270 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7a27e464-472b-4735-abba-e98059082d13 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a27e464-472b-4735-abba-e98059082d13 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:29.627939 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: exception: Aggregate -1 could not be found. Aug 03 04:32:29.629410 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '-1'} Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6470, in delete_aggregate Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:29.630418 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.631571 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a27e464-472b-4735-abba-e98059082d13 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a27e464-472b-4735-abba-e98059082d13 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032579 Aug 03 04:32:29.648638 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 172/370] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:29 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:29.649251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb574-1303-4419-8af0-786d2e30d27a", "name": "network-vif-unplugged", "status": "completed", "tag": "fac16e13-d03b-4b3d-a9e5-086317c05d62"}, {"name": "network-changed", "server_uuid": "146eb574-1303-4419-8af0-786d2e30d27a", "tag": "fac16e13-d03b-4b3d-a9e5-086317c05d62"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:29.649251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:29.649251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:29.661252 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] Creating event network-vif-unplugged:fac16e13-d03b-4b3d-a9e5-086317c05d62 for instance 146eb574-1303-4419-8af0-786d2e30d27a on n-h1-826756-5 Aug 03 04:32:29.661760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] Creating event network-changed:fac16e13-d03b-4b3d-a9e5-086317c05d62 for instance 146eb574-1303-4419-8af0-786d2e30d27a on n-h1-826756-5 Aug 03 04:32:29.669231 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-99623b07-79ea-4261-a1c6-473b81fa8f10 req-3509fad7-d42e-4a20-bd3b-a733aab21884 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036657 Aug 03 04:32:29.669842 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 173/371] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:29.686235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3301ba7-b86e-4692-92b1-f27a2003d164 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496916843"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:29.712406 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:29.712406 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:29.720364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-a3301ba7-b86e-4692-92b1-f27a2003d164 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid 4ccc3777-5696-4079-ad7f-929de89bdee7 for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:29.753083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:29.876602 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3301ba7-b86e-4692-92b1-f27a2003d164 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.205192 Aug 03 04:32:29.961348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 174/372] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:29.961348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1278613521", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:30.018846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:30.033767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ede22498-957d-4a18-b931-1f8382368bef tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/437961413/action" status: 200 len: 21 microversion: 2.1 time: 0.823119 Aug 03 04:32:30.103858 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 199/373] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:29 2022] POST /compute/v2.1/flavors/437961413/action => generated 21 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:32:30.103858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.103858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: d614b993-782e-4a9e-9bb7-bc012fe1ae31] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:30.103858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.104749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.104749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.104749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.104749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] HTTP exception thrown: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Request method failure captured: Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 HTTP/1.1 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foV54QWiR-cwhtEODzzk3RyZLVEzgkdahYb_GZPdMZ9UmBzsHov1UAASKqfWwo0pOQLbM0PfRRh0OXEJ7ArBgH8oPSEMCdmEkf-C0BjikMKeRvZIOqxxhnO6MYXHX3fBX1Hr0HjSHw3kXg4VMlxb_uIur4jJBfzUsoWpKKphlBh8n8 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6cf7cad2bd5a466caec230bbdef00681 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:30.106505 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6cf7cad2bd5a466caec230bbdef00681 Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveMigrationNegativeTest-203544700-project Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c2b2dfc0b09f4e1c8fe556d731f82a3a Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveMigrationNegativeTest-203544700-project Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. Aug 03 04:32:30.108221 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd614b993-782e-4a9e-9bb7-bc012fe1ae31'} Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:30.109129 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. Aug 03 04:32:30.110490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Returning 404 to user: Instance d614b993-782e-4a9e-9bb7-bc012fe1ae31 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e965a9d7-943e-4ce6-8eeb-817fffe0369d tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31" status: 404 len: 111 microversion: 2.1 time: 0.037061 Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 200/374] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/servers/d614b993-782e-4a9e-9bb7-bc012fe1ae31 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f453bab-85aa-43e6-a884-f17953a8cca2 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:30.111697 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f453bab-85aa-43e6-a884-f17953a8cca2 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f453bab-85aa-43e6-a884-f17953a8cca2 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:30.112158 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 04:32:30.115796 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '16'} Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:30.116899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:30.118833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f453bab-85aa-43e6-a884-f17953a8cca2 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:30.120013 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f453bab-85aa-43e6-a884-f17953a8cca2 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.008543 Aug 03 04:32:30.120013 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 201/375] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:30.120013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.120013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:30.120013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.120769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.120769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.126168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.159253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:32:30.321462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:30.321888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:30.322361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:30.322836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:30.323263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:30.346410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.347064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.348048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.348679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.373581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Getting quotas for project 6a69d52385ae419bb21cca6ccf60344e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:30.380680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Getting quotas for user 2a83f5aee35a414aa84dedde4e729347 and project 6a69d52385ae419bb21cca6ccf60344e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:30.396811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:30.399569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:30.547058 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-719c9093-9278-47ac-9651-360c7eae20aa tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667743 Aug 03 04:32:30.552238 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 175/376] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:30.557157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e77e33d8-2158-4ec1-814d-21c964e015b3 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.558360 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:30.558360 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:30.636723 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-69e574e4-acec-4a2f-87e7-bdffb4b586c9 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 204 len: 0 microversion: 2.1 time: 0.530231 Aug 03 04:32:30.636723 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 202/377] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:32:30 2022] DELETE /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:32:30.641929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-551ade7b-a13c-4a73-94ef-ebc0091a03b3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.642782 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:30.642782 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:30.678727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e77e33d8-2158-4ec1-814d-21c964e015b3 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/437961413" status: 202 len: 0 microversion: 2.1 time: 0.125325 Aug 03 04:32:30.689064 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 176/378] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:32:30 2022] DELETE /compute/v2.1/flavors/437961413 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:30.693457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.697572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:30.715470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.716231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.717152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:30.718502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:30.790806 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-551ade7b-a13c-4a73-94ef-ebc0091a03b3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.147414 Aug 03 04:32:30.790806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 203/379] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:30.796657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-70968fa9-e83d-4c41-bb9e-13b0fca1365c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.797618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-70968fa9-e83d-4c41-bb9e-13b0fca1365c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:30.909573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-70968fa9-e83d-4c41-bb9e-13b0fca1365c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:30.917297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-70968fa9-e83d-4c41-bb9e-13b0fca1365c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1222 microversion: 2.1 time: 0.129937 Aug 03 04:32:30.919081 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 204/380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:30.925357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6378d119-f687-4c6d-8f80-da452ccd200b tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:30.926280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6378d119-f687-4c6d-8f80-da452ccd200b tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:30.976636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:30.986493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:30.987905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:30.992247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af547f3a-586a-460e-bce2-294b97fdb4d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.305481 Aug 03 04:32:30.992867 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 177/381] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:31.010359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.011010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6378d119-f687-4c6d-8f80-da452ccd200b tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:31.014814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:31.018013 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6378d119-f687-4c6d-8f80-da452ccd200b tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1224 microversion: 2.1 time: 0.097692 Aug 03 04:32:31.019387 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 205/382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:31.023085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ec688a3-1563-4c64-a1f2-6f1d6b7dc514 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.026972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.028496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.029659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.030137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.063911 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ec688a3-1563-4c64-a1f2-6f1d6b7dc514 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.043963 Aug 03 04:32:31.072467 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 206/383] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:31.072467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45251313-42c2-4470-a819-82e7cb116af6 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.072467 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.072467 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.085394 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-45251313-42c2-4470-a819-82e7cb116af6 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45251313-42c2-4470-a819-82e7cb116af6 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:31.088200 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: exception: Aggregate -1 could not be found. Aug 03 04:32:31.094432 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '-1'} Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6417, in get_aggregate Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.095273 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 03 04:32:31.096736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.098651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45251313-42c2-4470-a819-82e7cb116af6 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:31.098651 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45251313-42c2-4470-a819-82e7cb116af6 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.025293 Aug 03 04:32:31.100390 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 207/384] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:32:31 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:31.112132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01e82097-a33a-40ea-a399-ea7dd6af304d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1447953071", "id": 263268843, "os-flavor-access:is_public": "False"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.113770 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.113770 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.198234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01e82097-a33a-40ea-a399-ea7dd6af304d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.097937 Aug 03 04:32:31.198855 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 208/385] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/flavors => generated 436 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:31.205720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:31.211234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-500b69a2-3a07-484a-9f95-5336bc779e5a tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.222813 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fdc7f204-b05b-4e57-a425-70e5c9f745cc tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1473 microversion: 2.1 time: 0.217161 Aug 03 04:32:31.223663 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 178/386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:30 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:31.223781 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.223781 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.225050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-500b69a2-3a07-484a-9f95-5336bc779e5a tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-500b69a2-3a07-484a-9f95-5336bc779e5a tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:31.226661 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 04:32:31.227975 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:31.228799 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 03 04:32:31.229905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.230863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97a918ba-c0ba-4d8f-aecc-7388c1aadf5d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9ec22f9a55834e48afffe95ead13fe8f"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.230959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-500b69a2-3a07-484a-9f95-5336bc779e5a tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:31.232004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-500b69a2-3a07-484a-9f95-5336bc779e5a tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.031361 Aug 03 04:32:31.232750 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 209/387] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:32:31 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:31.245163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58a64e41-6b83-4a1b-bc9b-ff0f26b89a68 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1135566828"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.249085 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.249085 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.249333 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.249333 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:31.250439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-58a64e41-6b83-4a1b-bc9b-ff0f26b89a68 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid af116709-30fd-4217-972e-a0882d6d9de6 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:31.348985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58a64e41-6b83-4a1b-bc9b-ff0f26b89a68 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.108558 Aug 03 04:32:31.355887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 210/388] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:31.374719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-674087d3-f9f4-41eb-952e-9217fd896aa3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.377241 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.377241 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.388937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674087d3-f9f4-41eb-952e-9217fd896aa3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.389768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674087d3-f9f4-41eb-952e-9217fd896aa3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.486395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-97a918ba-c0ba-4d8f-aecc-7388c1aadf5d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] HTTP exception thrown: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97a918ba-c0ba-4d8f-aecc-7388c1aadf5d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Request method failure captured: Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/flavors/263268843/action HTTP/1.1 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 70 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpV7yDhPIrAipYKVaUXURv7Uscpvm_Yw1h43WpB1NIFy20XgQn72ByEAJVtNSIOWryBbcaIr42Zw6P4f2djIB0dKBNSzlkQBUho-CifqJOcSjkObvckjcTbZ-5l6bVmRVUHyeaHDR50N8_f9tUQ5f2SFDcSDuryU0Y6bJvu2qzQNhY Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:31.488177 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ede9c2fb75cf4e0ca67988b040038655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ede9c2fb75cf4e0ca67988b040038655 Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924 Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: dbc9f7029a444cbfa6c112ee31cbb42f Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: {"removeTenantAccess": {"tenant": "9ec22f9a55834e48afffe95ead13fe8f"}} Aug 03 04:32:31.489632 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '263268843', 'body': {'removeTenantAccess': {'tenant': '9ec22f9a55834e48afffe95ead13fe8f'}}} Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 03 04:32:31.490387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.491427 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97a918ba-c0ba-4d8f-aecc-7388c1aadf5d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Returning 404 to user: Flavor access not found for 37 / 9ec22f9a55834e48afffe95ead13fe8f combination. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97a918ba-c0ba-4d8f-aecc-7388c1aadf5d tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/263268843/action" status: 404 len: 124 microversion: 2.1 time: 0.265311 Aug 03 04:32:31.494769 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 179/389] 10.222.0.72 () {60 vars in 1197 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/flavors/263268843/action => generated 124 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:31.500200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf8e87d6-b504-45d9-b1eb-182892a60df6 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.505980 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.505980 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:31.614118 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf8e87d6-b504-45d9-b1eb-182892a60df6 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/263268843" status: 202 len: 0 microversion: 2.1 time: 0.118798 Aug 03 04:32:31.614886 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 180/390] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:32:31 2022] DELETE /compute/v2.1/flavors/263268843 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:31.626376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efc285a8-55ca-47ff-8a36-b871951a9837 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.648079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-674087d3-f9f4-41eb-952e-9217fd896aa3 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.285734 Aug 03 04:32:31.654072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 211/391] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:31.654196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efc285a8-55ca-47ff-8a36-b871951a9837 tempest-FlavorsAccessNegativeTestJSON-1384545924 tempest-FlavorsAccessNegativeTestJSON-1384545924-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.033274 Aug 03 04:32:31.660416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 181/392] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:32:31 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:31.661580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4dafc343-48f6-4960-ad0d-ead6105aee91 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.664133 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.664133 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:31.665323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4dafc343-48f6-4960-ad0d-ead6105aee91 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '630924fbc11741858de98d924a2e8ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fabf9c5ce7746858b9558680eaad7eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4dafc343-48f6-4960-ad0d-ead6105aee91 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Request method failure captured: Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 42 Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpUO0ny2DNYwkuMibKPSDIbvt7ruRLpeWz0Bm53R4dW1XRFH88z1su2NNbQKlv9RISz3GuXIUviqf_QO1xumv8-pr0mqaS_Rc8GRNMF1VaAl3hxAdZ1OGWoJ_NtF2WDk_vz8KJOBS1iLUk_y51-MKmy-rQAPO7FVk4iQSs-0v8SPBU Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:31.667525 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8fabf9c5ce7746858b9558680eaad7eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8fabf9c5ce7746858b9558680eaad7eb Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718 Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 630924fbc11741858de98d924a2e8ca7 Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1218299718-project Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: {"remove_host": {"host": "n-h1-826756-5"}} Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:31.677384 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-826756-5'}}} Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:31.678641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 03 04:32:31.679739 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:31.680831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4dafc343-48f6-4960-ad0d-ead6105aee91 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:31.680831 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4dafc343-48f6-4960-ad0d-ead6105aee91 tempest-AggregatesAdminNegativeTestJSON-1218299718 tempest-AggregatesAdminNegativeTestJSON-1218299718-project] 10.222.0.72 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.012519 Aug 03 04:32:31.680831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 212/393] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:31.684489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c685f433-7bc3-4ce7-903f-b3cbaceaf58c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:31.687322 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:31.687322 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:31.698387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c685f433-7bc3-4ce7-903f-b3cbaceaf58c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.699465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c685f433-7bc3-4ce7-903f-b3cbaceaf58c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.939386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:31.940385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:31.947498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.947992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.949755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:31.958300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:31.987264 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c685f433-7bc3-4ce7-903f-b3cbaceaf58c tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.307241 Aug 03 04:32:31.988442 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 182/394] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:31.999537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-306a5d99-c1e3-4c97-b9ac-6b43cfde3ba4 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:32.000688 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:32.000688 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:32.051194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.060177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02701a33-13cf-49dd-8f4b-acfae47d18a3 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1226 microversion: 2.1 time: 0.124551 Aug 03 04:32:32.060775 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 213/395] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:31 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:32.071018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:32.074596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:32.078174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.078641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.079422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.080037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.113069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:32.162770 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-306a5d99-c1e3-4c97-b9ac-6b43cfde3ba4 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.167681 Aug 03 04:32:32.163353 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 183/396] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 03 04:32:32.177814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:32.184158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:32.190352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.191092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.192079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.192605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.334549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.347144 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9d7b50a-e2d8-4475-8a95-071370a9865f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1276 microversion: 2.1 time: 0.181703 Aug 03 04:32:32.347877 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 184/397] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:32 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:32.354718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24fe05ec-9dea-476f-b14b-26fba5487ab8 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1391241353"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:32.358454 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:32.358454 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:32.361262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.371656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.aggregate [None req-24fe05ec-9dea-476f-b14b-26fba5487ab8 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Generated uuid 2647c76d-c0dc-4463-a426-7623a64c06d1 for aggregate {{(pid=120831) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 04:32:32.372362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.373991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.375175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d18cfb1-cb85-4f88-b149-e85a206dd131 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.313161 Aug 03 04:32:32.375735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 214/398] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:32 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:32.380179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:32.380839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:32.387277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.387846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.388682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.389129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.510872 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24fe05ec-9dea-476f-b14b-26fba5487ab8 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.161058 Aug 03 04:32:32.514427 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 185/399] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 04:32:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:32.540771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:32.554243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19f1a6b9-b0b8-4141-b2fb-668efe1e6147 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1473 microversion: 2.1 time: 0.174570 Aug 03 04:32:32.554243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 215/400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:32 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1473 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:32.566399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:32.569535 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:32.569535 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:32.592850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.593910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.601167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:32.601667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:32.611691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.compute.aggregates [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 03 04:32:32.612243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Request method failure captured: Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 42 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpWom36mupw_Qe_tX9IiQlt563pC1lSl9TeXveHVD8cGwVBGKYGLBoYwZ6h7ocigZLjWLQIrTBtKPdZPHs11s80N3396v9i5HOxedoC6Fzp_beJ8ygbP3QvdHRl2CEIyhi5JY2p2DC0KNcWFqG4Z70Ro5SXWb8gukoKnZwTtEJF2ns Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:32.614650 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/39f67083cb5748f2a231ba02db9b1aa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 39f67083cb5748f2a231ba02db9b1aa3 Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-749992607 Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6d59928df165412ebac931f2ce5f4448 Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: {"remove_host": {"host": "nonexist_host"}} Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:32.616077 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5949, in _get_service_in_cell_by_host Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5955, in _get_service_in_cell_by_host Aug 03 04:32:32.616979 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in remove_host_from_aggregate Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 03 04:32:32.618219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5957, in _get_service_in_cell_by_host Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.619399 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f35ded41-8b48-44d5-baad-3abc76e45342 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.063044 Aug 03 04:32:32.620526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 216/401] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 04:32:32 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:32.634557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89b16e8b-65d6-41bd-9d14-6be163455265 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:32.635752 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:32.635752 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:32.684062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1326259865", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:32.752661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:32.774350 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89b16e8b-65d6-41bd-9d14-6be163455265 tempest-AggregatesAdminNegativeTestJSON-749992607 tempest-AggregatesAdminNegativeTestJSON-749992607-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.151611 Aug 03 04:32:32.775069 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 217/402] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:32:32 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 04:32:32.999602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:33.000025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:33.000533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:33.000942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:33.001354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:33.012683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.013311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.014140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.014582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.039294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:33.044836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:33.060564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:33.062923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:33.083906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:33.085293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:33.096284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.096825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.101486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.101486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.181202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:33.190130 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cd65221-cfad-421e-b51c-0c05fdcdb468 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1274 microversion: 2.1 time: 0.112521 Aug 03 04:32:33.190701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 218/403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:33 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:33.207140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0571e394-f89c-43e0-ba7f-d0f31883f2ba tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691535 Aug 03 04:32:33.208168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 186/404] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:33.222150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a0c3be05-397d-4d6a-ac69-87bd1805a38a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:33.223811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0c3be05-397d-4d6a-ac69-87bd1805a38a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:33.362237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a0c3be05-397d-4d6a-ac69-87bd1805a38a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:33.378360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a0c3be05-397d-4d6a-ac69-87bd1805a38a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1213 microversion: 2.1 time: 0.161675 Aug 03 04:32:33.381675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:33.382547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:33.407326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.408250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.409517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.410185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.412429 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 219/405] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:33 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:33.417519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:33.429421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:33.439378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.439378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.439378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.439730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.496600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:33.521254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05cb1a11-b1d9-45ec-8daf-44b929ff16d7 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1282 microversion: 2.1 time: 0.133008 Aug 03 04:32:33.546852 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 187/406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:33 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:33.576307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:33.577176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:33.586407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.591801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.593331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:33.595070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:33.997569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.015417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.020038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.024822 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39c1e6cb-44e5-4323-a7da-39020d7afdd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.608991 Aug 03 04:32:34.025719 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 220/407] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:33 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:34.030341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.040186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c10d285-4461-4da6-a242-8f5cc956ebcb tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1473 microversion: 2.1 time: 0.469157 Aug 03 04:32:34.041402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 188/408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:33 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:34.216858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:34.218437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:34.243671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:34.244783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:34.245955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:34.246839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:34.335269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-803ee6ae-e15e-48f1-a625-351d2252f073 req-c2793a45-89d9-41d2-a3ab-31de76bcf820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b7aed72-19cd-41a4-9e6b-544c4cf98047", "name": "network-vif-deleted", "tag": "fdfeffe6-e51a-4378-a9cf-2a692aa271b5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:34.349446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-803ee6ae-e15e-48f1-a625-351d2252f073 req-c2793a45-89d9-41d2-a3ab-31de76bcf820 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:34.350224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-803ee6ae-e15e-48f1-a625-351d2252f073 req-c2793a45-89d9-41d2-a3ab-31de76bcf820 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:34.365242 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-803ee6ae-e15e-48f1-a625-351d2252f073 req-c2793a45-89d9-41d2-a3ab-31de76bcf820 service nova] Creating event network-vif-deleted:fdfeffe6-e51a-4378-a9cf-2a692aa271b5 for instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 on n-h2-826756-5 Aug 03 04:32:34.374261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-803ee6ae-e15e-48f1-a625-351d2252f073 req-c2793a45-89d9-41d2-a3ab-31de76bcf820 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041291 Aug 03 04:32:34.381679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 189/409] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:34.405931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-281948ef-f9d0-41f7-810d-ffa537677b52 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:34.411324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-281948ef-f9d0-41f7-810d-ffa537677b52 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:34.729535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-281948ef-f9d0-41f7-810d-ffa537677b52 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.739681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-281948ef-f9d0-41f7-810d-ffa537677b52 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1213 microversion: 2.1 time: 0.337411 Aug 03 04:32:34.742221 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 190/410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:34 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1213 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:34.749666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:34.750653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:34.759437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:34.760231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:34.761244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:34.762675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:34.784729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:34.789075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:34.795000 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e54aea6-8e02-4060-a537-41c06d438279 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1280 microversion: 2.1 time: 0.584113 Aug 03 04:32:34.795598 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 221/411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:34 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1280 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:35.004290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:35.014523 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b3bbd3d-f711-450b-a9e0-05dc9a1dd654 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.270231 Aug 03 04:32:35.021214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 191/412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:34 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:35.062769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:35.064377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:35.068427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:35.069177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:35.073053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.077376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.079135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.080217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.080886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.081025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.084896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.085388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.197666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.203301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.203761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lazy-loading 'fault' on Instance uuid 2b7aed72-19cd-41a4-9e6b-544c4cf98047 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:35.270173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b2dfc0b09f4e1c8fe556d731f82a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf7cad2bd5a466caec230bbdef00681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:35.278397 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-216c4178-b6dd-457c-af04-ad884f676b53 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 200 len: 1308 microversion: 2.1 time: 0.213861 Aug 03 04:32:35.279315 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 192/413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:35 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:35.644793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:35.665855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:35.668328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:35.669909 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-222a9bc2-2890-4467-8ea5-be7d0d198b18 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.618844 Aug 03 04:32:35.670549 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 222/414] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:35 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:35.763846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:35.765915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:35.783363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.784481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.785433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.786013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.824254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:35.824909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:35.841650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.842093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.843140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:35.843673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:35.857087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:35.999774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:36.008153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba368e1f-af4f-4cd2-8aef-d715a43d6fbe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1209 microversion: 2.1 time: 0.250351 Aug 03 04:32:36.008803 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 193/415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:35 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1209 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:36.031231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:36.046015 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7706085-57eb-4639-9ce6-2110f246311c tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1280 microversion: 2.1 time: 0.224481 Aug 03 04:32:36.050158 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 223/416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:35 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1280 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:36.052541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:36.053452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:36.062977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.063806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.064639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.065166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.302634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:36.303299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] [instance: 2b7aed72-19cd-41a4-9e6b-544c4cf98047] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:36.318892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.323204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.323204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.325506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.360448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] HTTP exception thrown: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Request method failure captured: Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 HTTP/1.1 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foV54QWiR-cwhtEODzzk3RyZLVEzgkdahYb_GZPdMZ9UmBzsHov1UAASKqfWwo0pOQLbM0PfRRh0OXEJ7ArBgH8oPSEMCdmEkf-C0BjikMKeRvZIOqxxhnO6MYXHX3fBX1Hr0HjSHw3kXg4VMlxb_uIur4jJBfzUsoWpKKphlBh8n8 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6cf7cad2bd5a466caec230bbdef00681 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:36.362015 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cf7cad2bd5a466caec230bbdef00681"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6cf7cad2bd5a466caec230bbdef00681 Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-203544700 Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveMigrationNegativeTest-203544700-project Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c2b2dfc0b09f4e1c8fe556d731f82a3a Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveMigrationNegativeTest-203544700-project Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. Aug 03 04:32:36.363186 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2b7aed72-19cd-41a4-9e6b-544c4cf98047'} Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:36.363846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. Aug 03 04:32:36.365711 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:36.366680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] Returning 404 to user: Instance 2b7aed72-19cd-41a4-9e6b-544c4cf98047 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:36.366680 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36c3658c-4a41-49b8-886c-bc333b1f7e32 tempest-LiveMigrationNegativeTest-203544700 tempest-LiveMigrationNegativeTest-203544700-project] 10.222.0.72 "GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047" status: 404 len: 111 microversion: 2.1 time: 0.064761 Aug 03 04:32:36.366680 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 224/417] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:36 2022] GET /compute/v2.1/servers/2b7aed72-19cd-41a4-9e6b-544c4cf98047 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:36.372534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:36.390705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7413046-beda-43a6-a231-1a86e0116c27 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.350277 Aug 03 04:32:36.390705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 194/418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:36 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:36.414329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dcaff260-2e11-4cfa-9a1f-650c9f8279bc req-e3e42b75-dbc4-4344-be19-9f9fc1281680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:36.430171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcaff260-2e11-4cfa-9a1f-650c9f8279bc req-e3e42b75-dbc4-4344-be19-9f9fc1281680 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.430630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcaff260-2e11-4cfa-9a1f-650c9f8279bc req-e3e42b75-dbc4-4344-be19-9f9fc1281680 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.443522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dcaff260-2e11-4cfa-9a1f-650c9f8279bc req-e3e42b75-dbc4-4344-be19-9f9fc1281680 service nova] Creating event network-changed:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:32:36.450184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dcaff260-2e11-4cfa-9a1f-650c9f8279bc req-e3e42b75-dbc4-4344-be19-9f9fc1281680 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041774 Aug 03 04:32:36.451016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 225/419] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:36.693954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:36.694931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:36.706427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:36.718191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.718642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:36.719453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:36.719886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.030936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:37.033011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:37.040150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.053914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.054966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.055563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.286519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:37.312253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8b587ab-c134-4599-810a-fcdf3e7a66b0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1273 microversion: 2.1 time: 0.286619 Aug 03 04:32:37.313528 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 226/420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:37 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:37.315364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:37.322271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:37.323166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:37.332877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:37.334670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:37.336049 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e691328c-e255-49bb-b9ff-2115f6fde213 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.646968 Aug 03 04:32:37.336801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 195/421] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:36 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:37.339095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.339095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.339095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.341782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.413536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:37.414206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:37.439498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.439498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:37.440431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:37.440804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:38.146125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.158791 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eae223a9-b1ef-400e-bec1-024471852ba9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.843291 Aug 03 04:32:38.159477 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 227/422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:37 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:38.279448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.287647 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-450e31f6-e06c-497c-8b07-5c803f949226 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.878967 Aug 03 04:32:38.288917 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 196/423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:37 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:38.336313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:38.336313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:38.343906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:38.344671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:38.345690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:38.346340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:38.365077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:38.366431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:38.380493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:38.383911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:38.385855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:38.389337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:38.547496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.556207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7206ad4f-e8cb-49b8-91e2-48ca4110043c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1271 microversion: 2.1 time: 0.225750 Aug 03 04:32:38.572147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 228/424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:38 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:38.922802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.932945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.935531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:38.937236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-042b839e-8230-4a3a-915b-1ebfc8a5e401 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1567 microversion: 2.25 time: 0.576101 Aug 03 04:32:38.954750 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 197/425] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:38 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1567 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:32:39.112367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-aa930ca9-a472-4119-896b-bf8a464205ef req-9855ce55-2456-4c0d-b0c0-118e5300dde6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4286636-fbef-4e9a-acda-a62102b67d64", "tag": "5f8dfe05-515e-4b8b-a8e1-e2d5749ce304"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:39.139067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-aa930ca9-a472-4119-896b-bf8a464205ef req-9855ce55-2456-4c0d-b0c0-118e5300dde6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.140377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-aa930ca9-a472-4119-896b-bf8a464205ef req-9855ce55-2456-4c0d-b0c0-118e5300dde6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.156920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-aa930ca9-a472-4119-896b-bf8a464205ef req-9855ce55-2456-4c0d-b0c0-118e5300dde6 service nova] Creating event network-changed:5f8dfe05-515e-4b8b-a8e1-e2d5749ce304 for instance c4286636-fbef-4e9a-acda-a62102b67d64 on n-h1-826756-5 Aug 03 04:32:39.162064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-aa930ca9-a472-4119-896b-bf8a464205ef req-9855ce55-2456-4c0d-b0c0-118e5300dde6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057603 Aug 03 04:32:39.162668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 229/426] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:39.180377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:39.181020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:39.187791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.188354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.189716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.189716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.314821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:39.315462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:39.334731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.335198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.335992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.336501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.737815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:39.747974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24573d16-4631-490e-95cf-fad0c838ea69 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.571419 Aug 03 04:32:39.749108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 198/427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:39 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:39.754741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:39.755430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:39.762877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.764883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.775232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.775232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.845555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:39.856707 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ddd37442-5bbe-4f8a-8b4b-a018530afaa2 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.548392 Aug 03 04:32:39.858207 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 230/428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:39 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:39.877742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:39.898267 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-beda209b-9bfe-4f7d-9dc0-e56585a10544 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1271 microversion: 2.1 time: 0.148175 Aug 03 04:32:39.914837 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 199/429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:39 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:39.975409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:39.975409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:39.984168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.985583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:39.988988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:39.990769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.351606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:40.361620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:40.363817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:40.365429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df156c9c-049d-43dd-9e04-fecd64ec1768 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1557 microversion: 2.25 time: 0.398561 Aug 03 04:32:40.365981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 231/430] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:39 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1557 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:40.390021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-933a134f-c629-46e9-a869-5ba97f70537f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '.version_select at 0x7fdd553b0700>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:40.394116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-933a134f-c629-46e9-a869-5ba97f70537f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.394810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-933a134f-c629-46e9-a869-5ba97f70537f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.416326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-933a134f-c629-46e9-a869-5ba97f70537f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.030499 Aug 03 04:32:40.426360 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 200/431] 10.222.0.72 () {60 vars in 1184 bytes} [Wed Aug 3 04:32:40 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:40.431945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:40.432599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:40.439498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.440368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.441404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.442390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.806323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Calling method '.version_select at 0x7fdd553b03a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:40.810857 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:40.810857 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:40.812077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.819040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.819040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.819040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.847331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e5922da-b3ee-48ba-8fa5-48687b72c6d2 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.412855 Aug 03 04:32:40.847936 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 201/432] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:32:40 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:40.859141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:40.859672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:40.870895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.871357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.872258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:40.872729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:40.879206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 146eb574-1303-4419-8af0-786d2e30d27a {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:32:40.916527 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fdabc2b5-19d4-4f03-8fba-8f0a4ddd4ef6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 2049 microversion: 2.25 time: 0.484071 Aug 03 04:32:40.918274 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 232/433] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:40 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 2049 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:32:41.194561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:41.204028 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4aab02a1-c281-4c00-beb7-06dd6e365946 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.354465 Aug 03 04:32:41.205814 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 202/434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:40 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:41.215396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:41.221053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a39aae63-8925-4baf-9746-e73ea160e1fa tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Calling method '.version_select at 0x7fdd5506adc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:41.221425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:41.224786 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:41.224786 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:41.228918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a39aae63-8925-4baf-9746-e73ea160e1fa tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:41.235315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:41.238559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a39aae63-8925-4baf-9746-e73ea160e1fa tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:41.238683 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:32:41.240118 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:41.241000 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 03 04:32:41.242197 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.243782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a39aae63-8925-4baf-9746-e73ea160e1fa tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:41.243863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:41.243863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:41.244204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a39aae63-8925-4baf-9746-e73ea160e1fa tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.319614 Aug 03 04:32:41.244204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 233/435] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:32:40 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 325 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:41.256856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:41.257501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:41.280850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:41.281463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:41.282745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:41.284819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:41.799184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:41.806461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb2ae77c-2443-41ee-8487-420dd4bfdd99 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.599494 Aug 03 04:32:41.807079 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 203/436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:41 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:41.815469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:41.816502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2252bf08-0387-4917-87b5-e5e298853b87 req-a1c166b5-a32e-4564-bb0b-6ee05bd7609e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "name": "network-vif-plugged", "status": "completed", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:41.825920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e102053c-0e6c-483b-88fd-60d3603765a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.579108 Aug 03 04:32:41.826740 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 234/437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:41 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:41.831691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2252bf08-0387-4917-87b5-e5e298853b87 req-a1c166b5-a32e-4564-bb0b-6ee05bd7609e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:41.832136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1053816228", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:41.839723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2252bf08-0387-4917-87b5-e5e298853b87 req-a1c166b5-a32e-4564-bb0b-6ee05bd7609e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:41.863796 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2252bf08-0387-4917-87b5-e5e298853b87 req-a1c166b5-a32e-4564-bb0b-6ee05bd7609e service nova] Creating event network-vif-plugged:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:32:41.872450 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2252bf08-0387-4917-87b5-e5e298853b87 req-a1c166b5-a32e-4564-bb0b-6ee05bd7609e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064176 Aug 03 04:32:41.873077 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 204/438] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:41.892598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7364112-9ae8-4749-9622-643de15a9708 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Calling method '.version_select at 0x7fdd55007670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:41.898739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] validate_networks() for [('8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:41.902744 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:41.902744 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:41.907885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7364112-9ae8-4749-9622-643de15a9708 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7364112-9ae8-4749-9622-643de15a9708 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/n-d-826756-5/reboot HTTP/1.1 Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:41.910304 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'n-d-826756-5'} Aug 03 04:32:41.911649 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:41.912438 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 03 04:32:41.913522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:41.916345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7364112-9ae8-4749-9622-643de15a9708 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:41.916345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7364112-9ae8-4749-9622-643de15a9708 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-d-826756-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.039339 Aug 03 04:32:41.916345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 205/439] 10.222.0.72 () {58 vars in 1188 bytes} [Wed Aug 3 04:32:41 2022] GET /compute/v2.1/os-hosts/n-d-826756-5/reboot => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:42.103242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1386013933", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:42.158170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:42.598848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:42.632461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:42.633070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:42.634276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:42.634694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:42.635128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:42.643676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=52,nova_cell0:UPDATE=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:42.647554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.648172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.649168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.649610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.658690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=15 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:42.669651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Getting quotas for project 9cd3935f43704fa48034d787ff2672d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:42.674428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Getting quotas for user 63ce20ff6e8847589b9fef03fffe4981 and project 9cd3935f43704fa48034d787ff2672d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:42.689443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:42.692123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:42.731847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:42.732571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:42.733227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:42.734146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:42.734601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:42.743668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.744248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.745087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.745745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.763586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:42.768474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for user 4cb1b66854244b8197c4b1f0ccae0b0e and project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:42.781579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:42.783849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:42.786880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13d494f0-0bf1-419a-af39-0c376f97f20e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871816 Aug 03 04:32:42.793854 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 206/440] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:42.798574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e4c6b48-a445-4965-bc5e-e2b86b362564 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Calling method '.version_select at 0x7fdd5527ef70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:42.799377 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:42.799377 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:42.808234 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1e4c6b48-a445-4965-bc5e-e2b86b362564 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e4c6b48-a445-4965-bc5e-e2b86b362564 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:42.810403 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'nonexistent_hostname'} Aug 03 04:32:42.811874 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:42.812767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 04:32:42.814507 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e4c6b48-a445-4965-bc5e-e2b86b362564 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e4c6b48-a445-4965-bc5e-e2b86b362564 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.016953 Aug 03 04:32:42.815644 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 207/441] 10.222.0.72 () {58 vars in 1212 bytes} [Wed Aug 3 04:32:42 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:42.817019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:42.817622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:42.825048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.825509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.826295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:42.826732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:42.896463 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2190fd1c-6ba7-401e-b8d4-124b4dd35e3e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.068393 Aug 03 04:32:42.902976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 235/442] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:32:43.102254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.111178 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f80bc764-39da-46b0-b611-1a45ab118012 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.297698 Aug 03 04:32:43.113459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 208/443] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:42 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:43.127084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ef99b60-8b8f-4b7e-9ee0-05003c06acc2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.127084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ef99b60-8b8f-4b7e-9ee0-05003c06acc2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:43.185104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94393f62-b4e0-4e99-b038-b54a61561751 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] Action: 'create', calling method: .version_select at 0x7fdd5513ea60>, body: {"security_group": {"name": "tempest-securitygroup-1080756903", "description": "tempest-description-640312958"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:43.244735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ef99b60-8b8f-4b7e-9ee0-05003c06acc2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.253035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ef99b60-8b8f-4b7e-9ee0-05003c06acc2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1220 microversion: 2.1 time: 0.137044 Aug 03 04:32:43.253680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 209/444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:43.258231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-390cb704-8548-4606-9c78-c4ed2766beb2 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Calling method '.version_select at 0x7fdd551eddc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.259033 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:43.259033 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:43.260130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-390cb704-8548-4606-9c78-c4ed2766beb2 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-390cb704-8548-4606-9c78-c4ed2766beb2 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/n-d-826756-5 HTTP/1.1 Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:43.262039 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'n-d-826756-5'} Aug 03 04:32:43.263424 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:43.264328 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 03 04:32:43.265573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.267396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-390cb704-8548-4606-9c78-c4ed2766beb2 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:43.268230 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-390cb704-8548-4606-9c78-c4ed2766beb2 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-d-826756-5" status: 403 len: 109 microversion: 2.1 time: 0.013632 Aug 03 04:32:43.272560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 210/445] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/os-hosts/n-d-826756-5 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:43.273238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.274013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:43.281910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:43.282365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:43.283149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:43.283592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:43.570135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.579065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e61cf81-7da0-400c-aa8f-f6053ed27b3e tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1324 microversion: 2.1 time: 0.309238 Aug 03 04:32:43.579563 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 211/446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:43.592142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1ded9fca-837d-4369-b494-127e4069f113 req-0f1faa94-2f96-4bc5-9a32-f664e5397297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:43.607759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1ded9fca-837d-4369-b494-127e4069f113 req-0f1faa94-2f96-4bc5-9a32-f664e5397297 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:43.609020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1ded9fca-837d-4369-b494-127e4069f113 req-0f1faa94-2f96-4bc5-9a32-f664e5397297 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:43.620594 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1ded9fca-837d-4369-b494-127e4069f113 req-0f1faa94-2f96-4bc5-9a32-f664e5397297 service nova] Creating event network-changed:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h2-826756-5 Aug 03 04:32:43.626100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1ded9fca-837d-4369-b494-127e4069f113 req-0f1faa94-2f96-4bc5-9a32-f664e5397297 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038241 Aug 03 04:32:43.626706 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 212/447] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:43.632012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.632916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:43.641352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:43.641862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:43.642637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:43.643072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:43.838647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.848945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d456ba4a-bb7f-45b5-875a-5f149d9a068d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.221054 Aug 03 04:32:43.849902 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 213/448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:43.866843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.867454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:43.922104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.929689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.931389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.932625 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-364885a2-a484-4b1d-b4cf-3335cd761f05 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1262 microversion: 2.25 time: 0.081662 Aug 03 04:32:43.933984 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 214/449] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:43.939010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1aa3a21a-9543-4d49-8222-a8a0721612cc tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Calling method '.version_select at 0x7fdd55012790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.940039 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:43.940039 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:43.945919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1aa3a21a-9543-4d49-8222-a8a0721612cc tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1aa3a21a-9543-4d49-8222-a8a0721612cc tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:43.947576 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'nonexistent_hostname'} Aug 03 04:32:43.951160 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.952039 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.953596 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.956796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1aa3a21a-9543-4d49-8222-a8a0721612cc tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:43.958039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1aa3a21a-9543-4d49-8222-a8a0721612cc tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022824 Aug 03 04:32:43.958596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 215/450] 10.222.0.72 () {58 vars in 1191 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:43.969004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b2fd134-383b-4a26-b51e-a260282f7a49 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Calling method '.version_select at 0x7fdd54f6f9d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.969797 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:43.969797 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:43.973027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b2fd134-383b-4a26-b51e-a260282f7a49 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b2fd134-383b-4a26-b51e-a260282f7a49 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/n-d-826756-5/shutdown HTTP/1.1 Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:43.974537 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'n-d-826756-5'} Aug 03 04:32:43.976038 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:43.977237 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 03 04:32:43.978626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:43.980732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b2fd134-383b-4a26-b51e-a260282f7a49 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:43.980732 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b2fd134-383b-4a26-b51e-a260282f7a49 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-d-826756-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011815 Aug 03 04:32:43.980732 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 216/451] 10.222.0.72 () {58 vars in 1194 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/os-hosts/n-d-826756-5/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:32:43.987985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a39f648-13f1-4e95-a1c5-7a1e08a34f13 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Calling method '.version_select at 0x7fdd55012790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:43.997425 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-5a39f648-13f1-4e95-a1c5-7a1e08a34f13 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a39f648-13f1-4e95-a1c5-7a1e08a34f13 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:32:43.999110 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'nonexistent_hostname'} Aug 03 04:32:44.000646 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:44.001576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 04:32:44.002689 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a39f648-13f1-4e95-a1c5-7a1e08a34f13 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a39f648-13f1-4e95-a1c5-7a1e08a34f13 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.016327 Aug 03 04:32:44.003695 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 217/452] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:32:43 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:32:44.009597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c58f358-4e11-4e27-9f36-85333a1848eb tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Calling method '.version_select at 0x7fdd5527e700>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:44.010376 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:44.010376 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:32:44.011712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c58f358-4e11-4e27-9f36-85333a1848eb tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c58f358-4e11-4e27-9f36-85333a1848eb tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hosts/n-d-826756-5/startup HTTP/1.1 Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:32:44.013237 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'n-d-826756-5'} Aug 03 04:32:44.021676 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:44.023166 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 03 04:32:44.024459 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.025564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c58f358-4e11-4e27-9f36-85333a1848eb tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.025564 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c58f358-4e11-4e27-9f36-85333a1848eb tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-d-826756-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.008553 Aug 03 04:32:44.025564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 218/453] 10.222.0.72 () {58 vars in 1191 bytes} [Wed Aug 3 04:32:44 2022] GET /compute/v2.1/os-hosts/n-d-826756-5/startup => generated 110 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:32:44.025777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94393f62-b4e0-4e99-b038-b54a61561751 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.119021 Aug 03 04:32:44.025777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 236/454] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:32:42 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:44.033997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-155461d9-3d64-4b20-9a78-1133816d4dcb tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Calling method '.version_select at 0x7fdd5513e670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:44.034861 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:44.034861 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:44.035488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b80f4688-449a-43a1-a446-a0eec279256b tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] Action: 'create', calling method: .version_select at 0x7fdd5527e550>, body: {"security_group": {"name": "tempest-securitygroup-1149562068", "description": "tempest-description-2142317272"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.044167 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-155461d9-3d64-4b20-9a78-1133816d4dcb tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-155461d9-3d64-4b20-9a78-1133816d4dcb tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:44.045967 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'nonexistent_hostname'} Aug 03 04:32:44.048382 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:44.049542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 03 04:32:44.050965 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-155461d9-3d64-4b20-9a78-1133816d4dcb tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-155461d9-3d64-4b20-9a78-1133816d4dcb tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017334 Aug 03 04:32:44.054908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 237/455] 10.222.0.72 () {58 vars in 1215 bytes} [Wed Aug 3 04:32:44 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:44.062592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59ce6e76-511b-47f0-8543-53401a27d06d tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Action: 'update', calling method: .version_select at 0x7fdd5506aa60>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59ce6e76-511b-47f0-8543-53401a27d06d tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-hosts/n-d-826756-5 HTTP/1.1 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 51 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:44.066522 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: {"status": "enable", "maintenance_mode": "invalid"} Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.068457 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'n-d-826756-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance: Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.069357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.071035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59ce6e76-511b-47f0-8543-53401a27d06d tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-59ce6e76-511b-47f0-8543-53401a27d06d tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-hosts/n-d-826756-5" status: 400 len: 199 microversion: 2.1 time: 0.009039 Aug 03 04:32:44.072626 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 238/456] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-826756-5 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:32:44.078458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d48ba88-0144-4764-81f2-b53bbd59f176 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Action: 'update', calling method: .version_select at 0x7fdd5506aa60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d48ba88-0144-4764-81f2-b53bbd59f176 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-hosts/n-d-826756-5 HTTP/1.1 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 51 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:44.081716 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: {"status": "invalid", "maintenance_mode": "enable"} Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.083318 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'n-d-826756-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance: Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.084248 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.086037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d48ba88-0144-4764-81f2-b53bbd59f176 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d48ba88-0144-4764-81f2-b53bbd59f176 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-hosts/n-d-826756-5" status: 400 len: 189 microversion: 2.1 time: 0.009401 Aug 03 04:32:44.087367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 239/457] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-826756-5 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:32:44.093424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3db9eca7-cca9-41c6-b8d7-4bc5f88347d7 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Action: 'update', calling method: .version_select at 0x7fdd55116310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.095820 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:32:44.095820 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:32:44.096946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3db9eca7-cca9-41c6-b8d7-4bc5f88347d7 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e939f948de3048cca850a2fda4ffe226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8fee2530cd4fde94550e92704b2aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3db9eca7-cca9-41c6-b8d7-4bc5f88347d7 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Request method failure captured: Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-hosts/n-d-826756-5 HTTP/1.1 Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 50 Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpmZE0EQOWzvTcRGxS_-ce8IEHE8NE9Al4-A5PWHP1COc-gLzR7FgwRQiWvbOlsGX3HCAA7xeoHaUAe211ltCJsBjyE9VWeLMYn_X_VyEWTSwb-88fUR8DuUJZyUCkK51HkxEtiPNo8DYfw47MrXILW1M6kxYemU9Yt4PoP85Qbmbc Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:32:44.098570 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ed8fee2530cd4fde94550e92704b2aad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: ed8fee2530cd4fde94550e92704b2aad Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1893299477 Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e939f948de3048cca850a2fda4ffe226 Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1893299477-project Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: {"status": "enable", "maintenance_mode": "enable"} Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 04:32:44.102014 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'n-d-826756-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:44.103038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 03 04:32:44.104168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.106262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3db9eca7-cca9-41c6-b8d7-4bc5f88347d7 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.106262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3db9eca7-cca9-41c6-b8d7-4bc5f88347d7 tempest-HostsAdminNegativeTestJSON-1893299477 tempest-HostsAdminNegativeTestJSON-1893299477-project] 10.222.0.72 "PUT /compute/v2.1/os-hosts/n-d-826756-5" status: 403 len: 111 microversion: 2.1 time: 0.011461 Aug 03 04:32:44.106262 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 240/458] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-826756-5 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:44.110401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96f7f352-5ec0-4e49-bbb4-c22dfc179a0e tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Action: 'update', calling method: .version_select at 0x7fdd551db040>, body: {"status": null, "maintenance_mode": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96f7f352-5ec0-4e49-bbb4-c22dfc179a0e tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-hosts/n-d-826756-5 HTTP/1.1 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 42 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:44.113899 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: {"status": null, "maintenance_mode": null} Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 04:32:44.115448 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'n-d-826756-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'disable', Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Enable', Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'Disable', Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance: Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi None Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.116493 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.118183 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96f7f352-5ec0-4e49-bbb4-c22dfc179a0e tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96f7f352-5ec0-4e49-bbb4-c22dfc179a0e tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-hosts/n-d-826756-5" status: 400 len: 127 microversion: 2.1 time: 0.008817 Aug 03 04:32:44.119563 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 241/459] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:32:44 2022] PUT /compute/v2.1/os-hosts/n-d-826756-5 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:32:44.123618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Action: 'update', calling method: .version_select at 0x7fdd5513e9d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.126589 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.hosts [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Enabling host nonexistent_hostname. Aug 03 04:32:44.134808 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Request method failure captured: Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 50 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpowZnPQKj8x3BdBzGzDP6u81Z3ttoh2XodFMijt3kWtrAHSRoFYhM7huMPmsOAY5d4QBK95iRUac4YsWVBES8bNOFz6AtaG4KwkfWy1nyxCU2mh44VOxpcsrGnzz1zyqtb6k-VCEIcBciZ0oGFGiWBz_oa1BoYXofJbCxlqLNuRow Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:44.136770 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7469ccde204f41f28e58c909f5a7c1f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7469ccde204f41f28e58c909f5a7c1f3 Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-239820201 Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d7d9ab5d68a94de781471beda5e30457 Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HostsAdminNegativeTestJSON-239820201-project-admin Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: {"status": "enable", "maintenance_mode": "enable"} Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.142133 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5940, in targeted Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 03 04:32:44.143056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:44.144320 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:44.145790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:44.147336 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c4fd4a9d-33a2-4474-9f2b-dfb83c497101 tempest-HostsAdminNegativeTestJSON-239820201 tempest-HostsAdminNegativeTestJSON-239820201-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017910 Aug 03 04:32:44.147336 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 242/460] 10.222.0.72 () {60 vars in 1211 bytes} [Wed Aug 3 04:32:44 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:32:44.147336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:44.147336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:44.150180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.150633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.151981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.152589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.338928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:44.347457 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5bc1ad87-2b2f-4d3d-89cc-ce9832fbdd4a tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.207870 Aug 03 04:32:44.348023 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 243/461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:44 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:44.352520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:44.353270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:44.359168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.359623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.360409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.360849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.421205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:44.428610 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7cc7bf0-e112-4f94-9756-51577e05307b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1224 microversion: 2.1 time: 0.079528 Aug 03 04:32:44.429280 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 244/462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:44 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:44.601122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:44.601916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:44.608655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.611166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.611166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:44.611166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:44.612134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b80f4688-449a-43a1-a446-a0eec279256b tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.580756 Aug 03 04:32:44.612779 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 219/463] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:32:44 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:44.678607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f9641f1-00d3-4301-be0c-3c91a7224cd8 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] Action: 'create', calling method: .version_select at 0x7fdd551f98b0>, body: {"security_group": {"name": "tempest-securitygroup-491330290", "description": "tempest-description-549130428"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:44.764404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:44.773326 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25f32547-41f6-4f08-8531-ca13c78396b6 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1521 microversion: 2.1 time: 0.176106 Aug 03 04:32:44.774008 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 245/464] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:44 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:32:44.795445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da1f6373-8970-4bb3-ab61-19d2afc8fd8f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'create', calling method: .version_select at 0x7fdd55116c10>, body: {"pool": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:45.783195 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f9641f1-00d3-4301-be0c-3c91a7224cd8 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.161256 Aug 03 04:32:45.790890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 220/465] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:32:44 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:45.790890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:45.790890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:45.797366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:45.801195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:45.801195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:45.801195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.060566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.068108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-404ea3c9-be29-49df-ada4-91dd6d8e5038 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.282923 Aug 03 04:32:46.068935 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 221/466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:45 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:46.073534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:46.074141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:46.080727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.081210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.081985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.082422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.088485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:46.182971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.193192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.195050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.196215 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ff39d28-5879-4aaf-86ec-456f872558c2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1314 microversion: 2.25 time: 0.126355 Aug 03 04:32:46.196823 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 222/467] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:46 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1314 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:46.202069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:46.206591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:46.209471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.209935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.210798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.211239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.743732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.783166 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4988b77-cc76-48e9-915a-442b5c316d88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.569221 Aug 03 04:32:46.783924 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 223/468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:46 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:46.794701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:46.799449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:46.809485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.810453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.811500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:46.812307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:46.919645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:46.929731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66f0cf70-9818-4112-8bd6-9ab7c77870ab tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1272 microversion: 2.1 time: 0.139862 Aug 03 04:32:46.940561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 224/469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:46 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:46.940561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-067ef090-522c-4f25-8d4d-3630817ae426 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] Action: 'create', calling method: .version_select at 0x7fdd55007b80>, body: {"security_group": {"name": "tempest-securitygroup-303926909", "description": "tempest-description-1110966786"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:47.754428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-067ef090-522c-4f25-8d4d-3630817ae426 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.822912 Aug 03 04:32:47.755196 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 225/470] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:32:46 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:47.760144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:47.761271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:47.771767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:47.772234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:47.773046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:47.774000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:48.152251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:48.171550 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2b770d55-dfdb-4db5-8e4e-58a3ba04c3b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.414865 Aug 03 04:32:48.172650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 226/471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:47 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:48.181136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0717b0bd-8310-495e-bd61-a561e65a9b79 req-8101a3db-0e64-4bbb-982c-c7168afa93cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4286636-fbef-4e9a-acda-a62102b67d64", "name": "network-vif-plugged", "status": "completed", "tag": "5f8dfe05-515e-4b8b-a8e1-e2d5749ce304"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:48.201966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da1f6373-8970-4bb3-ab61-19d2afc8fd8f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.410280 Aug 03 04:32:48.203392 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 246/472] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:32:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:32:48.209454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:48.211200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:48.215634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0717b0bd-8310-495e-bd61-a561e65a9b79 req-8101a3db-0e64-4bbb-982c-c7168afa93cb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:48.216014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0717b0bd-8310-495e-bd61-a561e65a9b79 req-8101a3db-0e64-4bbb-982c-c7168afa93cb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:48.238135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:48.250887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:48.250887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:48.250887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:48.263494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0717b0bd-8310-495e-bd61-a561e65a9b79 req-8101a3db-0e64-4bbb-982c-c7168afa93cb service nova] Creating event network-vif-plugged:5f8dfe05-515e-4b8b-a8e1-e2d5749ce304 for instance c4286636-fbef-4e9a-acda-a62102b67d64 on n-h1-826756-5 Aug 03 04:32:48.275277 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0717b0bd-8310-495e-bd61-a561e65a9b79 req-8101a3db-0e64-4bbb-982c-c7168afa93cb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101248 Aug 03 04:32:48.277128 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 227/473] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:48.303584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fbcced78-34d3-419d-8245-683e2fa412c0 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] Calling method '.version_select at 0x7fdd553b0700>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:48.741697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:48.756560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:48.759221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:48.760662 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e94c3630-782e-4f87-bcd7-dda0b5453a15 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.556145 Aug 03 04:32:48.762251 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 247/474] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:48 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:48.768935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:48.769808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:48.777769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:48.778903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:48.779900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:48.781178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:49.120588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:49.130231 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b26b6653-62f6-4883-88bc-22dcba483d28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1322 microversion: 2.1 time: 0.365878 Aug 03 04:32:49.130935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 248/475] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:48 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:49.137588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:49.142729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:49.145302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:49.145760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:49.146540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:49.147148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:49.411566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:49.421448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-877f8069-2fc3-4f73-adfb-360b7dc85a37 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1278 microversion: 2.1 time: 0.289249 Aug 03 04:32:49.422710 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 249/476] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:49 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:49.435675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2119884515", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:49.500074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] validate_networks() for [('dfce1ef6-7388-4fd6-b6ff-60d5a043bace', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:50.188170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:50.188680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:50.189158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:50.189566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:50.190009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:50.198784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.199222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.200019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.200493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.217745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Getting quotas for project 7047317821904de5a740f4732994a9b0. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:50.222308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Getting quotas for user db179c437f284920b453883cc24ecbf5 and project 7047317821904de5a740f4732994a9b0. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:50.235389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:50.237573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:50.403573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72de1761-7526-4da9-8d24-26c41ee15ad4 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979536 Aug 03 04:32:50.404257 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 250/477] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:50.408694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-505e28b4-ef2a-4bdc-8f89-fe2d28160505 req-da032b8e-e0c3-4b0f-832f-15e9df161c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b7e1fa-9f95-45d4-b085-db34072d201f", "tag": "03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:50.420035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-505e28b4-ef2a-4bdc-8f89-fe2d28160505 req-da032b8e-e0c3-4b0f-832f-15e9df161c4f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.422406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-505e28b4-ef2a-4bdc-8f89-fe2d28160505 req-da032b8e-e0c3-4b0f-832f-15e9df161c4f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.436763 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-505e28b4-ef2a-4bdc-8f89-fe2d28160505 req-da032b8e-e0c3-4b0f-832f-15e9df161c4f service nova] Creating event network-changed:03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021 for instance f3b7e1fa-9f95-45d4-b085-db34072d201f on n-h2-826756-5 Aug 03 04:32:50.442652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-505e28b4-ef2a-4bdc-8f89-fe2d28160505 req-da032b8e-e0c3-4b0f-832f-15e9df161c4f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037145 Aug 03 04:32:50.443401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 251/478] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:50.450213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:50.450965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:50.458125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.458584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.459370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.459911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.476393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:50.650699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:50.658968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-800e73f3-d4c5-4d08-b57b-412c1fe1502b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.213929 Aug 03 04:32:50.659592 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 252/479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:50 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:50.803678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21f658e6-2625-4805-8e16-a63a20c3a372 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd551baa60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:50.866282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:50.880024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21f658e6-2625-4805-8e16-a63a20c3a372 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f" status: 200 len: 371 microversion: 2.1 time: 0.219384 Aug 03 04:32:50.880639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 253/480] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:32:50 2022] GET /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f => generated 371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:50.891383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:50.892000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:50.898500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.899154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:50.902890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:50.902890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.083401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.091624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.093445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.094553 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b2a62ce-a448-471d-82a7-2478ee6f710d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.212996 Aug 03 04:32:51.095427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 254/481] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:50 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:51.099740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.100364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:51.107467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.107941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.109108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.109226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.136847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fbcced78-34d3-419d-8245-683e2fa412c0 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] 10.222.0.72 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10367 microversion: 2.1 time: 2.847842 Aug 03 04:32:51.137530 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 228/482] 10.222.0.72 () {58 vars in 1191 bytes} [Wed Aug 3 04:32:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10367 bytes in 2860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:32:51.142267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2f574499-6c8e-4129-9007-03ff384e2ffb req-2d259ffe-ca8d-454c-8888-c5083af414f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "name": "network-vif-plugged", "status": "completed", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:51.152539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2f574499-6c8e-4129-9007-03ff384e2ffb req-2d259ffe-ca8d-454c-8888-c5083af414f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.154709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2f574499-6c8e-4129-9007-03ff384e2ffb req-2d259ffe-ca8d-454c-8888-c5083af414f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.164465 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2f574499-6c8e-4129-9007-03ff384e2ffb req-2d259ffe-ca8d-454c-8888-c5083af414f4 service nova] Creating event network-vif-plugged:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h2-826756-5 Aug 03 04:32:51.169898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2f574499-6c8e-4129-9007-03ff384e2ffb req-2d259ffe-ca8d-454c-8888-c5083af414f4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 Aug 03 04:32:51.170993 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 229/483] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:51.175691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dadca03c-748a-4b49-9813-80598047fe43 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.176451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dadca03c-748a-4b49-9813-80598047fe43 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:51.272467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dadca03c-748a-4b49-9813-80598047fe43 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.280577 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dadca03c-748a-4b49-9813-80598047fe43 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1224 microversion: 2.1 time: 0.108475 Aug 03 04:32:51.281369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 230/484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:51.288385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.290232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:51.297937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.298607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.299556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.299994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.346855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.355224 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-beb8a23a-e6fe-4fea-a788-ff0a3d3eba40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1472 microversion: 2.1 time: 0.257969 Aug 03 04:32:51.355935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 255/485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:51.360939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Action: 'update', calling method: .version_select at 0x7fdd550dcdc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:51.431621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.432230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.433186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.433629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.547989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:51.556701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64e3fb0e-b76b-4ba9-9a27-0f595ec5ecc8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.273997 Aug 03 04:32:51.558003 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 231/486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:51.563113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7988415c-9811-48d7-a817-269900eee99c tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] Calling method '.version_select at 0x7fdd551f9940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.594283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2efbabd-2e3b-449a-a4a0-1c0602149fc8 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f" status: 200 len: 328 microversion: 2.1 time: 0.236999 Aug 03 04:32:51.595321 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 256/487] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:32:51 2022] PUT /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f => generated 328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:51.730927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:51.731573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] [instance: 9e4adebf-1a87-4421-8dde-a574ef8e4383] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:51.738276 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] HTTP exception thrown: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Request method failure captured: Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/9e4adebf-1a87-4421-8dde-a574ef8e4383/action HTTP/1.1 Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpdJxgMGxAlp0StMfynJMlmx61DfqNhAVpNe4tlLs_vYREMwOtQs-pK_aCNKgp2bs0QZSPfg1Mt-59GFhzos3UbbBzWF_OXoWfuD8_ABG4BaqapksVvdTufwrEt63FOqMzePh6X2HS-ES3egoOXcClpm1qIVUr83w1D7Lb90Ht8ZKA Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:32:51.740162 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 9eaf5ae4e05c4004b453c960804cb4ed Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: {"migrate": {}} Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:32:51.741698 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9e4adebf-1a87-4421-8dde-a574ef8e4383', 'body': {'migrate': {}}} Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:32:51.742672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. Aug 03 04:32:51.744001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:32:51.746143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Returning 404 to user: Instance 9e4adebf-1a87-4421-8dde-a574ef8e4383 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:32:51.746143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f1e402b-ec7b-437b-b7e9-512c5d1638f4 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/9e4adebf-1a87-4421-8dde-a574ef8e4383/action" status: 404 len: 111 microversion: 2.1 time: 0.145085 Aug 03 04:32:51.748499 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 257/488] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:32:51 2022] POST /compute/v2.1/servers/9e4adebf-1a87-4421-8dde-a574ef8e4383/action => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:32:51.753871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d13ff07a-3b0d-45b5-afb7-286a44f53823 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.852993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d13ff07a-3b0d-45b5-afb7-286a44f53823 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f" status: 202 len: 0 microversion: 2.1 time: 0.102978 Aug 03 04:32:51.854006 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 258/489] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:32:51 2022] DELETE /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:51.859381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:51.860185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:51.868966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.869485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.871197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:51.871660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:51.900097 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7988415c-9811-48d7-a817-269900eee99c tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.337689 Aug 03 04:32:51.900097 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 232/490] 10.222.0.72 () {58 vars in 1191 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:51.904760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a565de48-2b62-4bbf-a216-8328e3cf86bf tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd54fb43a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:52.010266 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a565de48-2b62-4bbf-a216-8328e3cf86bf tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f" status: 200 len: 371 microversion: 2.1 time: 0.111549 Aug 03 04:32:52.019039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 233/491] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/os-quota-sets/63cad3afe74044299697bfdb94fd212f => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:52.019039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-273219178", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:52.097856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:32:52.124586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:52.126187 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-842d5559-1e00-41f1-a59d-09cf9ca507f0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1313 microversion: 2.1 time: 0.270626 Aug 03 04:32:52.126788 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 259/492] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:51 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:52.131836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3438840-b018-491c-90c6-18ba74339793 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] Calling method '.version_select at 0x7fdd550b3a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:52.505541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:32:52.506088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:32:52.506569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:32:52.507031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:32:52.507559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:32:52.516546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.517206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.518020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.519082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.538942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Getting quotas for project 6a69d52385ae419bb21cca6ccf60344e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:32:52.544455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Getting quotas for user 2a83f5aee35a414aa84dedde4e729347 and project 6a69d52385ae419bb21cca6ccf60344e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:32:52.556704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:32:52.561395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:32:52.589951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:52.656954 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3438840-b018-491c-90c6-18ba74339793 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/47abebfb-e186-44ea-9764-8ec3fa5b041d" status: 202 len: 0 microversion: 2.1 time: 0.528706 Aug 03 04:32:52.658106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 260/493] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:32:52 2022] DELETE /compute/v2.1/os-security-groups/47abebfb-e186-44ea-9764-8ec3fa5b041d => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:52.663552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:52.664441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:52.671180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.671695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.672730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.673242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.742634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7aaae012-5429-4dc3-af9d-1e6b6402fb28 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729310 Aug 03 04:32:52.747848 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 234/494] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:32:52.759765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:52.762990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:52.772431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.773268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.774247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:52.774857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:52.910633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:52.922690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2491efaa-cdfd-41e5-94ce-b8b2b0483881 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1284 microversion: 2.1 time: 0.172773 Aug 03 04:32:52.923972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 235/495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:52 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:52.943061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9448c7d-46ed-48f8-87c3-d9a633ad7f89 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd54f6fd30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:53.009731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.020101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.021488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.022607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-791a166b-047b-449b-98b9-5d939f86c110 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.363317 Aug 03 04:32:53.049150 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 261/496] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:52 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:53.064018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:53.069797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:53.078508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:53.079191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:53.080329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:53.080917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:53.204586 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9448c7d-46ed-48f8-87c3-d9a633ad7f89 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.272872 Aug 03 04:32:53.205271 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 236/497] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:32:52 2022] GET /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a/defaults => generated 371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:53.209788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-876eff8d-5087-40fd-bdd4-a83b67addff0 req-08804fb0-d4f3-4444-82c3-b2ea0e863d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "702edda0-8ebc-4784-8a7b-41613ae38bb1", "tag": "a922d2f9-900e-49a2-9acb-07e7df335258"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:53.222610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-876eff8d-5087-40fd-bdd4-a83b67addff0 req-08804fb0-d4f3-4444-82c3-b2ea0e863d17 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:53.223330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-876eff8d-5087-40fd-bdd4-a83b67addff0 req-08804fb0-d4f3-4444-82c3-b2ea0e863d17 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:53.235939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-876eff8d-5087-40fd-bdd4-a83b67addff0 req-08804fb0-d4f3-4444-82c3-b2ea0e863d17 service nova] Creating event network-changed:a922d2f9-900e-49a2-9acb-07e7df335258 for instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 on n-h2-826756-5 Aug 03 04:32:53.241745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-876eff8d-5087-40fd-bdd4-a83b67addff0 req-08804fb0-d4f3-4444-82c3-b2ea0e863d17 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035121 Aug 03 04:32:53.243028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 237/498] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:53.249848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ac4906b-2f43-4770-aba8-e1428b7a93f8 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] Calling method '.version_select at 0x7fdd5527ee50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:53.352698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.360919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba13d93b-784d-48b2-9778-98c031a4f064 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.300609 Aug 03 04:32:53.361507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 262/499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:53 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:53.367000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-777a4216-9c75-46df-bef7-d95f3be9e88b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:53.367809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-777a4216-9c75-46df-bef7-d95f3be9e88b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:53.468790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-777a4216-9c75-46df-bef7-d95f3be9e88b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.474812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=29 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:53.476543 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-777a4216-9c75-46df-bef7-d95f3be9e88b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1221 microversion: 2.1 time: 0.114056 Aug 03 04:32:53.477119 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 263/500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:53 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1221 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:53.482415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:53.483230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:53.490612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:53.491475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:53.492706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:53.493561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:53.851254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:53.861058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b44c35ac-c6e7-44ce-a13b-573dc8054003 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1463 microversion: 2.1 time: 0.382238 Aug 03 04:32:53.861726 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 264/501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:53 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1463 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:53.866309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Action: 'update', calling method: .version_select at 0x7fdd551baee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:54.009883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.010408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.011276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.011839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.133473 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-abb48fdf-0303-4312-a90f-81be9f43fb0c tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157" status: 200 len: 328 microversion: 2.1 time: 0.270604 Aug 03 04:32:54.134428 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 265/502] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:32:53 2022] PUT /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157 => generated 328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:54.136657 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ac4906b-2f43-4770-aba8-e1428b7a93f8 tempest-SecurityGroupsTestAdminJSON-1473499270 tempest-SecurityGroupsTestAdminJSON-1473499270-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/184c4956-a3e0-4252-a604-4e656891f8ba" status: 202 len: 0 microversion: 2.1 time: 0.891815 Aug 03 04:32:54.139808 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 238/503] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:32:53 2022] DELETE /compute/v2.1/os-security-groups/184c4956-a3e0-4252-a604-4e656891f8ba => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:54.154249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.155543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:54.162261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.163054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.164768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.165547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.314828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:54.328156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.331340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9698389e-eeeb-4cea-b66a-4378c42d997a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1282 microversion: 2.1 time: 0.181880 Aug 03 04:32:54.331340 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 239/504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:54 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:54.332309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:54.342020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.343673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:54.354452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.354851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.355936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.356584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.358454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.358919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.364570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.365031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.639745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:54.647694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:54.649210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:54.650513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47c84309-74ca-401f-a29d-9ba9bbcb4aeb tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.320111 Aug 03 04:32:54.651535 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 240/505] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:54 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:54.656065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd551f9e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.726530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.727073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.728070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.728537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.753908 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ce8566b-a427-40ee-b55f-707b136450a5 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157/detail" status: 200 len: 916 microversion: 2.1 time: 0.101178 Aug 03 04:32:54.755218 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 241/506] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:32:54 2022] GET /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157/detail => generated 916 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:54.767171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6a4bead-b918-4bc0-a2f8-20f90401d539 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] Calling method '.version_select at 0x7fdd54fb4310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.956770 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15981097-b7cb-462c-8b5e-559dd2422634 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1614 microversion: 2.1 time: 0.808886 Aug 03 04:32:54.956770 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 266/507] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:54 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1614 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:54.957601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:54.962329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:54.975216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.976034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:54.977208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:54.978027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.231567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:55.239928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40335db5-a86b-44c8-a9a7-8056692dcbe1 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.290719 Aug 03 04:32:55.240528 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 267/508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:54 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:55.245227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:55.245912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:55.252145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.252635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.253591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.254206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.363690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6a4bead-b918-4bc0-a2f8-20f90401d539 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/c8772048-0a94-4ed4-a7cb-6d984d4373cd" status: 202 len: 0 microversion: 2.1 time: 0.606724 Aug 03 04:32:55.364600 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 242/509] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:32:54 2022] DELETE /compute/v2.1/os-security-groups/c8772048-0a94-4ed4-a7cb-6d984d4373cd => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:55.367974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:55.370273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4e6d598b-a795-451e-8478-0b5e6f6e9673 req-d47d1c73-bda4-46b9-bf3b-0038514b67d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b7e1fa-9f95-45d4-b085-db34072d201f", "name": "network-vif-plugged", "status": "completed", "tag": "03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:55.376773 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e25b7dad-04ce-4624-b742-36b07c0c5e88 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1281 microversion: 2.1 time: 0.134649 Aug 03 04:32:55.377373 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 268/510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:55 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:55.391086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e6d598b-a795-451e-8478-0b5e6f6e9673 req-d47d1c73-bda4-46b9-bf3b-0038514b67d7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.392060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e6d598b-a795-451e-8478-0b5e6f6e9673 req-d47d1c73-bda4-46b9-bf3b-0038514b67d7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.393541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:55.395510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:55.403710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.404169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.405378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.406206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.409359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4e6d598b-a795-451e-8478-0b5e6f6e9673 req-d47d1c73-bda4-46b9-bf3b-0038514b67d7 service nova] Creating event network-vif-plugged:03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021 for instance f3b7e1fa-9f95-45d4-b085-db34072d201f on n-h2-826756-5 Aug 03 04:32:55.415815 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4e6d598b-a795-451e-8478-0b5e6f6e9673 req-d47d1c73-bda4-46b9-bf3b-0038514b67d7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048841 Aug 03 04:32:55.417606 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 243/511] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:55.427355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Action: 'update', calling method: .version_select at 0x7fdd55012670>, body: {"quota_set": {"ram": "2048"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:55.512222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.513025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.513918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0df99a4af46b47128869ba41accf575b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9091afc74ced4a8ea0d6d36df10744f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:55.514171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.514511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] flavor_id is None. Assuming migration. {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 04:32:55.514946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 04:32:55.515083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.567373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.573446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.573446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.573446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.718764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c53b05a-135d-4064-95ac-09f9bfabb57d tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157?user_id=8e9c61e459fa4b7e887841771e3ff369" status: 200 len: 328 microversion: 2.1 time: 0.299472 Aug 03 04:32:55.720056 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 244/512] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:32:55 2022] PUT /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157?user_id=8e9c61e459fa4b7e887841771e3ff369 => generated 328 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:55.725903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:55.727202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:55.734651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.735006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.735993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:55.737209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:55.899778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:55.907609 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6ac6f1d-5111-43ca-bf6a-02f003bee1c5 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.186110 Aug 03 04:32:55.908191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 245/513] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:55 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:55.912871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1eca8ed-187c-4808-98cd-36be714aff40 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] Calling method '.version_select at 0x7fdd54fb49d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:56.102165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-058b0fe7-8ccb-4506-ac21-50f6f198590d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7/action" status: 202 len: 0 microversion: 2.1 time: 0.723408 Aug 03 04:32:56.103483 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 269/514] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:32:55 2022] POST /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:56.111268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:56.112318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:56.125810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.126661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:56.140257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.140257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:56.574306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:56.582645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:56.584185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:56.585313 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-467e4e2f-d7e9-4e7e-8b67-b350f5d4372a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.479371 Aug 03 04:32:56.590672 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 270/515] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:56 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:56.595767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7a84f78-9e15-44db-a96e-12e0f4b1e75a tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd551dc3a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:56.728803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7a84f78-9e15-44db-a96e-12e0f4b1e75a tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157?user_id=8e9c61e459fa4b7e887841771e3ff369" status: 200 len: 370 microversion: 2.1 time: 0.141265 Aug 03 04:32:56.737030 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 271/516] 10.222.0.72 () {58 vars in 1323 bytes} [Wed Aug 3 04:32:56 2022] GET /compute/v2.1/os-quota-sets/5d2401041507448fb3a8dd90c9408157?user_id=8e9c61e459fa4b7e887841771e3ff369 => generated 370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:56.743029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:56.743651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:56.751628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.752079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:56.752934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.753540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:56.902222 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1eca8ed-187c-4808-98cd-36be714aff40 tempest-SecurityGroupsTestAdminJSON-1561756193 tempest-SecurityGroupsTestAdminJSON-1561756193-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/8725acd2-fc0c-4532-86aa-f5cdfc3b7ae7" status: 202 len: 0 microversion: 2.1 time: 0.992868 Aug 03 04:32:56.907367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 246/517] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:32:55 2022] DELETE /compute/v2.1/os-security-groups/8725acd2-fc0c-4532-86aa-f5cdfc3b7ae7 => generated 0 bytes in 998 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:32:56.913213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:56.914917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:56.922811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.923501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:56.924650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:56.925097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:57.172211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:57.185549 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-daee11f2-0670-4c65-83c6-d1dac38382da tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1472 microversion: 2.1 time: 0.446842 Aug 03 04:32:57.186243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 272/518] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:56 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:57.190873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:57.191508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:57.198534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:57.199279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:57.200051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:57.200524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:57.374645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:57.385662 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c717193-169a-44fb-b43b-b51b54ad662c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.475852 Aug 03 04:32:57.385955 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 247/519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:56 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:57.395764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-41c21754-0bdb-4ceb-a056-0ea477b86dcf req-0586f80e-0a29-49d7-876b-fe73da5083c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a01845c-5371-4867-8e3d-44c78a03e6f0", "tag": "18677af2-8204-4b7b-9a17-29489f57a50f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:57.400562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41c21754-0bdb-4ceb-a056-0ea477b86dcf req-0586f80e-0a29-49d7-876b-fe73da5083c6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:57.401613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41c21754-0bdb-4ceb-a056-0ea477b86dcf req-0586f80e-0a29-49d7-876b-fe73da5083c6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:57.413035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-41c21754-0bdb-4ceb-a056-0ea477b86dcf req-0586f80e-0a29-49d7-876b-fe73da5083c6 service nova] Creating event network-changed:18677af2-8204-4b7b-9a17-29489f57a50f for instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 on n-h1-826756-5 Aug 03 04:32:57.423881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-41c21754-0bdb-4ceb-a056-0ea477b86dcf req-0586f80e-0a29-49d7-876b-fe73da5083c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035186 Aug 03 04:32:57.424937 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 248/520] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:57.440739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:57.442424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:57.457501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:57.459703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:57.460838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:57.461687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.014665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.024599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b567361-d38f-4c9e-b105-9e1f86866849 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.837153 Aug 03 04:32:58.025372 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 273/521] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:57 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:58.045209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:58.046049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:58.055293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.055757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.057084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.057470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.111313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.118975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9466daaa-3f65-4462-8221-c25ca1496aab tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.692910 Aug 03 04:32:58.119620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 249/522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:57 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:58.124035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1bb93449-6d3e-4cb3-b627-370fd9ecc5ba tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Calling method '.version_select at 0x7fdd54fb4280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:58.319854 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1bb93449-6d3e-4cb3-b627-370fd9ecc5ba tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.199158 Aug 03 04:32:58.328185 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 250/523] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:32:58 2022] GET /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a/defaults => generated 371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:32:58.333464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:58.334242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:58.344475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.344475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.344475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.344783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.385697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:32:58.459563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.463635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:58.474387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.477671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.479318 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb630426-eaf7-4be8-be41-0361ad012445 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1362 microversion: 2.25 time: 0.451839 Aug 03 04:32:58.480072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 274/524] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:32:58 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:32:58.485137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:58.486118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:58.497985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.498754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.499726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.500175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.837275 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b2d4d50-b232-4f61-84e3-202cb1da2848 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 204 len: 0 microversion: 2.1 time: 0.507333 Aug 03 04:32:58.838335 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 251/525] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:32:58 2022] DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:32:58.844827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54f64ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:58.862790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:58.873750 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-369280e3-5140-4cd6-a7ba-e07f87b5bddb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1472 microversion: 2.1 time: 0.392160 Aug 03 04:32:58.874391 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 275/526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:58 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:58.888721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:32:58.888721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:32:58.888721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.888721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:58.889213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:58.889213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:59.080694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:32:59.089247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e9ce446-9e15-4e28-bb22-0c5cdb2d7965 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.213829 Aug 03 04:32:59.089976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 276/527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:32:58 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:32:59.108708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1786468914", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "68407449", "adminPass": "***", "networks": [{"uuid": "5ea0b700-d5ec-4f21-8466-4e93ff23ef8d"}], "security_groups": [{"name": "tempest-securitygroup--263558803"}], "key_name": "tempest-keypair-1496059845", "user_data": "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:32:59.247489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:59.248021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:59.248778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:32:59.249210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:32:59.257085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:32:59.364204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] validate_networks() for [('5ea0b700-d5ec-4f21-8466-4e93ff23ef8d', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:00.186563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:00.186563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:00.187181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:00.187410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:00.188054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:00.198564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.199248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:00.199934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.200398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:00.226605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for project 3c3b6b7574d544aab263dcd99930197d. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:00.231690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Getting quotas for user 8091cc486ba443e7a99732617e82ee5d and project 3c3b6b7574d544aab263dcd99930197d. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:00.251370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:00.251370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:00.360621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12ad7518-956b-496c-8125-8b308b9b2caf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.265349 Aug 03 04:33:00.361970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 277/528] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:32:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:00.366425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:00.367043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:00.371217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:00.377874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.378341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:00.383082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.383082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:00.595044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:INSERT=16,nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:00.599364 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e27def80-958e-4e1a-b60e-98eb868e4c4b tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a" status: 200 len: 329 microversion: 2.1 time: 1.759458 Aug 03 04:33:00.600011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 252/529] 10.222.0.72 () {60 vars in 1263 bytes} [Wed Aug 3 04:32:58 2022] PUT /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a => generated 329 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:00.605647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:00.607232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:00.616317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.616603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:00.617589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:00.618319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.168870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.176446 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a733c483-65e5-44f8-ad80-b8804c327c48 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.813654 Aug 03 04:33:01.177153 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 278/530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:00 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:01.181818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:01.182536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:01.188308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.188971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.189562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.190586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.300575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.308108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fcf94719-ce17-42c2-816c-a2e419039c53 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.706786 Aug 03 04:33:01.308709 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 253/531] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:00 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:01.313379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-43f45d3c-c753-4ed9-bb7d-c0f32ab01ed8 req-7957661d-4466-4477-98a9-0b66158c4fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cf69cf-793e-46d1-aeb4-3cc61c50902f", "tag": "f09b6efe-e7cf-4ded-bfb1-7af36ca439f8"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:01.323472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-43f45d3c-c753-4ed9-bb7d-c0f32ab01ed8 req-7957661d-4466-4477-98a9-0b66158c4fab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.323928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-43f45d3c-c753-4ed9-bb7d-c0f32ab01ed8 req-7957661d-4466-4477-98a9-0b66158c4fab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.334481 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-43f45d3c-c753-4ed9-bb7d-c0f32ab01ed8 req-7957661d-4466-4477-98a9-0b66158c4fab service nova] Creating event network-changed:f09b6efe-e7cf-4ded-bfb1-7af36ca439f8 for instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f on n-h1-826756-5 Aug 03 04:33:01.340801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-43f45d3c-c753-4ed9-bb7d-c0f32ab01ed8 req-7957661d-4466-4477-98a9-0b66158c4fab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030923 Aug 03 04:33:01.341397 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 254/532] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:01.346693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:01.347386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:01.353875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.354415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.355387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.355828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.672709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.685893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.688686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.692037 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47f5aa45-4eee-4888-bb8c-c427cba9b458 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1557 microversion: 2.25 time: 0.513851 Aug 03 04:33:01.711760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 279/533] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:01 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1557 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:01.720285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:01.720905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:01.739095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.739561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.740378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:01.740822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:01.790488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.799201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-564b6cfe-2c8b-4a57-871e-f34408a8fef3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1472 microversion: 2.1 time: 0.456258 Aug 03 04:33:01.812549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 255/534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:01 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1472 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:01.819086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3301e5b9-7f41-4a1f-a4b3-eaf165914bcf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:01.820079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3301e5b9-7f41-4a1f-a4b3-eaf165914bcf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:01.959589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3301e5b9-7f41-4a1f-a4b3-eaf165914bcf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:01.969703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3301e5b9-7f41-4a1f-a4b3-eaf165914bcf tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1261 microversion: 2.1 time: 0.155736 Aug 03 04:33:01.970476 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 256/535] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:01 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:01.986221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d1a9bb0e-ba9e-4113-b8e6-7d606388a378 req-a25f42fb-5761-4a11-bfb6-f804760ec350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702edda0-8ebc-4784-8a7b-41613ae38bb1", "name": "network-vif-plugged", "status": "completed", "tag": "a922d2f9-900e-49a2-9acb-07e7df335258"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:02.008936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d1a9bb0e-ba9e-4113-b8e6-7d606388a378 req-a25f42fb-5761-4a11-bfb6-f804760ec350 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.023989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d1a9bb0e-ba9e-4113-b8e6-7d606388a378 req-a25f42fb-5761-4a11-bfb6-f804760ec350 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.024212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d1a9bb0e-ba9e-4113-b8e6-7d606388a378 req-a25f42fb-5761-4a11-bfb6-f804760ec350 service nova] Creating event network-vif-plugged:a922d2f9-900e-49a2-9acb-07e7df335258 for instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 on n-h2-826756-5 Aug 03 04:33:02.030403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d1a9bb0e-ba9e-4113-b8e6-7d606388a378 req-a25f42fb-5761-4a11-bfb6-f804760ec350 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057386 Aug 03 04:33:02.032504 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 257/536] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:02.039365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54fb4d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:02.121579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:02.129362 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e33c9a7-f21a-42ec-8f67-f8d35422986b tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1320 microversion: 2.1 time: 0.415293 Aug 03 04:33:02.133072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 280/537] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:01 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:02.138281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:02.142689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:02.161104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.161835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.162629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.163076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.424092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.425004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.426900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.427749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.540349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:02.554402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a7b9dc8-1762-4644-8c30-44e0232ac17a tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2050 microversion: 2.25 time: 0.420084 Aug 03 04:33:02.554976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 281/538] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:02 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2050 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:02.559707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:02.560340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:02.568285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.568772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.569721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.570316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.873423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:02.882204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d30eab4-6f5f-4421-b4f2-10998adca703 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.326159 Aug 03 04:33:02.883260 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 282/539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:02 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:02.901978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:02.911434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:02.912566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.913164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:02.914110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:02.914665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:03.490626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:03.499649 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8d9d84e-7950-4d6f-b185-63fe15dd2360 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.615152 Aug 03 04:33:03.511550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 283/540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:02 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:03.674218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1049527154", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:03.757606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:04.180814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:04.183257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:04.185783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:04.186206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:04.187732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:04.202168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.202895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.204086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.205452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.233577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:04.240588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for user 86c950308de0427ca178e91f19278d93 and project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:04.250718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:04.276353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:04.279504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:04.392523 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5aac6757-1085-4038-8f1f-6c8ae16e44e6 tempest-QuotasAdminTestJSON-1624333939 tempest-QuotasAdminTestJSON-1624333939-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a" status: 200 len: 329 microversion: 2.1 time: 2.357977 Aug 03 04:33:04.399410 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 258/541] 10.222.0.72 () {60 vars in 1263 bytes} [Wed Aug 3 04:33:02 2022] PUT /compute/v2.1/os-quota-sets/8c2f15acff90460d82b3e494f63deb7a => generated 329 bytes in 2366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:04.412238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:04.413225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:04.421289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39413b4b-1f4a-48bf-9499-c86f584a084d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908397 Aug 03 04:33:04.422288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 284/542] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:04.433761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:04.433761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:04.436904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.437828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.439627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.439885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.440395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.440831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.441367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.441817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.780601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:04.795241 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41c39f5c-7cfd-47cc-a0cb-4ef740aaa7f3 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2050 microversion: 2.25 time: 0.394662 Aug 03 04:33:04.795833 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 259/543] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:04 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2050 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:04.800845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:04.801651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:04.808857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.813369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.813369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.813369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.829641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:04.838144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-349049ad-0c78-4625-8b30-51728073ded3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.414602 Aug 03 04:33:04.839562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 285/544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:04 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:04.848535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:04.849454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:04.856671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.857211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.858068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.858590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.887803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:04.896680 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c22b57c-a63d-4eff-89f9-39e811ec9caa tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1319 microversion: 2.1 time: 0.098799 Aug 03 04:33:04.897553 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 260/545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:04 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:04.903023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-919d5fc2-937a-4641-a93e-3b4b6b663e16 req-675c9023-f349-44f5-9ac2-72e1842351c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e21669-2e7e-486a-a0cc-366c34a986b8", "name": "network-vif-deleted", "tag": "5153e1fe-1415-4303-9583-ebfa21f93a5c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:04.915525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-919d5fc2-937a-4641-a93e-3b4b6b663e16 req-675c9023-f349-44f5-9ac2-72e1842351c4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.916314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-919d5fc2-937a-4641-a93e-3b4b6b663e16 req-675c9023-f349-44f5-9ac2-72e1842351c4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.928400 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-919d5fc2-937a-4641-a93e-3b4b6b663e16 req-675c9023-f349-44f5-9ac2-72e1842351c4 service nova] Creating event network-vif-deleted:5153e1fe-1415-4303-9583-ebfa21f93a5c for instance d1e21669-2e7e-486a-a0cc-366c34a986b8 on n-h2-826756-5 Aug 03 04:33:04.933476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-919d5fc2-937a-4641-a93e-3b4b6b663e16 req-675c9023-f349-44f5-9ac2-72e1842351c4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 Aug 03 04:33:04.934774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 261/546] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:04.940028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:04.940786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:04.947611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.948149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:04.949008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:04.949442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.243825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:05.270290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:05.281577 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7bd98293-2397-4673-aec5-3dc54fa580ca tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.345400 Aug 03 04:33:05.282173 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 262/547] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:04 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:05.287565 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7820d72e-db9a-4103-bc5b-ee80400ad1e2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1469 microversion: 2.1 time: 0.446603 Aug 03 04:33:05.288810 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 286/548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:04 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1469 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:05.299962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-865b6ca2-f5a5-4606-af7b-7211ebb9accf req-000b8f22-574a-4a56-b17a-f59325ee4d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a01845c-5371-4867-8e3d-44c78a03e6f0", "name": "network-vif-plugged", "status": "completed", "tag": "18677af2-8204-4b7b-9a17-29489f57a50f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:05.308768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-143395004", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:05.310357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-865b6ca2-f5a5-4606-af7b-7211ebb9accf req-000b8f22-574a-4a56-b17a-f59325ee4d15 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.311074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-865b6ca2-f5a5-4606-af7b-7211ebb9accf req-000b8f22-574a-4a56-b17a-f59325ee4d15 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.323992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-865b6ca2-f5a5-4606-af7b-7211ebb9accf req-000b8f22-574a-4a56-b17a-f59325ee4d15 service nova] Creating event network-vif-plugged:18677af2-8204-4b7b-9a17-29489f57a50f for instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 on n-h1-826756-5 Aug 03 04:33:05.329304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-865b6ca2-f5a5-4606-af7b-7211ebb9accf req-000b8f22-574a-4a56-b17a-f59325ee4d15 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045684 Aug 03 04:33:05.330166 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 263/549] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:05.335433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:05.336133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:05.347762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.348223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.349040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.349480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.402770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:05.854340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:05.864792 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fff0b411-6de7-47b4-8c14-f49fd57ce336 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.533176 Aug 03 04:33:05.865371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 264/550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:05 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:05.870593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:05.873184 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:05.873184 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:33:05.874396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.874843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.875644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.876088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.900476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec5a9211-4ccb-4319-a846-a4dbe2e11290 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033061 Aug 03 04:33:05.900476 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 265/551] 10.222.0.72 () {60 vars in 1217 bytes} [Wed Aug 3 04:33:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:33:05.902933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:05.903355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:05.903828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:05.904239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:05.907358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:05.918014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.918465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.919364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:05.919832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:05.938545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:05.943114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for user 86c950308de0427ca178e91f19278d93 and project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:05.957397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:05.959418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:06.132753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8256f457-499c-4289-a89b-a0f92c8349d2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842386 Aug 03 04:33:06.133409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 287/552] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:06.143518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.144144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.155539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.158678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.159661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.160366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.165592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.171504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.184864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.185346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.186127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.186569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.224501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:06.387297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:06.415121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4536464b-e98e-4e21-a74a-c78810f98121 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.278051 Aug 03 04:33:06.421613 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 288/553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:06 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:06.438452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:06.441630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.450693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.453315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.455050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.456755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.498133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:06.567254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf42bd5d-bd08-4cdd-b551-3afdeb82dc74 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] 10.222.0.72 "DELETE /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 204 len: 0 microversion: 2.1 time: 0.665676 Aug 03 04:33:06.567851 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 266/554] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:05 2022] DELETE /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:06.574131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.575121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.581302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.581951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.582738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.583454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.731201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8addcc71-4f30-4491-b039-f1d001afd377 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f/action" status: 202 len: 0 microversion: 2.25 time: 0.307294 Aug 03 04:33:06.735122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 289/555] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:33:06 2022] POST /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:06.737272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f22a93ac-ceee-4dc6-b3d8-bc2d8c785485 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.738120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f22a93ac-ceee-4dc6-b3d8-bc2d8c785485 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.816547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:06.829874 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6bca32ac-8482-4f92-a4a7-e55387add43c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.260283 Aug 03 04:33:06.837058 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 267/556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:06 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:06.860262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f22a93ac-ceee-4dc6-b3d8-bc2d8c785485 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:06.860977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.863744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.872204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f22a93ac-ceee-4dc6-b3d8-bc2d8c785485 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1213 microversion: 2.1 time: 0.138887 Aug 03 04:33:06.872908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 290/557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:06 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:06.876754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.879190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:06.879315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.880036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.880506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:06.883192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.909866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.912873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:06.915112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:06.918815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.177291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:07.177438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:07.178656 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d9dea95-a617-4021-994b-687b4a71d35a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1475 microversion: 2.1 time: 0.304469 Aug 03 04:33:07.179473 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 291/558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:06 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:07.185120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:07.186216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:07.191778 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-364cb6aa-049a-4c8a-b892-69b13dfc9336 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.356585 Aug 03 04:33:07.192574 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 268/559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:06 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:07.199900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.200766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.201557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.202050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.202901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:07.203829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:07.210493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.211235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.212227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.213694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.503946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:07.507524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:07.518025 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2cf032bd-21d0-444f-ba5e-8b41731e920f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2055 microversion: 2.25 time: 0.337593 Aug 03 04:33:07.518783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 292/560] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:07 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2055 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:07.523402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-87bc71d6-e4b5-4c25-bd5e-d8bc091b494c req-fcec3207-99ff-4602-8a20-2e91600e8a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0727004b-8d20-4352-afd4-3aea23924c6d", "tag": "89a5a28d-417f-4a74-9dea-d1259ed2ca6f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:07.536644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-87bc71d6-e4b5-4c25-bd5e-d8bc091b494c req-fcec3207-99ff-4602-8a20-2e91600e8a2b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.536644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-87bc71d6-e4b5-4c25-bd5e-d8bc091b494c req-fcec3207-99ff-4602-8a20-2e91600e8a2b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.546642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-87bc71d6-e4b5-4c25-bd5e-d8bc091b494c req-fcec3207-99ff-4602-8a20-2e91600e8a2b service nova] Creating event network-changed:89a5a28d-417f-4a74-9dea-d1259ed2ca6f for instance 0727004b-8d20-4352-afd4-3aea23924c6d on n-h1-826756-5 Aug 03 04:33:07.551483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-87bc71d6-e4b5-4c25-bd5e-d8bc091b494c req-fcec3207-99ff-4602-8a20-2e91600e8a2b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031453 Aug 03 04:33:07.552070 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 293/561] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:07.557647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c71f4689-88be-4005-8a26-ca8a6b79ffc2 req-15e3881e-2434-4ded-b0d5-4a4a8bb82582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cf69cf-793e-46d1-aeb4-3cc61c50902f", "name": "network-vif-plugged", "status": "completed", "tag": "f09b6efe-e7cf-4ded-bfb1-7af36ca439f8"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:07.567119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:07.567625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c71f4689-88be-4005-8a26-ca8a6b79ffc2 req-15e3881e-2434-4ded-b0d5-4a4a8bb82582 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.567733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c71f4689-88be-4005-8a26-ca8a6b79ffc2 req-15e3881e-2434-4ded-b0d5-4a4a8bb82582 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.574977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-38230767-5017-4a02-9c9b-e61974679476 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1324 microversion: 2.1 time: 0.378066 Aug 03 04:33:07.575475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 269/562] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:07 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:07.580800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:07.581559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:07.585928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c71f4689-88be-4005-8a26-ca8a6b79ffc2 req-15e3881e-2434-4ded-b0d5-4a4a8bb82582 service nova] Creating event network-vif-plugged:f09b6efe-e7cf-4ded-bfb1-7af36ca439f8 for instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f on n-h1-826756-5 Aug 03 04:33:07.594968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c71f4689-88be-4005-8a26-ca8a6b79ffc2 req-15e3881e-2434-4ded-b0d5-4a4a8bb82582 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041279 Aug 03 04:33:07.598791 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 294/563] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:07.601961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.602149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.603007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.604626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.852105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:07.852895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:07.859499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.860129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:07.860937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:07.861368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.195919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.203686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ae18adf-ba8e-4321-9450-9167b754ef5d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.626345 Aug 03 04:33:08.204282 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 270/564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:07 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:08.218192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:08.219205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.225719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.239918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.239918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.239918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.301038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.309740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4b34eb4-a58d-43cf-8320-cd598a037b97 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1217 microversion: 2.1 time: 0.096181 Aug 03 04:33:08.310382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 271/565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:08 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:08.315185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:08.315822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.322757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.323215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.324144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.324675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.334628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.345372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-146a32a2-909f-4837-8696-4adb57944b79 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.497900 Aug 03 04:33:08.348994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 295/566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:07 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:33:08.359171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:08.360077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.363351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:08.372037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.376484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.377465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.378066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.649447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.652249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.659161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75871ea5-c143-4f21-b6f2-c838cd19c090 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1475 microversion: 2.1 time: 0.347453 Aug 03 04:33:08.659753 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 272/567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:08 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1475 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:08.664404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:08.666370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.667673 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-87146506-8be3-43b7-89de-887d67edd004 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1321 microversion: 2.1 time: 0.317585 Aug 03 04:33:08.668282 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 296/568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:08 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:08.684918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:08.685169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.685549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.686114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.687147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.689231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.696756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.697562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.698584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.699259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.888224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:08.890711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:08.898307 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3aef6941-3eae-48ba-bf58-766e495e3549 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 200 len: 1520 microversion: 2.1 time: 0.228958 Aug 03 04:33:08.898859 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 297/569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:08 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:08.902989 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c2919d67-009e-4d4e-bd84-02fafcd235da tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2055 microversion: 2.25 time: 0.241902 Aug 03 04:33:08.903560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 273/570] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:08 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2055 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:08.920686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: .version_select at 0x7fdd577a6c10>, body: {"addFloatingIp": {"address": "172.25.3.65"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:08.923150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:08.929598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.930087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:08.930977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:08.931913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:09.002869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Acquired lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:33:09.228971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:09.230020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:09.241042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:09.241042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:09.241042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:09.241042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:09.645080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:09.652948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-32f89b24-12ce-4954-9fb9-5e805f549dce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.430917 Aug 03 04:33:09.653627 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 274/571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:09 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:09.791776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-651289561", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:09.870023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:10.373600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:10.374543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:10.375456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:10.376026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:10.376797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:10.387258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.387971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:10.388950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.389545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:10.430485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Getting quotas for project 1332e38dbbae4cf9a1b5cbf86781a79d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:10.437481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Getting quotas for user 56f2008e16c54fe989a73ff8ed5d781d and project 1332e38dbbae4cf9a1b5cbf86781a79d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:10.462082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:10.470783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:10.582764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e522164d-f5c4-4333-9a4a-e33b83da9da7 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927846 Aug 03 04:33:10.584459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 275/572] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:10.593356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:10.594576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:10.607015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.607608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:10.608535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.609075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:10.923928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:10.931482 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-313a015b-0457-4d88-afee-1545cbd915b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1271 microversion: 2.1 time: 0.345638 Aug 03 04:33:10.932071 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 276/573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:10 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1271 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:10.950835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:10.951449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:10.957522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.957965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:10.958806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:10.959235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.397982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:11.397982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad16d8b7-24d6-49c2-a80d-d3b4b4fa0993 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.335171 Aug 03 04:33:11.397982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 277/574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:10 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:11.397982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:11.399034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:11.399034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:11.399034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.399034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:11.399367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.399367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:11.399367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.399367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid 702edda0-8ebc-4784-8a7b-41613ae38bb1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:11.545278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:11.557434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3d7d6d5-de76-4678-baa4-0ffa6dfdb94f tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 200 len: 1310 microversion: 2.1 time: 0.268187 Aug 03 04:33:11.561424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 278/575] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:11 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 1310 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:11.567245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:11.568911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:11.579638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:11.580309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.587931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:11.587931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:11.767610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Building network info cache for instance {{(pid=120832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:11.959189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:11.969449 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f5a7f3b3-6c52-42de-b449-460b2e64b55f tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1471 microversion: 2.1 time: 0.406358 Aug 03 04:33:11.970617 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 279/576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:11 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:11.975349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:11.981273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:12.002341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.002777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.003576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.004009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.270997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:12.289307 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7123a725-313a-4354-83f2-e674820220f7 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2035 microversion: 2.25 time: 0.317102 Aug 03 04:33:12.291518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 280/577] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:11 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2035 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:12.297114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-707d7e3a-ff3a-461a-8ac1-936001a922bc req-50d62ed6-1514-4b2f-af29-5355abbb25ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "702edda0-8ebc-4784-8a7b-41613ae38bb1", "name": "network-vif-deleted", "tag": "a922d2f9-900e-49a2-9acb-07e7df335258"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:12.307895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-707d7e3a-ff3a-461a-8ac1-936001a922bc req-50d62ed6-1514-4b2f-af29-5355abbb25ba service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.308617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-707d7e3a-ff3a-461a-8ac1-936001a922bc req-50d62ed6-1514-4b2f-af29-5355abbb25ba service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.320387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-707d7e3a-ff3a-461a-8ac1-936001a922bc req-50d62ed6-1514-4b2f-af29-5355abbb25ba service nova] Creating event network-vif-deleted:a922d2f9-900e-49a2-9acb-07e7df335258 for instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 on n-h2-826756-5 Aug 03 04:33:12.327496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-707d7e3a-ff3a-461a-8ac1-936001a922bc req-50d62ed6-1514-4b2f-af29-5355abbb25ba service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 Aug 03 04:33:12.328387 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 281/578] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:12.334475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:12.335324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:12.343410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.344117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.345080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.345871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.440826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:12.450510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dcf7d5fa-9f6b-46d5-9b47-a41fa2789fce tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1217 microversion: 2.1 time: 0.120811 Aug 03 04:33:12.451280 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 282/579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:12 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:12.456686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:12.457564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:12.464770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.465428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.466380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.467237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.714021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:12.726011 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b8e7b86a-5a2c-44fe-bcda-b0fa0830a891 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.273341 Aug 03 04:33:12.726891 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 283/580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:12 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:12.746728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:12.747552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:12.756434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.756992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.757975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:12.758572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:12.940532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Updating instance_info_cache with network_info: [{"id": "0c5cb8ed-5218-4769-8708-b3538acf0fab", "address": "fa:16:3e:78:4b:30", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c5cb8ed-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:13.001052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:13.010895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad92fded-c69a-48b3-ae2d-4eed962bcb3b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1313 microversion: 2.1 time: 0.268938 Aug 03 04:33:13.012541 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 284/581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:12 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:13.022807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:13.028325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:13.031317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.032093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.034156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.034802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.042031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Releasing lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:33:13.043555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88a9d9cd-ec49-46f5-917c-5ebff9f3b772 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action" status: 202 len: 0 microversion: 2.1 time: 4.126638 Aug 03 04:33:13.044787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 298/582] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:08 2022] POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action => generated 0 bytes in 4129 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:33:13.049757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:13.051324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:13.066949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.074572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.074572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.074572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.098787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lazy-loading 'flavor' on Instance uuid f5cf69cf-793e-46d1-aeb4-3cc61c50902f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:13.376311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:13.388169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4428c431-0b59-4f29-9d6f-95f2d2f89586 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.342054 Aug 03 04:33:13.405916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 299/583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:13 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:13.408435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-5", "block_migration": "auto"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:13.411421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:13.417935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.422008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.423111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.423593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.464596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'flavor' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:13.491104 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7339eb1-f29b-4372-81f4-298cc56a79ea tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f/action" status: 202 len: 0 microversion: 2.1 time: 0.476839 Aug 03 04:33:13.497560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Going to try to live migrate instance to n-h1-826756-5 {{(pid=120832) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:33:13.497733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 285/584] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:13 2022] POST /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:33:13.501231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:13.512531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:13.519521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.526434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.526434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.526434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.536695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 HTTP/1.1 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:13.538768 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:13.540709 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '702edda0-8ebc-4784-8a7b-41613ae38bb1'} Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:13.541716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:13.543179 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:13.544864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:13.544864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3bd8c9ae-0cc7-4344-9480-ee0c0b97b0a0 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 404 len: 111 microversion: 2.1 time: 0.046966 Aug 03 04:33:13.544864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 286/585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:13 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:13.545727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: .version_select at 0x7fdd577a7c10>, body: {"addFloatingIp": {"address": "172.25.3.65"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:13.548554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:13.555223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.556546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.557726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:13.558323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:13.680060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Acquired lock "refresh_cache-1a01845c-5371-4867-8e3d-44c78a03e6f0" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:33:15.928990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:16.624512 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.neutron [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] re-assign floating IP 172.25.3.65 from instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 Aug 03 04:33:16.639177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f183654-a6e0-4ea6-b2b3-b5799d1477cd tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f/action" status: 202 len: 0 microversion: 2.25 time: 3.236688 Aug 03 04:33:16.640664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 300/586] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:33:13 2022] POST /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f/action => generated 0 bytes in 3239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:16.645567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6c0f1a72-1e73-4ae7-a492-f53180b0019d req-80674ca9-ae1e-42a1-942c-0061d47ea636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:16.665276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6c0f1a72-1e73-4ae7-a492-f53180b0019d req-80674ca9-ae1e-42a1-942c-0061d47ea636 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:16.668190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6c0f1a72-1e73-4ae7-a492-f53180b0019d req-80674ca9-ae1e-42a1-942c-0061d47ea636 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:16.691882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6c0f1a72-1e73-4ae7-a492-f53180b0019d req-80674ca9-ae1e-42a1-942c-0061d47ea636 service nova] Creating event network-changed:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:33:16.709280 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6c0f1a72-1e73-4ae7-a492-f53180b0019d req-80674ca9-ae1e-42a1-942c-0061d47ea636 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066527 Aug 03 04:33:16.710587 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 301/587] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:16.716475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:16.718911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:16.720824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:16.732130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:16.736967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:16.741236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:16.741236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:16.868913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=33 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:17.123234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:17.137854 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93f440a3-174a-4f8f-a1d9-303ea72b4618 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1313 microversion: 2.1 time: 0.425983 Aug 03 04:33:17.139259 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 302/588] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:16 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:17.145739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:17.147040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:17.160463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:17.161546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:17.162608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:17.163263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:17.893783 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1de8c85-ebc6-42bd-9bd9-08f1d0b88e0d tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1613 microversion: 2.1 time: 0.752739 Aug 03 04:33:17.894634 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 303/589] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:17 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1613 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:17.900346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:17.901420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:17.908208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:17.908996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:17.910004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:17.910651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:17.933544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Updating instance_info_cache with network_info: [{"id": "0c5cb8ed-5218-4769-8708-b3538acf0fab", "address": "fa:16:3e:78:4b:30", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c5cb8ed-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:17.948437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:18.069044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:18.652761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:18.661650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6366e6c7-9942-4569-9ea5-cb7d7d5facb7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.765579 Aug 03 04:33:18.662937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 304/590] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:17 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:18.668745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-246835469", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:18.728821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:19.259707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:19.260141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:19.260658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:19.261200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:19.261619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:19.271332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.272788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.273626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.274067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.292215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Getting quotas for project 9cd3935f43704fa48034d787ff2672d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:19.297102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Getting quotas for user 63ce20ff6e8847589b9fef03fffe4981 and project 9cd3935f43704fa48034d787ff2672d9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:19.309914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:19.313415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:19.339989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:19.461636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Updating instance_info_cache with network_info: [{"id": "18677af2-8204-4b7b-9a17-29489f57a50f", "address": "fa:16:3e:f4:05:cf", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18677af2-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:19.465028 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c75f72f9-7516-41a7-9835-abbb17ae57b8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800702 Aug 03 04:33:19.472058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 305/591] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:19.475561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:19.476179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:19.483859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.484190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.485102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.485417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.595076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Releasing lock "refresh_cache-1a01845c-5371-4867-8e3d-44c78a03e6f0" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:33:19.596156 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-39c3c406-97a3-48d4-89e2-dff2fa581a59 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0/action" status: 202 len: 0 microversion: 2.1 time: 6.054223 Aug 03 04:33:19.600033 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 287/592] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:13 2022] POST /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0/action => generated 0 bytes in 6056 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:33:19.614196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c13c7e50-2182-4ff5-9954-121d61a6bba3 req-4f19115a-2182-4ba6-9b75-f7871fc73197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:19.627281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:19.631835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c13c7e50-2182-4ff5-9954-121d61a6bba3 req-4f19115a-2182-4ba6-9b75-f7871fc73197 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.632320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c13c7e50-2182-4ff5-9954-121d61a6bba3 req-4f19115a-2182-4ba6-9b75-f7871fc73197 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.641599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98b47cb6-b127-4ee9-8eec-fd8f6ee7af49 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1313 microversion: 2.1 time: 0.174331 Aug 03 04:33:19.642621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 306/593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:19 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:19.644885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c13c7e50-2182-4ff5-9954-121d61a6bba3 req-4f19115a-2182-4ba6-9b75-f7871fc73197 service nova] Creating event network-changed:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:33:19.650504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:19.650504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:19.651032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c13c7e50-2182-4ff5-9954-121d61a6bba3 req-4f19115a-2182-4ba6-9b75-f7871fc73197 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052278 Aug 03 04:33:19.651634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 288/594] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:19.659316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cbf6db13-9b6d-487d-a449-4e6e2a38a9f7 req-167a73d9-d5d5-4205-8bb2-9acf475f8c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0727004b-8d20-4352-afd4-3aea23924c6d", "name": "network-vif-plugged", "status": "completed", "tag": "89a5a28d-417f-4a74-9dea-d1259ed2ca6f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:19.660195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.660688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.661472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.661910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.671804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cbf6db13-9b6d-487d-a449-4e6e2a38a9f7 req-167a73d9-d5d5-4205-8bb2-9acf475f8c60 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.672249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cbf6db13-9b6d-487d-a449-4e6e2a38a9f7 req-167a73d9-d5d5-4205-8bb2-9acf475f8c60 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.684307 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cbf6db13-9b6d-487d-a449-4e6e2a38a9f7 req-167a73d9-d5d5-4205-8bb2-9acf475f8c60 service nova] Creating event network-vif-plugged:89a5a28d-417f-4a74-9dea-d1259ed2ca6f for instance 0727004b-8d20-4352-afd4-3aea23924c6d on n-h1-826756-5 Aug 03 04:33:19.689314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cbf6db13-9b6d-487d-a449-4e6e2a38a9f7 req-167a73d9-d5d5-4205-8bb2-9acf475f8c60 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Aug 03 04:33:19.689905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 289/595] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:19.701264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:19.701988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:19.708684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.709326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.710992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.711463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.862736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:19.872208 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-981d49dd-27e9-4a73-991d-4f642adfd133 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.228307 Aug 03 04:33:19.885245 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 307/596] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:19 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:19.890573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:19.892962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:19.893548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:19.900428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.900887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.901354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:19.901786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.902143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.903158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:19.905339 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44ead836-3ebf-448c-84a0-6930635c27c0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.213928 Aug 03 04:33:19.907503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 290/597] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:19 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:19.912668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:19.913523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:19.920862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.921324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.922093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.922705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.931736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] HTTP exception thrown: Cannot 'migrate' instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f while it is in vm_state suspended Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Request method failure captured: Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f/action HTTP/1.1 Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpdJxgMGxAlp0StMfynJMlmx61DfqNhAVpNe4tlLs_vYREMwOtQs-pK_aCNKgp2bs0QZSPfg1Mt-59GFhzos3UbbBzWF_OXoWfuD8_ABG4BaqapksVvdTufwrEt63FOqMzePh6X2HS-ES3egoOXcClpm1qIVUr83w1D7Lb90Ht8ZKA Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:33:19.934618 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 9eaf5ae4e05c4004b453c960804cb4ed Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: {"migrate": {}} Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:19.941193 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'migrate' instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f while it is in vm_state suspended Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f5cf69cf-793e-46d1-aeb4-3cc61c50902f', 'body': {'migrate': {}}} Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f in vm_state suspended. Cannot resize while the instance is in this state. Aug 03 04:33:19.942142 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f while it is in vm_state suspended Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:19.943640 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f while it is in vm_state suspended Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Returning 409 to user: Cannot 'migrate' instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f while it is in vm_state suspended {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ed868a0-9fd6-4053-87f2-7201f3f170a1 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f/action" status: 409 len: 148 microversion: 2.1 time: 0.048396 Aug 03 04:33:19.945175 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 308/598] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:19 2022] POST /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f/action => generated 148 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:33:19.945848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ae12a32e-0b50-4889-94ff-7b8df95f9537 req-b2464be0-9701-4d5a-b6dc-e31925363464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf967c4-8207-48e3-82f2-8eb0fbb1f32d", "tag": "9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:19.950533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ae12a32e-0b50-4889-94ff-7b8df95f9537 req-b2464be0-9701-4d5a-b6dc-e31925363464 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:19.950987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ae12a32e-0b50-4889-94ff-7b8df95f9537 req-b2464be0-9701-4d5a-b6dc-e31925363464 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:19.962910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ae12a32e-0b50-4889-94ff-7b8df95f9537 req-b2464be0-9701-4d5a-b6dc-e31925363464 service nova] Creating event network-changed:9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9 for instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d on n-h2-826756-5 Aug 03 04:33:19.968434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ae12a32e-0b50-4889-94ff-7b8df95f9537 req-b2464be0-9701-4d5a-b6dc-e31925363464 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031844 Aug 03 04:33:19.969121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 309/599] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:19.974020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16d3824a-35ed-4c44-b0e1-be63c8217eb2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:19.974718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-16d3824a-35ed-4c44-b0e1-be63c8217eb2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:20.044030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-16d3824a-35ed-4c44-b0e1-be63c8217eb2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:20.059166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16d3824a-35ed-4c44-b0e1-be63c8217eb2 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1219 microversion: 2.1 time: 0.088849 Aug 03 04:33:20.064968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 310/600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:19 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:20.073108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: .version_select at 0x7fdd577a6b80>, body: {"removeFloatingIp": {"address": "172.25.3.65"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:20.152937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:20.171018 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d5f27b7-d21b-4135-81c7-ea8170885994 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1313 microversion: 2.1 time: 0.262407 Aug 03 04:33:20.174595 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 291/601] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:19 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:20.188356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:20.189175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:20.198106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.198567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.206801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.207469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.246023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:20.253443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.254162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.255103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.255703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.279203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:20.418385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:20.447090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=9 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:20.490925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:20.506603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1e1d6df-59c9-4ea4-8a2f-62182b7c205e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.330430 Aug 03 04:33:20.513798 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 292/602] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:20 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:20.528608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28d83702-565c-4907-8fb9-d9f857c72659 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28d83702-565c-4907-8fb9-d9f857c72659 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Request method failure captured: Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action HTTP/1.1 Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 39 Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpdJxgMGxAlp0StMfynJMlmx61DfqNhAVpNe4tlLs_vYREMwOtQs-pK_aCNKgp2bs0QZSPfg1Mt-59GFhzos3UbbBzWF_OXoWfuD8_ABG4BaqapksVvdTufwrEt63FOqMzePh6X2HS-ES3egoOXcClpm1qIVUr83w1D7Lb90Ht8ZKA Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:33:20.533633 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9eaf5ae4e05c4004b453c960804cb4ed Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: {"os-resetState": {"state": "invalid"}} Aug 03 04:33:20.534937 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c4286636-fbef-4e9a-acda-a62102b67d64', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.537367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:33:20.538671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 03 04:33:20.541353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.541353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28d83702-565c-4907-8fb9-d9f857c72659 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:20.541353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28d83702-565c-4907-8fb9-d9f857c72659 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action" status: 400 len: 144 microversion: 2.1 time: 0.020043 Aug 03 04:33:20.541353 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 293/603] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:20 2022] POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:20.546456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c206476-b823-4ae5-a8d2-cd5d1ac7eb56 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c206476-b823-4ae5-a8d2-cd5d1ac7eb56 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Request method failure captured: Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action HTTP/1.1 Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 31 Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpdJxgMGxAlp0StMfynJMlmx61DfqNhAVpNe4tlLs_vYREMwOtQs-pK_aCNKgp2bs0QZSPfg1Mt-59GFhzos3UbbBzWF_OXoWfuD8_ABG4BaqapksVvdTufwrEt63FOqMzePh6X2HS-ES3egoOXcClpm1qIVUr83w1D7Lb90Ht8ZKA Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:33:20.550222 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9eaf5ae4e05c4004b453c960804cb4ed Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: {"os-resetState": {"state": 1}} Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:20.551831 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c4286636-fbef-4e9a-acda-a62102b67d64', 'body': {'os-resetState': {'state': 1}}} Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 1 Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:20.552775 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 03 04:33:20.554294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.557264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c206476-b823-4ae5-a8d2-cd5d1ac7eb56 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:20.558319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c206476-b823-4ae5-a8d2-cd5d1ac7eb56 tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action" status: 400 len: 120 microversion: 2.1 time: 0.016003 Aug 03 04:33:20.559270 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 294/604] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:20 2022] POST /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64/action => generated 120 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:33:20.570893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:20.573395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Failed to fetch instance by id 999 {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:33:20.574081 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Request method failure captured: Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 37 Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpdJxgMGxAlp0StMfynJMlmx61DfqNhAVpNe4tlLs_vYREMwOtQs-pK_aCNKgp2bs0QZSPfg1Mt-59GFhzos3UbbBzWF_OXoWfuD8_ABG4BaqapksVvdTufwrEt63FOqMzePh6X2HS-ES3egoOXcClpm1qIVUr83w1D7Lb90Ht8ZKA Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:33:20.587386 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/bb59c829a0f148c3b5f36312dcbbf79b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: bb59c829a0f148c3b5f36312dcbbf79b Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-377508499 Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9eaf5ae4e05c4004b453c960804cb4ed Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminNegativeTestJSON-377508499-project-admin Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: {"os-resetState": {"state": "error"}} Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:20.589193 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 999 could not be found. Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:20.590110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:20.591494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7526773-b56a-4222-81fc-bf89955e4f9a tempest-ServersAdminNegativeTestJSON-377508499 tempest-ServersAdminNegativeTestJSON-377508499-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018199 Aug 03 04:33:20.592966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 295/605] 10.222.0.72 () {60 vars in 1179 bytes} [Wed Aug 3 04:33:20 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:33:20.598194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:20.599328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:20.608749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.609579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.610528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.611122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.641508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:20.718645 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] HTTP exception thrown: Floating IP 172.25.3.65 is not associated with instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439. Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Request method failure captured: Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action HTTP/1.1 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 48 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpb5IRGYH2d7dVKghWd0g3_EXwSEG6j-GWnDmYGwO_mBgvqp0JS0wRIFjygw2fCs-0YFY8n4fKhEQhEc4MkOyj7wk6nqFrMgvuXFqGNLVR-JyWVMoeGLmcIvI3HnoOuIWOqLzuj88RlzmfP9fDJqmIDXUg9dSSnfZsYFcmeEX7dH6I Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:20.720402 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7047317821904de5a740f4732994a9b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7047317821904de5a740f4732994a9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: db179c437f284920b453883cc24ecbf5 Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: {"removeFloatingIp": {"address": "172.25.3.65"}} Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:33:20.721653 n-d-826756-5 devstack@n-api.service[120832]: exception: Floating IP 172.25.3.65 is not associated with instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439. Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '59e59026-47a5-4fb9-b1c4-9a9aa26af439', 'body': {'removeFloatingIp': {'address': '172.25.3.65'}}} Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.65 is not associated with instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439. Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.722412 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.65 is not associated with instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439. Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Returning 409 to user: Floating IP 172.25.3.65 is not associated with instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9befd173-0ee0-4695-8c41-27f393415f5a tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action" status: 409 len: 145 microversion: 2.1 time: 0.654345 Aug 03 04:33:20.723563 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 311/606] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:20 2022] POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action => generated 145 bytes in 656 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:33:20.727038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:20.728331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:20.734653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.735104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.735881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:20.736345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:20.920818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:20.928459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80063fdb-e5d2-4487-abac-9ab05a6f2f5e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1313 microversion: 2.1 time: 0.205055 Aug 03 04:33:20.929027 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 312/607] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:20 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:20.934721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.65"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:21.019199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe53267c-ea37-4ddc-b37a-f6cd9051ccc7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 204 len: 0 microversion: 2.1 time: 0.425488 Aug 03 04:33:21.019912 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 296/608] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:20 2022] DELETE /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:21.029327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:21.030034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.036328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.036739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.037505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.038274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.126022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.133180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.142111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.142111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.142111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.329741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.338196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a15c3394-72c6-4ea3-85ec-d8feee11a463 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.316919 Aug 03 04:33:21.338779 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 297/609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:21 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:21.345232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:21.345840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.355229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.355677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.356526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.356924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.400338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Acquired lock "refresh_cache-1a01845c-5371-4867-8e3d-44c78a03e6f0" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:33:21.586313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.596191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.598169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.599333 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63624980-a4ae-4803-abda-8a96898c9f1f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.259440 Aug 03 04:33:21.599905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 298/610] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:21 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:21.618805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:21.619724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.626605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.627051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.627810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.628443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.844932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.853136 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d34973fe-be8d-4d64-a58d-d08530068f83 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1468 microversion: 2.1 time: 0.239077 Aug 03 04:33:21.855444 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 299/611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:21 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:21.858251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:21.858843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.864515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.864961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.865708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.866153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.961249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:21.971050 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8357ae43-9262-485b-82a3-1f3c6c1efc05 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1279 microversion: 2.1 time: 0.116237 Aug 03 04:33:21.972297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 300/612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:21 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:21.978175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:21.979007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:21.999067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.999067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:21.999067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:21.999067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.217207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:22.231681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-86369fc4-0a46-4d82-910f-19e446df5802 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1313 microversion: 2.1 time: 0.253495 Aug 03 04:33:22.240955 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 301/613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:21 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:22.240955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:22.240955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:22.248187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.248667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.249959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.250461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.423544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Building network info cache for instance {{(pid=120832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:22.459404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:22.471456 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9011c849-33e8-405f-9c43-c4eafed29120 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.237336 Aug 03 04:33:22.472673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 302/614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:22 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:22.479632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}, {"name": "network-changed", "server_uuid": "1a01845c-5371-4867-8e3d-44c78a03e6f0", "tag": "18677af2-8204-4b7b-9a17-29489f57a50f"}, {"name": "network-changed", "server_uuid": "0b451efb-fd37-4c22-8d44-17f65d743077", "tag": "324dc237-e788-4ca2-a837-2a36df45cd98"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:22.495406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.496317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.520106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Creating event network-changed:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:33:22.521318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Creating event network-changed:18677af2-8204-4b7b-9a17-29489f57a50f for instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 on n-h1-826756-5 Aug 03 04:33:22.522741 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] Creating event network-changed:324dc237-e788-4ca2-a837-2a36df45cd98 for instance 0b451efb-fd37-4c22-8d44-17f65d743077 on n-h1-826756-5 Aug 03 04:33:22.535150 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-595551d5-29db-46eb-ad97-f969e51c5fcb req-a76f6a8a-a7d3-49a3-8ba9-5dea5d440d04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.060982 Aug 03 04:33:22.539281 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 303/615] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:22.552444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-plugged", "status": "completed", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}, {"server_uuid": "dbf967c4-8207-48e3-82f2-8eb0fbb1f32d", "name": "network-vif-plugged", "status": "completed", "tag": "9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:22.573006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.573768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.595015 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] Creating event network-vif-plugged:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:33:22.597729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] Creating event network-vif-plugged:9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9 for instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d on n-h2-826756-5 Aug 03 04:33:22.611543 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9fa59f1b-364a-4794-a428-678d6bca4852 req-83ae894b-5753-480d-a5fc-3a7d825b435d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064605 Aug 03 04:33:22.613764 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 304/616] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:22.626310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:22.627076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:22.637611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.639069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:22.640925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:22.641267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.299777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:23.330434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa0079a0-e507-456b-a3c5-3ddd41fa97a7 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1313 microversion: 2.1 time: 0.712503 Aug 03 04:33:23.333599 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 305/617] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:22 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:23.354777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b7e1fa-9f95-45d4-b085-db34072d201f", "name": "network-vif-unplugged", "status": "completed", "tag": "03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021"}, {"name": "network-changed", "server_uuid": "f3b7e1fa-9f95-45d4-b085-db34072d201f", "tag": "03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:23.379232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:23.394492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.397692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.421471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] Creating event network-vif-unplugged:03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021 for instance f3b7e1fa-9f95-45d4-b085-db34072d201f on n-h2-826756-5 Aug 03 04:33:23.423037 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] Creating event network-changed:03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021 for instance f3b7e1fa-9f95-45d4-b085-db34072d201f on n-h2-826756-5 Aug 03 04:33:23.431524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ed35c22a-eb6f-4502-90d4-400502cd7006 req-eba55fe0-39f4-41f9-acf8-3a4a4a6c1ebe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.087009 Aug 03 04:33:23.434060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 306/618] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:23.450510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:23.452465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:23.464127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.467709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.467709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.467709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.528619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:23.836721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Updating instance_info_cache with network_info: [{"id": "18677af2-8204-4b7b-9a17-29489f57a50f", "address": "fa:16:3e:f4:05:cf", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18677af2-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:23.866647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:23.890382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc087a36-a09a-4843-b5a2-45c6d2f6e717 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1386 microversion: 2.1 time: 0.452223 Aug 03 04:33:23.891378 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 307/619] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:23 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:23.897099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:23.898246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:23.910245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.910888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.922482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.922940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.937247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Releasing lock "refresh_cache-1a01845c-5371-4867-8e3d-44c78a03e6f0" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:33:23.938333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6dbb140-4aa3-4b48-8eff-c9074af1fd0d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0/action" status: 202 len: 0 microversion: 2.1 time: 3.008167 Aug 03 04:33:23.942478 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 313/620] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:20 2022] POST /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0/action => generated 0 bytes in 3013 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:33:23.948139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:23.949102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:23.966514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.970855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:23.970855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:23.970855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.322005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.329817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81b30b1c-fe93-4121-b254-009e1420873e tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1468 microversion: 2.1 time: 0.385840 Aug 03 04:33:24.330387 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 314/621] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:23 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:24.346192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:24.347221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:24.355747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.356544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.357566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.361415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.365435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.370241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.371835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.374362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3523719-60b0-45ce-b49a-1f907af7b500 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.481925 Aug 03 04:33:24.376734 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 308/622] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:23 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:24.381674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:24.382500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:24.389405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.390100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.390878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.391314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.676763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.685167 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a0ee12b-7d79-4ba5-acb5-87758b65f4d4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.353573 Aug 03 04:33:24.685731 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 315/623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:24 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:24.690411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:24.691707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:24.704640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.705325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.707519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.707973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.721166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:24.729622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d156440b-0408-43c8-b528-973863dd2a3c tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1313 microversion: 2.1 time: 0.351474 Aug 03 04:33:24.730228 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 309/624] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:24 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:24.735013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:24.735446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:24.741418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.741876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.743196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:24.746538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:24.779931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:25.018196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.027829 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fbf5f445-81b0-4387-bfca-91243bdaf64c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.340824 Aug 03 04:33:25.041165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 316/625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:24 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:25.048676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:25.052953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.056804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.057577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.058667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.059302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.155604 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-443fe20d-5e23-4c8a-8731-62dae19631e0 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 204 len: 0 microversion: 2.1 time: 0.423364 Aug 03 04:33:25.155604 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 310/626] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:24 2022] DELETE /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:25.162062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5e094dbe-93f3-4f3f-aea6-f2ed248a397d req-0a2f8ec1-561d-491d-85aa-d1051d1baa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a01845c-5371-4867-8e3d-44c78a03e6f0", "tag": "18677af2-8204-4b7b-9a17-29489f57a50f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:25.170794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5e094dbe-93f3-4f3f-aea6-f2ed248a397d req-0a2f8ec1-561d-491d-85aa-d1051d1baa0d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.171250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5e094dbe-93f3-4f3f-aea6-f2ed248a397d req-0a2f8ec1-561d-491d-85aa-d1051d1baa0d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.183665 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5e094dbe-93f3-4f3f-aea6-f2ed248a397d req-0a2f8ec1-561d-491d-85aa-d1051d1baa0d service nova] Creating event network-changed:18677af2-8204-4b7b-9a17-29489f57a50f for instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 on n-h1-826756-5 Aug 03 04:33:25.188716 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5e094dbe-93f3-4f3f-aea6-f2ed248a397d req-0a2f8ec1-561d-491d-85aa-d1051d1baa0d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031808 Aug 03 04:33:25.189332 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 311/627] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:25.194433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:25.195144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.202481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.202935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.203715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.204220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.323781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.331372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-595555b2-0494-4494-8144-05c02e25b23a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1313 microversion: 2.1 time: 0.288984 Aug 03 04:33:25.331952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 317/628] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:25 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:25.337239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.65"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:25.339465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.346411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.347247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.347650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.349526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.371518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.375962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Acquired lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:33:25.379835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1e40881-a0a8-4fb9-9ecd-9ad9fa742275 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1585 microversion: 2.1 time: 0.189373 Aug 03 04:33:25.380444 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 312/629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:25 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1585 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:25.385287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-db89eca7-b58f-430b-98f8-e1e6a32ba245 req-3d573763-6689-449d-b329-7efdd3ec3336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b451efb-fd37-4c22-8d44-17f65d743077", "name": "network-vif-plugged", "status": "completed", "tag": "324dc237-e788-4ca2-a837-2a36df45cd98"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:25.395667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-db89eca7-b58f-430b-98f8-e1e6a32ba245 req-3d573763-6689-449d-b329-7efdd3ec3336 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.398142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-db89eca7-b58f-430b-98f8-e1e6a32ba245 req-3d573763-6689-449d-b329-7efdd3ec3336 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.407318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-db89eca7-b58f-430b-98f8-e1e6a32ba245 req-3d573763-6689-449d-b329-7efdd3ec3336 service nova] Creating event network-vif-plugged:324dc237-e788-4ca2-a837-2a36df45cd98 for instance 0b451efb-fd37-4c22-8d44-17f65d743077 on n-h1-826756-5 Aug 03 04:33:25.412125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-db89eca7-b58f-430b-98f8-e1e6a32ba245 req-3d573763-6689-449d-b329-7efdd3ec3336 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030561 Aug 03 04:33:25.413587 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 313/630] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:25.420414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:25.421160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.427987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.428537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.429316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.429749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.480724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.481171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.481621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lazy-loading 'fault' on Instance uuid f5cf69cf-793e-46d1-aeb4-3cc61c50902f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:25.553813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.561668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c90e588a-04f5-42a3-aed0-ebb7b6d1ec3d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 200 len: 1311 microversion: 2.1 time: 0.145550 Aug 03 04:33:25.562252 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 314/631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:25 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:25.566781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:25.567389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.575037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.575471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.576822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.577282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.889671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.897691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.899906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:25.901162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1592c841-6c36-4e74-a931-3cf2e6b72dfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.337959 Aug 03 04:33:25.901733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 315/632] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:25 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:25.906386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:25.906910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:25.913305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.913758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:25.917872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:25.917872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:26.076201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab9005e2-02ba-4e05-aa7e-21b4e7aee76b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173349 Aug 03 04:33:26.083602 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 316/633] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:33:25 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:26.083602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e", "tag": "65016d87-3cc1-4558-be87-d361a9b5bbc3"}, {"server_uuid": "f5cf69cf-793e-46d1-aeb4-3cc61c50902f", "name": "network-vif-deleted", "tag": "f09b6efe-e7cf-4ded-bfb1-7af36ca439f8"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:26.094816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:26.095099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:26.109857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] Creating event network-changed:65016d87-3cc1-4558-be87-d361a9b5bbc3 for instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e on n-h2-826756-5 Aug 03 04:33:26.110492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] Creating event network-vif-deleted:f09b6efe-e7cf-4ded-bfb1-7af36ca439f8 for instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f on n-h1-826756-5 Aug 03 04:33:26.118885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1c62c6e3-0b3c-49f3-832e-a7d915814891 req-611776fe-1a4e-4453-81cf-01faa2901ee9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040341 Aug 03 04:33:26.119860 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 317/634] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:26.125612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:26.126300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:26.132635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:26.133082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:26.135865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:26.135865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:26.432841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:26.440692 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2115da1b-4ceb-4b55-8072-876068f0f8dc tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.319162 Aug 03 04:33:26.441709 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 318/635] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:26 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:26.445903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:26.447146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:26.457057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:26.457518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:26.458305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:26.458748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:27.197621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:27.205479 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce456c5b-5998-41fb-9dc5-6f462977bff1 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1313 microversion: 2.1 time: 0.763215 Aug 03 04:33:27.216543 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 319/636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:26 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:27.216543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:27.216543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:27.220855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:27.220987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:27.221932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:27.222501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:27.654845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:27.663507 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-993c4bf3-0a8e-4989-b5bf-91f811338bfc tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.456138 Aug 03 04:33:27.677100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 320/637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:27 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:27.682970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:27.683582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:27.691486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:27.691486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:27.691486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:27.702836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:28.100154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Building network info cache for instance {{(pid=120832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:28.108012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:28.129196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-acdc7591-ae7d-42d7-919e-9b446504534d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1463 microversion: 2.1 time: 0.450258 Aug 03 04:33:28.142013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 321/638] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:27 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1463 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:28.153743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:28.160062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: f5cf69cf-793e-46d1-aeb4-3cc61c50902f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:28.162987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:28.163638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:28.165313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:28.165917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:28.184603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] HTTP exception thrown: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Request method failure captured: Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f HTTP/1.1 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpcRAvfnt59kSYVPDoG2-MlnEHhWiBChJ7qfJAGO7l7CzJ3r3-fElJ63u7xdEtVXf2PWUAmGcwoRVxb0Cr6rRsDI8esHcU4xsVwMPIygZ-4xSZrAV4RptXq4F5Srk96qlB8LI0KLF2mkJNY846HXGHMRPsXdLg8YiMjWupVK-sngp4 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 6a69d52385ae419bb21cca6ccf60344e Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:28.187611 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 6a69d52385ae419bb21cca6ccf60344e Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminNegativeTestJSON-1795509011-project Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2a83f5aee35a414aa84dedde4e729347 Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1795509011-project Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. Aug 03 04:33:28.198479 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f5cf69cf-793e-46d1-aeb4-3cc61c50902f'} Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:28.199569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. Aug 03 04:33:28.200991 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:28.202206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Returning 404 to user: Instance f5cf69cf-793e-46d1-aeb4-3cc61c50902f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:28.202206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b743c39-fd8b-4370-87fe-7f0ddfa09e40 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f" status: 404 len: 111 microversion: 2.1 time: 0.042048 Aug 03 04:33:28.202206 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 322/639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:28 2022] GET /compute/v2.1/servers/f5cf69cf-793e-46d1-aeb4-3cc61c50902f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:28.207098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:28.207713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:28.219893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:28.220389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:28.221181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:28.221619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:28.955442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:28.991724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:28.998187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:29.000764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-678f8a49-3ab4-440d-b10c-9b749a153f13 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.803296 Aug 03 04:33:29.004074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 323/640] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:28 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:29.014587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:29.028870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:29.042402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:29.043667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:29.044837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:29.045685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:29.282076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:29.345303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:29.356302 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40095167-0f51-4761-b6f7-5bf4e6dd8a87 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1585 microversion: 2.1 time: 0.348632 Aug 03 04:33:29.357600 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 324/641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:29 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1585 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:29.362495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:29.363455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:29.378112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:29.378565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:29.379595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:29.380207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:29.386064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:29.967156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:29.976035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-62908627-598e-4db9-a27e-b2e034779efa tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.617107 Aug 03 04:33:29.977494 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 325/642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:29 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:29.996087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c7991d8b-e92a-494a-a1c0-b2b46e95f189 req-2a45e565-1d6e-47a9-a82a-c7a04821158c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:30.006366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7991d8b-e92a-494a-a1c0-b2b46e95f189 req-2a45e565-1d6e-47a9-a82a-c7a04821158c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.007099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7991d8b-e92a-494a-a1c0-b2b46e95f189 req-2a45e565-1d6e-47a9-a82a-c7a04821158c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.015956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Updating instance_info_cache with network_info: [{"id": "0c5cb8ed-5218-4769-8708-b3538acf0fab", "address": "fa:16:3e:78:4b:30", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c5cb8ed-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:30.028111 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c7991d8b-e92a-494a-a1c0-b2b46e95f189 req-2a45e565-1d6e-47a9-a82a-c7a04821158c service nova] Creating event network-changed:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:33:30.040051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c7991d8b-e92a-494a-a1c0-b2b46e95f189 req-2a45e565-1d6e-47a9-a82a-c7a04821158c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 Aug 03 04:33:30.040051 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 326/643] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:30.040051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bda8f680-ab93-477e-9536-c6a71e7974c3 req-c19ce80b-9718-4208-90d7-e7b0a1148236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0727004b-8d20-4352-afd4-3aea23924c6d", "tag": "89a5a28d-417f-4a74-9dea-d1259ed2ca6f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:30.049172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bda8f680-ab93-477e-9536-c6a71e7974c3 req-c19ce80b-9718-4208-90d7-e7b0a1148236 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.049665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bda8f680-ab93-477e-9536-c6a71e7974c3 req-c19ce80b-9718-4208-90d7-e7b0a1148236 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.051784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:30.062700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bda8f680-ab93-477e-9536-c6a71e7974c3 req-c19ce80b-9718-4208-90d7-e7b0a1148236 service nova] Creating event network-changed:89a5a28d-417f-4a74-9dea-d1259ed2ca6f for instance 0727004b-8d20-4352-afd4-3aea23924c6d on n-h1-826756-5 Aug 03 04:33:30.067812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bda8f680-ab93-477e-9536-c6a71e7974c3 req-c19ce80b-9718-4208-90d7-e7b0a1148236 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032888 Aug 03 04:33:30.068695 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 327/644] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:30.074433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:30.075453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:30.082055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.082510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.083468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.084350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.182785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Releasing lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:33:30.184046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b993a016-f416-489f-9a24-c9d4fd6dc530 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action" status: 202 len: 0 microversion: 2.1 time: 4.851054 Aug 03 04:33:30.188872 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 318/645] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:25 2022] POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action => generated 0 bytes in 4856 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:33:30.194206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:30.194935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:30.202638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.203164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.204094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.204710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.231849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:30.342003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:30.351392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2d03f13-9bde-41dc-a972-59772ed93e1e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1462 microversion: 2.1 time: 0.281389 Aug 03 04:33:30.363307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 328/646] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:30 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1462 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:30.375829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:30.376716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:30.387219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.387850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.388936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.389440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.561008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1f6b8cdc-bc28-4d37-b708-d1f6d60d8be9 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 204 len: 0 microversion: 2.1 time: 0.370453 Aug 03 04:33:30.561980 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 319/647] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:30 2022] DELETE /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:30.567402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:30.568108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:30.574759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.575486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.576594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.577194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.773138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:30.782794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c07db1c7-c3fa-4d05-b877-db6e4030192e tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1463 microversion: 2.1 time: 0.417666 Aug 03 04:33:30.783388 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 329/648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:30 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1463 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:30.788148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:30.788782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:30.794801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.795453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.796205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:30.796661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:30.818196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:30.827493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63d3b7e9-9650-457e-97e9-30fd4c1c70e8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.264244 Aug 03 04:33:30.828083 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 320/649] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:30 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:30.832588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3205470f-a573-4a1f-908a-f4efeab9fb78 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '.version_select at 0x7fdd54e865e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.043481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.056228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.057904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.059113 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7dc55889-049c-4bca-be81-8d5368ade74e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.274539 Aug 03 04:33:31.061353 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 330/650] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:30 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:31.065161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1729351675", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "36b40676-fcb5-4244-ae7d-484b80fb894b"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:31.102496 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3205470f-a573-4a1f-908a-f4efeab9fb78 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips/778c5578-cc9e-4a74-b670-d7b0f912b132" status: 200 len: 184 microversion: 2.1 time: 0.272720 Aug 03 04:33:31.104022 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 321/651] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:33:30 2022] GET /compute/v2.1/os-floating-ips/778c5578-cc9e-4a74-b670-d7b0f912b132 => generated 184 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:31.109476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.114392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:31.122952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.123141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:31.123935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.125040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.125653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.355034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.362530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19fc1226-e5ee-472e-adb9-ddd030ada21b tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1478 microversion: 2.1 time: 0.257273 Aug 03 04:33:31.363104 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 322/652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1478 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:31.406265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:31.406682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:31.407175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:31.407637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:31.408042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:31.417504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.417949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.418735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.419310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.422911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Calling method '.version_select at 0x7fdd54ecd280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.434631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.435084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.437531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:31.442310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Getting quotas for user 86c950308de0427ca178e91f19278d93 and project 546823ffdb0d45d997b427498813a742. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:31.454201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:31.454740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.455193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.456525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:31.472885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c975b0b-ab10-4263-a222-99185bef0b9d tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage/1332e38dbbae4cf9a1b5cbf86781a79d?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130" status: 200 len: 694 microversion: 2.1 time: 0.108776 Aug 03 04:33:31.473464 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 323/653] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/os-simple-tenant-usage/1332e38dbbae4cf9a1b5cbf86781a79d?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130 => generated 694 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:31.478525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.479133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:31.485137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.485705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.486518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.486956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.596605 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db47f39b-3e09-43a7-9c52-8286ff257c4e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534974 Aug 03 04:33:31.597188 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 331/654] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:31.603332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Action: 'action', calling method: .version_select at 0x7fdd577a7b80>, body: {"removeFloatingIp": {"address": "172.25.3.65"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:31.662010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.671565 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-51a92b7a-2774-4237-840f-ee3c11900654 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.197052 Aug 03 04:33:31.672482 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 324/655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:31.677275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '.version_select at 0x7fdd54ed9d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.708427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.709098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.723083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.723750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.738583 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8daf8ce2-c176-4f22-bb5b-a36c93750eac tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage/1332e38dbbae4cf9a1b5cbf86781a79d?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130" status: 200 len: 694 microversion: 2.1 time: 0.064975 Aug 03 04:33:31.749523 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 325/656] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/os-simple-tenant-usage/1332e38dbbae4cf9a1b5cbf86781a79d?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130 => generated 694 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:31.754540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb328e73-7f7b-4f6a-8a2d-95d7f098bdda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.755671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb328e73-7f7b-4f6a-8a2d-95d7f098bdda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:31.928526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb328e73-7f7b-4f6a-8a2d-95d7f098bdda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:31.928526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb328e73-7f7b-4f6a-8a2d-95d7f098bdda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1214 microversion: 2.1 time: 0.126713 Aug 03 04:33:31.928526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 326/657] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:31.928526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Calling method '.version_select at 0x7fdd54e45f70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.929240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.929240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.929240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.929240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.957269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a38b78e0-1017-43d1-ad59-9287b96ea36f tempest-TenantUsagesTestJSON-950976685 tempest-TenantUsagesTestJSON-950976685-project-admin] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130&detailed=1" status: 200 len: 9223 microversion: 2.1 time: 0.077707 Aug 03 04:33:31.976354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 327/658] 10.222.0.72 () {58 vars in 1335 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T04%3A33%3A30.798130&end=2022-08-04T04%3A33%3A30.798130&detailed=1 => generated 9223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:31.976354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:31.976354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:31.976354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.977173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:31.977173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:31.977173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.007457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:32.017914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.018479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.019525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.020183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.492053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:32.497495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:32.502335 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb80a793-20d4-4a80-8795-c5cadf33d687 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.543099 Aug 03 04:33:32.503108 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 328/659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:31 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:32.517631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:32.518331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:32.525896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.526351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.527133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.527724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.554611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:32.691087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Acquired lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:33:32.904694 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-882cbe75-66d9-4491-a06a-d7c7f335f614 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 204 len: 0 microversion: 2.1 time: 0.391001 Aug 03 04:33:32.905785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 329/660] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:32 2022] DELETE /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:32.911927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-fddaad5b-167c-43bf-8ed1-acaeb71e370f req-daf2a146-b253-44a4-ad4d-a55f2ed69247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a01845c-5371-4867-8e3d-44c78a03e6f0", "name": "network-vif-deleted", "tag": "18677af2-8204-4b7b-9a17-29489f57a50f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:32.922947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fddaad5b-167c-43bf-8ed1-acaeb71e370f req-daf2a146-b253-44a4-ad4d-a55f2ed69247 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.923392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fddaad5b-167c-43bf-8ed1-acaeb71e370f req-daf2a146-b253-44a4-ad4d-a55f2ed69247 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.936971 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-fddaad5b-167c-43bf-8ed1-acaeb71e370f req-daf2a146-b253-44a4-ad4d-a55f2ed69247 service nova] Creating event network-vif-deleted:18677af2-8204-4b7b-9a17-29489f57a50f for instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 on n-h1-826756-5 Aug 03 04:33:32.942379 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-fddaad5b-167c-43bf-8ed1-acaeb71e370f req-daf2a146-b253-44a4-ad4d-a55f2ed69247 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Aug 03 04:33:32.943562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 330/661] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:32.949432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:32.950425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:32.957650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.958464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:32.959188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:32.959626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:33.546894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:33.555835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:33.557569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:33.558720 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-696a3b67-e760-4423-9e23-1f6bdacff94f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1567 microversion: 2.25 time: 0.613855 Aug 03 04:33:33.559272 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 331/662] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:32 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1567 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:33.576218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:33.576887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:33.583205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:33.583662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:33.584479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:33.584993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:33.881800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a83f5aee35a414aa84dedde4e729347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a69d52385ae419bb21cca6ccf60344e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:33.891904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e9fce3f-a3e6-4e9e-bdf8-5a31118e499d tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 200 len: 1478 microversion: 2.1 time: 0.331587 Aug 03 04:33:33.892510 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 332/663] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:33 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 1478 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:33.897389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:33.898178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:33.904789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:33.905886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:33.906942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:33.907380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.157920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:34.168081 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1cb3d05-5584-4121-aac5-a55cab36fc2c tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.274117 Aug 03 04:33:34.180797 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 333/664] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:33 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:34.186394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-fa2c4f52-300a-4fcc-a7fa-b06682a987a7 req-8366f00e-2226-4fd9-adfb-60de4acff0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e", "name": "network-vif-plugged", "status": "completed", "tag": "65016d87-3cc1-4558-be87-d361a9b5bbc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:34.197848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa2c4f52-300a-4fcc-a7fa-b06682a987a7 req-8366f00e-2226-4fd9-adfb-60de4acff0ee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.198295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa2c4f52-300a-4fcc-a7fa-b06682a987a7 req-8366f00e-2226-4fd9-adfb-60de4acff0ee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.212933 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-fa2c4f52-300a-4fcc-a7fa-b06682a987a7 req-8366f00e-2226-4fd9-adfb-60de4acff0ee service nova] Creating event network-vif-plugged:65016d87-3cc1-4558-be87-d361a9b5bbc3 for instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e on n-h2-826756-5 Aug 03 04:33:34.218563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-fa2c4f52-300a-4fcc-a7fa-b06682a987a7 req-8366f00e-2226-4fd9-adfb-60de4acff0ee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Aug 03 04:33:34.219080 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 334/665] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:34.225371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:34.226407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:34.233451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.234185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.234969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.235424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.545092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:33:34.566367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:34.575372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-acfb9643-b9ea-40dd-aa12-4f71b98dcdaf tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1469 microversion: 2.1 time: 0.354969 Aug 03 04:33:34.579945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 335/666] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:34 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:34.586651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:34.587854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:34.594671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.595413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.596508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.597622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.700429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:34.710023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af5677c9-02de-4844-99fb-f8d7a3ea6f63 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1284 microversion: 2.1 time: 0.128230 Aug 03 04:33:34.711917 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 336/667] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:34 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:34.718074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:34.729439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:34.729439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.729439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:34.729439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:34.729973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.167085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:35.180803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2abd4e96-51f7-48aa-aa0c-b57220d09d4b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.465831 Aug 03 04:33:35.195787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 337/668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:34 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:35.201424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:35.202099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:35.209561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.210035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.211433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.212084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.571522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:35.581696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:35.583706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:35.584924 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6b30bc5-e136-453f-bc83-65b18b39375a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1542 microversion: 2.25 time: 0.387862 Aug 03 04:33:35.599526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 338/669] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:35 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:35.614181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:35.615378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] [instance: c4286636-fbef-4e9a-acda-a62102b67d64] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:35.625724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.625724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.625724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.627094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.665229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] HTTP exception thrown: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Request method failure captured: Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 HTTP/1.1 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpcRAvfnt59kSYVPDoG2-MlnEHhWiBChJ7qfJAGO7l7CzJ3r3-fElJ63u7xdEtVXf2PWUAmGcwoRVxb0Cr6rRsDI8esHcU4xsVwMPIygZ-4xSZrAV4RptXq4F5Srk96qlB8LI0KLF2mkJNY846HXGHMRPsXdLg8YiMjWupVK-sngp4 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6a69d52385ae419bb21cca6ccf60344e Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:35.667929 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6a69d52385ae419bb21cca6ccf60344e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6a69d52385ae419bb21cca6ccf60344e Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1795509011 Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminNegativeTestJSON-1795509011-project Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2a83f5aee35a414aa84dedde4e729347 Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1795509011-project Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. Aug 03 04:33:35.669327 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c4286636-fbef-4e9a-acda-a62102b67d64'} Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:35.670073 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. Aug 03 04:33:35.671348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:35.675775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] Returning 404 to user: Instance c4286636-fbef-4e9a-acda-a62102b67d64 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:35.678992 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a92bc93d-0619-4cd1-bd3d-aff8154c3fb7 tempest-ServersAdminNegativeTestJSON-1795509011 tempest-ServersAdminNegativeTestJSON-1795509011-project] 10.222.0.72 "GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64" status: 404 len: 111 microversion: 2.1 time: 0.077745 Aug 03 04:33:35.684605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 339/670] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:35 2022] GET /compute/v2.1/servers/c4286636-fbef-4e9a-acda-a62102b67d64 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:35.692739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:35.693991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:35.709281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.709749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.717725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.717725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.921244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Updating instance_info_cache with network_info: [{"id": "0c5cb8ed-5218-4769-8708-b3538acf0fab", "address": "fa:16:3e:78:4b:30", "network": {"id": "dfce1ef6-7388-4fd6-b6ff-60d5a043bace", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1613197158-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7047317821904de5a740f4732994a9b0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0c5cb8ed-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:33:35.953817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:35.962053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2011a07a-0877-4227-aaf5-88c1bb4d4523 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.274265 Aug 03 04:33:35.962622 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 340/671] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:35 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:35.967347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4286636-fbef-4e9a-acda-a62102b67d64", "name": "network-vif-deleted", "tag": "5f8dfe05-515e-4b8b-a8e1-e2d5749ce304"}, {"name": "network-changed", "server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:35.978609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:35.983578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:35.991810 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] Creating event network-vif-deleted:5f8dfe05-515e-4b8b-a8e1-e2d5749ce304 for instance c4286636-fbef-4e9a-acda-a62102b67d64 on n-h1-826756-5 Aug 03 04:33:35.994010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Releasing lock "refresh_cache-59e59026-47a5-4fb9-b1c4-9a9aa26af439" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:33:35.994602 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] Creating event network-changed:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:33:35.994867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f867c692-aaef-456c-8910-579ebe43d69d tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action" status: 202 len: 0 microversion: 2.1 time: 4.396647 Aug 03 04:33:35.995475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 332/672] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:31 2022] POST /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439/action => generated 0 bytes in 4398 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:33:36.001628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.003012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.012939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4b9adf00-fbd6-474a-9b03-d7fb706d10e1 req-8a8d627e-8035-40b8-9edd-3348e990692e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047529 Aug 03 04:33:36.016127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.017542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.018760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.019883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.028216 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 341/673] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:36.037823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1692e16-3aaa-4650-b0d2-b2ca34ec63ab tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '.version_select at 0x7fdd54e79ee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.044679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1692e16-3aaa-4650-b0d2-b2ca34ec63ab tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.045142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1692e16-3aaa-4650-b0d2-b2ca34ec63ab tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.066139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.067076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.067879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lazy-loading 'fault' on Instance uuid 0b451efb-fd37-4c22-8d44-17f65d743077 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:36.079668 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1692e16-3aaa-4650-b0d2-b2ca34ec63ab tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.046598 Aug 03 04:33:36.080910 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 342/674] 10.222.0.72 () {60 vars in 1184 bytes} [Wed Aug 3 04:33:36 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:36.085942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.086950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.094655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.095197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.096051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.096628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.144431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56f2008e16c54fe989a73ff8ed5d781d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1332e38dbbae4cf9a1b5cbf86781a79d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:36.152593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b132c59f-79e4-4d5f-9484-29c91395171f tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 200 len: 1303 microversion: 2.1 time: 0.155832 Aug 03 04:33:36.153177 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 333/675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:35 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:36.161354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.161888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.173008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.173460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.174251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.174710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.188932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] HTTP exception thrown: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Request method failure captured: Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 HTTP/1.1 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpb5IRGYH2d7dVKghWd0g3_EXwSEG6j-GWnDmYGwO_mBgvqp0JS0wRIFjygw2fCs-0YFY8n4fKhEQhEc4MkOyj7wk6nqFrMgvuXFqGNLVR-JyWVMoeGLmcIvI3HnoOuIWOqLzuj88RlzmfP9fDJqmIDXUg9dSSnfZsYFcmeEX7dH6I Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:36.190632 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7047317821904de5a740f4732994a9b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7047317821904de5a740f4732994a9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: db179c437f284920b453883cc24ecbf5 Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.192128 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1a01845c-5371-4867-8e3d-44c78a03e6f0'} Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:36.193067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.194425 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.196733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Returning 404 to user: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:36.196733 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53b392e7-20f0-4da6-a249-b593791fbb35 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 404 len: 111 microversion: 2.1 time: 0.034680 Aug 03 04:33:36.196733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 334/676] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:36 2022] DELETE /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:36.198685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.199326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.206140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.206677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.207443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.207879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.701342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:36.710207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f6b57da-58fd-4e09-ab09-608f484bb3e3 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1326 microversion: 2.1 time: 0.627893 Aug 03 04:33:36.711351 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 343/677] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:36 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1326 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:36.720021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.720773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.727801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.734728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.734728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.734728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.770928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid f3b7e1fa-9f95-45d4-b085-db34072d201f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:36.785828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f49d064-d5ac-4e43-9912-6f4abfc56b54 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 2035 microversion: 2.25 time: 0.592245 Aug 03 04:33:36.786557 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 335/678] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:36 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 2035 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:36.792631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:36.793433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 1a01845c-5371-4867-8e3d-44c78a03e6f0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:36.800992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.801722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.803731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:36.803731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:36.833639 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] HTTP exception thrown: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Request method failure captured: Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 HTTP/1.1 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpb5IRGYH2d7dVKghWd0g3_EXwSEG6j-GWnDmYGwO_mBgvqp0JS0wRIFjygw2fCs-0YFY8n4fKhEQhEc4MkOyj7wk6nqFrMgvuXFqGNLVR-JyWVMoeGLmcIvI3HnoOuIWOqLzuj88RlzmfP9fDJqmIDXUg9dSSnfZsYFcmeEX7dH6I Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:36.835184 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7047317821904de5a740f4732994a9b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7047317821904de5a740f4732994a9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: db179c437f284920b453883cc24ecbf5 Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.837641 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1a01845c-5371-4867-8e3d-44c78a03e6f0'} Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:36.838385 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. Aug 03 04:33:36.840411 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:36.843055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Returning 404 to user: Instance 1a01845c-5371-4867-8e3d-44c78a03e6f0 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:36.843055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4423c705-ee24-43c1-859b-c55292700270 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0" status: 404 len: 111 microversion: 2.1 time: 0.049484 Aug 03 04:33:36.843055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 336/679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:36 2022] GET /compute/v2.1/servers/1a01845c-5371-4867-8e3d-44c78a03e6f0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:36.846099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60134ed6-f965-48a5-9e95-b0a4b7a8f437 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: .version_select at 0x7fdd54dfcdc0>, body: {"keypair": {"name": "tempest-keypair-567280295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGISWk5YrLR1VAbYxhsww8R1OZA9w71OXIT7MUrO+VuxW/uD3hnCY4vA1chOepU2xH0H8nhaYmAYtKGrO5setSEkI0pcEHfDuqFv3zmQ9WD04W4AC1BGAi1rdgRXTVTi8A=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:36.862200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-60134ed6-f965-48a5-9e95-b0a4b7a8f437 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for project 2d5eaf733df44eba92534066cb86541c. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:36.866877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-60134ed6-f965-48a5-9e95-b0a4b7a8f437 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for user 4cb1b66854244b8197c4b1f0ccae0b0e and project 2d5eaf733df44eba92534066cb86541c. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:36.972057 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60134ed6-f965-48a5-9e95-b0a4b7a8f437 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.132387 Aug 03 04:33:36.973364 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 337/680] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:33:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:33:36.979333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c031661d-0944-44d0-bfb5-01a9968592de tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '.version_select at 0x7fdd54ed5940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:37.022119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:37.031159 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05ceeb13-f6bd-40a2-acf1-ce2ff6e3ba1c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1477 microversion: 2.1 time: 0.318137 Aug 03 04:33:37.031848 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 344/681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:36 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:37.047146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:37.048410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:37.057156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.061214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.061214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.061214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.475137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:37.487457 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2549ad8-1879-409a-93da-a49685af5295 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1319 microversion: 2.1 time: 0.453959 Aug 03 04:33:37.493100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 345/682] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:37 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:37.498535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:37.499327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] [instance: 0b451efb-fd37-4c22-8d44-17f65d743077] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:37.521378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.522050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.524229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.529271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.560025 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] HTTP exception thrown: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Request method failure captured: Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 HTTP/1.1 Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fqEa0yJwrtLSoVcD9O8ntBOavSEIbW8OPv9xROTIFozlnGPB_Z2b2Wab4BT4QDZvIsFyF2Lar66XCLkAwIhKVnN8x0G8P2xQNIyXqx0YrDrx361n9wHfCPgmmV71fKuoUzcq9U4NoWovc49xclhVcK6n-TbU4y50uU3hCoePp-LyxI Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1332e38dbbae4cf9a1b5cbf86781a79d Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TenantUsagesTestJSON-1513560027 Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:37.561782 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1332e38dbbae4cf9a1b5cbf86781a79d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1332e38dbbae4cf9a1b5cbf86781a79d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1332e38dbbae4cf9a1b5cbf86781a79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1332e38dbbae4cf9a1b5cbf86781a79d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TenantUsagesTestJSON-1513560027 Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1332e38dbbae4cf9a1b5cbf86781a79d Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1513560027 Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TenantUsagesTestJSON-1513560027-project Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 56f2008e16c54fe989a73ff8ed5d781d Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TenantUsagesTestJSON-1513560027-project Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. Aug 03 04:33:37.563281 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0b451efb-fd37-4c22-8d44-17f65d743077'} Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:37.564224 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. Aug 03 04:33:37.567713 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:37.568807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] Returning 404 to user: Instance 0b451efb-fd37-4c22-8d44-17f65d743077 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:37.568807 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-245bb57a-56cc-4e57-a9b8-36c05adadf86 tempest-TenantUsagesTestJSON-1513560027 tempest-TenantUsagesTestJSON-1513560027-project] 10.222.0.72 "GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077" status: 404 len: 111 microversion: 2.1 time: 0.071755 Aug 03 04:33:37.568807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 346/683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:37 2022] GET /compute/v2.1/servers/0b451efb-fd37-4c22-8d44-17f65d743077 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:37.664765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dff146e6-0e4c-4ecb-acaa-08956492b33a req-9dca4689-b3f0-4529-a5ea-58a34fc65f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66de5839-7706-4868-8e0e-7ccd9e276946", "tag": "b306fac0-0978-4a80-9a1b-f53ad55263a6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:37.684172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dff146e6-0e4c-4ecb-acaa-08956492b33a req-9dca4689-b3f0-4529-a5ea-58a34fc65f29 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.684903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dff146e6-0e4c-4ecb-acaa-08956492b33a req-9dca4689-b3f0-4529-a5ea-58a34fc65f29 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.880948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dff146e6-0e4c-4ecb-acaa-08956492b33a req-9dca4689-b3f0-4529-a5ea-58a34fc65f29 service nova] Creating event network-changed:b306fac0-0978-4a80-9a1b-f53ad55263a6 for instance 66de5839-7706-4868-8e0e-7ccd9e276946 on n-h2-826756-5 Aug 03 04:33:37.889641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dff146e6-0e4c-4ecb-acaa-08956492b33a req-9dca4689-b3f0-4529-a5ea-58a34fc65f29 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225060 Aug 03 04:33:37.889641 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 347/684] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:33:37.892880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:37.893894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:37.902118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.906992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.906992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:37.906992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:37.924504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:38.272116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:38.281380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c118bf22-4b2b-4fc9-8fb7-8266ec65b6c4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.392721 Aug 03 04:33:38.282670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 348/685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:37 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:38.288347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ce4eb8d6-7887-48ae-8af1-fc1829a8d7b9 req-7a74097b-63b5-4170-a097-3df0d7e20832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b451efb-fd37-4c22-8d44-17f65d743077", "name": "network-vif-deleted", "tag": "324dc237-e788-4ca2-a837-2a36df45cd98"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:38.299604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:38.301976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ce4eb8d6-7887-48ae-8af1-fc1829a8d7b9 req-7a74097b-63b5-4170-a097-3df0d7e20832 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.302576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ce4eb8d6-7887-48ae-8af1-fc1829a8d7b9 req-7a74097b-63b5-4170-a097-3df0d7e20832 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.321878 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ce4eb8d6-7887-48ae-8af1-fc1829a8d7b9 req-7a74097b-63b5-4170-a097-3df0d7e20832 service nova] Creating event network-vif-deleted:324dc237-e788-4ca2-a837-2a36df45cd98 for instance 0b451efb-fd37-4c22-8d44-17f65d743077 on n-h1-826756-5 Aug 03 04:33:38.327602 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ce4eb8d6-7887-48ae-8af1-fc1829a8d7b9 req-7a74097b-63b5-4170-a097-3df0d7e20832 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043223 Aug 03 04:33:38.328599 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 349/686] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:38.333983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:38.335167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:38.344340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.350889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.350889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.350889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.621848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:38.630631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-32867c29-4fcf-4c59-bbf0-9d5b597086bf tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1476 microversion: 2.1 time: 0.300637 Aug 03 04:33:38.631119 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 350/687] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:38 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:38.640084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:38.641051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:38.648010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.649920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.651160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.651838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.820815 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c031661d-0944-44d0-bfb5-01a9968592de tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/778c5578-cc9e-4a74-b670-d7b0f912b132" status: 202 len: 0 microversion: 2.1 time: 1.846064 Aug 03 04:33:38.823149 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 338/688] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:33:36 2022] DELETE /compute/v2.1/os-floating-ips/778c5578-cc9e-4a74-b670-d7b0f912b132 => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:33:38.832785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:38.832785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:38.848223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.848223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.853077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.853077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.906160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:38.951884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:38.959377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9bf54811-993f-49a2-ba05-a1b7f2ec6685 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1469 microversion: 2.1 time: 0.325092 Aug 03 04:33:38.960001 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 351/689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:38 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:38.980225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:38.982687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:38.989377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.995381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:38.995381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:38.995381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.180981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:39.292841 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c52f755f-afd2-40db-af55-05af0dbde484 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "DELETE /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 204 len: 0 microversion: 2.1 time: 0.464826 Aug 03 04:33:39.293644 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 339/690] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:38 2022] DELETE /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:39.307171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:39.307171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:39.327751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.329428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.331119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.332734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.451283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-366a717e-0e1a-45b2-8dee-274bee1c1641 tempest-DeleteServersAdminTestJSON-1438953025 tempest-DeleteServersAdminTestJSON-1438953025-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e/action" status: 202 len: 0 microversion: 2.1 time: 0.474942 Aug 03 04:33:39.452774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 352/691] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:38 2022] POST /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:33:39.464511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:39.465372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:39.472928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.473622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.474837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.475509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.684522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:39.692582 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f809a64-94d6-479f-b98a-c99fa66bf6b1 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1527 microversion: 2.1 time: 0.394391 Aug 03 04:33:39.693705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 340/692] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:39 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1527 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:39.713208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:39.714131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:39.720841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.721765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.722917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.724185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.749269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:39.760629 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61c0301e-9034-4e38-b12b-c3a17f942b4f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.305351 Aug 03 04:33:39.761707 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 353/693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:39 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:39.763107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.763487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.763942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:39.768178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:39.769054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:39.776677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.779851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:39.779851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:39.779851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.053647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:40.067258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-807e224a-4380-4d4a-9510-c682945bfa26 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1452 microversion: 2.1 time: 0.358832 Aug 03 04:33:40.079087 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 341/694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:39 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1452 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:40.089431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:40.089924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:40.097832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.099952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.099952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.099952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.104788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:40.113670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c00216f-8aa5-413c-b27d-41c722c20fff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1476 microversion: 2.1 time: 0.350536 Aug 03 04:33:40.125731 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 354/695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:39 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:40.130584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:33:40.157794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:40.381329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "name": "network-vif-unplugged", "status": "completed", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}, {"name": "network-changed", "server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:40.394411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.394866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.407239 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Creating event network-vif-unplugged:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h1-826756-5 Aug 03 04:33:40.407753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Creating event network-changed:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h1-826756-5 Aug 03 04:33:40.417046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:33:40.429023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b36b63b8-6ffb-4824-9a54-8237c64b03f7 req-be4d7036-60c8-4cb6-8c1c-720eb44c2bfe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052979 Aug 03 04:33:40.429991 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 355/696] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:40.474888 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3eb783c6-fb20-4138-8682-e4690ee68a24 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 204 len: 0 microversion: 2.1 time: 0.390288 Aug 03 04:33:40.475461 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 342/697] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:40 2022] DELETE /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:33:40.485321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:40.486118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:40.494351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.494820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.495667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.496115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.539593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.540435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.541158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:40.717567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:40.718298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:40.732674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.733134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:40.733927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:40.734545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.292398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:41.305487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec745304-be27-479c-a5ba-21b00d1b0a3e tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1458 microversion: 2.1 time: 0.820178 Aug 03 04:33:41.306313 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 356/698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:40 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1458 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:41.325707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:41.326438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:41.345820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.346839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.350282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.351109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.361240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:41.369025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99ab7d13-3bf0-4387-82ba-93736fb3fc91 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1527 microversion: 2.1 time: 0.658189 Aug 03 04:33:41.381112 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 343/699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:40 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1527 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:41.427487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:41.683825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54f4cd30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:41.688712 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:41.688712 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:33:41.690239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.691603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.704131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:41.705999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.706460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.713834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a192391-824a-4c99-8eb4-a66ae6bceca2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.391533 Aug 03 04:33:41.728321 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] HTTP exception thrown: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:41.728673 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 357/700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:41 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Request method failure captured: Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 HTTP/1.1 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 56 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fqkbqWDv9SZ07bHlW0dcFu0zVeIW1n38H1JZQATff7f0dZ3gxZmbhYGsXtz8NO_0OXn5xQk8xqSbRD-ddX6DhKhAwJcv8V2nvbAWgT4iJ5wjiU7Oc6zDJ7UABJqHcQTB1QJLptb81GOkeuhrT6AIhwlJ7QQSkn1fl6OIfeqr70M5WE Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:33:41.728781 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 37a12255f39a494b8876539e78414d48 Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:33:41.730430 n-d-826756-5 devstack@n-api.service[120831]: exception: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '288b350a-8477-4e14-bed9-e8773e1020e9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.731392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:41.733449 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Returning 404 to user: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d1f77228-f961-4f81-b60a-b407fddf6aee tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9" status: 404 len: 110 microversion: 2.53 time: 0.341411 Aug 03 04:33:41.734863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 344/701] 10.222.0.72 () {62 vars in 1309 bytes} [Wed Aug 3 04:33:41 2022] PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 => generated 110 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:41.736486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:41.737156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:41.740513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-503663218", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4"}], "security_groups": [{"name": "tempest-securitygroup--1124158803"}], "key_name": "tempest-keypair-567280295", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:41.747851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.748642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.749647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:41.750097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:41.874244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:41.910230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:41.992533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] validate_networks() for [('8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:42.050740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:42.058883 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d60c858-cfa7-41fd-bf37-f4afd7403d8a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1476 microversion: 2.1 time: 0.339038 Aug 03 04:33:42.059466 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 358/702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:41 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:42.077004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54f3aca0>, body: {"status": "disabled"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:42.079703 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:42.079703 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:42.080907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.081369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.091193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] HTTP exception thrown: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Request method failure captured: Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 HTTP/1.1 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 22 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fqkbqWDv9SZ07bHlW0dcFu0zVeIW1n38H1JZQATff7f0dZ3gxZmbhYGsXtz8NO_0OXn5xQk8xqSbRD-ddX6DhKhAwJcv8V2nvbAWgT4iJ5wjiU7Oc6zDJ7UABJqHcQTB1QJLptb81GOkeuhrT6AIhwlJ7QQSkn1fl6OIfeqr70M5WE Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:33:42.102063 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 37a12255f39a494b8876539e78414d48 Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: {"status": "disabled"} Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: exception: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.104103 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '288b350a-8477-4e14-bed9-e8773e1020e9', 'body': {'status': 'disabled'}} Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.105286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:42.106835 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:42.108561 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.108561 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.108561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Returning 404 to user: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:42.108561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bda0a109-0bb8-4ec0-8967-a45aa8a5a77b tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9" status: 404 len: 110 microversion: 2.53 time: 0.030796 Aug 03 04:33:42.108561 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 359/703] 10.222.0.72 () {62 vars in 1309 bytes} [Wed Aug 3 04:33:42 2022] PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:42.114505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54dcc820>, body: {"status": "enabled"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:42.119300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.119851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.127032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.127685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.147442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] HTTP exception thrown: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Request method failure captured: Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 HTTP/1.1 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 21 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fqkbqWDv9SZ07bHlW0dcFu0zVeIW1n38H1JZQATff7f0dZ3gxZmbhYGsXtz8NO_0OXn5xQk8xqSbRD-ddX6DhKhAwJcv8V2nvbAWgT4iJ5wjiU7Oc6zDJ7UABJqHcQTB1QJLptb81GOkeuhrT6AIhwlJ7QQSkn1fl6OIfeqr70M5WE Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:33:42.150510 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dbb8977414de4bf98f70672eb928715d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dbb8977414de4bf98f70672eb928715d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: dbb8977414de4bf98f70672eb928715d Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267 Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 37a12255f39a494b8876539e78414d48 Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: {"status": "enabled"} Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: exception: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.152035 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '288b350a-8477-4e14-bed9-e8773e1020e9', 'body': {'status': 'enabled'}} Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6157, in service_get_by_id Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6017, in _find_service_in_cell Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6159, in service_get_by_id Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.153043 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:42.154305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:42.155670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. Aug 03 04:33:42.155670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:42.157372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Returning 404 to user: Service 288b350a-8477-4e14-bed9-e8773e1020e9 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:42.158218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fce3d58-d977-4514-a195-78874e6c3bd8 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9" status: 404 len: 110 microversion: 2.53 time: 0.048198 Aug 03 04:33:42.158802 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 360/704] 10.222.0.72 () {62 vars in 1309 bytes} [Wed Aug 3 04:33:42 2022] PUT /compute/v2.1/os-services/288b350a-8477-4e14-bed9-e8773e1020e9 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:42.168392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.171059 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:42.171059 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:42.172652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.173807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.174871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.175354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.201973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1492e5a9-f320-4245-86e5-068cba53cc41 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038058 Aug 03 04:33:42.203033 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 361/705] 10.222.0.72 () {60 vars in 1178 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:33:42.223014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.226340 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:42.226340 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:42.228248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.229074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.230144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.230828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.276505 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc210f89-a705-40e1-9c70-41c7cf9b3025 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062981 Aug 03 04:33:42.277591 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 362/706] 10.222.0.72 () {60 vars in 1211 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:42.293629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.296372 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:42.296372 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:42.297936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.298409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.299446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.299973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.335517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16e51d72-c457-4bc0-8325-1c69cb233996 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047883 Aug 03 04:33:42.337309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 363/707] 10.222.0.72 () {60 vars in 1178 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:33:42.350495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.351878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:42.358849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.359428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.360492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.361022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.399106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.399654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.400131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:42.754527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:42.762526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33e240cb-8cfc-47a6-ad50-6151435a401a tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1458 microversion: 2.1 time: 0.424146 Aug 03 04:33:42.763097 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 364/708] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1458 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:42.780541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.783202 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:42.783202 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:42.784458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.784911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.785723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.785992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:42.786469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.786570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:42.786905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:42.787313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:42.787751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:42.800643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.802372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.803219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.803999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.810908 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b02fb04-ffb7-4ea0-b319-47b8e5ac84a1 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?host=n-d-826756-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.033863 Aug 03 04:33:42.811887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 365/709] 10.222.0.72 () {60 vars in 1235 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/os-services?host=n-d-826756-5&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:42.816414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:42.823312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:42.826232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.826376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.827135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.827571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.833028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:42.838166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for user 4cb1b66854244b8197c4b1f0ccae0b0e and project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:42.851552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:42.853872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:42.893285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:42.901002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76ca5d67-8530-4753-8c56-398ae90b833f tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1485 microversion: 2.1 time: 0.088281 Aug 03 04:33:42.901559 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 366/710] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:42.906018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-25b1faf4-7454-411a-9aa9-c78dd70c0b11 req-060d319a-7657-4522-b04b-7a47f10b1367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e59026-47a5-4fb9-b1c4-9a9aa26af439", "name": "network-vif-deleted", "tag": "0c5cb8ed-5218-4769-8708-b3538acf0fab"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:42.916510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-25b1faf4-7454-411a-9aa9-c78dd70c0b11 req-060d319a-7657-4522-b04b-7a47f10b1367 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:42.919709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-25b1faf4-7454-411a-9aa9-c78dd70c0b11 req-060d319a-7657-4522-b04b-7a47f10b1367 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:42.928257 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-25b1faf4-7454-411a-9aa9-c78dd70c0b11 req-060d319a-7657-4522-b04b-7a47f10b1367 service nova] Creating event network-vif-deleted:0c5cb8ed-5218-4769-8708-b3538acf0fab for instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 on n-h1-826756-5 Aug 03 04:33:42.933846 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-25b1faf4-7454-411a-9aa9-c78dd70c0b11 req-060d319a-7657-4522-b04b-7a47f10b1367 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Aug 03 04:33:42.936557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 367/711] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:43.003777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ffde5202-b9c4-435f-b8e6-71511bbe843c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.273149 Aug 03 04:33:43.004818 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 345/712] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:33:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:33:43.010898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.012026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:43.018513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.019318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.020347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.021004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.066508 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37342bcc-50c1-4b6f-923e-5c658abda43d tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-02T04%3A33%3A42.611455&end=2022-08-04T04%3A33%3A42.611455" status: 404 len: 112 microversion: - time: 0.128775 Aug 03 04:33:43.067034 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 368/713] 10.222.0.72 () {58 vars in 1316 bytes} [Wed Aug 3 04:33:42 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-02T04%3A33%3A42.611455&end=2022-08-04T04%3A33%3A42.611455 => generated 112 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 04:33:43.073024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.077140 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:43.077140 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:43.078431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.078889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.079702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.080146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.105962 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-024a00b6-5dc0-4259-876d-f9aa249ec0d5 tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037749 Aug 03 04:33:43.107058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 369/714] 10.222.0.72 () {60 vars in 1178 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:43.111752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.112488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:43.185325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.195155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.196865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.198906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1cd87e0b-588f-48d6-8ceb-d96a4a9a0d82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1284 microversion: 2.25 time: 0.090617 Aug 03 04:33:43.199983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 370/715] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:43.205586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dbd098b5-5972-4045-8203-159f0ac89438 tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] Calling method '.version_select at 0x7fdd55035040>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.211455 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-dbd098b5-5972-4045-8203-159f0ac89438 tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 03 04:33:43.216857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dbd098b5-5972-4045-8203-159f0ac89438 tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] Request method failure captured: Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-simple-tenant-usage/b6e817e926d0442383fb374cb72d6270?start=2022-08-04T04%3A33%3A42.611455&end=2022-08-02T04%3A33%3A42.611455 HTTP/1.1 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fqmETJYjUcI4Zj7AwdCDQca9jbDGSyDtwHm0Sgq4sngRMZlJrNc2VlyWy_mmYNDjy-3228PbdsM_LTHAuv7vSXeUWv3DnfP28JzY5QH2rmLayN8FlQDQ1BMpwMwWQ_PuIk80alEdy_-3tHqhs2FCepuNsvrCtUXrxiPTFzZ5fstF9k Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8211eb0967c2412ba6803ddd26ef56b9 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1218681653 Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:33:43.222654 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8211eb0967c2412ba6803ddd26ef56b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8211eb0967c2412ba6803ddd26ef56b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8211eb0967c2412ba6803ddd26ef56b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8211eb0967c2412ba6803ddd26ef56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1218681653 Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8211eb0967c2412ba6803ddd26ef56b9 Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1218681653 Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ebfbc466a40c4c18a94498cf4275200f Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid start time. The start time cannot occur after the end time. Aug 03 04:33:43.223951 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'b6e817e926d0442383fb374cb72d6270'} Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 04:33:43.224758 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dbd098b5-5972-4045-8203-159f0ac89438 tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:43.226546 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dbd098b5-5972-4045-8203-159f0ac89438 tempest-TenantUsagesNegativeTestJSON-1218681653 tempest-TenantUsagesNegativeTestJSON-1218681653-project-admin] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage/b6e817e926d0442383fb374cb72d6270?start=2022-08-04T04%3A33%3A42.611455&end=2022-08-02T04%3A33%3A42.611455" status: 400 len: 111 microversion: 2.1 time: 0.022980 Aug 03 04:33:43.228513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe6a0c9f-8f39-4ab3-8d2b-3357e3269cda tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.221792 Aug 03 04:33:43.230031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 371/716] 10.222.0.72 () {58 vars in 1412 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/os-simple-tenant-usage/b6e817e926d0442383fb374cb72d6270?start=2022-08-04T04%3A33%3A42.611455&end=2022-08-02T04%3A33%3A42.611455 => generated 111 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:43.241204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.242648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:43.249590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 346/717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:43.257274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.258323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.261452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.261653 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:43.261653 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:33:43.262295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.262746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.262908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.263552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.265159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.265791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.292035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:43.298277 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50ef63fd-0830-4252-af7c-4ccc7699fa3e tempest-ServicesAdminNegativeV253TestJSON-1157006267 tempest-ServicesAdminNegativeV253TestJSON-1157006267-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.047513 Aug 03 04:33:43.299060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 347/718] 10.222.0.72 () {60 vars in 1239 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:43.459222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79633cb5-9533-48b4-b948-8148ec780ad7 tempest-TenantUsagesNegativeTestJSON-1960404137 tempest-TenantUsagesNegativeTestJSON-1960404137-project] Calling method '.version_select at 0x7fdd54e0a8b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.463201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.464012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79633cb5-9533-48b4-b948-8148ec780ad7 tempest-TenantUsagesNegativeTestJSON-1960404137 tempest-TenantUsagesNegativeTestJSON-1960404137-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '9c3b0fcfd6ca4dfa8f0cc93ef7682941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6e817e926d0442383fb374cb72d6270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79633cb5-9533-48b4-b948-8148ec780ad7 tempest-TenantUsagesNegativeTestJSON-1960404137 tempest-TenantUsagesNegativeTestJSON-1960404137-project] Request method failure captured: Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T04%3A33%3A42.611455&end=2022-08-04T04%3A33%3A42.611455&detailed=1 HTTP/1.1 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fql7rIYiOYcOnwIOQ6wNzdiy3FWdGkEqxRizc8_nsafqgdjVw2f7Ny0Qi3SLN_4_PP5jF5fR-SdhJYevcHuQx2suyEtvKlfR4AXBK2XPdBn7u3i6IVN7dG6NXXIzi1eykceRZnsKLPwoVFj6XMfM7cI9DDOYXa51KgvXFwEdEJo7B8 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b6e817e926d0442383fb374cb72d6270 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1960404137 Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:43.466176 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b6e817e926d0442383fb374cb72d6270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b6e817e926d0442383fb374cb72d6270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b6e817e926d0442383fb374cb72d6270"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b6e817e926d0442383fb374cb72d6270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1960404137 Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b6e817e926d0442383fb374cb72d6270 Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1960404137 Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TenantUsagesNegativeTestJSON-1960404137-project Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9c3b0fcfd6ca4dfa8f0cc93ef7682941 Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1960404137-project Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:33:43.467976 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:33:43.469170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:33:43.470590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:33:43.471980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 03 04:33:43.471980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.471980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79633cb5-9533-48b4-b948-8148ec780ad7 tempest-TenantUsagesNegativeTestJSON-1960404137 tempest-TenantUsagesNegativeTestJSON-1960404137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:43.471980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79633cb5-9533-48b4-b948-8148ec780ad7 tempest-TenantUsagesNegativeTestJSON-1960404137 tempest-TenantUsagesNegativeTestJSON-1960404137-project] 10.222.0.72 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T04%3A33%3A42.611455&end=2022-08-04T04%3A33%3A42.611455&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.164014 Aug 03 04:33:43.472368 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd1dd534-6276-4d26-a51c-871cc4054383 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1474 microversion: 2.1 time: 0.240635 Aug 03 04:33:43.473099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 372/719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1474 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:43.483206 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 348/720] 10.222.0.72 () {58 vars in 1335 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-02T04%3A33%3A42.611455&end=2022-08-04T04%3A33%3A42.611455&detailed=1 => generated 123 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:43.601010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b72e6d4-8869-4bb2-8158-3644ce9f4203 tempest-ServicesAdminNegativeV253TestJSON-1590339856 tempest-ServicesAdminNegativeV253TestJSON-1590339856-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.604506 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:43.604506 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:43.605775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2b72e6d4-8869-4bb2-8158-3644ce9f4203 tempest-ServicesAdminNegativeV253TestJSON-1590339856 tempest-ServicesAdminNegativeV253TestJSON-1590339856-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4c966201bbd2497d90154b525c9fe4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94274ebd71004c8aa24f155f48f030a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b72e6d4-8869-4bb2-8158-3644ce9f4203 tempest-ServicesAdminNegativeV253TestJSON-1590339856 tempest-ServicesAdminNegativeV253TestJSON-1590339856-project] Request method failure captured: Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fqjQdhP4sw9rSHVrErF0sTW8aIoNkj3KdIG6El8XU17izHWT4z7RWl86isnIS1_QCop2GSvedKTNxH58_IRJuJgGMM1-vZRZ21pxKgW1idl-R_JAhvSmg1cYsJDfLrzZ1e09oIhwgKUZiWqcZJuRuGwdiFmmY25CdtBbghhH_sItqE Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.53 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 94274ebd71004c8aa24f155f48f030a7 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1590339856 Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:43.607389 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/94274ebd71004c8aa24f155f48f030a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/94274ebd71004c8aa24f155f48f030a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_94274ebd71004c8aa24f155f48f030a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/94274ebd71004c8aa24f155f48f030a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1590339856 Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 94274ebd71004c8aa24f155f48f030a7 Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1590339856 Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1590339856-project Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4c966201bbd2497d90154b525c9fe4eb Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1590339856-project Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:33:43.611354 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:33:43.612085 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:33:43.613227 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:43.614784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b72e6d4-8869-4bb2-8158-3644ce9f4203 tempest-ServicesAdminNegativeV253TestJSON-1590339856 tempest-ServicesAdminNegativeV253TestJSON-1590339856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:43.614784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2b72e6d4-8869-4bb2-8158-3644ce9f4203 tempest-ServicesAdminNegativeV253TestJSON-1590339856 tempest-ServicesAdminNegativeV253TestJSON-1590339856-project] 10.222.0.72 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.134744 Aug 03 04:33:43.614784 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 373/721] 10.222.0.72 () {60 vars in 1178 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:33:43.784827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.785878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:43.804451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.807327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.811700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.812467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.882881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.889531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.891522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:43.925296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:43.925922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:43.947190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.952990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:43.953849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:43.954300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.046709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db179c437f284920b453883cc24ecbf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7047317821904de5a740f4732994a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.070796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13a7404b-b525-468e-90d4-82c0124e7d67 tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 200 len: 1309 microversion: 2.1 time: 0.150881 Aug 03 04:33:44.072824 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 374/722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:33:44.160556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.187062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a910828-3ff1-406a-aeb2-c55e3cfe1d06 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1458 microversion: 2.1 time: 0.407492 Aug 03 04:33:44.203461 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 349/723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:43 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1458 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:44.224778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:44.225402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:44.246418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.249156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.250024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.252873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.260939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:44.262059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:44.282429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.284632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.285725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.287300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.455174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.469494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.469494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.469494 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-716c2c42-d738-4b55-adab-98677c4c5138 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1288 microversion: 2.25 time: 0.247969 Aug 03 04:33:44.470597 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 375/724] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:44 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1288 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:44.473825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-12278d42-f0e2-40b6-a053-f2019400be82 req-10d75120-5358-4dd6-b1a3-9fe12c4f372b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e", "name": "network-vif-deleted", "tag": "65016d87-3cc1-4558-be87-d361a9b5bbc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:44.483854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-12278d42-f0e2-40b6-a053-f2019400be82 req-10d75120-5358-4dd6-b1a3-9fe12c4f372b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.484325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-12278d42-f0e2-40b6-a053-f2019400be82 req-10d75120-5358-4dd6-b1a3-9fe12c4f372b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.498697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-12278d42-f0e2-40b6-a053-f2019400be82 req-10d75120-5358-4dd6-b1a3-9fe12c4f372b service nova] Creating event network-vif-deleted:65016d87-3cc1-4558-be87-d361a9b5bbc3 for instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e on n-h2-826756-5 Aug 03 04:33:44.503798 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-12278d42-f0e2-40b6-a053-f2019400be82 req-10d75120-5358-4dd6-b1a3-9fe12c4f372b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Aug 03 04:33:44.505055 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 376/725] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:44.511325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:44.513869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:44.518512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.519032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.519829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.520339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.787920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.800828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-36442a22-ae91-4c8d-ac8a-ba2992fceee0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.543843 Aug 03 04:33:44.801645 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 350/726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:44 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:33:44.834248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:44.845408 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02b60bcd-bf79-4a1b-8b8f-03fe38c84596 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1474 microversion: 2.1 time: 0.339384 Aug 03 04:33:44.846255 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 377/727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:44 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1474 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:44.906266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-01cbea27-9b80-4070-a658-8cd09aeec5e9 req-4e85de05-4b9a-4a75-962e-ee90c73b037c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66de5839-7706-4868-8e0e-7ccd9e276946", "name": "network-vif-plugged", "status": "completed", "tag": "b306fac0-0978-4a80-9a1b-f53ad55263a6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:44.925063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-01cbea27-9b80-4070-a658-8cd09aeec5e9 req-4e85de05-4b9a-4a75-962e-ee90c73b037c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:44.925783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-01cbea27-9b80-4070-a658-8cd09aeec5e9 req-4e85de05-4b9a-4a75-962e-ee90c73b037c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:44.938576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-01cbea27-9b80-4070-a658-8cd09aeec5e9 req-4e85de05-4b9a-4a75-962e-ee90c73b037c service nova] Creating event network-vif-plugged:b306fac0-0978-4a80-9a1b-f53ad55263a6 for instance 66de5839-7706-4868-8e0e-7ccd9e276946 on n-h2-826756-5 Aug 03 04:33:44.944133 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-01cbea27-9b80-4070-a658-8cd09aeec5e9 req-4e85de05-4b9a-4a75-962e-ee90c73b037c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041541 Aug 03 04:33:44.944917 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 351/728] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:45.096773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:45.098177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] [instance: 59e59026-47a5-4fb9-b1c4-9a9aa26af439] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:45.120958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.121517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.126196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.126990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.153484 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] HTTP exception thrown: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Request method failure captured: Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 HTTP/1.1 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpb5IRGYH2d7dVKghWd0g3_EXwSEG6j-GWnDmYGwO_mBgvqp0JS0wRIFjygw2fCs-0YFY8n4fKhEQhEc4MkOyj7wk6nqFrMgvuXFqGNLVR-JyWVMoeGLmcIvI3HnoOuIWOqLzuj88RlzmfP9fDJqmIDXUg9dSSnfZsYFcmeEX7dH6I Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:45.155427 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7047317821904de5a740f4732994a9b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7047317821904de5a740f4732994a9b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7047317821904de5a740f4732994a9b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7047317821904de5a740f4732994a9b0 Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1897335300 Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: db179c437f284920b453883cc24ecbf5 Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1897335300-project Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. Aug 03 04:33:45.156947 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '59e59026-47a5-4fb9-b1c4-9a9aa26af439'} Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:45.157670 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. Aug 03 04:33:45.158846 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:45.169837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] Returning 404 to user: Instance 59e59026-47a5-4fb9-b1c4-9a9aa26af439 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:45.171144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d2c1e66-a1ee-47fe-bd50-aa32fcbafeae tempest-FloatingIPsAssociationTestJSON-1897335300 tempest-FloatingIPsAssociationTestJSON-1897335300-project] 10.222.0.72 "GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439" status: 404 len: 111 microversion: 2.1 time: 0.079973 Aug 03 04:33:45.172461 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 378/729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:45 2022] GET /compute/v2.1/servers/59e59026-47a5-4fb9-b1c4-9a9aa26af439 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:45.208395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:45.209446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:45.216251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.217188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.218124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.218714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.259495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.260196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.260834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lazy-loading 'fault' on Instance uuid a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:33:45.311554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ce20ff6e8847589b9fef03fffe4981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cd3935f43704fa48034d787ff2672d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:45.325044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66b9cf00-8b5c-4144-8011-2f6d2882ea55 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 200 len: 1309 microversion: 2.1 time: 0.120759 Aug 03 04:33:45.326406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 352/730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:45 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:45.496862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:45.500795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:45.517846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.518617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.520959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.521186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.654702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:45.665921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:45.667705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:45.668939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc001249-5241-48e5-bf6e-8a068f22b62e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1344 microversion: 2.25 time: 0.181601 Aug 03 04:33:45.670685 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 379/731] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:45 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1344 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:45.823977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:45.825169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:45.833256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.833709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.834492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.834945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.872165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:45.877089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:45.897736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.900915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:45.904368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:45.907044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.659835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:46.669999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e16d0c33-44da-48af-8dac-8df8193708a6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1314 microversion: 2.1 time: 0.850698 Aug 03 04:33:46.670816 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 353/732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:45 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:46.688977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:46.689811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:46.698188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.698949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.699875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.700493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.702458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:46.711581 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-258e93be-5314-45aa-9f90-3f57f4f7091b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1471 microversion: 2.1 time: 0.848289 Aug 03 04:33:46.713902 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 380/733] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:45 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1471 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:46.732418 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e HTTP/1.1 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:46.734293 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.735754 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e'} Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:46.736569 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.737715 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.738736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:46.738736 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0b069d2-1a8c-4bd3-9928-6d24145f1dd4 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 404 len: 111 microversion: 2.1 time: 0.050918 Aug 03 04:33:46.738736 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 354/734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:46 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:46.741004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:46.741831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:46.750694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:46.751239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:46.751453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.752069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.753099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.753732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.760613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.761066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.761847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.762334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.933792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:46.943261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:46.945601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:46.946903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7cb5955f-7b99-43b4-9caa-4bd43f25099b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1342 microversion: 2.25 time: 0.215628 Aug 03 04:33:46.947469 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 381/735] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:46 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:46.952109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:46.952638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:46.958563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.959038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.959972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.961173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.975432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e HTTP/1.1 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:46.977171 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.978701 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e'} Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:46.979567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:46.981080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:46.982483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:46.982483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-128aa630-602d-45db-a2a7-e1dc5d57f846 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 404 len: 111 microversion: 2.1 time: 0.030142 Aug 03 04:33:46.982483 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 382/736] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:46 2022] DELETE /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:46.990992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:46.992133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:46.998581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:46.999146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:46.999978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.000458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.015085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e HTTP/1.1 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:33:47.016605 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:47.018025 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e'} Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:47.018881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. Aug 03 04:33:47.023494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.030697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:47.030697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ed27029-138d-4476-8d31-2c2a6d4bc8c8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e" status: 404 len: 111 microversion: 2.1 time: 0.030934 Aug 03 04:33:47.035140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92cdcf46-9dad-43b7-9b4f-cf9678966774 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7/action" status: 204 len: 0 microversion: 2.1 time: 0.292209 Aug 03 04:33:47.035140 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 355/738] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:46 2022] POST /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7/action => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:47.035367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 383/738] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:46 2022] GET /compute/v2.1/servers/a5a39902-b9c1-48fd-b1b8-1a1f7d4e180e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:33:47.036407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:47.037220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:47.045276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:47.048482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:47.056913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.058810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.058810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.059155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.061616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.062070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.063400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.063400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.095778 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 HTTP/1.1 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:47.097498 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.099038 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '702edda0-8ebc-4784-8a7b-41613ae38bb1'} Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:47.099944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.101614 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.103738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:47.104812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d51e77a6-9685-4075-9908-ef40863f2dd8 tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "DELETE /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 404 len: 111 microversion: 2.1 time: 0.072544 Aug 03 04:33:47.108889 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 356/739] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:33:47 2022] DELETE /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:47.114056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:47.114876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] [instance: 702edda0-8ebc-4784-8a7b-41613ae38bb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:47.121411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.122189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.123157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.123757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.138977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] HTTP exception thrown: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Request method failure captured: Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 HTTP/1.1 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpnt0lqOiJE-FUH4yBpLk3jxnPZYrD2we19qqyUU57G52Cep6is-6dfiZm9x2EVi0LHMTZn_jvofUuo-dCr9cLWAaLO0-4PSkstE90QmDEuz-mQ3aziWO41YPAuFLxLlh9TAG7dRm1dldrNw9cvO3AmuU6-VTnl-cpaPI4Jhv0llbM Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:33:47.141586 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9cd3935f43704fa48034d787ff2672d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9cd3935f43704fa48034d787ff2672d9 Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1142744816 Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 63ce20ff6e8847589b9fef03fffe4981 Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersAdminTestJSON-1142744816-project Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.143128 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '702edda0-8ebc-4784-8a7b-41613ae38bb1'} Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:33:47.144012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. Aug 03 04:33:47.145545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:33:47.147633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] Returning 404 to user: Instance 702edda0-8ebc-4784-8a7b-41613ae38bb1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:33:47.149332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec5a7728-4f20-42fa-8d8c-854112ad60df tempest-DeleteServersAdminTestJSON-1142744816 tempest-DeleteServersAdminTestJSON-1142744816-project] 10.222.0.72 "GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1" status: 404 len: 111 microversion: 2.1 time: 0.039301 Aug 03 04:33:47.150116 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 357/740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:47 2022] GET /compute/v2.1/servers/702edda0-8ebc-4784-8a7b-41613ae38bb1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:33:47.416607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "name": "network-vif-plugged", "status": "completed", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:47.428652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.430009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.434662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:47.442539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c55709d-e09a-42a9-b7ad-c23d452522db tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1471 microversion: 2.1 time: 0.402841 Aug 03 04:33:47.456294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] Creating event network-vif-plugged:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h1-826756-5 Aug 03 04:33:47.456294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:33:47.457203 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 384/741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:47 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:47.481460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-511129eb-4d30-4800-b571-b1990e375340 req-3ea7ee5b-4e58-451d-adb9-28a3b23b292d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069207 Aug 03 04:33:47.497500 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 358/742] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:33:47.703118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:47.704500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:47.711880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.712690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.721670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.721670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.972993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:47.985372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:47.995898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.996705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:47.997989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:47.998724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:48.492580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:48.509312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-367ac624-0ec2-486e-8215-f9c2bffa7dca tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1463 microversion: 2.1 time: 0.822157 Aug 03 04:33:48.509911 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 385/743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:47 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1463 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:48.514476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:48.515175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:48.527566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:48.537059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:48.538929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:48.539729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:48.654150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:48.664428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:48.672469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:48.674169 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2833310-94a2-41eb-b64d-625bd98d5b1c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.705838 Aug 03 04:33:48.692930 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 359/744] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:47 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:33:48.996310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:49.009510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'deleted': False, 'project_id': 'cce4a43081664277a2c8760b7d93f748'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:49.016250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.016719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.017761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.018205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.046792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:49.053445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e4f4d7a-8d76-43e4-b53a-6ca8e49f7e35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1471 microversion: 2.1 time: 0.542504 Aug 03 04:33:49.056617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 386/745] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:48 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1471 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:49.201255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-353df415-1cfe-423e-a0b4-3e3546cf0e39 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.517100 Aug 03 04:33:49.202903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 360/746] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:33:48 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:49.224398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:49.232470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'deleted': False} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:49.243919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.243919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.244172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.244668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.405432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:33:49.567889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.568460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.708593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:49.709770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:49.720557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.722020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:49.723819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:49.724589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:50.536610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:50.547513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:50.550444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:50.551718 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b070fa7-02ad-4a70-ac2f-610cacf2e3b3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.847936 Aug 03 04:33:50.553405 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 361/747] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:49 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:50.564746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:50.565578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:50.582272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:50.582971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:50.583950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:50.585577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.050604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:51.058642 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17072e35-5563-48bf-ae78-08ac401111ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1463 microversion: 2.1 time: 0.503451 Aug 03 04:33:51.078158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 362/748] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:50 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1463 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:51.083951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7228ad47-5cfa-4a90-991f-b4eae092362e req-1bfdec5f-c20e-4e66-b841-0dad6bb64079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:51.096434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7228ad47-5cfa-4a90-991f-b4eae092362e req-1bfdec5f-c20e-4e66-b841-0dad6bb64079 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.097222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7228ad47-5cfa-4a90-991f-b4eae092362e req-1bfdec5f-c20e-4e66-b841-0dad6bb64079 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.113292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7228ad47-5cfa-4a90-991f-b4eae092362e req-1bfdec5f-c20e-4e66-b841-0dad6bb64079 service nova] Creating event network-changed:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h1-826756-5 Aug 03 04:33:51.142415 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7228ad47-5cfa-4a90-991f-b4eae092362e req-1bfdec5f-c20e-4e66-b841-0dad6bb64079 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062634 Aug 03 04:33:51.154094 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 363/749] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:51.169702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:51.173408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:51.185729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.186515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.187504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.188136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.192876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:51.229136 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f195a38e-cdc3-4294-99f9-367f955ebfb4 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13099 microversion: 2.1 time: 2.009597 Aug 03 04:33:51.229883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 387/750] 10.222.0.72 () {58 vars in 1171 bytes} [Wed Aug 3 04:33:49 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13099 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:33:51.279631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:51.285773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'deleted': False, 'project_id': 'cce4a43081664277a2c8760b7d93f748'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:51.291947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.292754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.293625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.294237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.420227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0153e256-c64a-4a35-97fe-f51490a4fd52 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail?tenant_id=546823ffdb0d45d997b427498813a742" status: 200 len: 15 microversion: 2.1 time: 0.146199 Aug 03 04:33:51.433365 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 388/751] 10.222.0.72 () {58 vars in 1231 bytes} [Wed Aug 3 04:33:51 2022] GET /compute/v2.1/servers/detail?tenant_id=546823ffdb0d45d997b427498813a742 => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:33:51.442891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cafe85f5-5077-4b43-a875-71fdc3490b30 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd55116310>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:51.480984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b870cac-c95f-4c81-9a37-979b5e203b7a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1614 microversion: 2.1 time: 0.324367 Aug 03 04:33:51.481868 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 364/752] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:51 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1614 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:51.504767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:51.534627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'tenant_id': '546823ffdb0d45d997b427498813a742', 'deleted': False} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:51.548135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cafe85f5-5077-4b43-a875-71fdc3490b30 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32" status: 200 len: 637 microversion: 2.1 time: 0.112807 Aug 03 04:33:51.549095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 389/753] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:33:51 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32 => generated 637 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:51.551486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.552446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.553417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.554212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.560815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f9d1c5c8-6f4a-4235-adec-939a4b213412 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '.version_select at 0x7fdd55035430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:51.565207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9d1c5c8-6f4a-4235-adec-939a4b213412 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.567353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9d1c5c8-6f4a-4235-adec-939a4b213412 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:51.593903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f9d1c5c8-6f4a-4235-adec-939a4b213412 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.043485 Aug 03 04:33:51.598997 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 390/754] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:33:51 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:51.600296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:33:51.608115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14109a21-3fbc-4bd5-9543-2c3bc0d8ed97 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd54f3aca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:51.718158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-14109a21-3fbc-4bd5-9543-2c3bc0d8ed97 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:51.735055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-14109a21-3fbc-4bd5-9543-2c3bc0d8ed97 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:51.816190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:51.816190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.139742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5632abf-cf72-4783-a2d7-16a2e61d697a tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=546823ffdb0d45d997b427498813a742" status: 200 len: 4824 microversion: 2.1 time: 0.641339 Aug 03 04:33:52.140666 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 365/755] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 04:33:51 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=546823ffdb0d45d997b427498813a742 => generated 4824 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:52.146027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:52.146908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:52.161258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.169695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.172480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.173250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.337748 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14109a21-3fbc-4bd5-9543-2c3bc0d8ed97 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.740764 Aug 03 04:33:52.339211 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 391/756] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:51 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:52.346955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-637217828", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:52.462529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:33:52.521425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:52.530552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:52.532060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:52.533315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a41ed9f-455f-488e-a711-2b209eefad82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.391447 Aug 03 04:33:52.533843 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 366/757] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:52 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:52.538580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:52.544859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'tenant_id': 'cce4a43081664277a2c8760b7d93f748', 'deleted': False} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:52.550359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.551007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.551797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.552407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.615557 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c20d3001-ace7-4533-9b0a-adef92069fb5 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cce4a43081664277a2c8760b7d93f748" status: 200 len: 15 microversion: 2.1 time: 0.079993 Aug 03 04:33:52.625174 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 367/758] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 04:33:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=cce4a43081664277a2c8760b7d93f748 => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:52.639264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1275d2c9-f4ad-463b-b6d0-37b9f6fdbf5d tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd54d720d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:52.854534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:52.855023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:52.855617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:52.856038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:52.856639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:52.860381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:52.878793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.879257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.880110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:52.880587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:52.920329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:52.934470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:52.957270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:33:52.962017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:33:53.093090 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86a3702a-ea49-46b5-8ac6-b3f8a89d2fe1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751887 Aug 03 04:33:53.094806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 392/759] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:33:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:33:53.101840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-884ff4d4-36ea-49aa-b637-813b38be8908 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:53.108023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-884ff4d4-36ea-49aa-b637-813b38be8908 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.011959 Aug 03 04:33:53.108931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 393/760] 10.222.0.72 () {58 vars in 1189 bytes} [Wed Aug 3 04:33:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:53.120207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64f4330a-29be-4cb9-9396-c45791eba3e6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:53.120207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64f4330a-29be-4cb9-9396-c45791eba3e6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:53.204208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64f4330a-29be-4cb9-9396-c45791eba3e6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:53.215026 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64f4330a-29be-4cb9-9396-c45791eba3e6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1212 microversion: 2.1 time: 0.104798 Aug 03 04:33:53.215970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 394/761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:53 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:53.222777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:53.226119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:53.242733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:53.248066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:53.249279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:53.249974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:53.415260 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1275d2c9-f4ad-463b-b6d0-37b9f6fdbf5d tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "DELETE /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.789380 Aug 03 04:33:53.417389 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 368/762] 10.222.0.72 () {58 vars in 1296 bytes} [Wed Aug 3 04:33:52 2022] DELETE /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_version => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:33:53.426057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07472066-f0e7-4dd8-a059-a039a06d5094 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd54d723a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:53.496541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07472066-f0e7-4dd8-a059-a039a06d5094 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074733 Aug 03 04:33:53.497123 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 369/763] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:33:53 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:53.510200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd5fb620-ebcb-4d31-8822-b092ae91df3c tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd54ee69d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:53.621376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fd5fb620-ebcb-4d31-8822-b092ae91df3c tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:53.633167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fd5fb620-ebcb-4d31-8822-b092ae91df3c tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:53.635064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9175ef3-b19a-400e-a9ea-fcf4664ee20f tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 0 microversion: 2.1 time: 0.417513 Aug 03 04:33:53.636562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 395/764] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:53 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:33:53.647099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:53.654006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:53.671173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:53.681608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:53.683524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:53.684876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:53.688687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:53.792133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:33:54.393173 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd5fb620-ebcb-4d31-8822-b092ae91df3c tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.888152 Aug 03 04:33:54.395101 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 370/765] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:53 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:54.413020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:54.422754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:54.424850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '546823ffdb0d45d997b427498813a742'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:54.434180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.434910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.435861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.436597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.461687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:54.477358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:54.482972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:54.489517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3aed3f02-8c66-46e5-803e-56e83c2ae30a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.851934 Aug 03 04:33:54.490330 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 396/766] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:53 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:54.508074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:54.508974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:54.520642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.524254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.525522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.526213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.576567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:33:54.675390 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb416d42-3780-4ff8-bf78-4b4f36b26d11 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.277976 Aug 03 04:33:54.676996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 371/767] 10.222.0.72 () {58 vars in 1150 bytes} [Wed Aug 3 04:33:54 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:54.683003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8ce1053-dd83-4917-8737-3f8111c58a95 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd54fb4940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:54.735208 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8ce1053-dd83-4917-8737-3f8111c58a95 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.056318 Aug 03 04:33:54.736050 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 372/768] 10.222.0.72 () {58 vars in 1290 bytes} [Wed Aug 3 04:33:54 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_distro => generated 33 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:54.830713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:54.842467 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aafdb5e4-7bb9-4f06-a120-41642dd5f3f4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1216 microversion: 2.1 time: 0.349877 Aug 03 04:33:54.843348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 397/769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:54 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1216 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:54.848676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:54.854422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:54.859415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.860589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.861934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.862606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:54.971773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Calling method '.version_select at 0x7fdd54e0a280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:54.972687 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:54.972687 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:33:54.974099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:54.974543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.060038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.060038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.084121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.089032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.098749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f364bd0b-93b4-4af9-88f0-c6fbce5a31e0 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.361418 Aug 03 04:33:55.099723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 373/770] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:33:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:33:55.110932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0acb44a3-c5ab-4f69-b236-cc67d104eb55 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd54e0af70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:55.179521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0acb44a3-c5ab-4f69-b236-cc67d104eb55 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:55.184523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0acb44a3-c5ab-4f69-b236-cc67d104eb55 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:55.320552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a09bce4-0c5a-437c-b38e-f9eaee459f9b tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 0 microversion: 2.1 time: 0.475128 Aug 03 04:33:55.321766 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 398/771] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:54 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:33:55.327592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Calling method '.version_select at 0x7fdd551db5e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:55.328611 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:33:55.328611 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:33:55.331346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.331346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.374641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.375358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.385471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffc4dad4-9565-4313-a32a-a04e52afb730 tempest-HypervisorAdminV228Test-1847181902 tempest-HypervisorAdminV228Test-1847181902-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.061240 Aug 03 04:33:55.386279 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 399/772] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:33:55 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:33:55.396052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:55.396996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:55.407282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.408570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.410226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.411027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.445320 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0acb44a3-c5ab-4f69-b236-cc67d104eb55 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.342586 Aug 03 04:33:55.445925 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 374/773] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:55 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:55.454877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0de9336-beef-44bc-be51-67b556acdb40 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd54e0aaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:55.530313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0de9336-beef-44bc-be51-67b556acdb40 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079068 Aug 03 04:33:55.530903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 375/774] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:33:55 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:33:55.535878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:55.544641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:55.560152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.560636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.561500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.561877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.915056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e29359c-bb97-427d-be1e-e6362e20d3e6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1613 microversion: 2.1 time: 0.527056 Aug 03 04:33:55.915671 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 400/775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:55 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1613 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:55.928832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:55.942483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-515a5bde-a9b2-400b-a4bc-6c2f47781769 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd553ca940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:55.946972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:55.946972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:55.947637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0eb57297-e6b1-4aeb-9091-108235717cf7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.415793 Aug 03 04:33:55.948213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 376/776] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:55 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:55.965907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:55.966760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:55.976713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.984087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:55.985250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:55.986028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:56.048058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-515a5bde-a9b2-400b-a4bc-6c2f47781769 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:56.079358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-515a5bde-a9b2-400b-a4bc-6c2f47781769 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:56.093099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:56.105634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-def94ae8-9577-4c03-9b91-208de36b0247 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1264 microversion: 2.1 time: 0.153879 Aug 03 04:33:56.106759 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 377/777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:55 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:56.119433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:56.122847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:56.133977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:56.134702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:56.139731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:56.140420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:56.440948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-515a5bde-a9b2-400b-a4bc-6c2f47781769 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.519686 Aug 03 04:33:56.441777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 401/778] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:55 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:56.466640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9503b161-1d9d-460f-a9c1-afee9669f247 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd55054d30>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:56.627670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9503b161-1d9d-460f-a9c1-afee9669f247 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:56.637081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9503b161-1d9d-460f-a9c1-afee9669f247 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:56.903272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e86a876-316c-4502-8c21-4daab6c154d6 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1613 microversion: 2.1 time: 0.793689 Aug 03 04:33:56.924404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 378/779] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:56 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1613 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:56.964503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:56.975121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'host': 'n-h2-826756-5', 'deleted': False} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:56.984210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:56.984984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:56.986546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:56.987260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.184089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:33:57.326470 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ccb66e00-4250-473a-a8d3-6fc97f39a1a3 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers?host=n-h2-826756-5&all_tenants=1" status: 200 len: 1325 microversion: 2.1 time: 0.378387 Aug 03 04:33:57.327619 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 379/780] 10.222.0.72 () {58 vars in 1190 bytes} [Wed Aug 3 04:33:56 2022] GET /compute/v2.1/servers?host=n-h2-826756-5&all_tenants=1 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:57.333463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:57.334674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:57.343515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.344676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.346288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.346918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.503155 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9503b161-1d9d-460f-a9c1-afee9669f247 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 64 microversion: 2.1 time: 1.054905 Aug 03 04:33:57.504137 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 402/781] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:56 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 64 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:33:57.510264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:57.512456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:57.520210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.520680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.522131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.522131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.654459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:57.668950 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e0c2a64-3070-49a3-a11d-0da637f45b78 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1270 microversion: 2.1 time: 0.163189 Aug 03 04:33:57.684413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 403/782] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:57 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:57.689519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:57.705111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:33:57.713263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.719628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.719628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:57.719628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:57.915821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e7274b9-adff-4675-9b27-fe95e9303fe9 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.230163 Aug 03 04:33:57.923858 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 404/783] 10.222.0.72 () {58 vars in 1196 bytes} [Wed Aug 3 04:33:57 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:57.930688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c9ffc972-aa93-4a2e-a3a9-ae2e7bd2827a tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd551dcd30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:57.991014 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c9ffc972-aa93-4a2e-a3a9-ae2e7bd2827a tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 64 microversion: 2.1 time: 0.065253 Aug 03 04:33:57.993663 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 405/784] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:33:57 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 64 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:58.002379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-be9fa120-5471-4cbb-a6cd-fe372a619302 req-102dae78-dc77-4ebd-99d0-be4c23184254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "name": "network-vif-plugged", "status": "completed", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:58.014239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-be9fa120-5471-4cbb-a6cd-fe372a619302 req-102dae78-dc77-4ebd-99d0-be4c23184254 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:58.015042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-be9fa120-5471-4cbb-a6cd-fe372a619302 req-102dae78-dc77-4ebd-99d0-be4c23184254 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:58.050531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-be9fa120-5471-4cbb-a6cd-fe372a619302 req-102dae78-dc77-4ebd-99d0-be4c23184254 service nova] Creating event network-vif-plugged:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h1-826756-5 Aug 03 04:33:58.063019 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-be9fa120-5471-4cbb-a6cd-fe372a619302 req-102dae78-dc77-4ebd-99d0-be4c23184254 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065253 Aug 03 04:33:58.063669 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 406/785] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:33:58.074037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:58.078009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:58.104012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:58.105805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:58.107223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:58.116495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:58.177626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:58.199024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:58.208094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:58.209300 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e3b5d99-286a-4bbb-a3b2-d8b34e15ac03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.880451 Aug 03 04:33:58.214211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 380/786] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:57 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:33:58.241532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef152316-a112-4d90-a270-2f16b21d51de tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd54efe5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:58.343332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ef152316-a112-4d90-a270-2f16b21d51de tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:58.359757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ef152316-a112-4d90-a270-2f16b21d51de tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:58.571568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-033780fd-6e12-449c-8cdc-b59b3a9ce6bf tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 0 microversion: 2.1 time: 0.505058 Aug 03 04:33:58.572353 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 407/787] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:58 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:33:58.586281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:58.594790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:58.617266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:58.617733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:58.618553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:58.625115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:58.853672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:33:58.854115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:33:58.856595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:33:58.857118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:33:58.861600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:33:59.097809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef152316-a112-4d90-a270-2f16b21d51de tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.883597 Aug 03 04:33:59.098953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 381/788] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:33:58 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:59.104202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:59.106124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:59.113723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.114249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.115107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.116787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.172250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:59.193378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.197736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.197736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.197945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.251180 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-85f05d66-243e-4e8f-8fac-6f4feb16dee6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 1066 microversion: 2.1 time: 0.669445 Aug 03 04:33:59.252092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 408/789] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:33:58 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 1066 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 04:33:59.257672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47e434fc-3f5b-439e-aca0-c207af18234f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update', calling method: .version_select at 0x7fdd55192f70>, body: {"meta": {"os_version": "alt"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:33:59.362938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-47e434fc-3f5b-439e-aca0-c207af18234f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:33:59.377106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-47e434fc-3f5b-439e-aca0-c207af18234f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:33:59.681325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:33:59.696697 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16b39c8c-d896-4366-93d3-2cf325ca9c73 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.593704 Aug 03 04:33:59.713397 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 382/790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:59 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:33:59.736143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:59.736143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:59.751089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.751856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.753235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.753845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.963509 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47e434fc-3f5b-439e-aca0-c207af18234f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.710075 Aug 03 04:33:59.970979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 409/791] 10.222.0.72 () {60 vars in 1313 bytes} [Wed Aug 3 04:33:59 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata/os_version => generated 31 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:33:59.984752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:33:59.984752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:33:59.991747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.994329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:33:59.995859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:33:59.996672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:00.573223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:00.581905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:00.583670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:00.585725 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf0f9e4b-fda5-46c0-b626-4676768a1477 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1410 microversion: 2.25 time: 0.867553 Aug 03 04:34:00.600505 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 383/792] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:33:59 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1410 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:34:00.606807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d185c7fe-4023-4087-84ff-8013dbe6e16d tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd54f6f280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:00.625226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:00.638817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5c3131d-4963-441c-b8d7-b746ba0d1247 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.665220 Aug 03 04:34:00.640593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 410/793] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:33:59 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:00.667314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d185c7fe-4023-4087-84ff-8013dbe6e16d tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 58 microversion: 2.1 time: 0.065169 Aug 03 04:34:00.679694 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 384/794] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:34:00 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 58 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:00.715411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-994f81a4-88e5-4c4f-9458-c7cd280b329f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'update_all', calling method: .version_select at 0x7fdd54f6f670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:00.775654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-994f81a4-88e5-4c4f-9458-c7cd280b329f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:00.780728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-994f81a4-88e5-4c4f-9458-c7cd280b329f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:01.057757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1289951900", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "adbcf694-b47e-4d38-a831-56cef3ebb590"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:01.136538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] validate_networks() for [('adbcf694-b47e-4d38-a831-56cef3ebb590', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:34:01.253498 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-994f81a4-88e5-4c4f-9458-c7cd280b329f tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 61 microversion: 2.1 time: 0.543380 Aug 03 04:34:01.254741 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 385/795] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:34:00 2022] PUT /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 61 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:01.263662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:01.264347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:01.270690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:01.271149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:01.272546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:01.273269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:01.712744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:01.739348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d250278-2967-4e70-b1a4-203456a24f2e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.477838 Aug 03 04:34:01.741840 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 386/796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:01 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:01.755776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c11679d4-e7c1-4b9a-bc61-3e9a7172d4b8 req-5a138907-0a2e-4915-b77b-3bfa9955f32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:01.784350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c11679d4-e7c1-4b9a-bc61-3e9a7172d4b8 req-5a138907-0a2e-4915-b77b-3bfa9955f32e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:01.796614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c11679d4-e7c1-4b9a-bc61-3e9a7172d4b8 req-5a138907-0a2e-4915-b77b-3bfa9955f32e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:01.815525 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c11679d4-e7c1-4b9a-bc61-3e9a7172d4b8 req-5a138907-0a2e-4915-b77b-3bfa9955f32e service nova] Creating event network-changed:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h1-826756-5 Aug 03 04:34:01.825522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c11679d4-e7c1-4b9a-bc61-3e9a7172d4b8 req-5a138907-0a2e-4915-b77b-3bfa9955f32e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081999 Aug 03 04:34:01.827417 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 387/797] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:01.837256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0859fbbe-1023-4bb4-b706-9b2c28050554 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Action: 'create', calling method: .version_select at 0x7fdd552e5790>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:01.944356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=35 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:01.945493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0859fbbe-1023-4bb4-b706-9b2c28050554 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:01.951254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0859fbbe-1023-4bb4-b706-9b2c28050554 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Getting quotas for user 13a911d28af6448baad6c6aa80462d55 and project 03e701b537f24bfda602b4d62deedbcd. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:02.179309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:34:02.180633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:34:02.181535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:34:02.182195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:34:02.183318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:34:02.198461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.200781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:02.202319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.207623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:02.254644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Getting quotas for project c47360eecc8e4f16a26eb8a1e64d9ee8. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:02.274921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Getting quotas for user 92f59caf8c414149bfe4c9852630d7d4 and project c47360eecc8e4f16a26eb8a1e64d9ee8. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:02.289528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:34:02.297381 n-d-826756-5 devstack@n-api.service[120832]: WARNING nova.utils [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1289951900 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-128995190 Aug 03 04:34:02.297381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:34:02.398988 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-467ce097-2087-4d88-9be1-a02d4f209812 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755944 Aug 03 04:34:02.400352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 411/798] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:34:02.406440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:02.407694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:02.418336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.418848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:02.420387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.420849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:02.507099 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0859fbbe-1023-4bb4-b706-9b2c28050554 tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "POST /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 85 microversion: 2.1 time: 0.677594 Aug 03 04:34:02.507985 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 388/799] 10.222.0.72 () {60 vars in 1281 bytes} [Wed Aug 3 04:34:01 2022] POST /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 85 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:02.514659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:02.517185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:02.541233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.541929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:02.543744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:02.544661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:03.036299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.038129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.039353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.039353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.039353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fafb841e-0a1e-4731-afb9-d99d277132a5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1606 microversion: 2.25 time: 0.491033 Aug 03 04:34:03.039836 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 412/800] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:34:02 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1606 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:34:03.039999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27ad8813-bdc5-409a-a1c0-751f5ac25102 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.385410 Aug 03 04:34:03.039999 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 389/801] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:02 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:03.040137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b0a87c01-b082-4d40-bc8c-51e190d716ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:03.040137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b0a87c01-b082-4d40-bc8c-51e190d716ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:03.040288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34f66626-745e-40e5-be56-98ca2305e99e tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] Calling method '.version_select at 0x7fdd553d0d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:03.040288 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34f66626-745e-40e5-be56-98ca2305e99e tempest-ImagesMetadataTestJSON-840730164 tempest-ImagesMetadataTestJSON-840730164-project] 10.222.0.72 "GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata" status: 200 len: 85 microversion: 2.1 time: 0.048890 Aug 03 04:34:03.040288 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 390/802] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:34:02 2022] GET /compute/v2.1/images/f64d5a8d-4f6e-4c72-b4a7-c5ddd8c9bc32/metadata => generated 85 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:03.040288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:03.040288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:03.040624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:03.040624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:03.040624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:03.040624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:03.040882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b0a87c01-b082-4d40-bc8c-51e190d716ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.040882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b0a87c01-b082-4d40-bc8c-51e190d716ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1232 microversion: 2.1 time: 0.079489 Aug 03 04:34:03.040882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 413/803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:02 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1232 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:03.052655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:03.053352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:03.066884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:03.071566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:03.074127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:03.075115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:03.344246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdc51761-a9e2-4ae0-80da-b5c09cac61d1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.297308 Aug 03 04:34:03.344976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 414/804] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:34:03 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:34:03.359045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:03.363598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:03.372183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ac57c5a4-c737-4b33-a23f-0a743f7e8703 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.425565 Aug 03 04:34:03.373004 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 391/805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:02 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:04.044669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6bd99ba1-59dc-4bd0-a945-435f296e8e1f tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:04.046744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6bd99ba1-59dc-4bd0-a945-435f296e8e1f tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:04.049241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:04.049940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:04.081186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.081186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.081186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.081186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.284855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6bd99ba1-59dc-4bd0-a945-435f296e8e1f tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:04.306976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6bd99ba1-59dc-4bd0-a945-435f296e8e1f tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1232 microversion: 2.1 time: 0.265965 Aug 03 04:34:04.307575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 392/806] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:04 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1232 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:04.328109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:04.328878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:04.350810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.351268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.358538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.359214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.443101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:34:04.503481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:04.508962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:04.517259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e132fcf-fd48-47aa-ba13-86e221869396 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.477613 Aug 03 04:34:04.536256 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 415/807] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:04 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:04.562004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:04.564131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:04.579547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.580672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.582047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.582661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.808736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:04.822524 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6c531f4-df79-4756-af26-06fa9fd46bf1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.284965 Aug 03 04:34:04.825292 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 416/808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:04 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:04.936519 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9859245-600a-4afa-903e-28b6033b48e0 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 204 len: 0 microversion: 2.1 time: 0.624668 Aug 03 04:34:04.937478 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 393/809] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:34:04 2022] DELETE /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:34:04.955180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:04.960043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:04.968071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.969082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:04.984806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:04.986692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.195039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:05.204689 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff2de925-1f58-41b1-92dc-51fd1d6a76fe tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1710 microversion: 2.1 time: 0.260960 Aug 03 04:34:05.205514 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 417/810] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:04 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1710 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:05.328626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:05.330464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:05.339698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.340704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.342090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.347965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.437361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:05.447723 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7c188df-3ac1-4228-8b55-dd19df75598a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1284 microversion: 2.1 time: 0.124141 Aug 03 04:34:05.449883 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 394/811] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:05 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:05.541157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:05.542554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:05.546260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:05.550914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.551439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.552303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.553063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.741084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:05.755678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5cbf0733-81bc-472c-8620-1548abea6282 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.220132 Aug 03 04:34:05.769932 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 418/812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:05 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:05.853393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:05.854269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:05.872930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.874653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:05.882439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:05.883252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.113845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:06.124682 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c02d1f5-b6fc-4237-a64a-81de5af4f04e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.276278 Aug 03 04:34:06.125983 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 395/813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:05 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:06.227956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:06.228615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:06.237029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.239560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.241435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.245174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.475884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:06.477927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:06.507300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.509848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.516521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.519451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.618805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:06.636866 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7999c17f-7501-467d-8ffe-1804df183954 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1710 microversion: 2.1 time: 0.407976 Aug 03 04:34:06.647415 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 419/814] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:06 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1710 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:06.659201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-699cabe9-b71d-49ed-aa4a-d368f5ca4f35 req-c960b27f-fedc-47f4-8f11-fdaffa56e982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:06.672450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-699cabe9-b71d-49ed-aa4a-d368f5ca4f35 req-c960b27f-fedc-47f4-8f11-fdaffa56e982 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.672909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-699cabe9-b71d-49ed-aa4a-d368f5ca4f35 req-c960b27f-fedc-47f4-8f11-fdaffa56e982 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.675909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:06.686140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4ca757b-fb26-46ee-ba29-116d9cd8593c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1290 microversion: 2.1 time: 0.219827 Aug 03 04:34:06.687298 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 396/815] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:06 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1290 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:06.713281 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-699cabe9-b71d-49ed-aa4a-d368f5ca4f35 req-c960b27f-fedc-47f4-8f11-fdaffa56e982 service nova] Creating event network-changed:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h1-826756-5 Aug 03 04:34:06.728761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-699cabe9-b71d-49ed-aa4a-d368f5ca4f35 req-c960b27f-fedc-47f4-8f11-fdaffa56e982 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079855 Aug 03 04:34:06.729745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 420/816] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:06.786177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:06.786844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:06.804690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.805147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:06.809827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:06.810351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.062103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:07.148621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:07.149341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:07.168964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.168964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.168964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.168964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.249927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:07.263913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2a47216-2cea-4af5-b05a-cc885a0be7a2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.482570 Aug 03 04:34:07.277961 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 397/817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:06 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:07.616302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:07.635703 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4311435e-9917-4971-99b2-6a9262ab1a10 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.492904 Aug 03 04:34:07.652306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 421/818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:07 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:07.662184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:07.663169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:07.669715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.670171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.679413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.679636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.712008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:07.716646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:07.723818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.724634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:07.725592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:07.726195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:08.417727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:08.430298 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e7b3541-0393-4ea7-b484-5c8aa09f0180 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1290 microversion: 2.1 time: 0.722054 Aug 03 04:34:08.432878 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 422/819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:07 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1290 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:08.440555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-895eafad-a2ee-45bf-b3aa-5e41a4b9347d req-93e85012-c056-482a-be40-b23c39d0614c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "name": "network-vif-plugged", "status": "completed", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:08.451561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-895eafad-a2ee-45bf-b3aa-5e41a4b9347d req-93e85012-c056-482a-be40-b23c39d0614c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:08.452983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-895eafad-a2ee-45bf-b3aa-5e41a4b9347d req-93e85012-c056-482a-be40-b23c39d0614c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:08.467617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-895eafad-a2ee-45bf-b3aa-5e41a4b9347d req-93e85012-c056-482a-be40-b23c39d0614c service nova] Creating event network-vif-plugged:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h1-826756-5 Aug 03 04:34:08.477891 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-895eafad-a2ee-45bf-b3aa-5e41a4b9347d req-93e85012-c056-482a-be40-b23c39d0614c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043373 Aug 03 04:34:08.479916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 423/820] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:08.498330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:08.501400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:08.522746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:08.523250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:08.524404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:08.524915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:08.547582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:08.566816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b09f8944-5e7e-4edc-a5ac-40b1d7920c6c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1710 microversion: 2.1 time: 0.908541 Aug 03 04:34:08.567482 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 398/821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:07 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1710 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:08.669799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:08.671378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:08.678712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:08.679468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:08.680522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:08.681168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:09.084056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:09.092812 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a93327c-e81c-4fed-9c8b-6dd27c8813f9 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.611369 Aug 03 04:34:09.096870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 424/822] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:08 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:09.132070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:09.141538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5bb838aa-f21a-4f42-9689-3fb09e330202 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1312 microversion: 2.1 time: 0.479890 Aug 03 04:34:09.146115 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 399/823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:08 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:09.454531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:09.455376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:09.488575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:09.488575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:09.492284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:09.492946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:09.592429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:09.593324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:09.609281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:09.611726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:09.612779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:09.614279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.366120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:10.386933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-795b5b21-61b6-4f87-8f3e-2fc7bf747357 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1643 microversion: 2.1 time: 0.799011 Aug 03 04:34:10.390282 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 400/824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:09 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1643 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:10.402464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:10.403336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:10.425898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:10.426673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.428566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:10.429230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.605729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:10.614797 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0679ea44-710a-4ab5-b35c-63a0a90f507c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 1.165017 Aug 03 04:34:10.624912 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 425/825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:09 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:10.638962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:10.640090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:10.652365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:10.664477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.665544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:10.666247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.837458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:10.863471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-38dca7ca-1d19-4858-8822-afc847416909 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 0.471204 Aug 03 04:34:10.872139 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 401/826] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:10 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:10.877396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-46e98d40-8431-41cb-a61a-69f629d2660f req-834098ce-7645-45cc-9a92-5c9f3fe13df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0727004b-8d20-4352-afd4-3aea23924c6d", "name": "network-vif-deleted", "tag": "89a5a28d-417f-4a74-9dea-d1259ed2ca6f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:10.898089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-46e98d40-8431-41cb-a61a-69f629d2660f req-834098ce-7645-45cc-9a92-5c9f3fe13df4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:10.898550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-46e98d40-8431-41cb-a61a-69f629d2660f req-834098ce-7645-45cc-9a92-5c9f3fe13df4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:10.932395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-46e98d40-8431-41cb-a61a-69f629d2660f req-834098ce-7645-45cc-9a92-5c9f3fe13df4 service nova] Creating event network-vif-deleted:89a5a28d-417f-4a74-9dea-d1259ed2ca6f for instance 0727004b-8d20-4352-afd4-3aea23924c6d on n-h1-826756-5 Aug 03 04:34:10.951672 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-46e98d40-8431-41cb-a61a-69f629d2660f req-834098ce-7645-45cc-9a92-5c9f3fe13df4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078318 Aug 03 04:34:10.957062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 402/827] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:10.964600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:10.974632 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cb2f92d-1c5b-43ea-af73-42cdc85fb6b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1462 microversion: 2.1 time: 0.348246 Aug 03 04:34:10.988437 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 426/828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:10 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1462 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:11.003346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:11.009260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:11.013249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.013770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.014562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.015029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.119099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:11.127158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Old instance type m1.heat2, new instance type m1.heat {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 04:34:11.136557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:34:11.137903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:34:11.137903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:34:11.138444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:34:11.139653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:34:11.413338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:11.414587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:11.433529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.433813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.434909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.435577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.520839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.521522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.522044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lazy-loading 'fault' on Instance uuid 0727004b-8d20-4352-afd4-3aea23924c6d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:34:11.609996 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b71136fe-21f9-4c94-bc69-e4e9d8263a72 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db/action" status: 202 len: 0 microversion: 2.1 time: 0.612926 Aug 03 04:34:11.612991 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 403/829] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:10 2022] POST /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:11.625467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:11.630966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:11.640199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8091cc486ba443e7a99732617e82ee5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c3b6b7574d544aab263dcd99930197d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:11.654284 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34fdd10d-e7a6-4920-bf3c-81b899be7b89 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 200 len: 1351 microversion: 2.1 time: 0.243256 Aug 03 04:34:11.654284 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 427/830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:11 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 1351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:11.655070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.656706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.665429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.666263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.668015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:11.671579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:11.687645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.688099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:11.693050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:11.696891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.180568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:12.188577 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6df2b20b-b315-4af8-ae48-9b6ec3fe1eac tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1471 microversion: 2.1 time: 0.571595 Aug 03 04:34:12.189167 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 404/831] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:11 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1471 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:12.202837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:12.202837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:12.224492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:12.238841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:12.238841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=24 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:12.239438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.242059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.247686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.248156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.253507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e3a7a431-954e-43d2-a3a1-1098d0efb528 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.595193 Aug 03 04:34:12.254756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 428/832] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:11 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:12.465387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5078a04f-43db-4bb2-845a-3e9ee3d6d294 req-f1523693-1f02-4f6e-b8f2-4218afee27df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334830e3-3398-4063-8efd-0f9d9e900a36", "tag": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:12.534045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5078a04f-43db-4bb2-845a-3e9ee3d6d294 req-f1523693-1f02-4f6e-b8f2-4218afee27df service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.538257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5078a04f-43db-4bb2-845a-3e9ee3d6d294 req-f1523693-1f02-4f6e-b8f2-4218afee27df service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.588570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5078a04f-43db-4bb2-845a-3e9ee3d6d294 req-f1523693-1f02-4f6e-b8f2-4218afee27df service nova] Creating event network-changed:b92ab860-515d-46b5-a8a7-fc29f4f1cc2b for instance 334830e3-3398-4063-8efd-0f9d9e900a36 on n-h2-826756-5 Aug 03 04:34:12.596973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5078a04f-43db-4bb2-845a-3e9ee3d6d294 req-f1523693-1f02-4f6e-b8f2-4218afee27df service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140834 Aug 03 04:34:12.598532 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 429/833] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:12.703283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:12.707149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:12.730366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.733318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.734407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.738611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.778920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d HTTP/1.1 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:12.785027 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:12.786528 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0727004b-8d20-4352-afd4-3aea23924c6d'} Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:12.788857 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:12.792420 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.795005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:12.795005 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae76c78e-97df-46bb-b5a1-85468e16ee50 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 404 len: 111 microversion: 2.1 time: 0.118193 Aug 03 04:34:12.797151 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 430/834] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:12 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:12.804410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:12.805148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:12.822278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.822942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.823957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.824604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.854769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 HTTP/1.1 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:12.856691 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.858000 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd1e21669-2e7e-486a-a0cc-366c34a986b8'} Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:12.859055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.860222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.865878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:12.866965 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-462326ee-6b92-4ea2-a192-c3ae196747d3 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 404 len: 111 microversion: 2.1 time: 0.068797 Aug 03 04:34:12.873056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 431/835] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:34:12 2022] DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:12.885523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:12.888357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:12.903325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.909047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.909047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:12.909047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:12.930268 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 HTTP/1.1 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:12.937540 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.939094 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd1e21669-2e7e-486a-a0cc-366c34a986b8'} Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:12.939839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:12.941222 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:12.942264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:12.942264 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d3015d2b-c669-42ab-98d7-a61fba3e55fc tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 404 len: 111 microversion: 2.1 time: 0.058665 Aug 03 04:34:12.944752 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 432/836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:12 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:12.950098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fa7cb0a-f3f0-4c20-8ccb-a0c5abf5eedb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '.version_select at 0x7fdd557b9160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:12.974938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=36 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:13.060053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fa7cb0a-f3f0-4c20-8ccb-a0c5abf5eedb tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496059845" status: 202 len: 0 microversion: 2.1 time: 0.113363 Aug 03 04:34:13.072526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 433/837] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496059845 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:13.211648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:13.212568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:13.227582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:13.229535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:13.231127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:13.233788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:13.348111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:13.366126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9257ca8-3100-486f-b7a8-f8a8682f3e12 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1470 microversion: 2.1 time: 1.168129 Aug 03 04:34:13.368230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 405/838] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:12 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1470 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:13.379372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:13.383996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:13.402470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:13.403342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:13.405173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:13.407970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:14.307321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=5 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:14.631633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:14.644378 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e92a5946-2dd2-4e9a-81f2-d44df365e753 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1471 microversion: 2.1 time: 1.437890 Aug 03 04:34:14.647242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 434/839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:13 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1471 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:14.658023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:14.666527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:14.684007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:14.684660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:14.686845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:14.687361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:15.005897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:15.020494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24a42545-fcd8-4035-ad2e-0840005a0dd5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 1.648672 Aug 03 04:34:15.023431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 406/840] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:13 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:15.217183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:15.256095 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e0e9758-2584-4a13-9e35-474432325049 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 0.607243 Aug 03 04:34:15.257344 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 435/841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:14 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:15.674944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:15.675987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:15.702768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:15.703231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:15.706376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:15.706376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:15.707407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:16.045570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.046560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:16.057293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:16.057757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:16.058555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:16.059042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:16.093317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:16.107646 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb175e02-2f71-432e-a3b5-c2ec56424b12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1471 microversion: 2.1 time: 0.437531 Aug 03 04:34:16.123811 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 407/842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:15 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1471 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:16.275818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0855a017-66ba-4598-a860-9f351c1e9433 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Calling method '.version_select at 0x7fdd55471dc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.427119 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0855a017-66ba-4598-a860-9f351c1e9433 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.301877 Aug 03 04:34:16.429509 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 408/843] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:34:16 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:16.438861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe8c70c5-f261-4c7f-ba07-b49187913888 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.441290 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:16.441290 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:16.525567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:16.539077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-934d28a5-8d49-4edd-9822-4105a998826d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.497340 Aug 03 04:34:16.540332 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 436/844] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:16 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:16.547296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.550461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:16.560928 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe8c70c5-f261-4c7f-ba07-b49187913888 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/184638485" status: 202 len: 0 microversion: 2.1 time: 0.127972 Aug 03 04:34:16.569335 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 409/845] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:34:16 2022] DELETE /compute/v2.1/flavors/184638485 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:16.569468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:16.569468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:16.569639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98c2696c-731b-49f4-ad5c-2353e981b3c7 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Action: 'create', calling method: .version_select at 0x7fdd54f6f9d0>, body: {"pool": "non_exist_pool"} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:16.569738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:16.569738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:16.575581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:16.744086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-98c2696c-731b-49f4-ad5c-2353e981b3c7 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] HTTP exception thrown: Floating IP pool not found. Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98c2696c-731b-49f4-ad5c-2353e981b3c7 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Request method failure captured: Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 26 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frHDELoV2eS9WmDsLGA-vDuSWpIxU2EoLZ209Raq-LJ-tsgMZd4fzmPLmiqmeIs9i7sVKNxehAmeFDSueGnvAJgzRivyH3HX-M4kqME7v476IymxWJ97ZD_yw2X4QUmZOzayrEVAy7OKLYQ5IOuG93zy29_gyzxeafz9vTu7aXUsYw Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f5df642cf3cd4ce1bab45bbb38deba62 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:16.747734 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f5df642cf3cd4ce1bab45bbb38deba62 Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsNegativeTestJSON-274869317-project Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 64e5f536f704404d8775ea510bf13267 Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-274869317-project Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: {"pool": "non_exist_pool"} Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: exception: Floating IP pool not found. Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 03 04:34:16.749105 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:16.750097 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 03 04:34:16.751338 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.755258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98c2696c-731b-49f4-ad5c-2353e981b3c7 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Returning 404 to user: Floating IP pool not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:16.757193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98c2696c-731b-49f4-ad5c-2353e981b3c7 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.194720 Aug 03 04:34:16.762880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 410/846] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:34:16 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:34:16.785909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c710f63c-c1d2-4149-b654-3a05db08d670 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.821644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c710f63c-c1d2-4149-b654-3a05db08d670 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5400 microversion: 2.1 time: 0.057223 Aug 03 04:34:16.823012 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 411/847] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:34:16 2022] GET /compute/v2.1/flavors/detail => generated 5400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:16.829111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Calling method '.version_select at 0x7fdd54e0adc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.934371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d0abd3c6-f553-4beb-a659-d0dc4652b77b could not be found", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:16.936699 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] HTTP exception thrown: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Request method failure captured: Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-floating-ips/d0abd3c6-f553-4beb-a659-d0dc4652b77b HTTP/1.1 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frHDELoV2eS9WmDsLGA-vDuSWpIxU2EoLZ209Raq-LJ-tsgMZd4fzmPLmiqmeIs9i7sVKNxehAmeFDSueGnvAJgzRivyH3HX-M4kqME7v476IymxWJ97ZD_yw2X4QUmZOzayrEVAy7OKLYQ5IOuG93zy29_gyzxeafz9vTu7aXUsYw Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f5df642cf3cd4ce1bab45bbb38deba62 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:16.945764 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f5df642cf3cd4ce1bab45bbb38deba62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f5df642cf3cd4ce1bab45bbb38deba62 Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-274869317 Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsNegativeTestJSON-274869317-project Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 64e5f536f704404d8775ea510bf13267 Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-274869317-project Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: exception: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd0abd3c6-f553-4beb-a659-d0dc4652b77b'} Aug 03 04:34:16.947205 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:16.947980 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d0abd3c6-f553-4beb-a659-d0dc4652b77b could not be found Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a1ca6399-ae6b-4cc5-8ed9-d0ec528b543f'] Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b. Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:16.949784 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:16.952473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:16.955201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b Aug 03 04:34:16.955201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:16.958160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] Returning 404 to user: Floating IP not found for ID d0abd3c6-f553-4beb-a659-d0dc4652b77b {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:16.959834 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91417a9e-3d04-455d-8b14-b28ef3a87cd9 tempest-FloatingIPsNegativeTestJSON-274869317 tempest-FloatingIPsNegativeTestJSON-274869317-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/d0abd3c6-f553-4beb-a659-d0dc4652b77b" status: 404 len: 111 microversion: 2.1 time: 0.135604 Aug 03 04:34:16.966978 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 412/848] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:34:16 2022] DELETE /compute/v2.1/os-floating-ips/d0abd3c6-f553-4beb-a659-d0dc4652b77b => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:16.972208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f24471b6-a0b0-4e8b-b77e-7ce055c9c78e tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:16.988748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:17.001149 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3fb8a71-5b7f-422e-a6f6-4c839354c554 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 0.459503 Aug 03 04:34:17.005251 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 437/849] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:16 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:17.136631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.143451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f24471b6-a0b0-4e8b-b77e-7ce055c9c78e tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/68407449" status: 202 len: 0 microversion: 2.1 time: 0.174613 Aug 03 04:34:17.146590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 413/850] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:34:16 2022] DELETE /compute/v2.1/flavors/68407449 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:17.147079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.156785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-39ae42fc-8317-4a9e-9cc7-16cbe6817351 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.190074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.197404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.199820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.202225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.242069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-39ae42fc-8317-4a9e-9cc7-16cbe6817351 tempest-ServersWithSpecificFlavorTestJSON-1918631863 tempest-ServersWithSpecificFlavorTestJSON-1918631863-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090132 Aug 03 04:34:17.244058 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 414/851] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:34:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:17.279602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.280019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.291362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.292075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.293107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.294408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.312257 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d HTTP/1.1 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:17.314235 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.315509 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0727004b-8d20-4352-afd4-3aea23924c6d'} Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:17.316352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.317537 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.321462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:17.322615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6a931609-fca8-486b-a05d-73f4ace0e875 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 404 len: 111 microversion: 2.1 time: 0.048260 Aug 03 04:34:17.327987 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 415/852] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:34:17 2022] DELETE /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:34:17.334531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.335495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: 0727004b-8d20-4352-afd4-3aea23924c6d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.343246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.344091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.345133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.346330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.369949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d HTTP/1.1 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:17.372524 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.373938 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0727004b-8d20-4352-afd4-3aea23924c6d'} Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:17.374655 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. Aug 03 04:34:17.375819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.380418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance 0727004b-8d20-4352-afd4-3aea23924c6d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:17.387743 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b4b80cc-bc03-4211-86aa-7fa59fd9124c tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d" status: 404 len: 111 microversion: 2.1 time: 0.052132 Aug 03 04:34:17.387743 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 416/853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:17 2022] GET /compute/v2.1/servers/0727004b-8d20-4352-afd4-3aea23924c6d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:17.399597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.400110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.425548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.425548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.425548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.425810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 HTTP/1.1 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:17.453874 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.455412 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd1e21669-2e7e-486a-a0cc-366c34a986b8'} Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:17.456170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.457435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.459214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:17.459214 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ed260f2-b11a-4daf-aeb3-f1f412d1f470 tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 404 len: 111 microversion: 2.1 time: 0.055281 Aug 03 04:34:17.459214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 417/854] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:34:17 2022] DELETE /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:34:17.459214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-36c607a6-5679-4257-84d0-02e45d952a37 req-552e1d16-67a7-4eaa-88d3-170d840e6536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-unplugged", "status": "completed", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:17.475593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-36c607a6-5679-4257-84d0-02e45d952a37 req-552e1d16-67a7-4eaa-88d3-170d840e6536 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.476042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-36c607a6-5679-4257-84d0-02e45d952a37 req-552e1d16-67a7-4eaa-88d3-170d840e6536 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.489496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-36c607a6-5679-4257-84d0-02e45d952a37 req-552e1d16-67a7-4eaa-88d3-170d840e6536 service nova] Creating event network-vif-unplugged:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:34:17.496948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-36c607a6-5679-4257-84d0-02e45d952a37 req-552e1d16-67a7-4eaa-88d3-170d840e6536 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044612 Aug 03 04:34:17.499506 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 418/855] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:17.504986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.506367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] [instance: d1e21669-2e7e-486a-a0cc-366c34a986b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.521942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.522794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.523962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.524657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.542809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] HTTP exception thrown: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Request method failure captured: Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 HTTP/1.1 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6foR02r3VYiSkhFaWb__bI0QdMap9Wq4cVIMHS4GeeHdLMMwFzrUQoAFxhNiDwTcMNjQxqMk8JT8DL6C1NfEruWSeaRgQ3qMlTqWsr1lGLwgt6Rc7bSs0znsX_o7MqnhMiHJ3Mk9-A4Fc_M8_JmPuv3keGpn9X1er7Lt6J7q_F91k38 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:17.547503 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c3b6b7574d544aab263dcd99930197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c3b6b7574d544aab263dcd99930197d Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820 Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8091cc486ba443e7a99732617e82ee5d Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1722954820-project Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.548852 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd1e21669-2e7e-486a-a0cc-366c34a986b8'} Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:17.549560 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. Aug 03 04:34:17.558348 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:17.559405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] Returning 404 to user: Instance d1e21669-2e7e-486a-a0cc-366c34a986b8 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:17.559405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7ebabaa-51f8-411e-bc28-e10991a4231b tempest-ServersWithSpecificFlavorTestJSON-1722954820 tempest-ServersWithSpecificFlavorTestJSON-1722954820-project] 10.222.0.72 "GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8" status: 404 len: 111 microversion: 2.1 time: 0.048445 Aug 03 04:34:17.559405 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 419/856] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:17 2022] GET /compute/v2.1/servers/d1e21669-2e7e-486a-a0cc-366c34a986b8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:17.561378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:17.562068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:17.568786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.569366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:17.570117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:17.570543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:18.073472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:18.088073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6fbece00-83ca-4279-994e-260c3bd550c3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1471 microversion: 2.1 time: 0.958863 Aug 03 04:34:18.094616 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 438/857] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:17 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1471 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:18.110087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:18.111252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:18.129273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:18.129727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:18.134025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:18.135315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:18.840765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:18.856183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78586d24-7d48-482c-9164-7c98406dcc39 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 1.298767 Aug 03 04:34:18.877723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 420/858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:17 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:19.115638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:19.116443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:19.134398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:19.135015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:19.136053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:19.136675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:19.137399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:19.148849 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc929c09-fc4b-4686-95d3-300282f965fa tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 1.052110 Aug 03 04:34:19.149668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 439/859] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:18 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:19.492839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:19.504919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc60426a-1b11-4446-a4db-eb043a238d43 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1471 microversion: 2.1 time: 0.393857 Aug 03 04:34:19.506654 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 421/860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:19 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:19.879055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:19.879683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:19.896552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:19.897312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:19.915527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:19.916418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:20.172172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:20.172867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:20.183301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:20.184054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:20.185495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:20.186172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:20.238001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:20.248445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db6b9174-c3d9-4d86-add8-d18bfcbc278d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.373486 Aug 03 04:34:20.249063 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 440/861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:19 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:20.430506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:20.463353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e8f63dee-9006-49b0-b3a3-a007d8f064e6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 0.294988 Aug 03 04:34:20.465719 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 422/862] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:20 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:20.536353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:20.537667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:20.556497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:20.556497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:20.556497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:20.557222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:20.926026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:20.957456 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9c1bf1a-71de-4cfd-8ca4-cb6d3eba068a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.433677 Aug 03 04:34:20.980631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 441/863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:20 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:21.269735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:21.272061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:21.279349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.280633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.281622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.282319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.492443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:21.493605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:21.504810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.507792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.509105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.512073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.580231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:21.589995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1911bf69-d0c6-4bdb-9cf1-92877edaacf5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.324386 Aug 03 04:34:21.610367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 423/864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:21 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:21.620578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-84a23e8b-36c0-4b5b-b14f-b3606c14c009 req-deeaecd6-fad4-44e2-8ddb-333986b86b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-plugged", "status": "completed", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:21.641543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84a23e8b-36c0-4b5b-b14f-b3606c14c009 req-deeaecd6-fad4-44e2-8ddb-333986b86b93 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.642309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84a23e8b-36c0-4b5b-b14f-b3606c14c009 req-deeaecd6-fad4-44e2-8ddb-333986b86b93 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.664465 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-84a23e8b-36c0-4b5b-b14f-b3606c14c009 req-deeaecd6-fad4-44e2-8ddb-333986b86b93 service nova] Creating event network-vif-plugged:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:34:21.671012 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-84a23e8b-36c0-4b5b-b14f-b3606c14c009 req-deeaecd6-fad4-44e2-8ddb-333986b86b93 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058769 Aug 03 04:34:21.672449 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 424/865] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:21.803680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:21.813428 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6dd0553-5661-444e-9624-d0f99c96779e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 0.326226 Aug 03 04:34:21.836935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 442/866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:21 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:21.981336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:21.982349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:21.997311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:21.997829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:21.998678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:22.001227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:22.332064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:22.335498 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63b3fa0e-e82f-400b-a5c8-f5711fc05b87 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.358488 Aug 03 04:34:22.353796 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 425/867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:21 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:22.618471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:22.619305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:22.632907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:22.634337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:22.638359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:22.639141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:22.845585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:22.847937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:22.866035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:22.866731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:22.869367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:22.873800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:22.905625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:22.915674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab8f0ee9-21e0-4a5c-b34b-0a174428023a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.301769 Aug 03 04:34:22.939337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 443/868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:22 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:23.219726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:23.231496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b31735f-0ff5-4d05-9960-12439f59ac7b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 0.390846 Aug 03 04:34:23.235043 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 426/869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:22 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:23.363126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:23.363940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:23.374139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:23.374867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:23.375826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:23.377779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:23.681200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:23.689789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f28d5965-a589-45a0-a935-647967cf2355 req-96a90137-5594-47b8-95e6-a411bef0d21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334830e3-3398-4063-8efd-0f9d9e900a36", "name": "network-vif-plugged", "status": "completed", "tag": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:23.715179 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36b2713e-1e13-428f-9349-61fc39ef9712 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.357976 Aug 03 04:34:23.717471 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 444/870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:23 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:23.731105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f28d5965-a589-45a0-a935-647967cf2355 req-96a90137-5594-47b8-95e6-a411bef0d21e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:23.731738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f28d5965-a589-45a0-a935-647967cf2355 req-96a90137-5594-47b8-95e6-a411bef0d21e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:23.744925 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f28d5965-a589-45a0-a935-647967cf2355 req-96a90137-5594-47b8-95e6-a411bef0d21e service nova] Creating event network-vif-plugged:b92ab860-515d-46b5-a8a7-fc29f4f1cc2b for instance 334830e3-3398-4063-8efd-0f9d9e900a36 on n-h2-826756-5 Aug 03 04:34:23.750283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f28d5965-a589-45a0-a935-647967cf2355 req-96a90137-5594-47b8-95e6-a411bef0d21e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064102 Aug 03 04:34:23.751678 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 427/871] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:23.942264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:23.943294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:23.954635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:23.957736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:23.960289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:23.963099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:24.260051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:24.261065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:24.269037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:24.269757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:24.273007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:24.273659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:24.337437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:24.348869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9478bebd-de98-4ee9-a8f1-5d06e48bbe16 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.411327 Aug 03 04:34:24.356671 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 445/872] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:23 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:24.738051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:24.738804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:24.755736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:24.755736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:24.755736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:24.755736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:25.451468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:25.469649 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7e15ed3-f43f-4a73-b5a6-837335db545e tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1476 microversion: 2.1 time: 1.218729 Aug 03 04:34:25.475814 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 428/873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:24 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1476 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:25.482566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:25.486777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:25.502009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:25.502887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:25.506474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:25.510564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:25.596040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:25.608231 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd724876-c892-4428-b89e-2cce58c1774f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.874532 Aug 03 04:34:25.623806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 446/874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:24 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:26.168132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-792895144", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:26.172111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:26.258660 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8214bfed-48f4-43d2-aac2-4be975e26e0d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1332 microversion: 2.1 time: 0.781214 Aug 03 04:34:26.261707 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 429/875] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:25 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1332 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:26.297238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] validate_networks() for [('c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:34:26.491662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:26.493822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:26.503671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:26.504192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:26.505059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:26.505504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:26.858046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:26.882857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af626588-09d0-4599-ae21-202078ccd6e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1462 microversion: 2.1 time: 0.390601 Aug 03 04:34:26.885571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 430/876] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:26 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1462 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:26.909855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:26.914356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:26.954475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:26.955123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:26.956419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:26.957085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:27.588938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:27.601348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ed5196f2-6358-4354-b994-c909707e2cd5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.712436 Aug 03 04:34:27.603381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 431/877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:26 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:27.620859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:27.621808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:27.636098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:27.636749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:27.641336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:27.641336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:27.936491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:34:27.937737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:34:27.938778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:34:27.939438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:34:27.940200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:34:27.953509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:27.954366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:27.955468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:27.957134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:27.986728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:28.006132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for user 14aa35fa1b9d4a5786b67c5a3234f571 and project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:28.028140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:34:28.032060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:34:28.166435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:28.174354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-150977a6-121f-43c8-bbaf-487d309945e4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1462 microversion: 2.1 time: 0.569399 Aug 03 04:34:28.188734 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 432/878] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:27 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1462 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:28.196551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:28.197517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:28.203906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.204734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.206018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.206681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.213517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4ffea33-3382-49fc-810b-818acee82440 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.292945 Aug 03 04:34:28.215089 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 447/879] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:34:28.228018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:28.235436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:28.253922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.254456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.255862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.256445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.509368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:34:28.512544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:34:28.513779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:34:28.515075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:34:28.520961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:34:28.573259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:28.583896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2f34987-f1b4-4a0e-b60e-b3abebe5e2e9 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1535 microversion: 2.1 time: 0.393603 Aug 03 04:34:28.584923 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 433/880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:28 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1535 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:28.589440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d553977-5310-4dda-8d75-9bff22c392af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:28.590131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d553977-5310-4dda-8d75-9bff22c392af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:28.700933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d553977-5310-4dda-8d75-9bff22c392af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:28.712636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d553977-5310-4dda-8d75-9bff22c392af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1207 microversion: 2.1 time: 0.125505 Aug 03 04:34:28.720833 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 434/881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:28 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1207 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:28.734380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59a07efd-c09c-4cf8-ace3-d6df8039d5e8 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'create', calling method: .version_select at 0x7fdd552e5ee0>, body: {"pool": "1174c063-27cd-4b37-9449-022c0c71d48b"} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:28.788513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:28.798450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.801077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.802732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.803358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.840238 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6fa22757-61fd-446b-aacc-614ac10d9ccf tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 1066 microversion: 2.1 time: 0.623846 Aug 03 04:34:28.841507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 448/882] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:28 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 1066 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 04:34:28.846649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:28.852944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:28.855798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.856261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:28.857248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:28.858152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:30.050819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:30.063021 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-178a67ad-9794-4011-a8d0-1144f23e9244 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 1.220244 Aug 03 04:34:30.065171 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 449/883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:28 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:30.084666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:30.085674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:30.095507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:30.097447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:30.106347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:30.107116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:30.688068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:30.697842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4871b5e8-0d15-4d07-863c-d0b7beb6ab1d tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.618836 Aug 03 04:34:30.715714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 450/884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:30 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:30.736553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:30.737622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:30.747521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:30.747985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:30.748814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:30.749265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:30.872766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:30.880924 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d618b995-0516-4e7b-99e5-62e1cc36c3dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1259 microversion: 2.1 time: 0.163363 Aug 03 04:34:30.884002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 451/885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:30 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:31.087103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:31.088614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:31.103325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:31.104163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:31.105256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:31.105924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:31.142996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:31.626496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:31.652177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-858c9a94-9725-47ef-b13b-dcad13282dda tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.569509 Aug 03 04:34:31.653075 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 452/886] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:31 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:31.727661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:31.728317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:31.739840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:31.747773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:31.750200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:31.750200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:32.071655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:32.079819 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ceaf4b9-2b13-46a3-aede-bc895144fe41 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.360504 Aug 03 04:34:32.094885 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 453/887] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:31 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:32.101124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:32.102051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:32.109684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:32.110435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:32.111557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:32.112262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:32.181996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:32.189604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03ba98ed-537b-4b20-937b-8b176d749998 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1265 microversion: 2.1 time: 0.092954 Aug 03 04:34:32.190417 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 454/888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:32 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:32.674345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:32.675328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:32.682783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:32.683455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:32.684420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:32.685153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.134916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:33.144255 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e963416-ad11-4472-b663-7fc29d6a2330 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.474420 Aug 03 04:34:33.147807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 455/889] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:32 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:33.154756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:33.155599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:33.174116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.175134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.178242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.180997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.230138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59a07efd-c09c-4cf8-ace3-d6df8039d5e8 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.508118 Aug 03 04:34:33.238518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 435/890] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:34:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:33.243954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:33.244699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:33.258370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.259763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.260935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.261730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.377712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:33.392898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59cea661-1f31-48c5-9c0c-93108772b331 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1265 microversion: 2.1 time: 0.152656 Aug 03 04:34:33.393797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 436/891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:33 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:33.400117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.22"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:33.403212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:33.409758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.410403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.411748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:33.412514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:33.423225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:33.432818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6fb7790-52f6-43be-9280-0abf55f9a123 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.283377 Aug 03 04:34:33.434339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:33.448815 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 456/892] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:33 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:33.462567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Acquired lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:34:34.171848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:34.172769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:34.179386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:34.183566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.184428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:34.185458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.186112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:34.460870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:34.481530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8738b67e-2009-448b-90e4-b3094fcb079e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.313556 Aug 03 04:34:34.482122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 457/893] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:34 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:34.504786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:34.505670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:34.513874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.514553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:34.515541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.532441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:34.897513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:34.906959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9112460a-ca29-4807-a755-403087229516 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.416631 Aug 03 04:34:34.936020 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 458/894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:34 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:34.936020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:34.936020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:34.939998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.954165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:34.964371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:34.964371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:35.245417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:35.256927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f86aa62f-2c7f-4647-8439-f4d979dc0513 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.330257 Aug 03 04:34:35.258835 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 459/895] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:34 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:35.505891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:35.506793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:35.517057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:35.527088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:35.529013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:35.529655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:35.903078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:34:35.960840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:35.976563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-569de3f0-f77f-4993-9669-3e43abd15bbb tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.475570 Aug 03 04:34:35.977184 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 460/896] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:35 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:35.991589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6942ab29-cfc8-4a9a-ba10-7db2b40fd60f req-ad5c991e-469f-4d27-b6fb-5fcd248151b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334830e3-3398-4063-8efd-0f9d9e900a36", "tag": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:36.014074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6942ab29-cfc8-4a9a-ba10-7db2b40fd60f req-ad5c991e-469f-4d27-b6fb-5fcd248151b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:36.014764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6942ab29-cfc8-4a9a-ba10-7db2b40fd60f req-ad5c991e-469f-4d27-b6fb-5fcd248151b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:36.042619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6942ab29-cfc8-4a9a-ba10-7db2b40fd60f req-ad5c991e-469f-4d27-b6fb-5fcd248151b5 service nova] Creating event network-changed:b92ab860-515d-46b5-a8a7-fc29f4f1cc2b for instance 334830e3-3398-4063-8efd-0f9d9e900a36 on n-h2-826756-5 Aug 03 04:34:36.053135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6942ab29-cfc8-4a9a-ba10-7db2b40fd60f req-ad5c991e-469f-4d27-b6fb-5fcd248151b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069700 Aug 03 04:34:36.057017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 461/897] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:36.075728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:36.077542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:36.099778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:36.100480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:36.101303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:36.101749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:36.460904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:36.473641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63b396d0-da28-4d58-8285-dd5b4a8c2c97 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.414588 Aug 03 04:34:36.478185 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 462/898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:36 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:36.498351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:36.498351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:36.516156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:36.517014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:36.518717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:36.522089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:37.112099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:37.119722 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c53529b-072b-4005-bd25-df99b0f26508 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.640061 Aug 03 04:34:37.121607 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 463/899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:36 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:37.388036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-535550966", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d3daf729-08e1-47de-b3ca-43c48307355d"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:37.463785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] validate_networks() for [('d3daf729-08e1-47de-b3ca-43c48307355d', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:34:37.503431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Updating instance_info_cache with network_info: [{"id": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b", "address": "fa:16:3e:3c:ca:dc", "network": {"id": "adbcf694-b47e-4d38-a831-56cef3ebb590", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-744289897-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c47360eecc8e4f16a26eb8a1e64d9ee8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb92ab860-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:34:37.632243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Releasing lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:34:37.635525 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff1eb564-6035-4219-b551-139f31b8e558 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 202 len: 0 microversion: 2.1 time: 4.238245 Aug 03 04:34:37.635525 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 437/900] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:33 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 0 bytes in 4240 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:34:37.645176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1a6eccc5-5c4b-4989-9860-6c084c3047a2 req-23e864ed-10ce-462f-a98a-840bcf7aa6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36e1b37-606b-4a4f-a778-0a4f1d8c42e5", "tag": "01d475bb-4fa9-4dfc-85a7-6ee4765decd7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:37.654848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a6eccc5-5c4b-4989-9860-6c084c3047a2 req-23e864ed-10ce-462f-a98a-840bcf7aa6f3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:37.655562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a6eccc5-5c4b-4989-9860-6c084c3047a2 req-23e864ed-10ce-462f-a98a-840bcf7aa6f3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:37.677007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1a6eccc5-5c4b-4989-9860-6c084c3047a2 req-23e864ed-10ce-462f-a98a-840bcf7aa6f3 service nova] Creating event network-changed:01d475bb-4fa9-4dfc-85a7-6ee4765decd7 for instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 on n-h2-826756-5 Aug 03 04:34:37.710115 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1a6eccc5-5c4b-4989-9860-6c084c3047a2 req-23e864ed-10ce-462f-a98a-840bcf7aa6f3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073461 Aug 03 04:34:37.711076 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 438/901] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:37.719383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:37.720345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:37.742328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:37.742977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:37.744489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:37.745033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:37.972577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:38.018741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:38.128308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:38.157492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f60b80c1-5c35-41a2-be79-66cf4108560c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.445162 Aug 03 04:34:38.161637 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 439/902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:37 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:38.169142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:38.170131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:38.179300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.180142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.180879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.181896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.431491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:34:38.432601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:34:38.433403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:34:38.435898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:34:38.437180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:34:38.457139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.457857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.459129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.459767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.477173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:38.479121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:38.484767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6123b1bb-481e-44fb-8b91-77f1eb1de2df tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.324371 Aug 03 04:34:38.485222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for user ef84ed9611c449ec8ee31cf936faeb75 and project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:38.485350 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 440/903] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:38 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:38.498939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-305a98c3-b306-4559-9dee-4bc9806ae57d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'create', calling method: .version_select at 0x7fdd54cd5b80>, body: {"pool": "1174c063-27cd-4b37-9449-022c0c71d48b"} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:38.501020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:34:38.503526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:34:38.646028 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d719dd6c-999b-44eb-8cea-044586a7f03b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.524566 Aug 03 04:34:38.651168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 464/904] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:34:38.661897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:38.663365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:38.687637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.687637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.687637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:38.687637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:38.712220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:39.073964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:39.083939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8435a30d-0f05-47a1-bbfa-5765cf82ec31 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.431023 Aug 03 04:34:39.084785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 465/905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:38 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:39.103883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-09f0f335-48dd-43a7-8966-7c99f12b1427 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:39.104964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-09f0f335-48dd-43a7-8966-7c99f12b1427 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:39.203436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-09f0f335-48dd-43a7-8966-7c99f12b1427 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:39.211100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-09f0f335-48dd-43a7-8966-7c99f12b1427 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1210 microversion: 2.1 time: 0.124209 Aug 03 04:34:39.212019 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 466/906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:39 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:39.217547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:39.219168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:39.229120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:39.229964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:39.230969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:39.231624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:39.564426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:39.573225 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb264979-3433-4607-8f1f-f4e2dd699364 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.359907 Aug 03 04:34:39.573813 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 467/907] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:39 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:39.593860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:39.594545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:39.604049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:39.606668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:39.607493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:39.607947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:40.523782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:40.537812 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31ae1dba-01ad-4d6a-a89c-f4434d85b810 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.962726 Aug 03 04:34:40.538772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 468/908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:39 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:40.551819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:40.556669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:40.565331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:40.565961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:40.571788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:40.574364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:40.949727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:40.977464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e17160f8-4a76-46d5-847a-8f50562faa67 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.431154 Aug 03 04:34:40.978377 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 469/909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:40 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:41.002332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:41.022863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:41.049031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.049493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.050315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.051673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.203751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:41.218215 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-868c7b51-6c61-4d7f-8faa-201f64f01668 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1206 microversion: 2.1 time: 0.231829 Aug 03 04:34:41.232803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 470/910] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:40 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1206 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:41.238768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:41.239987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:41.246451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.247140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.248130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.248779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.270102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:41.610975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:34:41.649102 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91f6573f-0fcd-4d2b-971c-c08ddfbe40d6 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 2342 microversion: 2.25 time: 0.414649 Aug 03 04:34:41.650614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 471/911] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:34:41 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 2342 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:34:41.657153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:41.658090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:41.678629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.679345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.680478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.682374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.913276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:41.923882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2acdc2f-8591-4ac5-a884-581247bc1670 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1476 microversion: 2.1 time: 0.271848 Aug 03 04:34:41.924598 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 472/912] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:41 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:41.939096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:41.939096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:41.939096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.939683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:41.940861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:41.941422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.231888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:42.240300 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d84f0cf6-0acc-4bb4-9808-a970e0f0955e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.314171 Aug 03 04:34:42.241474 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 473/913] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:41 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:42.246722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:42.251562 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:42.251562 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:34:42.254781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.254781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.257538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.258575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.314991 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ea45679-e4f7-4e35-b608-6f7a933502c2 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072184 Aug 03 04:34:42.315616 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 474/914] 10.222.0.72 () {60 vars in 1217 bytes} [Wed Aug 3 04:34:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:34:42.327483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:42.330687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:42.339035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.339497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.343974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.352215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.610404 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-305a98c3-b306-4559-9dee-4bc9806ae57d tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.123976 Aug 03 04:34:42.611001 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 441/915] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:34:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:42.618050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:42.620781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:42.640482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.641365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.644472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.648260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.734548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:42.750777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e0d9b20-ed27-4120-8919-921f7dc9986b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.432842 Aug 03 04:34:42.760246 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 475/916] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:42 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:42.783350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.123"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:42.788462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:42.811250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.819153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.819153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.819153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.887515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:42.897698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e65cd532-8aee-48a9-8d1c-d5e0aab55c39 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1270 microversion: 2.1 time: 0.284377 Aug 03 04:34:42.899056 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 442/917] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:42 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1270 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:42.918568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Acquired lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:34:42.950071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:42.950794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:42.965012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.965472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:42.969660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:42.974117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:43.598154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:43.611351 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c0e055a-1727-4e90-babd-1e56969ffe18 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1475 microversion: 2.1 time: 0.668210 Aug 03 04:34:43.612358 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 443/918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:42 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1475 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:43.639347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:43.641984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:43.645846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:43.649382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:43.651658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:43.651658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:43.651658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:44.883513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:44.887650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b.", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:44.888108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Releasing lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:34:44.889301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.889301 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Request method failure captured: Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action HTTP/1.1 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 46 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fq3RqY9YLqxC-nPlcUEJefBjkiYb_ZGVNtpWjWMjK8B9RFduXDD405Dk_Jp0ERQywd6t7eQ6s8Nr1I0C_1Ujr2Tpvo_HGP-QumIvdIIB5i_qBRj5rX2iKG2skkWla1U_nqg-Smj42bljjxnNgJcupV8WjvfMK7w5id8ekuFO8ikKx4 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:44.895032 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 92f59caf8c414149bfe4c9852630d7d4 Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: {"addFloatingIp": {"address": "172.25.3.123"}} Aug 03 04:34:44.897448 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '334830e3-3398-4063-8efd-0f9d9e900a36', 'body': {'addFloatingIp': {'address': '172.25.3.123'}}} Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.898444 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:44.899942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.901096 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.903102 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] Aug 03 04:34:44.904730 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:44.908294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Returning 400 to user: Cannot associate floating IP 172.25.3.123 (c204f615-b911-4ffc-af00-71449ada3587) with port b92ab860-515d-46b5-a8a7-fc29f4f1cc2b using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 1174c063-27cd-4b37-9449-022c0c71d48b. Aug 03 04:34:44.908294 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-6c0c4d69-3cf4-4f48-9c35-2e990ba7d1cd'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:44.908294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22f6f991-07ab-4426-be03-a3bc1a29388c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 400 len: 381 microversion: 2.1 time: 2.131313 Aug 03 04:34:44.917173 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 476/919] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:42 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 381 bytes in 2144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:34:44.930221 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dce3771a-2471-4457-b718-5feaf17c2ca4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 1.313980 Aug 03 04:34:44.942030 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 444/920] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:43 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:44.944159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:44.944820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:44.950646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:44.951760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:44.965586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:44.966318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:44.967259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:44.967711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:44.968665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:44.975658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:44.977008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:44.978977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:45.311614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:45.325322 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fabcddda-f953-4d84-b511-066b78b244fb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.409739 Aug 03 04:34:45.329196 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 477/921] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:44 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:45.391930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:45.404120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aaffdba8-c5e9-4b95-936b-bfef633119a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.460604 Aug 03 04:34:45.412393 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 445/922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:44 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:45.417404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b31a5c2f-4967-4869-8f16-8dc3c2b629b3 req-49c93346-b57a-43e2-b836-5983eefb5705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36e1b37-606b-4a4f-a778-0a4f1d8c42e5", "name": "network-vif-plugged", "status": "completed", "tag": "01d475bb-4fa9-4dfc-85a7-6ee4765decd7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:45.438510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b31a5c2f-4967-4869-8f16-8dc3c2b629b3 req-49c93346-b57a-43e2-b836-5983eefb5705 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:45.439532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b31a5c2f-4967-4869-8f16-8dc3c2b629b3 req-49c93346-b57a-43e2-b836-5983eefb5705 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:45.484032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b31a5c2f-4967-4869-8f16-8dc3c2b629b3 req-49c93346-b57a-43e2-b836-5983eefb5705 service nova] Creating event network-vif-plugged:01d475bb-4fa9-4dfc-85a7-6ee4765decd7 for instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 on n-h2-826756-5 Aug 03 04:34:45.494080 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b31a5c2f-4967-4869-8f16-8dc3c2b629b3 req-49c93346-b57a-43e2-b836-5983eefb5705 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079994 Aug 03 04:34:45.494887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 446/923] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:45.499890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "name": "network-vif-unplugged", "status": "completed", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:45.513707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:45.514159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:45.534317 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] Creating event network-vif-unplugged:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h2-826756-5 Aug 03 04:34:45.542050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] Instance 04b7a2c1-2404-4a23-a372-6d98770a14db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:34:45.558711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fefd7bd2-ad6a-43a9-8b42-a958f7456ec2 req-5e5b5845-db3d-4c55-991e-c0f5ce21eaf6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062621 Aug 03 04:34:45.563892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 447/924] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:45.574333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:45.574333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:45.575021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-058b7261-b937-40da-a55f-3e1ea3811a85 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-512806620", "ram": 512, "vcpus": 1, "disk": 10, "id": 1416010448, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:45.578238 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:45.578238 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:34:45.579958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:45.580664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:45.581799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:45.582763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:45.687643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-058b7261-b937-40da-a55f-3e1ea3811a85 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.356921 Aug 03 04:34:45.693187 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 478/925] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:34:45 2022] POST /compute/v2.1/flavors => generated 415 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:45.703761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcd03943-4080-4a43-80c4-c3d1b7adb08c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '.version_select at 0x7fdd54a91430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:46.023123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:46.038283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-940e4354-ae8d-474a-b622-7b714af2f7e7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1475 microversion: 2.1 time: 0.471375 Aug 03 04:34:46.042712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 448/926] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:45 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1475 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:46.263276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61ccc362-6b2f-4c1c-9fe7-0104e86f7272 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:46.273607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-61ccc362-6b2f-4c1c-9fe7-0104e86f7272 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] HTTP exception thrown: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61ccc362-6b2f-4c1c-9fe7-0104e86f7272 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Request method failure captured: Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6friZZ_z18dOkwDZzYQI8r3J11FqxwyIhZRgymAv5fCbawHjs4jYzCU3_DBIN0FgeONDsM3DGfq196z78ICTTT9RJ8BzFIMdcMnYY8YNI2z59QcSR02C4ZQGcpfdIJIKrU3fuCnN0fsjycg4FqA3NGRbVHhY7U0S3Ff8AvdBLsdqkVg Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:46.277416 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 638d4b55acc94615b582e7626f91123d Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:46.279038 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'flavor_id': '1416010448', 'id': 'hw:cpu_thread_policy'} Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:46.279860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:46.281376 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.282875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61ccc362-6b2f-4c1c-9fe7-0104e86f7272 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Returning 404 to user: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:46.284511 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61ccc362-6b2f-4c1c-9fe7-0104e86f7272 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] 10.222.0.72 "GET /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.239965 Aug 03 04:34:46.286899 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 449/927] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:34:46 2022] GET /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:46.293355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:46.294466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:46.305019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:46.306046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:46.316765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:46.317997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:46.932725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:46.942249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-652133c7-996e-4251-ad34-1c9a6be62679 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.653893 Aug 03 04:34:46.964012 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 450/928] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:46 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:46.970049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a158366c-c9c2-47f6-95f6-531a1e82761d tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:46.975225 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:46.975225 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:46.976973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a158366c-c9c2-47f6-95f6-531a1e82761d tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '638d4b55acc94615b582e7626f91123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fad31aa81c4a5796200fe92c333aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a158366c-c9c2-47f6-95f6-531a1e82761d tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Request method failure captured: Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/flavors/1416010448/os-extra_specs HTTP/1.1 Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 66 Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6friZZ_z18dOkwDZzYQI8r3J11FqxwyIhZRgymAv5fCbawHjs4jYzCU3_DBIN0FgeONDsM3DGfq196z78ICTTT9RJ8BzFIMdcMnYY8YNI2z59QcSR02C4ZQGcpfdIJIKrU3fuCnN0fsjycg4FqA3NGRbVHhY7U0S3Ff8AvdBLsdqkVg Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:46.979934 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 638d4b55acc94615b582e7626f91123d Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 03 04:34:46.981273 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'flavor_id': '1416010448', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:34:46.982172 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 03 04:34:46.983915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:46.985884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a158366c-c9c2-47f6-95f6-531a1e82761d tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:46.985884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a158366c-c9c2-47f6-95f6-531a1e82761d tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] 10.222.0.72 "POST /compute/v2.1/flavors/1416010448/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.015788 Aug 03 04:34:46.985884 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 451/929] 10.222.0.72 () {60 vars in 1224 bytes} [Wed Aug 3 04:34:46 2022] POST /compute/v2.1/flavors/1416010448/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:46.991668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:46.992310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:47.000670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.001216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.002007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.002452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.267993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:47.277748 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4705f52-46ef-4654-a99c-a4f428f48486 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.294358 Aug 03 04:34:47.278834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 452/930] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:46 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:47.284296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:47.288546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:47.293330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.294118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.294983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.295592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.674660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:47.682803 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-772b8665-2520-4bd8-aca4-dc4dc6253e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.403188 Aug 03 04:34:47.683372 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 453/931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:47 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:47.710382 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcd03943-4080-4a43-80c4-c3d1b7adb08c tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/c204f615-b911-4ffc-af00-71449ada3587" status: 202 len: 0 microversion: 2.1 time: 2.020435 Aug 03 04:34:47.711638 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 479/932] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:34:45 2022] DELETE /compute/v2.1/os-floating-ips/c204f615-b911-4ffc-af00-71449ada3587 => generated 0 bytes in 2022 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:47.717370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-562bf93b-b917-4701-b593-7a89497a173c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:47.720247 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:47.720247 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:34:47.767474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Calling method '.version_select at 0x7fdd54a659d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:47.804309 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-562bf93b-b917-4701-b593-7a89497a173c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/1416010448/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.091303 Aug 03 04:34:47.805177 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 480/933] 10.222.0.72 () {60 vars in 1224 bytes} [Wed Aug 3 04:34:47 2022] POST /compute/v2.1/flavors/1416010448/os-extra_specs => generated 66 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:47.810223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:47.810836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:47.818027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.818596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.819388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.819828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.820432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:47.821426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Neutron security group a7180872-3b00-424d-88c5-8a76cec32f9f not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:34:47.822593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] HTTP exception thrown: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.822593 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Request method failure captured: Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/a7180872-3b00-424d-88c5-8a76cec32f9f HTTP/1.1 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frm9ri6ow1d4AN36o-7K0cpStQK-eVHAN1ErK4-kxp3DLTfjFpMngQMlAmqHqEe5Oo1yrgQ2TqqE4gV1O4d9E82w3uMkn_j3nQ_m2mSYjPvbh66ngI8OqN7nm-Kzn9HqIoJucOl0B0YqwrPyS1t2JPIEW8qIQ_LRaNhji9JdCy4gT4 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:47.825434 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: a5cc78bc85da401b9c7e8dd769112864 Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.826746 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a7180872-3b00-424d-88c5-8a76cec32f9f'} Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:47.827593 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:34:47.829294 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.830387 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] Aug 03 04:34:47.831652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:47.834305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Returning 404 to user: Security group a7180872-3b00-424d-88c5-8a76cec32f9f does not exist Aug 03 04:34:47.834305 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be2ac7f5-cb62-48a3-a3f2-e18e2fc61c36'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:47.835463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2f6f58b-643a-4888-8154-91ad55a8ff4b tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/a7180872-3b00-424d-88c5-8a76cec32f9f" status: 404 len: 194 microversion: 2.1 time: 0.150956 Aug 03 04:34:47.840764 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 454/934] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:34:47 2022] DELETE /compute/v2.1/os-security-groups/a7180872-3b00-424d-88c5-8a76cec32f9f => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:47.847683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6413636a-1d9a-4148-b9f5-fb3132ad0d5c", "device": "/dev/xvdb"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:47.853493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:47.862068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.862680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:47.864868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:47.865410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.050202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:48.059442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-863fac55-6b37-4993-a0f6-069bac7a60aa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1473 microversion: 2.1 time: 0.253087 Aug 03 04:34:48.060380 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 481/935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:47 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:48.079164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2881bbc1-ad5c-4eb1-ad03-a3f375fc8dd5 req-b6dbd399-6be9-4a02-b41f-f65b98c741bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fde05c5-b996-409c-9e44-e6f2dc34f4c2", "tag": "79987c6a-a281-4dd5-afd1-d767893a20dd"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:48.089647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2881bbc1-ad5c-4eb1-ad03-a3f375fc8dd5 req-b6dbd399-6be9-4a02-b41f-f65b98c741bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.090123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2881bbc1-ad5c-4eb1-ad03-a3f375fc8dd5 req-b6dbd399-6be9-4a02-b41f-f65b98c741bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.101797 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2881bbc1-ad5c-4eb1-ad03-a3f375fc8dd5 req-b6dbd399-6be9-4a02-b41f-f65b98c741bd service nova] Creating event network-changed:79987c6a-a281-4dd5-afd1-d767893a20dd for instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 on n-h1-826756-5 Aug 03 04:34:48.107040 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2881bbc1-ad5c-4eb1-ad03-a3f375fc8dd5 req-b6dbd399-6be9-4a02-b41f-f65b98c741bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045297 Aug 03 04:34:48.107648 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 482/936] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:48.114426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:48.124817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.125298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.138219 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] Creating event network-changed:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h2-826756-5 Aug 03 04:34:48.143921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] Instance 04b7a2c1-2404-4a23-a372-6d98770a14db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:34:48.154450 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-660d7abc-2aa5-45ef-8010-75a0e200b217 req-bd68d1b1-0d83-4fbd-8287-42d022bf6e9c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045396 Aug 03 04:34:48.155649 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 483/937] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:48.160956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.22"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:48.331552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:48.338228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.338678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.339479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.339918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.581454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Acquired lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:34:48.739431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21d1ec71-465d-4ae5-9fcc-89b14cf84f42 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.897033 Aug 03 04:34:48.740771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 455/938] 10.222.0.72 () {62 vars in 1364 bytes} [Wed Aug 3 04:34:47 2022] POST /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:34:48.746151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8848b9b1-84e5-4dc8-9652-21d2bc715369 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:48.746957 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:48.746957 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:48.748134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8848b9b1-84e5-4dc8-9652-21d2bc715369 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '638d4b55acc94615b582e7626f91123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fad31aa81c4a5796200fe92c333aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8848b9b1-84e5-4dc8-9652-21d2bc715369 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Request method failure captured: Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6friZZ_z18dOkwDZzYQI8r3J11FqxwyIhZRgymAv5fCbawHjs4jYzCU3_DBIN0FgeONDsM3DGfq196z78ICTTT9RJ8BzFIMdcMnYY8YNI2z59QcSR02C4ZQGcpfdIJIKrU3fuCnN0fsjycg4FqA3NGRbVHhY7U0S3Ff8AvdBLsdqkVg Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:48.750353 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 638d4b55acc94615b582e7626f91123d Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:48.751830 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'flavor_id': '1416010448', 'id': 'hw:numa_nodes'} Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:34:48.752740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 03 04:34:48.754522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:48.756592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8848b9b1-84e5-4dc8-9652-21d2bc715369 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:48.757922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8848b9b1-84e5-4dc8-9652-21d2bc715369 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] 10.222.0.72 "DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015746 Aug 03 04:34:48.758568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 456/939] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:34:48 2022] DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:48.762877 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c701d48d-f7b0-4435-b288-9ab7db718fc2 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003566 Aug 03 04:34:48.771338 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 457/940] 10.222.0.72 () {58 vars in 1164 bytes} [Wed Aug 3 04:34:48 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 04:34:48.771338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:48.771338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:48.778050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.778666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:48.779515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:48.780134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:49.007661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:49.015955 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d0606bf-7d26-4cee-94d8-5233c3f01ef0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1307 microversion: 2.1 time: 0.251462 Aug 03 04:34:49.016659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 458/941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:48 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:49.025230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:49.025230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:49.029305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:49.029765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:49.030612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:49.031051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:49.052496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:49.208866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:49.460710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:49.472964 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b221bfb-7a82-401a-8827-6beac6a520cd tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.454985 Aug 03 04:34:49.473767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 459/942] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:49 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:49.479228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:49.480076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:49.498775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:49.499401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:49.500446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:49.501245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:50.256962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:50.267855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80516fa8-d070-4d61-a00f-3cd0e992430d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.792892 Aug 03 04:34:50.287119 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 460/943] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:49 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:50.295465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffb9bbb4-cdcf-41e8-8991-05ac96469940 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:50.298891 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:50.298891 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:50.336462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ffb9bbb4-cdcf-41e8-8991-05ac96469940 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors/1416010448/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046344 Aug 03 04:34:50.340121 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 461/944] 10.222.0.72 () {60 vars in 1224 bytes} [Wed Aug 3 04:34:50 2022] POST /compute/v2.1/flavors/1416010448/os-extra_specs => generated 66 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:34:50.345408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d3802b8-f04b-46ae-9ca8-82f186f48f36 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Calling method '.version_select at 0x7fdd54973af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:50.737100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Building network info cache for instance {{(pid=120832) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:34:50.984387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d3802b8-f04b-46ae-9ca8-82f186f48f36 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.641629 Aug 03 04:34:50.985271 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 462/945] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:34:50 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:50.996183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:50.999689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:51.022862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.023735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.038997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.039669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.411247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:51.426191 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60a04fea-f084-471c-a6cf-63c1af61785e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1470 microversion: 2.1 time: 0.438662 Aug 03 04:34:51.428303 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 463/946] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:50 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:51.440301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:51.441665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:51.482516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.484485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.492499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.493160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.857245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:51.874736 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92066e5b-75b0-4bda-964c-c3a60508c581 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1487 microversion: 2.1 time: 0.443834 Aug 03 04:34:51.876844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 464/947] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:51 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1487 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:51.908364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e19428dd-b9d2-4bdf-b4a0-c161e5add070 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:51.908747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Updating instance_info_cache with network_info: [{"id": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b", "address": "fa:16:3e:3c:ca:dc", "network": {"id": "adbcf694-b47e-4d38-a831-56cef3ebb590", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-744289897-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c47360eecc8e4f16a26eb8a1e64d9ee8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb92ab860-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:34:51.909341 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:51.909341 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:51.910922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e19428dd-b9d2-4bdf-b4a0-c161e5add070 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '638d4b55acc94615b582e7626f91123d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fad31aa81c4a5796200fe92c333aac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e19428dd-b9d2-4bdf-b4a0-c161e5add070 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Request method failure captured: Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 22 Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6friZZ_z18dOkwDZzYQI8r3J11FqxwyIhZRgymAv5fCbawHjs4jYzCU3_DBIN0FgeONDsM3DGfq196z78ICTTT9RJ8BzFIMdcMnYY8YNI2z59QcSR02C4ZQGcpfdIJIKrU3fuCnN0fsjycg4FqA3NGRbVHhY7U0S3Ff8AvdBLsdqkVg Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:51.914959 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/76fad31aa81c4a5796200fe92c333aac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 76fad31aa81c4a5796200fe92c333aac Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 638d4b55acc94615b582e7626f91123d Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: {"hw:numa_nodes": "1"} Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:51.916601 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'flavor_id': '1416010448', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:34:51.917533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 03 04:34:51.918747 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:51.920048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e19428dd-b9d2-4bdf-b4a0-c161e5add070 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:51.921528 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e19428dd-b9d2-4bdf-b4a0-c161e5add070 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065 tempest-FlavorsExtraSpecsNegativeTestJSON-702127065-project] 10.222.0.72 "PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.043041 Aug 03 04:34:51.927285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 465/948] 10.222.0.72 () {60 vars in 1265 bytes} [Wed Aug 3 04:34:51 2022] PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:51.934739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:51.935976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:51.945520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.946231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.958416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.958416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:51.974514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Releasing lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120832) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:34:51.975863 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-145632ae-90c0-4eb8-9328-d5b28f8cf283 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 202 len: 0 microversion: 2.1 time: 3.818922 Aug 03 04:34:51.977069 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 484/949] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:48 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 0 bytes in 3821 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:34:51.982194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-513a8e8d-b35e-4812-8248-dcf2e2b9508e req-4ee9c13b-3935-4557-a3c3-c9b7a8c152bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334830e3-3398-4063-8efd-0f9d9e900a36", "tag": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:51.993676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-513a8e8d-b35e-4812-8248-dcf2e2b9508e req-4ee9c13b-3935-4557-a3c3-c9b7a8c152bc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:51.994366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-513a8e8d-b35e-4812-8248-dcf2e2b9508e req-4ee9c13b-3935-4557-a3c3-c9b7a8c152bc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.012574 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-513a8e8d-b35e-4812-8248-dcf2e2b9508e req-4ee9c13b-3935-4557-a3c3-c9b7a8c152bc service nova] Creating event network-changed:b92ab860-515d-46b5-a8a7-fc29f4f1cc2b for instance 334830e3-3398-4063-8efd-0f9d9e900a36 on n-h2-826756-5 Aug 03 04:34:52.018233 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-513a8e8d-b35e-4812-8248-dcf2e2b9508e req-4ee9c13b-3935-4557-a3c3-c9b7a8c152bc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039662 Aug 03 04:34:52.020101 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 485/950] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:52.025730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Calling method '.version_select at 0x7fdd557b9af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:52.267400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:52.418974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:52.441493 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0096d47-e4db-4466-9611-e7160be4c0fc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.513233 Aug 03 04:34:52.441493 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 466/951] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:51 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:52.445358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:52.446182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:52.465268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.466677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.467749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.468369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.506282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:52.507246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 03 04:34:52.507246 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Request method failure captured: Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-security-groups/9e77f69b-ba38-41df-a83d-e31292f9c2b8 HTTP/1.1 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frm9ri6ow1d4AN36o-7K0cpStQK-eVHAN1ErK4-kxp3DLTfjFpMngQMlAmqHqEe5Oo1yrgQ2TqqE4gV1O4d9E82w3uMkn_j3nQ_m2mSYjPvbh66ngI8OqN7nm-Kzn9HqIoJucOl0B0YqwrPyS1t2JPIEW8qIQ_LRaNhji9JdCy4gT4 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:52.510593 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: a5cc78bc85da401b9c7e8dd769112864 Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: exception: Insufficient rights for removing default security group. Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.524413 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9e77f69b-ba38-41df-a83d-e31292f9c2b8'} Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:52.525210 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 03 04:34:52.527256 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.528642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7d24fe06-8d88-4266-85d0-1017c66497b1'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1e5ba33-201c-4e34-9e1b-25a3c2324ed1 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/9e77f69b-ba38-41df-a83d-e31292f9c2b8" status: 400 len: 182 microversion: 2.1 time: 0.491233 Aug 03 04:34:52.530090 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 486/952] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:34:52 2022] DELETE /compute/v2.1/os-security-groups/9e77f69b-ba38-41df-a83d-e31292f9c2b8 => generated 182 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:34:52.530945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:52.530945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:52.541388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.542385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.543341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.544046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.737271 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81512d5d-357f-4950-af30-d401d70f8740 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db/action" status: 204 len: 0 microversion: 2.1 time: 0.221092 Aug 03 04:34:52.738349 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 487/953] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:52 2022] POST /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db/action => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:34:52.786376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:52.787316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:52.803142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:52.808503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.810069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.814808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fe5242c-dfe0-4499-aa74-8e2a239baedc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.370638 Aug 03 04:34:52.814943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:52.814943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:52.819528 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 467/954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:52 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:52.838306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad45f09e-43ba-419f-8e15-5838a36637aa tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:52.840771 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:52.840771 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:52.859121 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ad45f09e-43ba-419f-8e15-5838a36637aa tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] HTTP exception thrown: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad45f09e-43ba-419f-8e15-5838a36637aa tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Request method failure captured: Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frjhGRqLOZlkZZA2yp0A9pmi6BYnrtn3UDUF3bPWqp9jvBCknzVKbxdgsxJYNHYKp3GztptOW4RX26POaTISDUZGVcKX-p_2yJgBqI7A-MMUUeXNg_12_5rLpt75-I5qHiiYGluo5NAeVfco4_RdOAPBjTfDGogqtX7diNlIrALddc Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:34:52.863269 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_032cbd395732428a943fe76e48477640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/032cbd395732428a943fe76e48477640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 50f83bbb9c1644ff9bab5a897addb530 Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:34:52.864643 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'flavor_id': '1416010448', 'id': 'hw:cpu_thread_policy'} Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:52.865339 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. Aug 03 04:34:52.866618 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:52.870534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad45f09e-43ba-419f-8e15-5838a36637aa tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Returning 404 to user: Flavor 1416010448 has no extra specs with key hw:cpu_thread_policy. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:52.871797 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad45f09e-43ba-419f-8e15-5838a36637aa tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.051150 Aug 03 04:34:52.876055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 468/955] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:34:52 2022] DELETE /compute/v2.1/flavors/1416010448/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:52.890258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6796bafb-462f-47e3-b895-4df182f66c8e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '.version_select at 0x7fdd5495bb80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:53.212970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7ffa3abd-bf17-4d34-819a-a6628e80dcbf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5/action" status: 202 len: 0 microversion: 2.1 time: 0.445627 Aug 03 04:34:53.215016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 488/956] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:52 2022] POST /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:53.239881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Calling method '.version_select at 0x7fdd551db160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:53.273679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:53.274300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Neutron security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:34:53.274845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] HTTP exception thrown: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.274845 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Request method failure captured: Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-security-groups/8f8c8a77-d70b-4b51-9245-e633ae3545a4 HTTP/1.1 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frm9ri6ow1d4AN36o-7K0cpStQK-eVHAN1ErK4-kxp3DLTfjFpMngQMlAmqHqEe5Oo1yrgQ2TqqE4gV1O4d9E82w3uMkn_j3nQ_m2mSYjPvbh66ngI8OqN7nm-Kzn9HqIoJucOl0B0YqwrPyS1t2JPIEW8qIQ_LRaNhji9JdCy4gT4 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:53.277085 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: a5cc78bc85da401b9c7e8dd769112864 Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.285961 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8f8c8a77-d70b-4b51-9245-e633ae3545a4'} Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:53.286776 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:34:53.287928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.289031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Returning 404 to user: Security group 8f8c8a77-d70b-4b51-9245-e633ae3545a4 does not exist Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-c9152dba-ed2d-4a19-9238-d2a0eb29d65a'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6ce6439-eb23-4998-93d7-3c9e90782066 tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/8f8c8a77-d70b-4b51-9245-e633ae3545a4" status: 404 len: 194 microversion: 2.1 time: 0.061117 Aug 03 04:34:53.290329 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 489/957] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:34:53 2022] GET /compute/v2.1/os-security-groups/8f8c8a77-d70b-4b51-9245-e633ae3545a4 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:53.291203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:53.291203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:53.295212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:53.295727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:53.296550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:53.296995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:53.686433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:53.703091 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03d1d5d5-3cd6-484b-b307-67e4774281d2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1470 microversion: 2.1 time: 0.422760 Aug 03 04:34:53.704124 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 490/958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:53 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:53.713451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d185bd4b-b30c-4989-aa01-8ac78467f21b tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:53.717315 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:53.717315 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:34:53.718665 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d185bd4b-b30c-4989-aa01-8ac78467f21b tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d185bd4b-b30c-4989-aa01-8ac78467f21b tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Request method failure captured: Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 27 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frjhGRqLOZlkZZA2yp0A9pmi6BYnrtn3UDUF3bPWqp9jvBCknzVKbxdgsxJYNHYKp3GztptOW4RX26POaTISDUZGVcKX-p_2yJgBqI7A-MMUUeXNg_12_5rLpt75-I5qHiiYGluo5NAeVfco4_RdOAPBjTfDGogqtX7diNlIrALddc Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:34:53.720497 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_032cbd395732428a943fe76e48477640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/032cbd395732428a943fe76e48477640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 50f83bbb9c1644ff9bab5a897addb530 Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: {"hw:cpu_policy": "shared"} Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:34:53.722781 n-d-826756-5 devstack@n-api.service[120832]: exception: Request body and URI mismatch Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'flavor_id': '1416010448', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:53.723973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d185bd4b-b30c-4989-aa01-8ac78467f21b tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:53.725436 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d185bd4b-b30c-4989-aa01-8ac78467f21b tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017939 Aug 03 04:34:53.729653 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 491/959] 10.222.0.72 () {60 vars in 1265 bytes} [Wed Aug 3 04:34:53 2022] PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:34:53.734575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:53.735314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:53.743157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:53.743734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:53.745114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:53.745780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:54.396165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:54.407239 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eb6ff2ef-412e-4d59-9842-c9a329fbb349 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1492 microversion: 2.1 time: 0.676263 Aug 03 04:34:54.408769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 492/960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:53 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1492 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:54.415358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Action: 'update', calling method: .version_select at 0x7fdd54e16280>, body: {"security_group": {"name": "tempest-sg-1834819939", "description": "tempest-description-1359214575"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:54.468401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:34:54.470241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Neutron security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:34:54.471304 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] HTTP exception thrown: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.471304 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Request method failure captured: Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/os-security-groups/6c4de22a-93e0-4e44-8faa-5e3adf789fd2 HTTP/1.1 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 102 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frm9ri6ow1d4AN36o-7K0cpStQK-eVHAN1ErK4-kxp3DLTfjFpMngQMlAmqHqEe5Oo1yrgQ2TqqE4gV1O4d9E82w3uMkn_j3nQ_m2mSYjPvbh66ngI8OqN7nm-Kzn9HqIoJucOl0B0YqwrPyS1t2JPIEW8qIQ_LRaNhji9JdCy4gT4 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:54.476992 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2e9a3a7df6c145bea1665c4eaec3d4b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2e9a3a7df6c145bea1665c4eaec3d4b3 Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740 Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: a5cc78bc85da401b9c7e8dd769112864 Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1682105740-project Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: {"security_group": {"name": "tempest-sg-1834819939", "description": "tempest-description-1359214575"}} Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:34:54.478425 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6c4de22a-93e0-4e44-8faa-5e3adf789fd2', 'body': {'security_group': {'name': 'tempest-sg-1834819939', 'description': 'tempest-description-1359214575'}}} Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:34:54.479249 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:34:54.480373 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.482201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] Aug 03 04:34:54.485110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:54.495219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] Returning 404 to user: Security group 6c4de22a-93e0-4e44-8faa-5e3adf789fd2 does not exist Aug 03 04:34:54.495219 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fa42e867-af12-49ca-866d-e31a206765c7'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:54.500334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6153f35e-2d75-4d31-b4c6-287aa466119f tempest-SecurityGroupsNegativeTestJSON-1682105740 tempest-SecurityGroupsNegativeTestJSON-1682105740-project] 10.222.0.72 "PUT /compute/v2.1/os-security-groups/6c4de22a-93e0-4e44-8faa-5e3adf789fd2" status: 404 len: 194 microversion: 2.1 time: 0.088001 Aug 03 04:34:54.502523 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 493/961] 10.222.0.72 () {60 vars in 1290 bytes} [Wed Aug 3 04:34:54 2022] PUT /compute/v2.1/os-security-groups/6c4de22a-93e0-4e44-8faa-5e3adf789fd2 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:34:54.518495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:54.519833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:54.530340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:54.532022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:54.533121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:54.533813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:54.558331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:54.944224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:54.957333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86fef299-5a08-449f-aa74-f0da8e130692 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.451856 Aug 03 04:34:54.958053 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 494/962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:54 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:54.962984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f7dd2ded-7455-4b3e-a7f2-234a24979180 req-0a979308-71c2-42d4-a5a6-687c9414bc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fde05c5-b996-409c-9e44-e6f2dc34f4c2", "name": "network-vif-plugged", "status": "completed", "tag": "79987c6a-a281-4dd5-afd1-d767893a20dd"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:54.974148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f7dd2ded-7455-4b3e-a7f2-234a24979180 req-0a979308-71c2-42d4-a5a6-687c9414bc45 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:54.974873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f7dd2ded-7455-4b3e-a7f2-234a24979180 req-0a979308-71c2-42d4-a5a6-687c9414bc45 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:54.986211 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f7dd2ded-7455-4b3e-a7f2-234a24979180 req-0a979308-71c2-42d4-a5a6-687c9414bc45 service nova] Creating event network-vif-plugged:79987c6a-a281-4dd5-afd1-d767893a20dd for instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 on n-h1-826756-5 Aug 03 04:34:54.991208 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f7dd2ded-7455-4b3e-a7f2-234a24979180 req-0a979308-71c2-42d4-a5a6-687c9414bc45 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Aug 03 04:34:54.992181 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 495/963] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:54.998294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbd3d306-97d9-425f-8f30-a580fe59ca0c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbd3d306-97d9-425f-8f30-a580fe59ca0c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Request method failure captured: Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 49 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frjhGRqLOZlkZZA2yp0A9pmi6BYnrtn3UDUF3bPWqp9jvBCknzVKbxdgsxJYNHYKp3GztptOW4RX26POaTISDUZGVcKX-p_2yJgBqI7A-MMUUeXNg_12_5rLpt75-I5qHiiYGluo5NAeVfco4_RdOAPBjTfDGogqtX7diNlIrALddc Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:34:55.002707 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/032cbd395732428a943fe76e48477640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_032cbd395732428a943fe76e48477640"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/032cbd395732428a943fe76e48477640"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 032cbd395732428a943fe76e48477640 Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 50f83bbb9c1644ff9bab5a897addb530 Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 03 04:34:55.004575 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'flavor_id': '1416010448', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance: Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 03 04:34:55.005447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.007868 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 03 04:34:55.011219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.013198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbd3d306-97d9-425f-8f30-a580fe59ca0c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:55.019381 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbd3d306-97d9-425f-8f30-a580fe59ca0c tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020824 Aug 03 04:34:55.019381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 496/964] 10.222.0.72 () {60 vars in 1265 bytes} [Wed Aug 3 04:34:54 2022] PUT /compute/v2.1/flavors/1416010448/os-extra_specs/hw:numa_nodes => generated 117 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:34:55.021532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.022475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:55.045980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.047961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.052446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.056648 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6796bafb-462f-47e3-b895-4df182f66c8e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/2af4e3d7-e088-4e04-a523-777f114b86fa" status: 202 len: 0 microversion: 2.1 time: 2.179199 Aug 03 04:34:55.058194 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 469/965] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:34:52 2022] DELETE /compute/v2.1/os-floating-ips/2af4e3d7-e088-4e04-a523-777f114b86fa => generated 0 bytes in 2181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:55.062483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.065037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.067706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:55.079810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.080903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.083844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.085568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.480092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:55.488952 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1a49d35-8beb-4422-acf2-5431accc664b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1470 microversion: 2.1 time: 0.429334 Aug 03 04:34:55.489811 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 470/966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:55 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:55.500502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:55.509984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a1d00b6-7418-4318-8804-652245a59391 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.510510 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:55.510510 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:34:55.510901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53afc26c-1403-4b84-abbc-d43ac152925a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.494404 Aug 03 04:34:55.511485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 497/967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:55 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:55.516846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-125ef3ab-5e4b-4644-a6ad-f197c0590e4a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-125ef3ab-5e4b-4644-a6ad-f197c0590e4a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Request method failure captured: Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action HTTP/1.1 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 34 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fq3RqY9YLqxC-nPlcUEJefBjkiYb_ZGVNtpWjWMjK8B9RFduXDD405Dk_Jp0ERQywd6t7eQ6s8Nr1I0C_1Ujr2Tpvo_HGP-QumIvdIIB5i_qBRj5rX2iKG2skkWla1U_nqg-Smj42bljjxnNgJcupV8WjvfMK7w5id8ekuFO8ikKx4 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:34:55.522480 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 92f59caf8c414149bfe4c9852630d7d4 Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: {"addFloatingIp": {"address": ""}} Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:34:55.523856 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '334830e3-3398-4063-8efd-0f9d9e900a36', 'body': {'addFloatingIp': {'address': ''}}} Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '' Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:55.524721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:34:55.526037 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:34:55.527192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 03 04:34:55.527192 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.528768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-125ef3ab-5e4b-4644-a6ad-f197c0590e4a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:55.529681 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-125ef3ab-5e4b-4644-a6ad-f197c0590e4a tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 400 len: 142 microversion: 2.1 time: 0.016725 Aug 03 04:34:55.530354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 498/968] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:55 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:34:55.537426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.538851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:55.542658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:55.547007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.547463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.548241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.548890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.640032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a1d00b6-7418-4318-8804-652245a59391 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1416010448" status: 202 len: 0 microversion: 2.1 time: 0.137072 Aug 03 04:34:55.647289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 471/969] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:34:55 2022] DELETE /compute/v2.1/flavors/1416010448 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:34:55.652857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:55.655333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:55.666232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.666687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.667495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.667921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.703401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Acquired lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:34:55.796698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:55.810741 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c4ff81b6-aa2d-4557-a555-efa876880ecd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 200 len: 1472 microversion: 2.1 time: 0.274145 Aug 03 04:34:55.813895 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 499/970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:55 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:55.819625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71f17cd9-7374-44c4-bc90-892475ce29ee tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.844994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71f17cd9-7374-44c4-bc90-892475ce29ee tempest-FlavorsExtraSpecsNegativeTestJSON-241963723 tempest-FlavorsExtraSpecsNegativeTestJSON-241963723-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029654 Aug 03 04:34:55.846084 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 500/971] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:34:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:55.851489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-671241588"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:55.856827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:55.860345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.860910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.861931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:55.862525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:55.876390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Releasing lock "refresh_cache-334830e3-3398-4063-8efd-0f9d9e900a36" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:34:55.877258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] HTTP exception thrown: floating IP not found Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Request method failure captured: Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action HTTP/1.1 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 41 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fq3RqY9YLqxC-nPlcUEJefBjkiYb_ZGVNtpWjWMjK8B9RFduXDD405Dk_Jp0ERQywd6t7eQ6s8Nr1I0C_1Ujr2Tpvo_HGP-QumIvdIIB5i_qBRj5rX2iKG2skkWla1U_nqg-Smj42bljjxnNgJcupV8WjvfMK7w5id8ekuFO8ikKx4 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:55.879759 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 92f59caf8c414149bfe4c9852630d7d4 Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:34:55.888520 n-d-826756-5 devstack@n-api.service[120831]: exception: floating IP not found Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '334830e3-3398-4063-8efd-0f9d9e900a36', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.889488 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 03 04:34:55.890850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.892392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Returning 404 to user: floating IP not found {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:55.892392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75c30858-a420-4299-9b5d-1c89be4cdd20 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 404 len: 67 microversion: 2.1 time: 0.232854 Aug 03 04:34:55.892392 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 472/972] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:55 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 67 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:34:55.898265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33f060bc-8dd6-4b95-ae56-0a6a9ffbf67e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:55.979497 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-33f060bc-8dd6-4b95-ae56-0a6a9ffbf67e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33f060bc-8dd6-4b95-ae56-0a6a9ffbf67e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Request method failure captured: Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action HTTP/1.1 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 44 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fq3RqY9YLqxC-nPlcUEJefBjkiYb_ZGVNtpWjWMjK8B9RFduXDD405Dk_Jp0ERQywd6t7eQ6s8Nr1I0C_1Ujr2Tpvo_HGP-QumIvdIIB5i_qBRj5rX2iKG2skkWla1U_nqg-Smj42bljjxnNgJcupV8WjvfMK7w5id8ekuFO8ikKx4 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:34:55.981668 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 92f59caf8c414149bfe4c9852630d7d4 Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:34:55.982998 n-d-826756-5 devstack@n-api.service[120831]: exception: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '334830e3-3398-4063-8efd-0f9d9e900a36', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:34:55.983974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 03 04:34:55.985205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:34:55.986409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33f060bc-8dd6-4b95-ae56-0a6a9ffbf67e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:34:55.986409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33f060bc-8dd6-4b95-ae56-0a6a9ffbf67e tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action" status: 404 len: 88 microversion: 2.1 time: 0.094948 Aug 03 04:34:55.989316 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 473/973] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:55 2022] POST /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36/action => generated 88 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:34:55.994661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:55.995380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:56.002926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.003506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.004453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.004994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.217957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:56.227487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a6c60cf-c5b0-4c0a-bb8f-5afff833c9f1 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.236578 Aug 03 04:34:56.228549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 474/974] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:55 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:56.234675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:56.235361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:56.242549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.243357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.244441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.245297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.272407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:34:56.308651 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8a8e9d9-d751-4b6c-991d-7ab14afc4ea6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5/action" status: 202 len: 0 microversion: 2.1 time: 0.460709 Aug 03 04:34:56.309399 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 501/975] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:55 2022] POST /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:34:56.320525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01138273-d0f2-4c02-bf94-e153fb68c2c3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a3de50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:56.385824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01138273-d0f2-4c02-bf94-e153fb68c2c3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.069693 Aug 03 04:34:56.396013 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 502/976] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:34:56 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:56.512652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:56.514106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:56.529468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.529922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.530711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.531145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.742863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6d4971a-5d23-4032-8eac-429ac08af60b tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "DELETE /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 204 len: 0 microversion: 2.1 time: 0.510885 Aug 03 04:34:56.744325 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 475/977] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:34:56 2022] DELETE /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:34:56.752495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:56.752495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:56.758409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.759185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.760173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.760867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.809656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:56.818381 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-daa6c91a-0f32-4c33-95b6-6cc23fee3030 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1462 microversion: 2.1 time: 0.309958 Aug 03 04:34:56.818957 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 503/978] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:56 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1462 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:56.823888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:56.824704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:56.831121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.832761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:56.832761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:56.833468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.173134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:57.180793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ab66219-f36b-4bc9-bd9e-6c0ecd81043c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1310 microversion: 2.1 time: 0.435177 Aug 03 04:34:57.181383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 476/979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:56 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1310 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:57.186242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:57.186848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:57.188900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:57.193554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:57.194240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.195325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:57.195762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.198528 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0af079fc-30b3-4585-a570-b69772a0bdb5 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1541 microversion: 2.1 time: 0.378195 Aug 03 04:34:57.199348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 504/980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:56 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1541 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:57.216381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ceb9e87b-1101-4229-a89e-65e9e9fff1f5 req-beb6d40b-2149-471f-8b7a-278e54e9907a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "name": "network-vif-plugged", "status": "completed", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:57.227123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ceb9e87b-1101-4229-a89e-65e9e9fff1f5 req-beb6d40b-2149-471f-8b7a-278e54e9907a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:57.227664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ceb9e87b-1101-4229-a89e-65e9e9fff1f5 req-beb6d40b-2149-471f-8b7a-278e54e9907a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.242067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ceb9e87b-1101-4229-a89e-65e9e9fff1f5 req-beb6d40b-2149-471f-8b7a-278e54e9907a service nova] Creating event network-vif-plugged:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h2-826756-5 Aug 03 04:34:57.247228 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ceb9e87b-1101-4229-a89e-65e9e9fff1f5 req-beb6d40b-2149-471f-8b7a-278e54e9907a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046163 Aug 03 04:34:57.247836 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 505/981] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:57.253086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:57.253852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:57.260040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:57.260525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.261293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:57.261724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:57.812111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:57.820556 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a96d8a0-f9f9-4bff-9e09-a9fa97d0305b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1462 microversion: 2.1 time: 0.638166 Aug 03 04:34:57.821140 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 477/982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:57 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1462 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:57.825782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6434654-d160-4293-a588-0df76dfff391 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54973af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:57.848717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:57.857599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1be43851-c40f-49b5-ada5-9c2c873bcf75 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.608339 Aug 03 04:34:57.858178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 506/983] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:57 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:57.864341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db507480-969f-4de1-bb2a-77b841fcf238 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'create', calling method: .version_select at 0x7fdd557b9f70>, body: {"keypair": {"name": "tempest-keypair-1676407734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYtV12XeYX9RtT4n1LnvQoj/z2ZPf+1NxkAFVtRlGV+XFPPUGa2gHA/KTAzY92mZ7xARYDn+qDYWjpP9P0TJ35Y8Cf7Seqe96M0Gsck/p3uKE2G5svo64T2opxLIQpT7w=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:57.884472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-db507480-969f-4de1-bb2a-77b841fcf238 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:34:57.887292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6434654-d160-4293-a588-0df76dfff391 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.064717 Aug 03 04:34:57.889262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-db507480-969f-4de1-bb2a-77b841fcf238 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:34:57.895454 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 478/984] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:34:57 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:58.027813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db507480-969f-4de1-bb2a-77b841fcf238 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168299 Aug 03 04:34:58.028454 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 507/985] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:34:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:58.202805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:58.203312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:58.215706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.216870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.219082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.219769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.222542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:58.223292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:58.235507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.235974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.236806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.237255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.621387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:58.637510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:58.640988 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e718443-5f11-402f-bf32-1f82644f1ca4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1494 microversion: 2.1 time: 0.442618 Aug 03 04:34:58.642503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 479/986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:58 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1494 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:58.655887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34b6dcd0-5594-4a4a-8af1-f62377a03099 tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1541 microversion: 2.1 time: 0.438377 Aug 03 04:34:58.656656 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 508/987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:58 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1541 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:58.880776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:58.881516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:58.888694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.889548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.890567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.891231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:58.991388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:58.992010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:58.998661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:58.999552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.000338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.000926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.135848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:59.145045 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1291991e-3187-402b-ace9-74d35d444a1b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.269140 Aug 03 04:34:59.160724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 509/988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:58 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:34:59.166841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f29be673-bf0a-447d-b644-4f7656e292e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a2cee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:59.221196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dcc5225e-78fc-42f0-8251-bfded49cdada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1645 microversion: 2.1 time: 0.552289 Aug 03 04:34:59.222540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 480/989] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:58 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1645 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:59.231056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f29be673-bf0a-447d-b644-4f7656e292e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.068422 Aug 03 04:34:59.232120 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 510/990] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:34:59 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:59.245198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:59.245805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:59.251946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.252453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.253300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.253727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.430447 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c01d0743-be94-40fa-b7b0-114815c25576 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1645 microversion: 2.1 time: 0.188873 Aug 03 04:34:59.445214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 481/991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:59 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1645 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:34:59.451685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:59.454550 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:34:59.454550 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:34:59.456902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.459021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.459881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.478903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.503447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1e84c22-3d15-42d7-893f-488471c95cbe tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055368 Aug 03 04:34:59.522406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:34:59.525428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:59.527787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 511/992] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:34:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:34:59.534271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.534897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.535893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.536690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.567194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lazy-loading 'flavor' on Instance uuid 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:34:59.572312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:34:59.587547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120831) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:34:59.679067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:34:59.680115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:34:59.691674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.692762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.694175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:34:59.694785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:34:59.936795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:34:59.961499 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a0355cf0-1815-403a-91e1-48abbcfe81fe tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1541 microversion: 2.1 time: 0.287009 Aug 03 04:34:59.962668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 512/993] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:34:59 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1541 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:00.167269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:00.168072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:00.176006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:00.177210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:00.178251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:00.178868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:00.362950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:00.374170 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4abcc528-70ca-42da-9d0a-e43a834a56a0 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.210730 Aug 03 04:35:00.396418 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 513/994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:00 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:00.431856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14f24d15-5deb-4d09-ba49-5a88381de5c1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a8a940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:00.548664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14f24d15-5deb-4d09-ba49-5a88381de5c1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.150187 Aug 03 04:35:00.553677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 514/995] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:00 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:00.641172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dcdf1311-6124-4f32-a1af-6498796312e8 req-7dbb6bd3-894f-4aca-82f4-e0bd56220d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334830e3-3398-4063-8efd-0f9d9e900a36", "name": "network-vif-deleted", "tag": "b92ab860-515d-46b5-a8a7-fc29f4f1cc2b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:00.684253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcdf1311-6124-4f32-a1af-6498796312e8 req-7dbb6bd3-894f-4aca-82f4-e0bd56220d3c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:00.685136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dcdf1311-6124-4f32-a1af-6498796312e8 req-7dbb6bd3-894f-4aca-82f4-e0bd56220d3c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:00.757475 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dcdf1311-6124-4f32-a1af-6498796312e8 req-7dbb6bd3-894f-4aca-82f4-e0bd56220d3c service nova] Creating event network-vif-deleted:b92ab860-515d-46b5-a8a7-fc29f4f1cc2b for instance 334830e3-3398-4063-8efd-0f9d9e900a36 on n-h2-826756-5 Aug 03 04:35:00.782004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dcdf1311-6124-4f32-a1af-6498796312e8 req-7dbb6bd3-894f-4aca-82f4-e0bd56220d3c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136229 Aug 03 04:35:00.782004 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 515/996] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:00.987115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:00.988078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:01.000726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.003380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.003380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.003380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.067913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.069053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.069763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lazy-loading 'fault' on Instance uuid 334830e3-3398-4063-8efd-0f9d9e900a36 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:01.149158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92f59caf8c414149bfe4c9852630d7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c47360eecc8e4f16a26eb8a1e64d9ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:01.157749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d935066-2941-41a2-9247-388307a3b0ce tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 200 len: 1322 microversion: 2.1 time: 0.175257 Aug 03 04:35:01.159825 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 516/997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:00 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:01.410258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:01.416226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:01.426544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.427426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.428556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.429737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.601034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:01.609787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17faff4b-8667-4df5-94b0-a75da176b931 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.216127 Aug 03 04:35:01.611095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 517/998] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:01 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:01.618262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f95b6b8-805c-40eb-9857-7381b06baec5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549f7670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:01.676534 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f95b6b8-805c-40eb-9857-7381b06baec5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.063841 Aug 03 04:35:01.677212 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 518/999] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:01 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:01.681829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef3bcbae-0438-4a3c-a31a-eff11ed3cc5d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '.version_select at 0x7fdd553a9a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:01.686562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef3bcbae-0438-4a3c-a31a-eff11ed3cc5d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:01.687020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef3bcbae-0438-4a3c-a31a-eff11ed3cc5d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:01.699204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef3bcbae-0438-4a3c-a31a-eff11ed3cc5d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 1907 microversion: 2.1 time: 0.020847 Aug 03 04:35:01.709359 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 519/1000] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:35:01 2022] GET /compute/v2.1/os-migrations => generated 1907 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:01.720044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-874ff633-130e-420f-9dff-eea91902bb9a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:01.728517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-874ff633-130e-420f-9dff-eea91902bb9a tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012716 Aug 03 04:35:01.729233 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 520/1001] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:35:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:01.741147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d887d4bc-5f92-411b-85f5-bbd173ea2940 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-667868571", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:01.744423 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:01.744423 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:01.853708 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d887d4bc-5f92-411b-85f5-bbd173ea2940 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.115073 Aug 03 04:35:01.853708 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 521/1002] 10.222.0.72 () {60 vars in 1146 bytes} [Wed Aug 3 04:35:01 2022] POST /compute/v2.1/flavors => generated 498 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:35:02.139480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86044956-a566-42c0-86b2-459752ceb201 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1253546799", "id": 2070918915, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:02.242241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86044956-a566-42c0-86b2-459752ceb201 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.387843 Aug 03 04:35:02.243193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 522/1003] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:35:01 2022] POST /compute/v2.1/flavors => generated 449 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:35:02.249285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4675d7d0-c506-4072-aefe-1a0ce345494d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:02.259921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4675d7d0-c506-4072-aefe-1a0ce345494d tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015860 Aug 03 04:35:02.261041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 523/1004] 10.222.0.72 () {58 vars in 1182 bytes} [Wed Aug 3 04:35:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:35:02.277983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:02.278631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] [instance: 334830e3-3398-4063-8efd-0f9d9e900a36] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:02.285762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:02.286539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:02.287488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:02.288098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:02.306217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] HTTP exception thrown: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Request method failure captured: Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 HTTP/1.1 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fq3RqY9YLqxC-nPlcUEJefBjkiYb_ZGVNtpWjWMjK8B9RFduXDD405Dk_Jp0ERQywd6t7eQ6s8Nr1I0C_1Ujr2Tpvo_HGP-QumIvdIIB5i_qBRj5rX2iKG2skkWla1U_nqg-Smj42bljjxnNgJcupV8WjvfMK7w5id8ekuFO8ikKx4 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:02.307875 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c47360eecc8e4f16a26eb8a1e64d9ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c47360eecc8e4f16a26eb8a1e64d9ee8 Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486 Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 92f59caf8c414149bfe4c9852630d7d4 Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:35:02.309609 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '334830e3-3398-4063-8efd-0f9d9e900a36'} Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:02.310433 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. Aug 03 04:35:02.311683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:02.321472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] Returning 404 to user: Instance 334830e3-3398-4063-8efd-0f9d9e900a36 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:02.321472 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17ff1591-a1c3-42ae-bd08-87bacb6282ed tempest-FloatingIPsAssociationNegativeTestJSON-621562486 tempest-FloatingIPsAssociationNegativeTestJSON-621562486-project] 10.222.0.72 "GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36" status: 404 len: 111 microversion: 2.1 time: 0.037370 Aug 03 04:35:02.321472 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 524/1005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:02 2022] GET /compute/v2.1/servers/334830e3-3398-4063-8efd-0f9d9e900a36 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:02.626155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d016944-dc5e-48ad-9c84-302cb7922026 tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:02.644810 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d016944-dc5e-48ad-9c84-302cb7922026 tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] 10.222.0.72 "GET /compute/v2.1/flavors/2070918915" status: 200 len: 449 microversion: 2.55 time: 0.329338 Aug 03 04:35:02.648700 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 525/1006] 10.222.0.72 () {60 vars in 1199 bytes} [Wed Aug 3 04:35:02 2022] GET /compute/v2.1/flavors/2070918915 => generated 449 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:35:02.661081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-211666592", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "ef9c53d3-2a04-49e1-b9f3-0b3546d8126a"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:02.751838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:03.340350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:03.341220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:03.341703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:03.342124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:03.342538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:03.352934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.353392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.354225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.354698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.374840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6ea4450-d1c2-4404-86e6-fa916386c8ae tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2/action" status: 202 len: 0 microversion: 2.1 time: 3.856775 Aug 03 04:35:03.378114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:03.378498 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 482/1007] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:34:59 2022] POST /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2/action => generated 0 bytes in 3862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:03.385167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:03.389332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:03.390138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:03.399630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:35:03.401534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.402351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.404012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:35:03.404602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.405273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.574584 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2f867ce-710e-4000-8adc-d82e7aaa3d67 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923617 Aug 03 04:35:03.580101 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 526/1008] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:35:03.585690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54c33069-9e02-46cf-be86-8361f26ee989 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:03.588590 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:03.588590 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:03.673750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:03.684157 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53181d6f-2935-453d-a80f-9984f37787b4 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.304563 Aug 03 04:35:03.685220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 483/1009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:03 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:03.695328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-807a34dc-3de2-442b-b8be-69e586734c03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54910430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:03.755532 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54c33069-9e02-46cf-be86-8361f26ee989 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] 10.222.0.72 "PUT /compute/v2.1/flavors/2070918915" status: 200 len: 450 microversion: 2.55 time: 0.173803 Aug 03 04:35:03.766062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-807a34dc-3de2-442b-b8be-69e586734c03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.071076 Aug 03 04:35:03.766062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 484/1010] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:03 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:03.769862 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 527/1011] 10.222.0.72 () {62 vars in 1219 bytes} [Wed Aug 3 04:35:03 2022] PUT /compute/v2.1/flavors/2070918915 => generated 450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:35:03.778461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:03.779025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:03.780467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:03.781654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:03.795588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.796203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.800492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.800492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.805691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.808967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:03.809085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:03.809085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:03.812562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:04.166974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:04.174969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e8d86fa-165c-4721-b775-2a9a5d893c48 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.403635 Aug 03 04:35:04.179774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 528/1012] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:03 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:04.184263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b04979ec-7f50-44bd-9bc0-7dc3ef8a4788 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.185096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b04979ec-7f50-44bd-9bc0-7dc3ef8a4788 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:04.200260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:04.243950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ebdbc54-b5b5-4a86-adc7-19d1eb9b3a68 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 2420 microversion: 2.25 time: 0.479711 Aug 03 04:35:04.248702 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 485/1013] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:03 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 2420 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:04.272918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-502b146e-a813-4944-a98a-dcbf45cc0b95 tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.280687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b04979ec-7f50-44bd-9bc0-7dc3ef8a4788 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:04.294988 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b04979ec-7f50-44bd-9bc0-7dc3ef8a4788 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1278 microversion: 2.1 time: 0.116285 Aug 03 04:35:04.295878 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 529/1014] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:04 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:04.301662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": "auto"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:04.304916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:04.312289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:04.313337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:04.314814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:04.315663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:04.316878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-502b146e-a813-4944-a98a-dcbf45cc0b95 tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.55 time: 0.059139 Aug 03 04:35:04.318118 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 486/1015] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:35:04 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:04.344630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09132b78-06a7-4968-a517-f99d4ab249ca tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.366382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'flavor' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:04.398508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120832) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:35:04.404056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09132b78-06a7-4968-a517-f99d4ab249ca tempest-FlavorsV255TestJSON-1442059889 tempest-FlavorsV255TestJSON-1442059889-project] 10.222.0.72 "GET /compute/v2.1/flavors" status: 200 len: 3495 microversion: 2.55 time: 0.064324 Aug 03 04:35:04.408404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 487/1016] 10.222.0.72 () {60 vars in 1166 bytes} [Wed Aug 3 04:35:04 2022] GET /compute/v2.1/flavors => generated 3495 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:04.424795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8976a94c-43b2-4204-a694-99aebaad7108 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.426523 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:04.426523 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:04.528284 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8976a94c-43b2-4204-a694-99aebaad7108 tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/2070918915" status: 202 len: 0 microversion: 2.55 time: 0.106245 Aug 03 04:35:04.530066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 488/1017] 10.222.0.72 () {60 vars in 1202 bytes} [Wed Aug 3 04:35:04 2022] DELETE /compute/v2.1/flavors/2070918915 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:04.545656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-131a25d0-612a-4640-8e18-dd2984484d2b tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.612422 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-131a25d0-612a-4640-8e18-dd2984484d2b tempest-FlavorsV255TestJSON-1308014421 tempest-FlavorsV255TestJSON-1308014421-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5794 microversion: 2.55 time: 0.076700 Aug 03 04:35:04.630615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 489/1018] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 04:35:04 2022] GET /compute/v2.1/flavors/detail => generated 5794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:04.711950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:04.713579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:04.734413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:04.738812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:04.741113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:04.741856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.256720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:05.256720 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bda7f025-1142-4a8e-ac96-0a6d85f47ba2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.411686 Aug 03 04:35:05.256720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 490/1019] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:04 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:05.256720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3791cac1-5c98-49e4-8e85-0386e6838eae tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5496bb80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:05.258945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3791cac1-5c98-49e4-8e85-0386e6838eae tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.076171 Aug 03 04:35:05.258945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 491/1020] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:05 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:05.258945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d2769093-f032-475a-aafd-b01bf1626bfe req-e5cf0319-9dcb-4c9d-9519-56be221e5cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36e1b37-606b-4a4f-a778-0a4f1d8c42e5", "name": "network-vif-plugged", "status": "completed", "tag": "01d475bb-4fa9-4dfc-85a7-6ee4765decd7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:05.258945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=89,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:05.258945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2769093-f032-475a-aafd-b01bf1626bfe req-e5cf0319-9dcb-4c9d-9519-56be221e5cce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:05.260094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2769093-f032-475a-aafd-b01bf1626bfe req-e5cf0319-9dcb-4c9d-9519-56be221e5cce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.260094 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d2769093-f032-475a-aafd-b01bf1626bfe req-e5cf0319-9dcb-4c9d-9519-56be221e5cce service nova] Creating event network-vif-plugged:01d475bb-4fa9-4dfc-85a7-6ee4765decd7 for instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 on n-h2-826756-5 Aug 03 04:35:05.260094 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d2769093-f032-475a-aafd-b01bf1626bfe req-e5cf0319-9dcb-4c9d-9519-56be221e5cce service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Aug 03 04:35:05.260094 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 492/1021] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:05.260094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:05.261701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:05.291305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:05.291975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.292958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:05.293757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.603858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:05.622047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0dda37d-fe02-4d7b-8396-b3467c54b23a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.384857 Aug 03 04:35:05.622898 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 493/1022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:05 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:05.636584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:05.637414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:05.650991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:05.651448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.653385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:05.653842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:05.750791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:05.769116 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd6abf7e-decb-492a-a7c0-60b32c4eacf7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1282 microversion: 2.1 time: 0.143790 Aug 03 04:35:05.770893 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 494/1023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:05 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:06.264940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8886274-d989-4c20-8406-1f2a6c2205dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd548f9d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:06.366344 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8886274-d989-4c20-8406-1f2a6c2205dd tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.116032 Aug 03 04:35:06.367559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 495/1024] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:06 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:06.382329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:06.388530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:06.397919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:06.402214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:06.402214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:06.402214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:06.809337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:06.819474 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-414224dd-500e-4724-a66d-600aa322fd02 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1471 microversion: 2.1 time: 0.449693 Aug 03 04:35:06.833512 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 496/1025] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:06 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:06.841647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:06.843496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:06.851203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:06.852018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:06.852796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:06.853370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:07.235009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:07.243881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6668c1cd-c6e4-46f7-8274-e78668429be8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.408878 Aug 03 04:35:07.248413 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 497/1026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:06 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:07.264883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:07.265823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:07.274435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:07.274972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:07.275763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:07.276206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:07.569599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:07.587128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d29751e3-3bfc-49c5-87c3-03fd138abb1b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1338 microversion: 2.1 time: 0.332785 Aug 03 04:35:07.612432 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 498/1027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:07 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1338 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:07.624557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1a314e6-8d80-48a9-9519-836154ac04db tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5496b280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:07.711466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1a314e6-8d80-48a9-9519-836154ac04db tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.097794 Aug 03 04:35:07.712376 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 499/1028] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:07 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:07.848513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:07.848513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:07.864060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:07.866002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:07.867157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:07.867608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:09.334889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:09.398675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0772f337-1a71-41a5-9b46-b50e0276cb40 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 1.555765 Aug 03 04:35:09.413664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 500/1029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:07 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:09.426237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:09.427547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:09.436699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:09.437579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:09.438721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:09.440475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:09.635160 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8395be8-617a-4664-bb39-765ceea1a0ee tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/action" status: 202 len: 0 microversion: 2.25 time: 5.333898 Aug 03 04:35:09.635160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 530/1030] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:35:04 2022] POST /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/action => generated 0 bytes in 5335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:09.641254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:09.643582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:09.652787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:09.653539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:09.654596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:09.656058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.009877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:10.018884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-448c4d81-48fd-4d20-bfb7-977238878ad0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1336 microversion: 2.1 time: 0.381020 Aug 03 04:35:10.019937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 531/1031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:09 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1336 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:10.028524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72dcc576-1fce-4437-87f2-d7921e55390d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a17a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:10.087463 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72dcc576-1fce-4437-87f2-d7921e55390d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.063062 Aug 03 04:35:10.096945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 532/1032] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:10 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:10.102414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6bb6d4fc-ccb2-4c3b-925c-7ae1303f2226 req-6eb0786c-60e1-4694-97f0-0585797b1261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fde05c5-b996-409c-9e44-e6f2dc34f4c2", "name": "network-vif-unplugged", "status": "completed", "tag": "79987c6a-a281-4dd5-afd1-d767893a20dd"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:10.117958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6bb6d4fc-ccb2-4c3b-925c-7ae1303f2226 req-6eb0786c-60e1-4694-97f0-0585797b1261 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:10.118919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6bb6d4fc-ccb2-4c3b-925c-7ae1303f2226 req-6eb0786c-60e1-4694-97f0-0585797b1261 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.144589 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6bb6d4fc-ccb2-4c3b-925c-7ae1303f2226 req-6eb0786c-60e1-4694-97f0-0585797b1261 service nova] Creating event network-vif-unplugged:79987c6a-a281-4dd5-afd1-d767893a20dd for instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 on n-h1-826756-5 Aug 03 04:35:10.150967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6bb6d4fc-ccb2-4c3b-925c-7ae1303f2226 req-6eb0786c-60e1-4694-97f0-0585797b1261 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052433 Aug 03 04:35:10.151923 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 533/1033] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:10.163979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:10.165841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:10.188127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:10.193323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.194202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:10.194651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.370274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:10.379371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eda8efdf-5114-40bf-93a9-e8427196c387 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.964480 Aug 03 04:35:10.380314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 501/1034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:09 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:10.429831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:10.430827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:10.448466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:10.448958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.449865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:10.450268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:10.808017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:10.827906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:10.831085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:10.833993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-527847cc-f655-4e19-8770-2553bc5d0539 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.676185 Aug 03 04:35:10.835058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 534/1035] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:10 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:10.982916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:11.015412 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2cfd5cd4-db03-4890-8d22-cd5b09fe34f2 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 0.591613 Aug 03 04:35:11.019254 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 502/1036] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:10 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:11.050917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:11.050917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:11.055757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:11.060795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.061775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:11.062894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.063482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:11.103704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1971812-9723-49ba-850a-875a8485e942 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549221f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:11.189216 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1971812-9723-49ba-850a-875a8485e942 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.089690 Aug 03 04:35:11.191757 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 503/1037] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:11 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:11.404201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:11.410556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:11.425995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.428550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:11.432468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.433053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:11.908757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:11.921236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f88979f2-17b3-4419-b676-8f29f2eb54fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.877298 Aug 03 04:35:11.922445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 535/1038] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:11 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:11.964781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:11.970873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:11.984500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.991215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:11.995287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:11.996608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.143652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:12.155901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ffed075-b44b-4d14-aa91-d4d02c806c34 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.756564 Aug 03 04:35:12.168337 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 504/1039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:11 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:12.181212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:12.183691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:12.191691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:12.192772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.194374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:12.195032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.664306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:12.671969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b52bccd-9baa-411f-8a87-3c8c24e34540 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 0.502308 Aug 03 04:35:12.681507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 505/1040] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:12 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:12.685688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-693015c7-e611-47c3-91fd-8c8fdf29cfce req-bd24b59f-d41c-4bb9-9374-df4b7ec52812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fde05c5-b996-409c-9e44-e6f2dc34f4c2", "tag": "79987c6a-a281-4dd5-afd1-d767893a20dd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:12.714424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-693015c7-e611-47c3-91fd-8c8fdf29cfce req-bd24b59f-d41c-4bb9-9374-df4b7ec52812 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:12.725056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-693015c7-e611-47c3-91fd-8c8fdf29cfce req-bd24b59f-d41c-4bb9-9374-df4b7ec52812 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.746848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-693015c7-e611-47c3-91fd-8c8fdf29cfce req-bd24b59f-d41c-4bb9-9374-df4b7ec52812 service nova] Creating event network-changed:79987c6a-a281-4dd5-afd1-d767893a20dd for instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 on n-h1-826756-5 Aug 03 04:35:12.747188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:12.755488 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-693015c7-e611-47c3-91fd-8c8fdf29cfce req-bd24b59f-d41c-4bb9-9374-df4b7ec52812 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075363 Aug 03 04:35:12.756623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 506/1041] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:12.760819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:12.763666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68cb8a29-f5a0-4cbf-8bc8-38073e3f5e38 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54973790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:12.765444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:12.772552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-08765d66-6cf4-4ff8-a11f-c898d271062d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.848695 Aug 03 04:35:12.773528 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 536/1042] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:11 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:12.862148 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68cb8a29-f5a0-4cbf-8bc8-38073e3f5e38 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.103778 Aug 03 04:35:12.871046 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 507/1043] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:12 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:12.943041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:12.943670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:12.951842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:12.952327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.953396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:12.954008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:12.988140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3f071b10-7b90-4d5c-bfc6-80d756e692b8 req-a07f498a-0589-4bf3-8346-4fac614c9fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-unplugged", "status": "completed", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:13.009554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3f071b10-7b90-4d5c-bfc6-80d756e692b8 req-a07f498a-0589-4bf3-8346-4fac614c9fad service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:13.010336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3f071b10-7b90-4d5c-bfc6-80d756e692b8 req-a07f498a-0589-4bf3-8346-4fac614c9fad service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:13.056240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3f071b10-7b90-4d5c-bfc6-80d756e692b8 req-a07f498a-0589-4bf3-8346-4fac614c9fad service nova] Creating event network-vif-unplugged:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:35:13.068496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3f071b10-7b90-4d5c-bfc6-80d756e692b8 req-a07f498a-0589-4bf3-8346-4fac614c9fad service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086470 Aug 03 04:35:13.071590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 508/1044] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:35:13.192238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:13.193563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:13.217407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:13.218152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:13.219458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:13.220250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:13.226069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:13.364405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:14.273020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:14.296071 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c184802-950b-4708-ac5e-35029fcf55f1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 1.357111 Aug 03 04:35:14.296909 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 537/1045] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:12 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:14.305036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:14.309199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:14.323368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:14.325483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:14.328912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:14.331599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:14.332242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:14.343880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:14.360936 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37c15571-a855-49fd-8dbe-90b1d29f20e8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 1.174335 Aug 03 04:35:14.366286 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 509/1046] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:13 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:14.375538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:14.381235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:14.412234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:14.414496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:14.417801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:14.418493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.280032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:15.298295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:15.301228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:15.302631 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-87b34bd6-e21c-4163-8cd7-8e0b4e6482d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.933957 Aug 03 04:35:15.303448 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 510/1047] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:14 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:15.308444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec978273-3aaf-4f79-9606-f31305e4fd9d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549360d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:15.325268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:15.336703 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0596a67f-1cd9-44e7-ada3-f3634c7afcef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 1.036781 Aug 03 04:35:15.337643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 538/1048] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:14 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:15.427123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec978273-3aaf-4f79-9606-f31305e4fd9d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.119546 Aug 03 04:35:15.428377 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 511/1049] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:15 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:15.627888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd549f70d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:15.631872 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:15.631872 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:15.637391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.637391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.637391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.637391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.714797 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b9ca99c-eecc-45f1-8c20-f85e87907fc5 tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.375736 Aug 03 04:35:15.716175 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 539/1050] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:35:15 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:15.735736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:15.736672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:15.737746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea44d7df-297e-4fa5-9df2-a2a7a77e92fc tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Calling method '.version_select at 0x7fdd5496bb80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:15.744726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.745403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.746368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.746968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.774725 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ea44d7df-297e-4fa5-9df2-a2a7a77e92fc tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea44d7df-297e-4fa5-9df2-a2a7a77e92fc tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/images/314d68bf-c5ce-4c88-b781-357ec708c224/metadata/os_distro HTTP/1.1 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:15.788787 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'image_id': '314d68bf-c5ce-4c88-b781-357ec708c224', 'id': 'os_distro'} Aug 03 04:35:15.790535 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:15.791541 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 314d68bf-c5ce-4c88-b781-357ec708c224 Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:15.792959 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 314d68bf-c5ce-4c88-b781-357ec708c224 could not be found. Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:15.794574 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:15.796697 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:15.799240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea44d7df-297e-4fa5-9df2-a2a7a77e92fc tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:15.800297 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea44d7df-297e-4fa5-9df2-a2a7a77e92fc tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "DELETE /compute/v2.1/images/314d68bf-c5ce-4c88-b781-357ec708c224/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.370808 Aug 03 04:35:15.801050 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 512/1051] 10.222.0.72 () {58 vars in 1293 bytes} [Wed Aug 3 04:35:15 2022] DELETE /compute/v2.1/images/314d68bf-c5ce-4c88-b781-357ec708c224/metadata/os_distro => generated 62 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:15.822864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:15.823587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:15.831573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.832113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:15.832983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:15.833498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.319415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:16.324307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:16.336011 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e84b1d9-7c35-4d87-9a87-3b3b7e4eb82e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.618493 Aug 03 04:35:16.341600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66d3cc1b-ca62-4f8d-8747-2d5ccd125b0d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.535649 Aug 03 04:35:16.354122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 540/1052] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:15 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:16.354122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8f3901df-589c-4d24-887e-66541a294572 req-f8c24ed8-0b3b-44f8-8ca7-3f94908e2bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:16.356400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 513/1053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:15 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:16.361328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54955550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:16.364329 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:16.364329 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:16.365566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.366021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.366827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.367265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.374366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8f3901df-589c-4d24-887e-66541a294572 req-f8c24ed8-0b3b-44f8-8ca7-3f94908e2bd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.378621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8f3901df-589c-4d24-887e-66541a294572 req-f8c24ed8-0b3b-44f8-8ca7-3f94908e2bd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.396941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8f3901df-589c-4d24-887e-66541a294572 req-f8c24ed8-0b3b-44f8-8ca7-3f94908e2bd9 service nova] Creating event network-changed:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:35:16.458443 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99dad66b-5ac1-45fc-9b84-1ac4f46fd8db tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.040926 Aug 03 04:35:16.458443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 514/1054] 10.222.0.72 () {58 vars in 1139 bytes} [Wed Aug 3 04:35:16 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:16.458443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f5327b0-1b9d-4881-83f6-a739dec86d9b tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Calling method '.version_select at 0x7fdd549d8c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:16.460541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8f3901df-589c-4d24-887e-66541a294572 req-f8c24ed8-0b3b-44f8-8ca7-3f94908e2bd9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060222 Aug 03 04:35:16.460541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 541/1055] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:16.460541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:16.460541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:16.460846 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0f5327b0-1b9d-4881-83f6-a739dec86d9b tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:16.460935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.460935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.460935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f5327b0-1b9d-4881-83f6-a739dec86d9b tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/images/ee34acfc-6fbb-4a1d-be54-325011a41e80/metadata/os_version HTTP/1.1 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:16.461167 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'image_id': 'ee34acfc-6fbb-4a1d-be54-325011a41e80', 'id': 'os_version'} Aug 03 04:35:16.462421 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:16.463212 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ee34acfc-6fbb-4a1d-be54-325011a41e80 Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:16.465129 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee34acfc-6fbb-4a1d-be54-325011a41e80 could not be found. Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:16.468306 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:16.473576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:16.475214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.475460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f5327b0-1b9d-4881-83f6-a739dec86d9b tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:16.475460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f5327b0-1b9d-4881-83f6-a739dec86d9b tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "GET /compute/v2.1/images/ee34acfc-6fbb-4a1d-be54-325011a41e80/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.032691 Aug 03 04:35:16.475460 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 515/1056] 10.222.0.72 () {58 vars in 1293 bytes} [Wed Aug 3 04:35:16 2022] GET /compute/v2.1/images/ee34acfc-6fbb-4a1d-be54-325011a41e80/metadata/os_version => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:16.475460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:16.475460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:16.475974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.475974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:16.475974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:16.475974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.088007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.105457 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-23e3b9c8-34c9-49a1-a93e-b3dfc1d457f8 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 0.664156 Aug 03 04:35:17.106045 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 516/1057] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:16 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:17.120018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54922820>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.120018 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:17.120018 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:17.120018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.120018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.120708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.120708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.126022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.141830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.143508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.152806 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d4c3531-9b0e-483d-b81d-14334b71e94a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.734625 Aug 03 04:35:17.164473 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 542/1058] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:16 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:17.164473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2dddde97-993b-4b78-b228-bac4eb77aa30 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54ba3a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.195507 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47690624-9cb7-4f1e-8029-d79eb04ad35b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.088396 Aug 03 04:35:17.216693 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 517/1059] 10.222.0.72 () {58 vars in 1145 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:35:17.222177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c17aef44-04ae-4e76-9983-e87d12a59657 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Calling method '.version_select at 0x7fdd5496b9d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c17aef44-04ae-4e76-9983-e87d12a59657 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c17aef44-04ae-4e76-9983-e87d12a59657 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/images/59185cfd-c578-45aa-bb4c-e6bfa54cd180/metadata HTTP/1.1 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:17.308235 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'image_id': '59185cfd-c578-45aa-bb4c-e6bfa54cd180'} Aug 03 04:35:17.311678 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.313506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 59185cfd-c578-45aa-bb4c-e6bfa54cd180 Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.315363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59185cfd-c578-45aa-bb4c-e6bfa54cd180 could not be found. Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:17.316895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.318272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c17aef44-04ae-4e76-9983-e87d12a59657 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:17.321628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c17aef44-04ae-4e76-9983-e87d12a59657 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "GET /compute/v2.1/images/59185cfd-c578-45aa-bb4c-e6bfa54cd180/metadata" status: 404 len: 62 microversion: 2.1 time: 0.088701 Aug 03 04:35:17.321628 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 518/1060] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/images/59185cfd-c578-45aa-bb4c-e6bfa54cd180/metadata => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:17.321628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8c546387-5b12-4e2e-a438-c07e260cc5be req-1512c644-3986-4c2b-bde2-f78e545c06fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-plugged", "status": "completed", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:17.336874 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2dddde97-993b-4b78-b228-bac4eb77aa30 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.182289 Aug 03 04:35:17.346758 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 543/1061] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:17.365985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54a2cc10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.370976 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:17.370976 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:17.370976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.370976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.371405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8c546387-5b12-4e2e-a438-c07e260cc5be req-1512c644-3986-4c2b-bde2-f78e545c06fa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.371405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8c546387-5b12-4e2e-a438-c07e260cc5be req-1512c644-3986-4c2b-bde2-f78e545c06fa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.372988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.373653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.401086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8c546387-5b12-4e2e-a438-c07e260cc5be req-1512c644-3986-4c2b-bde2-f78e545c06fa service nova] Creating event network-vif-plugged:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:35:17.409024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9be3f9f-06da-4775-8681-8c0ed0c29d0e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.047140 Aug 03 04:35:17.410463 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 544/1062] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:17.418251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8c546387-5b12-4e2e-a438-c07e260cc5be req-1512c644-3986-4c2b-bde2-f78e545c06fa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110070 Aug 03 04:35:17.421023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b293e76-867d-4927-80e6-af73221bd1eb tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Action: 'update_all', calling method: .version_select at 0x7fdd54a2cca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:17.426433 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 519/1063] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:17.437265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.438004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:17.457389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.458074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.459012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.460688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.477250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4b293e76-867d-4927-80e6-af73221bd1eb tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b293e76-867d-4927-80e6-af73221bd1eb tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/images/7801d8fe-1ad2-489b-bb82-b056affd7dc8/metadata HTTP/1.1 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 57 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:17.490306 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:35:17.491701 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'image_id': '7801d8fe-1ad2-489b-bb82-b056affd7dc8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.492639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7801d8fe-1ad2-489b-bb82-b056affd7dc8 Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.493891 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7801d8fe-1ad2-489b-bb82-b056affd7dc8 could not be found. Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:17.495306 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:17.496693 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.502990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b293e76-867d-4927-80e6-af73221bd1eb tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:17.506223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b293e76-867d-4927-80e6-af73221bd1eb tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "PUT /compute/v2.1/images/7801d8fe-1ad2-489b-bb82-b056affd7dc8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.094538 Aug 03 04:35:17.507826 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 545/1064] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:35:17 2022] PUT /compute/v2.1/images/7801d8fe-1ad2-489b-bb82-b056affd7dc8/metadata => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:17.522728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.524425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:17.544392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.545173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.549074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.549677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.786634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.804076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1a9b216-a6f3-4f92-9146-050ea72b4d49 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.374703 Aug 03 04:35:17.815854 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 520/1065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:17.820568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd5495baf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.823097 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:17.823097 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:17.824245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.824748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.825547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.825982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.873563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:17.878560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-25f7998f-51e7-4e4b-858a-2a22f15ac91b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.061471 Aug 03 04:35:17.879772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 521/1066] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:17.884914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2878404-1799-433d-8d87-e0a1429d6b86 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Action: 'update', calling method: .version_select at 0x7fdd5495b040>, body: {"meta": {"os_distro": "alt"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:17.891552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d81bcfbb-6724-43dd-8eb1-f9b1109acae9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.379860 Aug 03 04:35:17.907720 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 546/1067] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:17.913760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54a06280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.917828 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:17.917828 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:17.920322 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b2878404-1799-433d-8d87-e0a1429d6b86 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:17.921301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.926096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.926096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:17.926096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2878404-1799-433d-8d87-e0a1429d6b86 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/images/954345c1-0ce4-4f10-950d-eee0a8709bf8/metadata/os_distro HTTP/1.1 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 30 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:17.926607 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: {"meta": {"os_distro": "alt"}} Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:35:17.928216 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'image_id': '954345c1-0ce4-4f10-950d-eee0a8709bf8', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.929109 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 954345c1-0ce4-4f10-950d-eee0a8709bf8 Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.930188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 954345c1-0ce4-4f10-950d-eee0a8709bf8 could not be found. Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:17.932330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:17.935016 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.940739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2878404-1799-433d-8d87-e0a1429d6b86 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:17.940739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2878404-1799-433d-8d87-e0a1429d6b86 tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "PUT /compute/v2.1/images/954345c1-0ce4-4f10-950d-eee0a8709bf8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048894 Aug 03 04:35:17.940739 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 522/1068] 10.222.0.72 () {60 vars in 1310 bytes} [Wed Aug 3 04:35:17 2022] PUT /compute/v2.1/images/954345c1-0ce4-4f10-950d-eee0a8709bf8/metadata/os_distro => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:17.948694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c6a1b4a-5014-4605-a434-9c27c57a906f tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Action: 'create', calling method: .version_select at 0x7fdd548ac4c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:17.972457 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43ee35e1-333a-4d09-9054-5d92b940425f tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.062304 Aug 03 04:35:17.973208 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 547/1069] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:17.981907 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-2c6a1b4a-5014-4605-a434-9c27c57a906f tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] HTTP exception thrown: Image not found. Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c6a1b4a-5014-4605-a434-9c27c57a906f tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Request method failure captured: Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/images/86cceb9c-5bb9-43d3-864b-280dd7459587/metadata HTTP/1.1 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 57 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsDuDjFWd2LaECrGY6Qu9dhTltgwe98Lhw8KBuCNBOA6VZXaK4bX6iJSAJCyuZINt3sHfvX6pNXzuM-z1vf3IknmzSZ9Uhpj2hnM6xIdnySZo5_bFzDGOwm9gL0XiwKv5JDw_7KbXTYdw5u3mXIKxLU-cbqPBT1vFMH8psLSxpMtC0 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:17.984198 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c5f1c9491c04e78a6e685e0dc2c980b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c5f1c9491c04e78a6e685e0dc2c980b Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-607293001 Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 011cd405cc6649cba366374f44c71f6f Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-607293001-project Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:35:17.985773 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'image_id': '86cceb9c-5bb9-43d3-864b-280dd7459587', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.986812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 86cceb9c-5bb9-43d3-864b-280dd7459587 Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:35:17.988034 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 86cceb9c-5bb9-43d3-864b-280dd7459587 could not be found. Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:17.989589 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:35:17.990853 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:17.993018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54a2ca60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:17.994026 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:17.994026 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:17.994303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c6a1b4a-5014-4605-a434-9c27c57a906f tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:17.995374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c6a1b4a-5014-4605-a434-9c27c57a906f tempest-ImagesMetadataNegativeTestJSON-607293001 tempest-ImagesMetadataNegativeTestJSON-607293001-project] 10.222.0.72 "POST /compute/v2.1/images/86cceb9c-5bb9-43d3-864b-280dd7459587/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058912 Aug 03 04:35:18.000774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 523/1070] 10.222.0.72 () {60 vars in 1281 bytes} [Wed Aug 3 04:35:17 2022] POST /compute/v2.1/images/86cceb9c-5bb9-43d3-864b-280dd7459587/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:35:18.015080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.019480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.055498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.056217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.133109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:18.133756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:18.140490 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7be98ed0-3a08-45d7-b1cf-f1ff48dbcd3e tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-h1-826756-5" status: 200 len: 729 microversion: 2.1 time: 0.140571 Aug 03 04:35:18.141368 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 548/1071] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:35:17 2022] GET /compute/v2.1/os-hosts/n-h1-826756-5 => generated 729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:18.145327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.145784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.149219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.149722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.167891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Calling method '.version_select at 0x7fdd54a17f70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:18.168821 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:18.168821 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:18.180103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.180579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.218004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.218781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.327205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01f34619-c78a-4853-bc71-8d5cf63d285b tempest-HostsAdminTestJSON-84151138 tempest-HostsAdminTestJSON-84151138-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hosts/n-h2-826756-5" status: 200 len: 859 microversion: 2.1 time: 0.177176 Aug 03 04:35:18.328416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 549/1072] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:35:18 2022] GET /compute/v2.1/os-hosts/n-h2-826756-5 => generated 859 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:18.339528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:18.343477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:18.366978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.368205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.381900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:18.381900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:18.392943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:18.969487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:18.979839 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b6f4d85-cb6d-470a-abcd-b04e7e411038 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1477 microversion: 2.1 time: 0.852123 Aug 03 04:35:18.989178 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 524/1073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:18 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1477 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:19.012030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc54409e-b09e-44c3-96c9-022fb9e9b73b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd548930d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:19.145381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc54409e-b09e-44c3-96c9-022fb9e9b73b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.147790 Aug 03 04:35:19.147971 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 525/1074] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:18 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:19.156073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:19.160539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:19.171793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:19.173539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:19.178630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:19.179164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:19.325849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:19.344518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:19.347645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:19.352051 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1944d7b0-0a44-403d-ae10-845f593cc697 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 1.022328 Aug 03 04:35:19.352667 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 550/1075] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:18 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:19.376860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:19.394821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:19.416031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:19.416527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:19.417527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:19.420077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:19.873169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:19.886705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc5cef44-872a-4d54-99fc-7d2e9e0fcf53 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.736665 Aug 03 04:35:19.890188 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 526/1076] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:19 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:20.011602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:20.017044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:20.039233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.042260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:20.055165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42653f17-3216-4578-8b02-e47614dcb6bb tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.698931 Aug 03 04:35:20.055891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:20.057430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.057840 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 551/1077] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:19 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:20.058541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:20.162628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72923dc4-8a52-433f-9ed8-e5e5fb40091a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54b65280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:20.271858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72923dc4-8a52-433f-9ed8-e5e5fb40091a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.111931 Aug 03 04:35:20.286020 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 552/1078] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:20 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:20.385745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:20.387402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:20.418113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.424802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:20.426070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.429859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:20.711279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:20.723561 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98432fe0-b662-436e-bf68-e18dd5d39d4b tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1462 microversion: 2.1 time: 0.716167 Aug 03 04:35:20.732472 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 527/1079] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:20 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1462 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:20.751258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:20.754824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:20.771825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.772669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:20.775815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:20.777397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.219229 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88754108-e6c9-4f90-9ce3-4c581da204a2 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 0 microversion: 2.1 time: 0.472228 Aug 03 04:35:21.220302 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 528/1080] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:20 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:35:21.226873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:21.228081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:21.241516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:21.250419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.250419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.251128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.252248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.256178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:21.259469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:21.262132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f72ba748-5a8c-487b-8b15-b6cdc96d278f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.885771 Aug 03 04:35:21.273809 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 553/1081] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:20 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:21.285720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:21.286462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:21.299502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.299961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.319408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.319878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.862884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:21.875905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fbc72796-9abc-49ed-8a84-443f236f072a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.651356 Aug 03 04:35:21.881003 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 529/1082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:21 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:21.898521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:21.909993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6db84b09-b65e-468e-9629-76c34e71ab93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1504 microversion: 2.1 time: 0.634786 Aug 03 04:35:21.911364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:21.928298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:21.929492 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 554/1083] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:21 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1504 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:21.930999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.934730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.936373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:21.936373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:21.941403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b9bdc21-2ae7-4c64-8250-36d3c31c2657 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549a6310>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:22.003589 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2b9bdc21-2ae7-4c64-8250-36d3c31c2657 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.072649 Aug 03 04:35:22.004891 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 555/1084] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:21 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:22.015268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.022802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.022802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lazy-loading 'fault' on Instance uuid 36b40676-fcb5-4244-ae7d-484b80fb894b {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:22.215341 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7939e598-c595-4261-9f77-02d908818ffd tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1596 microversion: 2.1 time: 0.332836 Aug 03 04:35:22.220379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 530/1085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:21 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1596 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:22.243841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:22.246444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:22.273356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.274116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.275314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.275946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.289895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:22.290702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:22.304798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.310518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.315870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.319286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.716482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b168280-bb3f-428a-a440-afab512dd672 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action" status: 202 len: 0 microversion: 2.1 time: 0.477191 Aug 03 04:35:22.721530 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 556/1086] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:22 2022] POST /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:22.724920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:22.740637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:22.745199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:22.747434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0b581ae3-17a6-4933-8c7f-e6485c2cbb56 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.462727 Aug 03 04:35:22.748626 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 531/1087] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:22 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:22.773457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-176364af-86c3-4e81-8180-8ea1e3d3685b req-9f153e15-79fb-43c6-8b4f-e997f0aac7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-plugged", "status": "completed", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:22.806129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-176364af-86c3-4e81-8180-8ea1e3d3685b req-9f153e15-79fb-43c6-8b4f-e997f0aac7ff service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.808616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-176364af-86c3-4e81-8180-8ea1e3d3685b req-9f153e15-79fb-43c6-8b4f-e997f0aac7ff service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.848240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-176364af-86c3-4e81-8180-8ea1e3d3685b req-9f153e15-79fb-43c6-8b4f-e997f0aac7ff service nova] Creating event network-vif-plugged:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:35:22.862169 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-176364af-86c3-4e81-8180-8ea1e3d3685b req-9f153e15-79fb-43c6-8b4f-e997f0aac7ff service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111741 Aug 03 04:35:22.866944 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 532/1088] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:22.873370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:22.874324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:22.883306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.883954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:22.885194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:22.887774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.304801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-adf49b81-a5dc-43c6-9af9-9ab7370aeb88 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Action: 'create', calling method: .version_select at 0x7fdd549ac8b0>, body: {"keypair": {"name": "tempest-keypair-887300322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdf4JQ7o4etQGhz3iLmOZmwzEB10XdHEibPX5Bp0M6RWU7C4fIvCxK3wzSJvh5Z1PFXCKfa1lYrTiFQQCiYpiFQIubdaJNe80V79zHco/RuusuYplNgYjRPRThzs8zyQg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:23.352832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-adf49b81-a5dc-43c6-9af9-9ab7370aeb88 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for project 4fb4861a8384459d891519fa39e47b4e. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:23.358972 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ac29d26-34f9-41bf-a216-06c9dbd83213 tempest-ServersAdminTestJSON-817279483 tempest-ServersAdminTestJSON-817279483-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1613 microversion: 2.1 time: 0.490692 Aug 03 04:35:23.363642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-adf49b81-a5dc-43c6-9af9-9ab7370aeb88 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for user a2d74e823c974fb4a6cd91c467470e3f and project 4fb4861a8384459d891519fa39e47b4e. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:23.377747 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 533/1089] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:22 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1613 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:23.385177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:23.387425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:23.395934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.396849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.397675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.398276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.416447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:23.451204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-adf49b81-a5dc-43c6-9af9-9ab7370aeb88 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.728112 Aug 03 04:35:23.452085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 557/1090] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:35:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:23.462486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:23.465400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:23.483948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.488376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.490916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.491637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.762505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:23.773083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cd7cef18-eef3-4e03-b3d6-10dc569e2836 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.393465 Aug 03 04:35:23.774233 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 534/1091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:23 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:23.780337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c16321f1-0bf2-4fd3-8c69-07f3a98f5c20 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54936af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:23.856641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c16321f1-0bf2-4fd3-8c69-07f3a98f5c20 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.080041 Aug 03 04:35:23.865262 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 535/1092] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:23 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:23.878078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:23.879206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:23.890979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.891436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.893158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.893784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.923139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:35:23.927177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:23.936632 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5cbb9500-4dfa-4108-a393-4a7d534abe0b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1494 microversion: 2.1 time: 0.483243 Aug 03 04:35:23.937720 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 558/1093] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:23 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1494 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:23.943440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:23.944262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:23.951289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.951942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:23.952892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:23.953492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.368623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:24.413902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:24.423500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:24.428686 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-55d42caa-40d3-474f-882c-24ed4c0a2bd5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.489582 Aug 03 04:35:24.429306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 559/1094] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:23 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:24.442182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4600b48b-8c5b-4e49-81f1-5171715ce770 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '.version_select at 0x7fdd54ba3820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:24.446931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4600b48b-8c5b-4e49-81f1-5171715ce770 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.449256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4600b48b-8c5b-4e49-81f1-5171715ce770 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.463175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4600b48b-8c5b-4e49-81f1-5171715ce770 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.030890 Aug 03 04:35:24.463935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 560/1095] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:35:24 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:24.480405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:24.481028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:24.488742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.489536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.490510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.490950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.581610 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-39d563fc-5122-4865-99a0-8adb0ad05ac6 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "DELETE /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 204 len: 0 microversion: 2.1 time: 0.722544 Aug 03 04:35:24.582221 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 536/1096] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:35:23 2022] DELETE /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:24.591996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:24.592831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:24.599850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.601803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.602667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.603116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.679497 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-063a970e-f0fc-4de1-be6f-3a76a30716b5 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1645 microversion: 2.1 time: 0.169435 Aug 03 04:35:24.679497 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 561/1097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:24 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1645 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:24.792789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:24.792789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9513e29a-b2a6-4cac-a17b-8d6b769e964f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1469 microversion: 2.1 time: 0.198822 Aug 03 04:35:24.803239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 537/1098] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:24 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:24.808652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:24.809345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:24.819922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.820500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.821323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:24.821940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:24.873280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d208ca06-f9e2-4207-9c5f-2c67efa16de0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54955dc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:24.942422 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d208ca06-f9e2-4207-9c5f-2c67efa16de0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.072989 Aug 03 04:35:24.943026 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 538/1099] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:24 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:24.948735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1284635069", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d3daf729-08e1-47de-b3ca-43c48307355d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:25.018879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] validate_networks() for [('d3daf729-08e1-47de-b3ca-43c48307355d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:25.048652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:25.064812 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-080993ac-d978-4519-9837-297195372c08 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1378 microversion: 2.1 time: 0.269959 Aug 03 04:35:25.078185 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 562/1100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:24 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1378 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:25.463413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:25.464013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:25.475378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.475841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:25.484570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.496079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:25.746524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:25.747063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:25.747643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:25.748185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:25.749045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:25.767984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.767984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:25.767984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.767984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:25.788781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:25.808413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for user ef84ed9611c449ec8ee31cf936faeb75 and project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:25.825820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:35:25.829568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:35:25.928539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:25.945512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:25.948657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:25.950143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2e4d0da-1c2a-40b1-9f6e-fe8d0dfbefd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.493540 Aug 03 04:35:25.961816 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 563/1101] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:25 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:25.975098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:25.976228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:25.987056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.987954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:25.989164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:25.990587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.029166 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ad88bda-da9c-4c67-8e47-6819eb91f01f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085011 Aug 03 04:35:26.033963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 539/1102] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:35:26.054575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d562694-a56a-432c-a11f-bb4c1b88f52a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549491f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.138850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d562694-a56a-432c-a11f-bb4c1b88f52a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.103698 Aug 03 04:35:26.140431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 540/1103] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:26 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:26.163137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f42d1f1-8ad2-4cbb-a3c7-1330355b19fc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.163974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f42d1f1-8ad2-4cbb-a3c7-1330355b19fc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:26.199131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:26.312033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f42d1f1-8ad2-4cbb-a3c7-1330355b19fc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:26.322110 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f42d1f1-8ad2-4cbb-a3c7-1330355b19fc tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1211 microversion: 2.1 time: 0.179726 Aug 03 04:35:26.322695 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 541/1104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:26 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:26.339220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.339999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:26.368476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.369123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.369972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.370424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.389804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:26.406444 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-170ac249-2736-4787-b593-d264f997b831 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1469 microversion: 2.1 time: 0.441370 Aug 03 04:35:26.422181 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 564/1105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:25 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1469 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:26.658177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:26.669717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe3f3849-99ff-4f77-b2bc-3dce595f66f3 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1526 microversion: 2.1 time: 0.345797 Aug 03 04:35:26.672841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 542/1106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:26 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1526 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:26.708159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.708864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:26.718296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.719304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.720391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.721202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.906886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:26.932727 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f00cf66-7c5a-4d35-a649-58f3601eda31 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1526 microversion: 2.1 time: 0.228530 Aug 03 04:35:26.932727 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 565/1107] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:26 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:26.946511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c763a776-e91e-4f87-9aab-5b3977dd5128 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.947379 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:26.947379 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:26.977994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:26.978706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:26.986255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.986621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:26.987663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:26.988380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.154569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.169627 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c763a776-e91e-4f87-9aab-5b3977dd5128 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/ef9c53d3-2a04-49e1-b9f3-0b3546d8126a" status: 202 len: 0 microversion: 2.1 time: 0.221768 Aug 03 04:35:27.169627 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 543/1108] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:35:26 2022] DELETE /compute/v2.1/flavors/ef9c53d3-2a04-49e1-b9f3-0b3546d8126a => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:27.169964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.169964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.169964 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c68b1cd-587e-426e-8fbc-14e611ce44b0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.194046 Aug 03 04:35:27.170271 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 566/1109] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:26 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:35:27.170349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0937a01e-6d40-47b0-9574-79b128e8693b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54893ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.172667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58acdfb1-fdd2-4938-be25-3c58d1211f51 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.197114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58acdfb1-fdd2-4938-be25-3c58d1211f51 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027812 Aug 03 04:35:27.210825 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 567/1110] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:27.217138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:27.221063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:27.233013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.233013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.233013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.233013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.253937 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0937a01e-6d40-47b0-9574-79b128e8693b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1411 microversion: 2.1 time: 0.088969 Aug 03 04:35:27.254536 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 544/1111] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:27.338123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.344745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d20874c9-4bd6-4081-9880-a7a7a2b07758 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.345672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d20874c9-4bd6-4081-9880-a7a7a2b07758 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:27.348563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Old instance type tempest-test_resize_flavor_-667868571, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 04:35:27.374221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:27.374849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:27.375381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:27.375842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:27.376944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:27.433295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d20874c9-4bd6-4081-9880-a7a7a2b07758 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.437105 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d20874c9-4bd6-4081-9880-a7a7a2b07758 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1211 microversion: 2.1 time: 0.097502 Aug 03 04:35:27.438355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 545/1112] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:27.447334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.449011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:27.468109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.468109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.468109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.468109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.637201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:27.707501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:27.716302 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dae830b1-2d37-42b8-a58f-476116f887cc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1469 microversion: 2.1 time: 0.275603 Aug 03 04:35:27.717205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 546/1113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:27.764819 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1dfae090-2cdd-48fd-9816-b51f02309337 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24/action" status: 202 len: 0 microversion: 2.1 time: 0.549184 Aug 03 04:35:27.767347 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 568/1114] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:27 2022] POST /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:27.780616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.780616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:27.800837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.801291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.803189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.803637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:27.947600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:27.971752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Calling method '.version_select at 0x7fdd549d8ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:27.973103 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:27.973103 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:27.974530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:27.975093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.002165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.002165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.002437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:28.014900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d7151afa-c745-4dba-8c41-d8a7470e4226 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1535 microversion: 2.1 time: 0.242109 Aug 03 04:35:28.015841 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 569/1115] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:28.039740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.041320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.048805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb31af64-5b11-46f1-93c1-9e7f74bb4ecf tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.330099 Aug 03 04:35:28.049500 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 547/1116] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:35:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:28.061081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Calling method '.version_select at 0x7fdd54a2cf70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.062278 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:28.062278 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:28.063479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.064912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.087690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.088568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.115670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.116123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.122143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-962a6679-1639-40af-a632-6ca778d97405 tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/n-h1-826756-5/servers" status: 200 len: 433 microversion: 2.1 time: 0.065720 Aug 03 04:35:28.122755 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 570/1117] 10.222.0.72 () {58 vars in 1212 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-5/servers => generated 433 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:28.137628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Calling method '.version_select at 0x7fdd548a08b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.138484 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:28.138484 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:28.139661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.140145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.155819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.156295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.167126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.167576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.174421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18f761a8-f1ab-493c-8f9a-e75b023a430c tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040583 Aug 03 04:35:28.175525 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 548/1118] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:28.194661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Calling method '.version_select at 0x7fdd549acdc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.194893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.195660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:28.197113 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:28.197113 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:28.198392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.198789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.204040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.205545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.207235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.207842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.240789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.252017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.254585 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-06c92e08-fa3f-44f7-ac6a-0a035c94fafa tempest-HypervisorAdminUnderV252Test-62177841 tempest-HypervisorAdminUnderV252Test-62177841-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/n-h1-826756-5/search" status: 200 len: 104 microversion: 2.1 time: 0.071117 Aug 03 04:35:28.264694 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 571/1119] 10.222.0.72 () {58 vars in 1209 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-5/search => generated 104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:28.273252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8f8dd34-0c6d-4ea7-8682-fcac5525884e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd548fdc10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.332845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8f8dd34-0c6d-4ea7-8682-fcac5525884e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1420 microversion: 2.1 time: 0.065869 Aug 03 04:35:28.334288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 572/1120] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:28.352153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d9bd700-4c3f-4b2e-9339-94a9a32957a7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54879160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.444197 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d9bd700-4c3f-4b2e-9339-94a9a32957a7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 200 len: 1420 microversion: 2.1 time: 0.099389 Aug 03 04:35:28.444933 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 573/1121] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:28.460462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9692ff4c-8065-43d8-bdd0-ddb8a3eccffc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd548fdca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.488821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:28.506272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:28.509616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:28.511090 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6127c21-7dcd-4741-a1cf-4899cbab9cb8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.323239 Aug 03 04:35:28.515964 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 549/1122] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:28.527889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:28.528548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:28.551540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.552424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.555809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:28.556304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:28.642521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:28.659083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2b7445e-db24-438a-bdb1-b16c6465f871 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1263 microversion: 2.1 time: 0.141637 Aug 03 04:35:28.660364 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 550/1123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:28 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:28.670346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-887453392", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "aab14507-c2d5-418e-bcdd-fcebce5d88c8"}], "security_groups": [{"name": "tempest-securitygroup--738660863"}], "key_name": "tempest-keypair-887300322", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:28.906762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] validate_networks() for [('aab14507-c2d5-418e-bcdd-fcebce5d88c8', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:29.936180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for project 4fb4861a8384459d891519fa39e47b4e. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:29.949940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for user a2d74e823c974fb4a6cd91c467470e3f and project 4fb4861a8384459d891519fa39e47b4e. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:29.968561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:29.969401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:29.970834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:29.971459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:29.972418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:29.984335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:29.985070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:29.995322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:29.995921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.097732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for project 4fb4861a8384459d891519fa39e47b4e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:30.114352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Getting quotas for user a2d74e823c974fb4a6cd91c467470e3f and project 4fb4861a8384459d891519fa39e47b4e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:30.164860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:35:30.172294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:35:30.409932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d4e0a66-486e-4733-a797-82f1c20ead8c tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.748113 Aug 03 04:35:30.421539 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 551/1124] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:35:30.445792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:30.446474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:30.462296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:30.466368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.468684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:30.473209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.550927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:30.551553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.552239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lazy-loading 'fault' on Instance uuid 66de5839-7706-4868-8e0e-7ccd9e276946 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:30.742084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9692ff4c-8065-43d8-bdd0-ddb8a3eccffc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 204 len: 0 microversion: 2.1 time: 2.285849 Aug 03 04:35:30.746633 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 574/1125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:28 2022] DELETE /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 0 bytes in 2288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:30.752580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:30.753212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:30.789632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:30.790112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.794597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:30.799204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:30.963337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:30.979516 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d47ab9e6-3a69-45ea-987f-53f176815666 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 200 len: 1304 microversion: 2.1 time: 0.556592 Aug 03 04:35:30.981349 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 552/1126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:30 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 1304 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:31.007321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:31.008217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:31.034861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.036083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.037817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.044750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.275627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.290442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.292732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.294100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b43af6f-50d7-46d8-9c96-b824e9f7efde tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.297584 Aug 03 04:35:31.294787 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 553/1127] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:30 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:31.308653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.311723 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27115536-3f76-42cb-aee8-0b02f156029a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1535 microversion: 2.1 time: 0.563965 Aug 03 04:35:31.312654 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 575/1128] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:30 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1535 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:31.317548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:31.318293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:31.319901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6337e99c-6257-40ef-9896-4604d2ac08ec req-f3443b0c-4a68-45d6-ae4b-ea15e52a0e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66de5839-7706-4868-8e0e-7ccd9e276946", "name": "network-vif-deleted", "tag": "b306fac0-0978-4a80-9a1b-f53ad55263a6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:31.326077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.326801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.328471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.329186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.331447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6337e99c-6257-40ef-9896-4604d2ac08ec req-f3443b0c-4a68-45d6-ae4b-ea15e52a0e28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.331890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6337e99c-6257-40ef-9896-4604d2ac08ec req-f3443b0c-4a68-45d6-ae4b-ea15e52a0e28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.349911 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6337e99c-6257-40ef-9896-4604d2ac08ec req-f3443b0c-4a68-45d6-ae4b-ea15e52a0e28 service nova] Creating event network-vif-deleted:b306fac0-0978-4a80-9a1b-f53ad55263a6 for instance 66de5839-7706-4868-8e0e-7ccd9e276946 on n-h2-826756-5 Aug 03 04:35:31.358306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6337e99c-6257-40ef-9896-4604d2ac08ec req-f3443b0c-4a68-45d6-ae4b-ea15e52a0e28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044071 Aug 03 04:35:31.359709 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 576/1129] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:31.402242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ae141f7-368e-4d4e-bf35-51f0aebe6b31 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:31.403327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ae141f7-368e-4d4e-bf35-51f0aebe6b31 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:31.577735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ae141f7-368e-4d4e-bf35-51f0aebe6b31 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.587080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ae141f7-368e-4d4e-bf35-51f0aebe6b31 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1268 microversion: 2.1 time: 0.199635 Aug 03 04:35:31.592541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 577/1130] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:31 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1268 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:31.603394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:31.620196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:31.634705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.635168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.635974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:31.636451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:31.708064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:35:31.802624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:31.810810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5fa6679a-709d-4399-8aba-829ca4c355f9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.500246 Aug 03 04:35:31.812332 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 554/1131] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:31 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:31.970128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:32.004640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:32.005646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 66de5839-7706-4868-8e0e-7ccd9e276946] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:32.033268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.034205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.037741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.047534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.129311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] HTTP exception thrown: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Request method failure captured: Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 HTTP/1.1 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fp8H9k0pSJABwqHYvCWRFX4d2eNbveWMVKu1FhT3kvics1w58_vXdC6UmXPOYHvbWHjMV6sbIgV1UUkup5MyTBhnnbXG-zlwgb24VAebtvylGCbbul_NKEe7DcHFWT0ITPw9N-5md2-Ui2T0lhbRFEaqODk30C3zSfCxBzJUg_56UY Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:32.134333 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_546823ffdb0d45d997b427498813a742"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/546823ffdb0d45d997b427498813a742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 86c950308de0427ca178e91f19278d93 Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. Aug 03 04:35:32.136017 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '66de5839-7706-4868-8e0e-7ccd9e276946'} Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:32.137080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. Aug 03 04:35:32.138652 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:32.139969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Returning 404 to user: Instance 66de5839-7706-4868-8e0e-7ccd9e276946 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:32.143548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-572d494d-c297-4c37-8cf9-4e25d717dc6a tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946" status: 404 len: 111 microversion: 2.1 time: 0.142287 Aug 03 04:35:32.145528 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1c29466-dd74-4b82-85aa-539878951d95 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 204 len: 0 microversion: 2.1 time: 0.549154 Aug 03 04:35:32.159464 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 555/1133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:31 2022] GET /compute/v2.1/servers/66de5839-7706-4868-8e0e-7ccd9e276946 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:35:32.162306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 578/1133] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:35:31 2022] DELETE /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:32.180335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:32.183206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:32.188742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.189490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.190685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.191280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.230682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:35:32.332499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:32.333562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:32.346977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.347787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.351751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.354531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.364366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:32.558015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:32.569179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:32.571190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:32.572554 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-346a08a3-de8c-400c-b520-0962f48facd7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.250594 Aug 03 04:35:32.577602 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 579/1134] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:32 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:32.578044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-400734406", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:32.601667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e569631c-92c9-4b5c-a222-4ee4c0fdee26 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "DELETE /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 204 len: 0 microversion: 2.1 time: 0.421228 Aug 03 04:35:32.601667 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 556/1135] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:35:32 2022] DELETE /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:32.607115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:32.609251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:32.624644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.625137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.630232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:32.630359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:32.658799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] validate_networks() for [('c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:33.601995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:33.613487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b32b503-e0b2-4ecd-b37b-f63b392f0906 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1535 microversion: 2.1 time: 1.013859 Aug 03 04:35:33.616534 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 557/1136] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:32 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1535 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:33.628490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:33.629440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:33.636332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:33.640218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:33.640218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:33.640218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:34.175376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:34.186914 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3ae4e3c-1037-4805-b010-88a147a86f94 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1469 microversion: 2.1 time: 0.569086 Aug 03 04:35:34.187756 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 558/1137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:33 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1469 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:34.195032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:34.200508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:34.222905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:34.237085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:34.238183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:34.238789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:34.567472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:34.582739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c7b93d1-6fad-4b5c-923e-c85f5a94dba8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1328 microversion: 2.1 time: 0.386852 Aug 03 04:35:34.584887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 559/1138] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:34 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:34.614939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:34.615568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:34.647903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:34.652127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:34.653853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:34.655143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.335672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:35.336302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:35.336964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:35.337499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:35.338019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:35.341673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:35.350992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f1a3795-58bc-43d9-a7ce-3e5ef63fa689 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.753835 Aug 03 04:35:35.352450 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 560/1139] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:34 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:35.357454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.357691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:35.358145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.358666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:35.362510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.363094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.366625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.367272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.368791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.369399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.417876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:35.426355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for user 14aa35fa1b9d4a5786b67c5a3234f571 and project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:35.442315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:35:35.461740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:35:35.672322 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07e1af69-1b0c-44e4-a60e-dbf2f041197b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.096837 Aug 03 04:35:35.683881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 580/1140] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:35:35.688938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6148493b-53b9-481b-9bc5-729fdb3fabd7 req-857a9021-ab71-44f2-b4c9-6353102f5c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36e1b37-606b-4a4f-a778-0a4f1d8c42e5", "name": "network-vif-unplugged", "status": "completed", "tag": "01d475bb-4fa9-4dfc-85a7-6ee4765decd7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:35.771540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6148493b-53b9-481b-9bc5-729fdb3fabd7 req-857a9021-ab71-44f2-b4c9-6353102f5c4c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.772016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6148493b-53b9-481b-9bc5-729fdb3fabd7 req-857a9021-ab71-44f2-b4c9-6353102f5c4c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.820110 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6148493b-53b9-481b-9bc5-729fdb3fabd7 req-857a9021-ab71-44f2-b4c9-6353102f5c4c service nova] Creating event network-vif-unplugged:01d475bb-4fa9-4dfc-85a7-6ee4765decd7 for instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 on n-h2-826756-5 Aug 03 04:35:35.826718 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6148493b-53b9-481b-9bc5-729fdb3fabd7 req-857a9021-ab71-44f2-b4c9-6353102f5c4c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141521 Aug 03 04:35:35.835643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 581/1141] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:35.847950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-654026a1-75de-49f9-b38e-80c6eb7812e7 req-da4b46eb-b018-4b46-bc42-918b8488394e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e177ca7-4008-4345-9e66-b36e8b1e9c0c", "tag": "3a048de8-d942-45ac-ba50-253e71cc418f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:35.886619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-654026a1-75de-49f9-b38e-80c6eb7812e7 req-da4b46eb-b018-4b46-bc42-918b8488394e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:35.890501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-654026a1-75de-49f9-b38e-80c6eb7812e7 req-da4b46eb-b018-4b46-bc42-918b8488394e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:35.935942 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-654026a1-75de-49f9-b38e-80c6eb7812e7 req-da4b46eb-b018-4b46-bc42-918b8488394e service nova] Creating event network-changed:3a048de8-d942-45ac-ba50-253e71cc418f for instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c on n-h1-826756-5 Aug 03 04:35:35.966246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-654026a1-75de-49f9-b38e-80c6eb7812e7 req-da4b46eb-b018-4b46-bc42-918b8488394e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128525 Aug 03 04:35:35.966878 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 582/1142] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:35.976523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:35.982476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:36.006692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.011285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.012368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.013588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.401595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:36.412382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:36.420351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:36.426968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db7b6425-6591-418b-a3c2-d88cfbe67c50 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 1.068206 Aug 03 04:35:36.426968 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 561/1143] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:35 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:36.444735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:36.445851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:36.468689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.471402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.472298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.472852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.638889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:36.651031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-facd2701-3010-4285-9edd-8d168debb196 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1535 microversion: 2.1 time: 0.679810 Aug 03 04:35:36.658962 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 583/1144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:35 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1535 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:36.679197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:36.680331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:36.687917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.689493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.690541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:36.691192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:36.866202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:36.879280 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10a5bac6-faf3-47ef-9177-a63ae05ac387 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1326 microversion: 2.1 time: 0.218723 Aug 03 04:35:36.880082 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 584/1145] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:36 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:36.900206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d7428e4-d4cb-402f-952e-b0675d4783b7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:36.900908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d7428e4-d4cb-402f-952e-b0675d4783b7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:37.068594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:37.090730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d7428e4-d4cb-402f-952e-b0675d4783b7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:37.098261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7798ba7-838d-4dd0-ad39-c9a2e31060cb tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1469 microversion: 2.1 time: 0.669217 Aug 03 04:35:37.099606 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 562/1146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:36 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1469 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:37.105021 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d7428e4-d4cb-402f-952e-b0675d4783b7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1207 microversion: 2.1 time: 0.218661 Aug 03 04:35:37.112314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 585/1147] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:36 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1207 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:37.126162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:37.128688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:37.149424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:37.153944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:37.153944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:37.155231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:37.577169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4649c8da-86d9-4f74-842f-87237f3f3891 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd548800d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-546898056", "description": "tempest-description-154510100"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:37.787967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:37.814977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd16caac-1e84-4e19-8fa4-29f74642e326 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.712701 Aug 03 04:35:37.815593 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 563/1148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:37 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:37.831782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:37.831782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:37.846490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:37.850721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:37.853726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:37.854204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.325019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:38.347191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:38.351703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:38.353755 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc72a214-b554-41f2-b3fc-b240b958d3f3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.536869 Aug 03 04:35:38.380501 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 564/1149] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:37 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:38.390531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4649c8da-86d9-4f74-842f-87237f3f3891 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.279306 Aug 03 04:35:38.405454 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 586/1150] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:35:37 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:38.412859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:38.418475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:38.432558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.433202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.434309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.440563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.509865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Calling method '.version_select at 0x7fdd548ac160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:38.511065 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:38.511065 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:38.512583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.513315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.546185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.546653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.561064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.561524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.569162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be4f954c-727e-4cbb-9d9b-b0058bbf1f4a tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.187355 Aug 03 04:35:38.576301 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 565/1151] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:35:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:38.582458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:38.583312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:38.589587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.591616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:38.592939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:38.593604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.496793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:39.517882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c6618ee-edcb-4c31-a6f2-61ac337ca3c0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 1.116532 Aug 03 04:35:39.518496 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 587/1152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:38 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:39.523201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:39.523753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:39.539923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.540414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.541204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.541642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.559462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:39.572009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81190512-6a88-423d-a6b6-34ce9255a37e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.994246 Aug 03 04:35:39.573380 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 566/1153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:38 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:39.593802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:39.595164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:39.602734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.603189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.603978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.604449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.609529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.610658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.611466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lazy-loading 'fault' on Instance uuid dbf967c4-8207-48e3-82f2-8eb0fbb1f32d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:39.699212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:39.713700 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-38ecdf17-4294-48c8-b3c0-ca00b3896785 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 200 len: 1303 microversion: 2.1 time: 0.194098 Aug 03 04:35:39.731056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 588/1154] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:39 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 1303 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:39.731056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58ab69c0-ba16-4539-ae2b-000be639f093 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd54880040>, body: {"security_group_rule": {"parent_group_id": "646242c8-17a8-4a47-9119-98a3c2d1c4f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:39.757345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:39.769357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d6c3478-a64b-489d-bc98-f1d96af2fcc3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1265 microversion: 2.1 time: 0.179655 Aug 03 04:35:39.770298 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 567/1155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:39 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:39.776688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ca4783e9-301c-45f6-936d-d060bdeef80c req-0224f944-e056-4233-8ea6-fcdcf31218c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf967c4-8207-48e3-82f2-8eb0fbb1f32d", "name": "network-vif-deleted", "tag": "9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:39.788568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ca4783e9-301c-45f6-936d-d060bdeef80c req-0224f944-e056-4233-8ea6-fcdcf31218c6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.789504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ca4783e9-301c-45f6-936d-d060bdeef80c req-0224f944-e056-4233-8ea6-fcdcf31218c6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.803085 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ca4783e9-301c-45f6-936d-d060bdeef80c req-0224f944-e056-4233-8ea6-fcdcf31218c6 service nova] Creating event network-vif-deleted:9ac37f68-0ed6-4afa-b5b4-c56d4006f8f9 for instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d on n-h2-826756-5 Aug 03 04:35:39.808779 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ca4783e9-301c-45f6-936d-d060bdeef80c req-0224f944-e056-4233-8ea6-fcdcf31218c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 Aug 03 04:35:39.810078 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 568/1156] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:39.929081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cca1f72-c8c6-4d0f-8934-cdecb152a08f tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Calling method '.version_select at 0x7fdd548a6c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:39.930448 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:39.930448 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:39.931590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1cca1f72-c8c6-4d0f-8934-cdecb152a08f tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'bf64ce49828a46008665dcc1e010f991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd244b8ba9a42a3970ca30ffd733473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cca1f72-c8c6-4d0f-8934-cdecb152a08f tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Request method failure captured: Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors/n-h1-826756-5/search HTTP/1.1 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsXTBTfDE3vm3lCGbjXfYbewHsK_YwesavZW658SWqeIMrsjDtKVX5DNSC-hpugabekBLSNbuA_JMsuW2YAqHuhIbn6mQUHLTrK2zuGH0R5RVjlEx_2ubrmqAGQoZml2vME7U78jtEIIm-QZf-_rEXc3J-_iktLRlCs3d2xbrb_4wk Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cbd244b8ba9a42a3970ca30ffd733473 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:39.934359 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cbd244b8ba9a42a3970ca30ffd733473 Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: bf64ce49828a46008665dcc1e010f991 Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 04:35:39.936298 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'n-h1-826756-5'} Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:35:39.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 03 04:35:39.945576 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:39.946863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cca1f72-c8c6-4d0f-8934-cdecb152a08f tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:39.946863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1cca1f72-c8c6-4d0f-8934-cdecb152a08f tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/n-h1-826756-5/search" status: 403 len: 117 microversion: 2.1 time: 0.130184 Aug 03 04:35:39.946863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 569/1157] 10.222.0.72 () {58 vars in 1209 bytes} [Wed Aug 3 04:35:39 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-5/search => generated 117 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:39.954745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:39.955769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:39.972702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:39.976635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.981530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:39.982924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:39.983385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.052235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:40.141865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=20 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:40.302836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:40.307542 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e22601cf-7d01-403d-97bc-128247a7dbc9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.364330 Aug 03 04:35:40.312210 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 570/1158] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:39 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:40.317670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:40.318709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:40.330206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.339336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.340862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.341477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.620470 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58ab69c0-ba16-4539-ae2b-000be639f093 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.904695 Aug 03 04:35:40.621075 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 589/1159] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:40.626736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Calling method '.version_select at 0x7fdd5492c9d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:40.628372 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:40.628372 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:40.637720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:40.645765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.646230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.650711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:40.655821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Request method failure captured: Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsZq9rx5yYOpbgIebiH9B8JG27NpRuquRLBGfx62fbKqp3Yv7CIy3PkRtXQAZriyKcx5Q--lREHXR-dARmAv3Bh-zW9zQkx8XUWlx-7Awg9yNxGTfqjNKNbP9CgQUZa9zroDys6pup9rf2a-Wh_7_PvrTOkTcLQM9J1s1HLxv1wRdA Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3be296540d484bb684e71c4805aa5c1d Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 04:35:40.658026 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3be296540d484bb684e71c4805aa5c1d Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0d87f2f63d8f45e787fae2fd683bf92c Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 04:35:40.659318 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:40.660086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbdd5095-37e7-412c-8666-2c5976f64fad tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.037069 Aug 03 04:35:40.661375 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 590/1160] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:35:40 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:40.668525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:40.670107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-46bf6f0a-c690-4ad7-afcb-4db7f6d3dd9d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.356341 Aug 03 04:35:40.680801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 571/1161] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:40 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:40.690181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:40.691052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:40.693656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:40.694990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:40.702541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.703260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.703447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.703806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.704847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.704967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:40.705358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:40.705843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.071497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:41.081668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c2e2522-6b56-4d5a-bfe6-ea4600341f5b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.399393 Aug 03 04:35:41.099502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:41.108008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-59cce324-c746-43a5-8c59-66b02a1e086e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.430926 Aug 03 04:35:41.108304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 572/1162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:40 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:41.113388 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 591/1163] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:40 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:41.116783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4de0364d-c70f-42f6-b2af-a53da8bfc40a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd548a6dc0>, body: {"security_group_rule": {"parent_group_id": "646242c8-17a8-4a47-9119-98a3c2d1c4f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:41.128971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Calling method '.version_select at 0x7fdd57c539d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.130117 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:41.130117 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:41.131678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.132519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.164918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.165627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.179532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.180218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.186907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-06703194-573d-4ea8-b05d-d6f104e34761 tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.072200 Aug 03 04:35:41.188297 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 592/1164] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:35:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:41.193710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.194561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: dbf967c4-8207-48e3-82f2-8eb0fbb1f32d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:41.201006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.201674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.206570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.206570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.220756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] HTTP exception thrown: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Request method failure captured: Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d HTTP/1.1 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fp8H9k0pSJABwqHYvCWRFX4d2eNbveWMVKu1FhT3kvics1w58_vXdC6UmXPOYHvbWHjMV6sbIgV1UUkup5MyTBhnnbXG-zlwgb24VAebtvylGCbbul_NKEe7DcHFWT0ITPw9N-5md2-Ui2T0lhbRFEaqODk30C3zSfCxBzJUg_56UY Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:41.223214 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_546823ffdb0d45d997b427498813a742"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/546823ffdb0d45d997b427498813a742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 86c950308de0427ca178e91f19278d93 Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. Aug 03 04:35:41.224845 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dbf967c4-8207-48e3-82f2-8eb0fbb1f32d'} Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:41.226570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. Aug 03 04:35:41.228039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.230819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Returning 404 to user: Instance dbf967c4-8207-48e3-82f2-8eb0fbb1f32d could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:41.231881 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27d05ff1-8b54-4dc2-82f8-340a8a574409 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d" status: 404 len: 111 microversion: 2.1 time: 0.042206 Aug 03 04:35:41.232988 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 593/1165] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:41 2022] GET /compute/v2.1/servers/dbf967c4-8207-48e3-82f2-8eb0fbb1f32d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:41.238292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.239129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:41.246154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.246617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.247404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.247847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.262346 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4de0364d-c70f-42f6-b2af-a53da8bfc40a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4de0364d-c70f-42f6-b2af-a53da8bfc40a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 138 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:41.264194 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: {"security_group_rule": {"parent_group_id": "646242c8-17a8-4a47-9119-98a3c2d1c4f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 04:35:41.265807 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: exception: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'security_group_rule': {'parent_group_id': '646242c8-17a8-4a47-9119-98a3c2d1c4f3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:41.267414 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.270071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4de0364d-c70f-42f6-b2af-a53da8bfc40a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: This rule already exists in group 646242c8-17a8-4a47-9119-98a3c2d1c4f3 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:41.271159 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4de0364d-c70f-42f6-b2af-a53da8bfc40a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.155956 Aug 03 04:35:41.271159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 573/1166] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:41 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:35:41.271332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:41.276964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-99f53be1-5be5-4856-be5e-7ac5ad692c19 req-4a370952-6680-453a-be3c-6afd9b3b2c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7768f510-7bf4-476d-86ae-5e497506f219", "tag": "ce3f669c-f4df-4fb6-a916-6836bb7b4ac9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:41.295109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99f53be1-5be5-4856-be5e-7ac5ad692c19 req-4a370952-6680-453a-be3c-6afd9b3b2c27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.303400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99f53be1-5be5-4856-be5e-7ac5ad692c19 req-4a370952-6680-453a-be3c-6afd9b3b2c27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.322312 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-99f53be1-5be5-4856-be5e-7ac5ad692c19 req-4a370952-6680-453a-be3c-6afd9b3b2c27 service nova] Creating event network-changed:ce3f669c-f4df-4fb6-a916-6836bb7b4ac9 for instance 7768f510-7bf4-476d-86ae-5e497506f219 on n-h1-826756-5 Aug 03 04:35:41.328965 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-99f53be1-5be5-4856-be5e-7ac5ad692c19 req-4a370952-6680-453a-be3c-6afd9b3b2c27 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060143 Aug 03 04:35:41.330009 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 574/1167] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:41.335507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-400d527a-e563-4819-aed6-70c0fe8f1c31 tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Calling method '.version_select at 0x7fdd54893280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.336838 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:41.336838 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:41.338357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-400d527a-e563-4819-aed6-70c0fe8f1c31 tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'bf64ce49828a46008665dcc1e010f991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd244b8ba9a42a3970ca30ffd733473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-400d527a-e563-4819-aed6-70c0fe8f1c31 tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Request method failure captured: Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsXTBTfDE3vm3lCGbjXfYbewHsK_YwesavZW658SWqeIMrsjDtKVX5DNSC-hpugabekBLSNbuA_JMsuW2YAqHuhIbn6mQUHLTrK2zuGH0R5RVjlEx_2ubrmqAGQoZml2vME7U78jtEIIm-QZf-_rEXc3J-_iktLRlCs3d2xbrb_4wk Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cbd244b8ba9a42a3970ca30ffd733473 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:41.340207 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cbd244b8ba9a42a3970ca30ffd733473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cbd244b8ba9a42a3970ca30ffd733473 Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485 Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: bf64ce49828a46008665dcc1e010f991 Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 04:35:41.343471 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1'} Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:35:41.345163 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 03 04:35:41.346307 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:41.347675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-400d527a-e563-4819-aed6-70c0fe8f1c31 tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:41.347675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-400d527a-e563-4819-aed6-70c0fe8f1c31 tempest-HypervisorAdminNegativeUnderV252Test-1163352485 tempest-HypervisorAdminNegativeUnderV252Test-1163352485-project] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010695 Aug 03 04:35:41.347675 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 575/1168] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:35:41 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:41.347894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.348495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:41.355797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.356642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.362163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.362163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.401162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:35:41.447698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:41.561529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:41.569354 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ad7a41e-f1b4-4000-89e4-9f387edc7d7c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.335123 Aug 03 04:35:41.573198 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 594/1169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:41 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:41.574558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe4c69d4-79ba-4ca6-86d8-1a0c49f7754e tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd5486fee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.688660 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c46b91a-00b9-4364-b14c-ee7d387c6dfc tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "DELETE /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 204 len: 0 microversion: 2.1 time: 0.341159 Aug 03 04:35:41.703987 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 576/1170] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:35:41 2022] DELETE /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:35:41.717403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:41.718582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:41.726781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.727601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.728834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:41.730548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:41.994773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.003222 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c0105eb-b45b-4a79-abff-0cc4ffe64838 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.296102 Aug 03 04:35:42.003893 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 577/1171] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:41 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:42.008965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Calling method '.version_select at 0x7fdd547ebc10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.010097 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:42.010097 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:42.012113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.012766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.026560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] HTTP exception thrown: No hypervisor matching 'cb5bffe8-0da0-4139-978e-e820a7a7ee17' could be found. Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Request method failure captured: Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-hypervisors/cb5bffe8-0da0-4139-978e-e820a7a7ee17/servers HTTP/1.1 Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsZq9rx5yYOpbgIebiH9B8JG27NpRuquRLBGfx62fbKqp3Yv7CIy3PkRtXQAZriyKcx5Q--lREHXR-dARmAv3Bh-zW9zQkx8XUWlx-7Awg9yNxGTfqjNKNbP9CgQUZa9zroDys6pup9rf2a-Wh_7_PvrTOkTcLQM9J1s1HLxv1wRdA Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3be296540d484bb684e71c4805aa5c1d Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:35:42.028995 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3be296540d484bb684e71c4805aa5c1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3be296540d484bb684e71c4805aa5c1d Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452 Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0d87f2f63d8f45e787fae2fd683bf92c Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: exception: No hypervisor matching 'cb5bffe8-0da0-4139-978e-e820a7a7ee17' could be found. Aug 03 04:35:42.030447 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'cb5bffe8-0da0-4139-978e-e820a7a7ee17'} Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'cb5bffe8-0da0-4139-978e-e820a7a7ee17' could be found. Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.031248 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'cb5bffe8-0da0-4139-978e-e820a7a7ee17' could be found. Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] Returning 404 to user: No hypervisor matching 'cb5bffe8-0da0-4139-978e-e820a7a7ee17' could be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:42.033177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc725424-fca0-40f7-b75e-2bfa5d770efd tempest-HypervisorAdminNegativeUnderV252Test-1619500452 tempest-HypervisorAdminNegativeUnderV252Test-1619500452-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors/cb5bffe8-0da0-4139-978e-e820a7a7ee17/servers" status: 404 len: 123 microversion: 2.1 time: 0.025151 Aug 03 04:35:42.037950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 578/1172] 10.222.0.72 () {58 vars in 1281 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/os-hypervisors/cb5bffe8-0da0-4139-978e-e820a7a7ee17/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:42.046132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.046760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:42.056071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.056881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.057680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.058278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.078895 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe4c69d4-79ba-4ca6-86d8-1a0c49f7754e tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-group-rules/57b955fa-d380-4ac7-bd80-7f5617a6c168" status: 202 len: 0 microversion: 2.1 time: 0.502115 Aug 03 04:35:42.078895 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 595/1173] 10.222.0.72 () {58 vars in 1287 bytes} [Wed Aug 3 04:35:41 2022] DELETE /compute/v2.1/os-security-group-rules/57b955fa-d380-4ac7-bd80-7f5617a6c168 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:42.081596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.082357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:42.097127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.099158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.100150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.103034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.276304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.284649 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef8b5d4c-6b5e-4fb5-8601-aa83714984ef tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1468 microversion: 2.1 time: 0.245475 Aug 03 04:35:42.296301 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 579/1174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:42.296301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36e1b37-606b-4a4f-a778-0a4f1d8c42e5", "name": "network-vif-deleted", "tag": "01d475bb-4fa9-4dfc-85a7-6ee4765decd7"}, {"name": "network-changed", "server_uuid": "ddbf6f5e-4e1f-421b-8529-bc0295fe7a13", "tag": "70652a52-cff6-40ac-b702-a2e8428ac96e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.301662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.304853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.306622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.315640 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] Creating event network-vif-deleted:01d475bb-4fa9-4dfc-85a7-6ee4765decd7 for instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 on n-h2-826756-5 Aug 03 04:35:42.316146 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] Creating event network-changed:70652a52-cff6-40ac-b702-a2e8428ac96e for instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 on n-h2-826756-5 Aug 03 04:35:42.322210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.322348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-258b5261-96a4-48a5-9336-939aa4b4e5f4 req-04cfcac1-05bb-4106-bec0-f24fb1805f28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035812 Aug 03 04:35:42.322906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.323215 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 580/1175] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:42.328124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a9e92c23-cb6e-4f09-9637-9936db04ae80 req-44d6b270-2dd8-4126-9951-3e03eb2d60d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e177ca7-4008-4345-9e66-b36e8b1e9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "3a048de8-d942-45ac-ba50-253e71cc418f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.330902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c8b3680-9135-4ef9-b62e-1c5313b05346 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.256223 Aug 03 04:35:42.331476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 596/1176] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:42.340188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c40fb405-afd6-4765-884e-1c0958a15bf7 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5485e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1803134957", "description": "tempest-description-1711932761"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.353302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a9e92c23-cb6e-4f09-9637-9936db04ae80 req-44d6b270-2dd8-4126-9951-3e03eb2d60d4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.353746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a9e92c23-cb6e-4f09-9637-9936db04ae80 req-44d6b270-2dd8-4126-9951-3e03eb2d60d4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.364767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a9e92c23-cb6e-4f09-9637-9936db04ae80 req-44d6b270-2dd8-4126-9951-3e03eb2d60d4 service nova] Creating event network-vif-plugged:3a048de8-d942-45ac-ba50-253e71cc418f for instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c on n-h1-826756-5 Aug 03 04:35:42.369496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a9e92c23-cb6e-4f09-9637-9936db04ae80 req-44d6b270-2dd8-4126-9951-3e03eb2d60d4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045039 Aug 03 04:35:42.370090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 581/1177] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:42.374995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.376222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:42.382291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.382735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.383494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.383923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.535902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.545832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc90736c-74b1-415d-b430-3093eea691f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.174600 Aug 03 04:35:42.559013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 582/1178] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:42.566347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.567210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:42.573598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.574252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.575041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.575481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.740173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.748031 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8075977c-3d57-48e5-b26e-bf7037616790 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.187808 Aug 03 04:35:42.748652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 583/1179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:42.754010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:42.754808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:42.758689 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c40fb405-afd6-4765-884e-1c0958a15bf7 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.424387 Aug 03 04:35:42.770233 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 597/1180] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:42.772551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.772551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.772551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:42.772551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:42.775142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45cef71b-06a5-4101-bc8d-1a5835fdcb7f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5485eaf0>, body: {"security_group_rule": {"parent_group_id": "0ce448d7-29ab-44e6-a7a8-c19a1b2ce16f", "ip_protocol": "tcp", "from_port": 614276518, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.869597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-45cef71b-06a5-4101-bc8d-1a5835fdcb7f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Invalid port range 614276518:22. Former value cannot be greater than the later Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45cef71b-06a5-4101-bc8d-1a5835fdcb7f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 145 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:42.872222 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: {"security_group_rule": {"parent_group_id": "0ce448d7-29ab-44e6-a7a8-c19a1b2ce16f", "ip_protocol": "tcp", "from_port": 614276518, "to_port": 22}} Aug 03 04:35:42.874063 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid port range 614276518:22. Former value cannot be greater than the later Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0ce448d7-29ab-44e6-a7a8-c19a1b2ce16f', 'ip_protocol': 'tcp', 'from_port': 614276518, 'to_port': 22}}} Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 614276518:22. Former value cannot be greater than the later Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.875001 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 614276518:22. Former value cannot be greater than the later Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 614276518:22. Former value cannot be greater than the later Aug 03 04:35:42.877045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.878677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45cef71b-06a5-4101-bc8d-1a5835fdcb7f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: Invalid port range 614276518:22. Former value cannot be greater than the later {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:42.878677 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45cef71b-06a5-4101-bc8d-1a5835fdcb7f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.101302 Aug 03 04:35:42.878677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 598/1181] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:35:42.886974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76e54bb2-a988-48d6-93c0-c8c137404a72 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5489c3a0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-707437397", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.888745 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-76e54bb2-a988-48d6-93c0-c8c137404a72 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Security group id should be uuid Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76e54bb2-a988-48d6-93c0-c8c137404a72 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 130 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:42.891698 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-707437397", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:42.893339 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group id should be uuid Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-707437397', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:42.898709 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76e54bb2-a988-48d6-93c0-c8c137404a72 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: Security group id should be uuid {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:42.907518 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76e54bb2-a988-48d6-93c0-c8c137404a72 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.010396 Aug 03 04:35:42.908548 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 599/1182] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 03 04:35:42.908548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-606fd2f1-3c00-4be5-a8a8-c985d426629a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5489caf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-819635054", "description": "tempest-description-760088419"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:42.971598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:42.979712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ee49545-0cdc-4135-9dc1-bf0a56fc5717 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.229877 Aug 03 04:35:42.980317 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 584/1183] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:42 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:43.025067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:43.025674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:43.032556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.033024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.033800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.034227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.382717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.392190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73b39a85-93fa-4f95-9626-a3dc0a6c23c1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.370948 Aug 03 04:35:43.392767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 585/1184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:43 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:43.397736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:43.398533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:43.408937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.409398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.410224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.410879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.550127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.557542 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba412935-8398-4173-a643-4dd215b8c91f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1468 microversion: 2.1 time: 0.163620 Aug 03 04:35:43.558115 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 586/1185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:43 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:43.564910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:43.564910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:43.566923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-606fd2f1-3c00-4be5-a8a8-c985d426629a tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.667575 Aug 03 04:35:43.568147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 600/1186] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:35:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:43.570284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.570791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.571580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.572018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.576415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:43.577122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:43.583850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.584336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.585165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.585685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.862146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.871792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d98bdbe-626b-4656-8448-c31888fe887e tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.302181 Aug 03 04:35:43.872562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 601/1187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:43 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:43.874168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.878304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-025ca77d-f00f-4d97-ac8d-908adb435f28 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd548fd820>, body: {"security_group_rule": {"parent_group_id": "b89e400a-019f-4341-b63a-1ab6cff189a1", "ip_protocol": "tempest-999-1349984982", "from_port": 22, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:43.902652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.904480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:43.905694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb73b787-a882-4c6d-be85-e41501a928f2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.346658 Aug 03 04:35:43.907127 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 587/1188] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:43 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:43.919362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:43.920001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:43.928853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.929313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.930518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:43.931110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:43.953975 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-025ca77d-f00f-4d97-ac8d-908adb435f28 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Invalid IP protocol tempest-999-1349984982. Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-025ca77d-f00f-4d97-ac8d-908adb435f28 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 157 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:43.955550 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: {"security_group_rule": {"parent_group_id": "b89e400a-019f-4341-b63a-1ab6cff189a1", "ip_protocol": "tempest-999-1349984982", "from_port": 22, "to_port": 22}} Aug 03 04:35:43.957184 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid IP protocol tempest-999-1349984982. Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b89e400a-019f-4341-b63a-1ab6cff189a1', 'ip_protocol': 'tempest-999-1349984982', 'from_port': 22, 'to_port': 22}}} Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1349984982. Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:43.958153 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1349984982. Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1349984982. Aug 03 04:35:43.959675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:43.962207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-025ca77d-f00f-4d97-ac8d-908adb435f28 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: Invalid IP protocol tempest-999-1349984982. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:43.963305 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-025ca77d-f00f-4d97-ac8d-908adb435f28 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.089645 Aug 03 04:35:43.964430 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 602/1189] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:43 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:35:43.974138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7dce8af6-ff89-4f7f-aeb2-5ab1ca71d68f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5485e4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-418318689", "description": "tempest-description-1210995094"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:44.138943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:44.148451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e7d7600-ad75-4c5e-a2bc-5f05e716ae8c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.239844 Aug 03 04:35:44.149041 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 588/1190] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:43 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:44.153803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:44.154598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:44.161609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.162060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.179555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.179555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.531969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:44.542122 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a99adb43-35f3-4b0a-8339-5a469f415d4f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.391437 Aug 03 04:35:44.544329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 589/1191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:44 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:44.550131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:44.550994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:44.558856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.563590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.563590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.563590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.703121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7dce8af6-ff89-4f7f-aeb2-5ab1ca71d68f tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.732556 Aug 03 04:35:44.704957 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 603/1192] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:35:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:44.713488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:44.720524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:44.751862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:44.752313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.752313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.752313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.752313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.754852 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b48e173e-6c8f-49bb-8f15-7155354d8360 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1311 microversion: 2.1 time: 0.209161 Aug 03 04:35:44.755449 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 590/1193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:44 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:44.760223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-185479ba-969d-4923-bbba-2c2c896445a9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd548625e0>, body: {"security_group_rule": {"parent_group_id": "a70de8dc-5a27-4056-96d6-966320c4827f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:44.858365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:44.870232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0be3123c-99aa-4191-bb9f-1b7c8b67589f tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1426 microversion: 2.1 time: 0.161991 Aug 03 04:35:44.870833 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 604/1194] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:44 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1426 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:44.878520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cd023e73-5ff3-4152-992c-b0968e69d45b req-b71d3871-ef61-4b3d-85ad-322b1497fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b40676-fcb5-4244-ae7d-484b80fb894b", "name": "network-vif-deleted", "tag": "2d958cc9-6a0b-489c-bab0-36001689e21a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:44.879728 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-185479ba-969d-4923-bbba-2c2c896445a9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-185479ba-969d-4923-bbba-2c2c896445a9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 138 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:44.881415 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: {"security_group_rule": {"parent_group_id": "a70de8dc-5a27-4056-96d6-966320c4827f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 03 04:35:44.882797 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a70de8dc-5a27-4056-96d6-966320c4827f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:44.883573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 03 04:35:44.885312 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:44.886595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-185479ba-969d-4923-bbba-2c2c896445a9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:44.886595 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-185479ba-969d-4923-bbba-2c2c896445a9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.126186 Aug 03 04:35:44.886595 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 591/1195] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:44 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:35:44.893851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:44.896601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:44.910087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cd023e73-5ff3-4152-992c-b0968e69d45b req-b71d3871-ef61-4b3d-85ad-322b1497fb2d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.910357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.910554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cd023e73-5ff3-4152-992c-b0968e69d45b req-b71d3871-ef61-4b3d-85ad-322b1497fb2d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.910823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.911620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:44.912151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:44.924059 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cd023e73-5ff3-4152-992c-b0968e69d45b req-b71d3871-ef61-4b3d-85ad-322b1497fb2d service nova] Creating event network-vif-deleted:2d958cc9-6a0b-489c-bab0-36001689e21a for instance 36b40676-fcb5-4244-ae7d-484b80fb894b on n-h2-826756-5 Aug 03 04:35:44.930748 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cd023e73-5ff3-4152-992c-b0968e69d45b req-b71d3871-ef61-4b3d-85ad-322b1497fb2d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058397 Aug 03 04:35:44.931506 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 605/1196] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:44.939708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10429a5b-e6bd-46e0-90d4-c498c0d127eb tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd5485cdc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1184102449", "description": "tempest-description-876076080"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:45.072633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.081878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce2a50e3-81c4-4eac-99c2-ddaaf9455676 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.192513 Aug 03 04:35:45.082469 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 592/1197] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:44 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:45.087294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.087929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:45.094517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.095115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.102571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.102571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.279239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.290723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.292588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.295254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8575524d-a694-4c01-8a73-1be1dcf8db00 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.211551 Aug 03 04:35:45.303859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 593/1198] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:45 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:45.309119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.309849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:45.316667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.318155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.318155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.318626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.346491 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10429a5b-e6bd-46e0-90d4-c498c0d127eb tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.413191 Aug 03 04:35:45.352105 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 606/1199] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:35:44 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:45.364442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee929513-e336-46ab-af73-69020edfef59 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd54880b80>, body: {"security_group_rule": {"parent_group_id": "b1936cf6-0c62-4a1e-82f8-825298df63f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 231497905}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:45.391452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:45.450994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ee929513-e336-46ab-af73-69020edfef59 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee929513-e336-46ab-af73-69020edfef59 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 145 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:45.453112 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: {"security_group_rule": {"parent_group_id": "b1936cf6-0c62-4a1e-82f8-825298df63f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 231497905}} Aug 03 04:35:45.454835 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b1936cf6-0c62-4a1e-82f8-825298df63f9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 231497905}}} Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.455591 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 Aug 03 04:35:45.457162 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.459501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee929513-e336-46ab-af73-69020edfef59 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 400 to user: Invalid port range 22:231497905. Valid TCP ports should be between 1-65535 {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:45.460380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee929513-e336-46ab-af73-69020edfef59 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.100830 Aug 03 04:35:45.460966 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 607/1200] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:45 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:35:45.471209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Action: 'create', calling method: .version_select at 0x7fdd549a6e50>, body: {"security_group_rule": {"parent_group_id": "66e3eda7-9993-4ed7-9fdf-035d99e1017a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:45.482197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.492464 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71b9de13-659e-4773-8491-19407e968fad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.187234 Aug 03 04:35:45.493222 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 594/1201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:45 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:45.502361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:35:45.503207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Neutron security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:35:45.503787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.503787 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 138 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:45.506096 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: {"security_group_rule": {"parent_group_id": "66e3eda7-9993-4ed7-9fdf-035d99e1017a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 03 04:35:45.508086 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'security_group_rule': {'parent_group_id': '66e3eda7-9993-4ed7-9fdf-035d99e1017a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:35:45.508895 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 03 04:35:45.510095 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.511260 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 404 to user: Security group 66e3eda7-9993-4ed7-9fdf-035d99e1017a does not exist Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-ea80515c-e303-4b9e-b712-82c4b4da252a'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:45.512576 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30eb9d35-500b-45d6-936f-0f289a8161e1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.040890 Aug 03 04:35:45.513744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 608/1202] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:35:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:35:45.519310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd547eb790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.544403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:35:45.545019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Neutron security group rule c3571a60-806d-4049-9e1b-35f9718921f6 not found {{(pid=120831) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 03 04:35:45.545538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] HTTP exception thrown: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.545538 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Request method failure captured: Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-group-rules/c3571a60-806d-4049-9e1b-35f9718921f6 HTTP/1.1 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsYi0knvvKWO6n2ICgVgj0NuvTl1LZrlVwviOMV-ZsToRwNRkial9O3ag_OvfGWVp_OIaglAzAhE-p-Cj8toc4SeN0raxUApRH8HmaryPY9yF2suHzmjXzJVYlWCAW0aiaGSreu46T30VzCOCJ38Isu-uN9KkfZRKiaZp25kCPv_VY Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:45.548045 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f1814f0141404af384db844437433a74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f1814f0141404af384db844437433a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f1814f0141404af384db844437433a74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f1814f0141404af384db844437433a74 Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828 Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2112b11d03274f4b9dde38a0f9b34d6d Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.549761 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c3571a60-806d-4049-9e1b-35f9718921f6'} Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.550686 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 03 04:35:45.552118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.554032 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Returning 404 to user: Security group rule c3571a60-806d-4049-9e1b-35f9718921f6 does not exist Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-97a1f0e8-6d2c-44c4-bc1c-cb4ad7eccc50'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:45.556077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e449247d-21ee-40db-8ac3-5c8c3558a0b1 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-group-rules/c3571a60-806d-4049-9e1b-35f9718921f6" status: 404 len: 199 microversion: 2.1 time: 0.034825 Aug 03 04:35:45.559130 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 595/1203] 10.222.0.72 () {58 vars in 1287 bytes} [Wed Aug 3 04:35:45 2022] DELETE /compute/v2.1/os-security-group-rules/c3571a60-806d-4049-9e1b-35f9718921f6 => generated 199 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:45.559231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e596f92c-31cc-4418-8d0e-d5eae02500f5 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd54880a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.566137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.566744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:45.573684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.574138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.574915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.575353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.590097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:45.767801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:45.775767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6011d928-ec70-4e60-a0be-cc82ddc00271 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.213265 Aug 03 04:35:45.776711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 596/1204] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:45 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:45.782107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.782776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:45.788683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.789126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.789896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.790333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.908760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e596f92c-31cc-4418-8d0e-d5eae02500f5 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/b1936cf6-0c62-4a1e-82f8-825298df63f9" status: 202 len: 0 microversion: 2.1 time: 0.353619 Aug 03 04:35:45.910272 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 609/1205] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:35:45 2022] DELETE /compute/v2.1/os-security-groups/b1936cf6-0c62-4a1e-82f8-825298df63f9 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:45.917552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:45.918931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:45.927602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.928537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.929627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:45.930162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:45.995875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.007361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b280d655-27a9-45f2-b078-573ee82ad865 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1495 microversion: 2.1 time: 0.229468 Aug 03 04:35:46.013277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.013773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 597/1206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:45 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1495 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.023247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d4ac78e-224a-4133-9466-6084531c1ca5 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1426 microversion: 2.1 time: 0.111693 Aug 03 04:35:46.024610 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 610/1207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:45 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.027737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e3011ec1-a0be-4311-93e5-8bb888b0bcc9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd54862ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.044098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.044851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.051964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.052669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.053530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.053976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.282785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b5435fa-0c0f-4d72-b6b7-5453350a877c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1646 microversion: 2.1 time: 0.242645 Aug 03 04:35:46.284239 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 611/1208] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1646 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.289111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.289752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.296356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.297816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.298406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.299013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.393580 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e3011ec1-a0be-4311-93e5-8bb888b0bcc9 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/a70de8dc-5a27-4056-96d6-966320c4827f" status: 202 len: 0 microversion: 2.1 time: 0.377231 Aug 03 04:35:46.393580 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 598/1209] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:35:46 2022] DELETE /compute/v2.1/os-security-groups/a70de8dc-5a27-4056-96d6-966320c4827f => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:46.398915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.399640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.406434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.407160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.407992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.408530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.467205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.474916 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3730a7c0-facb-40d4-ba4c-199d8c7301fe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.189399 Aug 03 04:35:46.475488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 612/1210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.480148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.480783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.487393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.487853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.488669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.489231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.571515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0189921b-55c5-4168-946e-06f15ae464fa tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1646 microversion: 2.1 time: 0.177107 Aug 03 04:35:46.572902 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 599/1211] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1646 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.579960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0a5eb2e-a8a0-4d82-a8af-d046a41c5066 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd54868430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.710894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.726752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.728692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.730489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64b240d3-e378-4814-aa0e-ea9c327de3f9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.253509 Aug 03 04:35:46.731718 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 613/1212] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:46.738417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.739293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.747633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.748501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.749195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.749709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.938288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:46.945963 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-503fce8e-a5f6-46d9-9d31-f0ec017859b9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.212911 Aug 03 04:35:46.946576 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 614/1213] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:46.960399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.960399 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:46.960399 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:35:46.960399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.960399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.960830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.960830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.982603 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f18f7b3-3118-451b-a408-f1c2f89477b2 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034241 Aug 03 04:35:46.983134 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 615/1214] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:46.988332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:46.988941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:46.995119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.995573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:46.996369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:46.996813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.001128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0a5eb2e-a8a0-4d82-a8af-d046a41c5066 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/b89e400a-019f-4341-b63a-1ab6cff189a1" status: 202 len: 0 microversion: 2.1 time: 0.426831 Aug 03 04:35:47.003946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 600/1215] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:35:46 2022] DELETE /compute/v2.1/os-security-groups/b89e400a-019f-4341-b63a-1ab6cff189a1 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:47.097980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:47.159733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:47.167820 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-51b9c2bb-8cab-46e7-8ea0-0d327ebeac04 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.183667 Aug 03 04:35:47.168753 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 616/1216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:46 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:47.187076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:47.187954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:47.194223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.194863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.195983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.196452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.201965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5b957bb-db93-4d30-88b8-b1d1beaeca57 tempest-InstanceUsageAuditLogTestJSON-2226120 tempest-InstanceUsageAuditLogTestJSON-2226120-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.203701 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:47.203701 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:47.229106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5b957bb-db93-4d30-88b8-b1d1beaeca57 tempest-InstanceUsageAuditLogTestJSON-2226120 tempest-InstanceUsageAuditLogTestJSON-2226120-project-admin] 10.222.0.72 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03 04:35:46" status: 200 len: 318 microversion: 2.1 time: 0.224341 Aug 03 04:35:47.230370 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 601/1217] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-03%2004%3A35%3A46 => generated 318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:47.237805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9a776db-5c09-450a-836c-db3acbec0768 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd54868c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.451219 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d383509-b8eb-4e72-9438-d068a313bcc6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c/action" status: 202 len: 0 microversion: 2.1 time: 0.267587 Aug 03 04:35:47.455663 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 617/1218] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:47 2022] POST /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:47.458302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.459096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:47.465931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.466498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.467286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.467779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.480447 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9a776db-5c09-450a-836c-db3acbec0768 tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/0ce448d7-29ab-44e6-a7a8-c19a1b2ce16f" status: 202 len: 0 microversion: 2.1 time: 0.248401 Aug 03 04:35:47.481149 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 602/1219] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:35:47 2022] DELETE /compute/v2.1/os-security-groups/0ce448d7-29ab-44e6-a7a8-c19a1b2ce16f => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:47.486603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43e5733a-adde-4ef3-8d2f-95e0d202bcaf tempest-InstanceUsageAuditLogTestJSON-2226120 tempest-InstanceUsageAuditLogTestJSON-2226120-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.493170 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:47.493170 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:47.500098 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43e5733a-adde-4ef3-8d2f-95e0d202bcaf tempest-InstanceUsageAuditLogTestJSON-2226120 tempest-InstanceUsageAuditLogTestJSON-2226120-project-admin] 10.222.0.72 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.017551 Aug 03 04:35:47.501424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 603/1220] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:47.509643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-64465273-ffda-4ec7-9967-4bf7e6f1389a req-7378b41c-b15a-437b-bcb8-6bac8c2a4a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "name": "network-vif-unplugged", "status": "completed", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:47.514483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.514979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.515776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lazy-loading 'fault' on Instance uuid 36b40676-fcb5-4244-ae7d-484b80fb894b {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:47.522252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-64465273-ffda-4ec7-9967-4bf7e6f1389a req-7378b41c-b15a-437b-bcb8-6bac8c2a4a23 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.522705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-64465273-ffda-4ec7-9967-4bf7e6f1389a req-7378b41c-b15a-437b-bcb8-6bac8c2a4a23 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.534272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-64465273-ffda-4ec7-9967-4bf7e6f1389a req-7378b41c-b15a-437b-bcb8-6bac8c2a4a23 service nova] Creating event network-vif-unplugged:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h1-826756-5 Aug 03 04:35:47.539268 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-64465273-ffda-4ec7-9967-4bf7e6f1389a req-7378b41c-b15a-437b-bcb8-6bac8c2a4a23 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036245 Aug 03 04:35:47.540296 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 604/1221] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:47.545387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.546448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:47.556462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.557573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.559282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.562730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.618344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c950308de0427ca178e91f19278d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '546823ffdb0d45d997b427498813a742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:47.628662 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c0833dd-51f8-4fca-a3fb-35d220b4018c tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 200 len: 1304 microversion: 2.1 time: 0.175262 Aug 03 04:35:47.629848 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 618/1222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:47.642042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.646472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:47.650843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.652460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.654128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.654743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.831962 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b197639f-16a5-40b4-86d8-d11d0bfa4b3d tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1651 microversion: 2.1 time: 0.289590 Aug 03 04:35:47.833392 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 605/1223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1651 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:47.840765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9703b06-3c5a-4c7f-a5e6-d99273bc3d4b tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] Calling method '.version_select at 0x7fdd54809160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.876003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:47.921497 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-554a9ebd-6985-4e54-b197-b03745678cbe tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.286225 Aug 03 04:35:47.923131 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 619/1224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:47.936179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:47.940335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:47.956739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.957474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:47.962300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:47.965898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.243034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:48.256030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:48.257972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:48.260406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c7099f3-5af8-4b05-88bf-4d7549f8ef8d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.332173 Aug 03 04:35:48.260993 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 620/1225] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:47 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:48.266174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:48.266789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:48.272825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.273360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.274153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.274600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.356329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9703b06-3c5a-4c7f-a5e6-d99273bc3d4b tempest-SecurityGroupRulesNegativeTestJSON-1595780828 tempest-SecurityGroupRulesNegativeTestJSON-1595780828-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/646242c8-17a8-4a47-9119-98a3c2d1c4f3" status: 202 len: 0 microversion: 2.1 time: 0.521072 Aug 03 04:35:48.358166 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 606/1226] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:35:47 2022] DELETE /compute/v2.1/os-security-groups/646242c8-17a8-4a47-9119-98a3c2d1c4f3 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:48.365472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c06b89e9-03e8-47df-809a-dabe33ea6ec6 req-a1a8fe50-39b8-4984-b979-f19cc6095d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7768f510-7bf4-476d-86ae-5e497506f219", "name": "network-vif-plugged", "status": "completed", "tag": "ce3f669c-f4df-4fb6-a916-6836bb7b4ac9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:48.388674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c06b89e9-03e8-47df-809a-dabe33ea6ec6 req-a1a8fe50-39b8-4984-b979-f19cc6095d0a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.388674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c06b89e9-03e8-47df-809a-dabe33ea6ec6 req-a1a8fe50-39b8-4984-b979-f19cc6095d0a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.410341 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c06b89e9-03e8-47df-809a-dabe33ea6ec6 req-a1a8fe50-39b8-4984-b979-f19cc6095d0a service nova] Creating event network-vif-plugged:ce3f669c-f4df-4fb6-a916-6836bb7b4ac9 for instance 7768f510-7bf4-476d-86ae-5e497506f219 on n-h1-826756-5 Aug 03 04:35:48.417045 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c06b89e9-03e8-47df-809a-dabe33ea6ec6 req-a1a8fe50-39b8-4984-b979-f19cc6095d0a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056637 Aug 03 04:35:48.418192 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 607/1227] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:48.429355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:48.430836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:48.442297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.455552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.461165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.461831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.471337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:48.487699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e691b24-a20b-4bba-a444-bfc3f3f7a386 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.224303 Aug 03 04:35:48.490631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 621/1228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:48 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:48.654260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:48.655733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] [instance: 36b40676-fcb5-4244-ae7d-484b80fb894b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:48.663371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.663818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.664868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.665858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.670701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:48.683053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] HTTP exception thrown: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Request method failure captured: Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b HTTP/1.1 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fp8H9k0pSJABwqHYvCWRFX4d2eNbveWMVKu1FhT3kvics1w58_vXdC6UmXPOYHvbWHjMV6sbIgV1UUkup5MyTBhnnbXG-zlwgb24VAebtvylGCbbul_NKEe7DcHFWT0ITPw9N-5md2-Ui2T0lhbRFEaqODk30C3zSfCxBzJUg_56UY Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:35:48.685172 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/546823ffdb0d45d997b427498813a742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_546823ffdb0d45d997b427498813a742"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/546823ffdb0d45d997b427498813a742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 546823ffdb0d45d997b427498813a742 Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminTestJSON-1931179768 Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 86c950308de0427ca178e91f19278d93 Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminTestJSON-1931179768-project Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. Aug 03 04:35:48.686849 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '36b40676-fcb5-4244-ae7d-484b80fb894b'} Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:48.688743 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. Aug 03 04:35:48.690614 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:35:48.694170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] Returning 404 to user: Instance 36b40676-fcb5-4244-ae7d-484b80fb894b could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:48.695299 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-840bf543-0fa8-449a-8a21-7085b819b882 tempest-ServersAdminTestJSON-1931179768 tempest-ServersAdminTestJSON-1931179768-project] 10.222.0.72 "GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b" status: 404 len: 111 microversion: 2.1 time: 0.045040 Aug 03 04:35:48.699827 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 622/1229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:48 2022] GET /compute/v2.1/servers/36b40676-fcb5-4244-ae7d-484b80fb894b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:48.855320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:48.856052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:48.865491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.866013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:48.868350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:48.868812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.107935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.129429 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3bac03b-af40-43e9-a57a-1e7de32e8427 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.709304 Aug 03 04:35:49.130352 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 608/1230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:48 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:49.148218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:49.149118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:49.162044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.162576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.163436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.163954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.269248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b24d263-15a3-4ccd-9a59-97aae0835a36 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1631 microversion: 2.1 time: 0.417856 Aug 03 04:35:49.269927 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 623/1231] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:48 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1631 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:49.288717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:49.289331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:49.307904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.308387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.309387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.309991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.480825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.490426 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4766b606-b56c-4415-a52b-4655093dd84d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1393 microversion: 2.1 time: 0.358841 Aug 03 04:35:49.491019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 609/1232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:49 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1393 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:49.503089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:49.506513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:49.513081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.513957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.515092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.516130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.545612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lazy-loading 'flavor' on Instance uuid 3e177ca7-4008-4345-9e66-b36e8b1e9c0c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:35:49.559550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120831) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:35:49.576578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.590588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.592128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.594312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77cd9eba-89ec-4ccd-863b-4fa3b8d8e125 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.308989 Aug 03 04:35:49.595218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 624/1233] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:49 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:35:49.600044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:49.600914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:49.607902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.608732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.610607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.611238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.786221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:49.793966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc12136d-49b4-491f-841a-ae47eea74d2a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.197611 Aug 03 04:35:49.794729 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 625/1234] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:49 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:49.801520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0500a04b-ed29-4310-92af-731113804e8c req-dc149e0e-0009-468b-86dc-f7c721d49da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:49.811546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0500a04b-ed29-4310-92af-731113804e8c req-dc149e0e-0009-468b-86dc-f7c721d49da6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:49.812004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0500a04b-ed29-4310-92af-731113804e8c req-dc149e0e-0009-468b-86dc-f7c721d49da6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:49.828652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0500a04b-ed29-4310-92af-731113804e8c req-dc149e0e-0009-468b-86dc-f7c721d49da6 service nova] Creating event network-changed:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h1-826756-5 Aug 03 04:35:49.846269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0500a04b-ed29-4310-92af-731113804e8c req-dc149e0e-0009-468b-86dc-f7c721d49da6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045720 Aug 03 04:35:49.846269 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 626/1235] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:50.158403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:50.159316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:50.175361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.175820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:50.182177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.184790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:50.358717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:50.366396 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b6ea0e5-5cb2-4f0a-9d0c-e04a011a8ce8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.213806 Aug 03 04:35:50.366971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 627/1236] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:50 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:50.526911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:50.529042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:50.536695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:50.538619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.539176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:50.540236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.540803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:50.832537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:50.840836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c40567ec-28a3-4007-93c2-d6974428599a tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1575 microversion: 2.1 time: 0.331458 Aug 03 04:35:50.841941 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 628/1237] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:50 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1575 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:50.848800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:50.848800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:50.862602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.863258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:50.864426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:50.865086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.182843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:51.195873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:51.197798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:51.201638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-657a761f-d2c8-408f-8d6f-e2f02bf13d73 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.358561 Aug 03 04:35:51.221802 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 629/1238] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:50 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:51.232189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:51.240719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:51.248422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.249126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.251314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.251996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.513440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:51.523704 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-264c72bc-2d5d-44ac-a707-635e84bc5d97 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.299830 Aug 03 04:35:51.523824 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 630/1239] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:51 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:51.541368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:51.542079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:51.549396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.549867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.550655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.551092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.632406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c05d922e-727d-4266-8b3c-cda50d09be08 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107491 Aug 03 04:35:51.633702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 631/1240] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:35:51 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:51.638679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:51.639360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:51.646766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.647401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:51.648557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:51.649142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:52.014341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:52.024114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c91602df-829b-485e-aa20-baaf472c0a42 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.389299 Aug 03 04:35:52.025269 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 632/1241] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:51 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:52.230171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:52.231304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:52.242809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:52.243495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:52.244983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:52.246150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:52.490364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:52.503765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:52.505285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:52.506448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17b4af0a-89df-4d7d-9a5a-30cc3bb28a31 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.281968 Aug 03 04:35:52.507509 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 633/1242] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:52 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:35:52.547292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:52.547907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:52.559887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:52.560300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:52.561073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:52.561504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:52.835949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:52.849974 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9ac3448-b563-4e3d-92bf-1d513e6f1ce8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.306073 Aug 03 04:35:52.856522 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 634/1243] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:52 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:53.047666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:53.048615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:53.060136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.060620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.061409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.061847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.520424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:53.529796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86f0c168-d345-44e0-a5b8-78b26b37b4fc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.486574 Aug 03 04:35:53.530569 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 635/1244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:53 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:53.536596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:53.537383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:53.544013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.544682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.545678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.545898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.729164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7165041-7ee9-4fde-8df7-a6d2cc948582 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c/action" status: 202 len: 0 microversion: 2.1 time: 4.236843 Aug 03 04:35:53.730979 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 610/1245] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:49 2022] POST /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c/action => generated 0 bytes in 4239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:53.737347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:53.739221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:53.750687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.751534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.760802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.760802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.792294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:53.813341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:53.814910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:53.819631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20c29341-8e89-40b3-bc38-db1f6b631d06 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.287062 Aug 03 04:35:53.823699 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 636/1246] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:53 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:53.835787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8df8a5eb-8b8a-4ce1-82ee-88a4999c7f13 req-4c69fb18-3e8b-485f-afce-97598f419cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7768f510-7bf4-476d-86ae-5e497506f219", "tag": "ce3f669c-f4df-4fb6-a916-6836bb7b4ac9"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:53.867793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8df8a5eb-8b8a-4ce1-82ee-88a4999c7f13 req-4c69fb18-3e8b-485f-afce-97598f419cb8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.872725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8df8a5eb-8b8a-4ce1-82ee-88a4999c7f13 req-4c69fb18-3e8b-485f-afce-97598f419cb8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.920510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8df8a5eb-8b8a-4ce1-82ee-88a4999c7f13 req-4c69fb18-3e8b-485f-afce-97598f419cb8 service nova] Creating event network-changed:ce3f669c-f4df-4fb6-a916-6836bb7b4ac9 for instance 7768f510-7bf4-476d-86ae-5e497506f219 on n-h1-826756-5 Aug 03 04:35:53.927547 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8df8a5eb-8b8a-4ce1-82ee-88a4999c7f13 req-4c69fb18-3e8b-485f-afce-97598f419cb8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101322 Aug 03 04:35:53.928327 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 637/1247] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:53.934683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:53.935661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:53.959406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.960140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:53.964369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:53.964369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.091062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:54.103020 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03ceeaee-a0a7-43ed-a39d-a204f17a43f8 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1575 microversion: 2.1 time: 0.367178 Aug 03 04:35:54.104579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 611/1248] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:53 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1575 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:54.115746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:54.119526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:54.133060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.134401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.137747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.138359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.384255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:54.396838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47f7d1ab-6204-4381-86f1-5fc59217af41 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.463748 Aug 03 04:35:54.396838 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 638/1249] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:53 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:54.457338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:54.466785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-06edc573-8a18-4906-b9b3-3ed880247021 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.360858 Aug 03 04:35:54.468121 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 612/1250] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:54 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:54.551893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:54.552541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:54.564117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.564620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.569266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.569727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.659858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee55c6dd-ca75-40d8-ad17-bd2fb68ac500 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Calling method '.version_select at 0x7fdd54861820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:54.852043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:54.876875 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-127e79c5-cab8-49e1-927f-23346e3ce1e9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.326878 Aug 03 04:35:54.879138 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 613/1251] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:54 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:35:54.901699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee55c6dd-ca75-40d8-ad17-bd2fb68ac500 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 371 microversion: 2.1 time: 0.491999 Aug 03 04:35:54.906916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 639/1252] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:35:54 2022] GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 371 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:54.916048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:54.916992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:54.935415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.941624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:54.941624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:54.941624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.157978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:55.169474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.171402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:55.173702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:55.174454 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:55.174454 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:55.176171 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d78a3ae-326c-4999-838e-1cbc15aa4af8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.266413 Aug 03 04:35:55.176171 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 640/1253] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:54 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:55.181053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54808040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:55.181751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.182300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.183237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.183742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.210293 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f985db5a-969c-41ad-88ec-fe217ff3bf8b tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.330052 Aug 03 04:35:55.211160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 614/1254] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:35:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:55.241080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.244395 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:55.244395 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:55.251013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.251618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.253393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.253851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.304702 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a956a0d-2af9-4476-ba99-15d41bf9ee79 tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?host=n-d-826756-5" status: 200 len: 578 microversion: 2.1 time: 0.083965 Aug 03 04:35:55.315407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 615/1255] 10.222.0.72 () {58 vars in 1172 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/os-services?host=n-d-826756-5 => generated 578 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:35:55.323082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.327683 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:55.327683 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:55.329857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.334321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.337610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.338729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.370100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.372360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.374610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.375404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.376905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-912bf2b5-9ab7-4686-b4a4-e8ec5488d1dc tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059649 Aug 03 04:35:55.380317 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 616/1256] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:55.391809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.404752 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:35:55.404752 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:35:55.406734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.407213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.408238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.408897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.435174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f42379ec-e64d-4808-863d-390a52a6d68c tempest-ServicesAdminTestJSON-28609367 tempest-ServicesAdminTestJSON-28609367-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048399 Aug 03 04:35:55.435782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 617/1257] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:35:55.440560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.441372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:55.450503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.450503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.451373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.451947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.557728 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad2bb1c6-078e-4bf9-87e3-ae7108c86266 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 328 microversion: 2.1 time: 0.380014 Aug 03 04:35:55.558842 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 641/1258] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:35:55 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:55.564120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.564784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:55.571610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.572490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.573289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.573737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.615128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:55.623887 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26eb1ae4-8efc-4431-bb7b-29a8d9a36e27 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.186862 Aug 03 04:35:55.624715 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 618/1259] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:55.639714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1cf8c67a-e0b3-41a7-9956-e2e8720e24c6 req-f99f47f8-0d52-4bf6-b238-d7bb73058095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf6f5e-4e1f-421b-8529-bc0295fe7a13", "name": "network-vif-plugged", "status": "completed", "tag": "70652a52-cff6-40ac-b702-a2e8428ac96e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:55.641712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1cf8c67a-e0b3-41a7-9956-e2e8720e24c6 req-f99f47f8-0d52-4bf6-b238-d7bb73058095 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.642011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1cf8c67a-e0b3-41a7-9956-e2e8720e24c6 req-f99f47f8-0d52-4bf6-b238-d7bb73058095 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.657701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1cf8c67a-e0b3-41a7-9956-e2e8720e24c6 req-f99f47f8-0d52-4bf6-b238-d7bb73058095 service nova] Creating event network-vif-plugged:70652a52-cff6-40ac-b702-a2e8428ac96e for instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 on n-h2-826756-5 Aug 03 04:35:55.669143 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1cf8c67a-e0b3-41a7-9956-e2e8720e24c6 req-f99f47f8-0d52-4bf6-b238-d7bb73058095 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038503 Aug 03 04:35:55.669143 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 619/1260] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:55.742196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:55.745136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:55.752336 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ba19219-f0f5-4eae-8fa6-ffd14aa0a9a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.192050 Aug 03 04:35:55.753113 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 642/1261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:55.902230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:55.903224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:55.910237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.910893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:55.911967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:55.912441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.028813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-661164469", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:56.045199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:56.054153 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff87b52c-dcca-4a3e-98fa-2fa1bc217d69 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.156091 Aug 03 04:35:56.054727 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 643/1262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:55 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:56.086675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:56.202044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:56.202733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:56.209496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.210651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.211039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.211522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.363418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:56.364367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:56.365211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:56.365858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:56.366612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:56.378928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.379890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.380969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.382244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.401678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:56.423537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:56.423537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:56.423900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:56.424493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6bf9ea8f-66f1-4e71-98c3-0b7691e51396 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.226127 Aug 03 04:35:56.425691 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 644/1263] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:56 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:35:56.426926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:56.430437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for user 1f0ab2cebfac4932a1a450e4cee15682 and project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:56.446163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.utils [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] cores quota exceeded for 3c8035ac10db42719f85a383586df996, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120831) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 04:35:56.447251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Request method failure captured: Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 144 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsoPp65O3mUH9EXou4FYyCA-wOAJH4M8QfDYLsj4z5RcytLWYnzPW6Ru1NVnWKSL2loNtDZyCkQp_ibLZf9V470E95SvYw7W9iagnwbH_j4CQLsz7XIQ3eFstu_xMftCPPET9W303euIktFqL_Atwex28RdAPglxutu88jT1MsNHyQ Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:56.451033 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c8035ac10db42719f85a383586df996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c8035ac10db42719f85a383586df996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1f0ab2cebfac4932a1a450e4cee15682 Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-661164469", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} Aug 03 04:35:56.453134 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-661164469', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452'}}} Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 04:35:56.454709 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:56.457146 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.459499 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f28e5af1-4058-48b6-8434-73301bd937d2 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.662897 Aug 03 04:35:56.464940 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 620/1264] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:55 2022] POST /compute/v2.1/servers => generated 111 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:35:56.472257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54814e50>, body: {"quota_set": {"cores": 20}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:56.646044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:56.652056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:56.654959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.656160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.657229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.657882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.720700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.732488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.732488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.732488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.860325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:56.876179 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47df626f-8655-4785-b41a-73d8106846a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.225809 Aug 03 04:35:56.876179 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 621/1265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:56 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:56.876179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:56.876179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:56.882197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.882883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.884424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:56.885076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:56.902142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:35:56.971791 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3239055-d3c5-4571-87e2-a45d43d185c2 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 329 microversion: 2.1 time: 0.504200 Aug 03 04:35:56.973066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 645/1266] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:35:56 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 329 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:56.986277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-932e15b3-82d7-4f74-af1c-6ce242809541 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Calling method '.version_select at 0x7fdd5485eaf0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:57.083819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:57.091773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90fa6959-d393-4d0f-94d8-75d04fe3eb17 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.222141 Aug 03 04:35:57.102215 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 622/1267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:56 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:57.102453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:57.103139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:57.111517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.111977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.113113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.113563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.285724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:57.295100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-39dfcca6-b8a0-446b-9a28-28b707cb90f2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1307 microversion: 2.1 time: 0.201631 Aug 03 04:35:57.295688 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 623/1268] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:57 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:57.389539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-932e15b3-82d7-4f74-af1c-6ce242809541 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 371 microversion: 2.1 time: 0.406978 Aug 03 04:35:57.397002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 646/1269] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:35:56 2022] GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:57.403448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd5478c3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:57.450979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:57.451743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:57.465737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.466578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.471696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.472613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.647497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.647937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.649324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.649765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.676867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:57.685247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:57.687080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:57.700410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa458fc8-a23a-44fa-bfc0-01a73929fd71 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.241994 Aug 03 04:35:57.701715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 647/1270] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:57 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:57.787385 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19717f10-a69b-4143-96fc-cfd8b7ee4b03 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 328 microversion: 2.1 time: 0.388237 Aug 03 04:35:57.797074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 624/1271] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:35:57 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 328 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:35:57.893756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:57.894503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:57.907925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.908593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.909485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:57.909980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:57.915660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-374337932", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:58.002410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:35:58.745840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:58.762158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae280465-3597-4ea5-bf75-f0cd5014fc1c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.869121 Aug 03 04:35:58.762796 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 648/1272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:57 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:58.786844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:58.788210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:58.795591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:58.796203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:58.797541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:58.799810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:58.933510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:35:58.933995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:35:58.934741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:35:58.935175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:35:58.935595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:35:58.946469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:58.947067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:58.948860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:58.949252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:58.997505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:35:59.002754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for user 1f0ab2cebfac4932a1a450e4cee15682 and project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:35:59.016672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.utils [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] instances quota exceeded for 3c8035ac10db42719f85a383586df996, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120831) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 04:35:59.017441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Request method failure captured: Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 144 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsoPp65O3mUH9EXou4FYyCA-wOAJH4M8QfDYLsj4z5RcytLWYnzPW6Ru1NVnWKSL2loNtDZyCkQp_ibLZf9V470E95SvYw7W9iagnwbH_j4CQLsz7XIQ3eFstu_xMftCPPET9W303euIktFqL_Atwex28RdAPglxutu88jT1MsNHyQ Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:35:59.019673 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c8035ac10db42719f85a383586df996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c8035ac10db42719f85a383586df996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1f0ab2cebfac4932a1a450e4cee15682 Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-374337932", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} Aug 03 04:35:59.021076 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-374337932', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452'}}} Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 04:35:59.021831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:59.031838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.033960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-564eb243-f385-4475-be2a-b5731a18006e tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.109805 Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 625/1273] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:35:57 2022] POST /compute/v2.1/servers => generated 119 bytes in 1111 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:35:59.036205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:59.037570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:59.037570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.037570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.038391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.038861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.123441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:59.135257 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16558381-5f11-4571-916f-dc2277cf9500 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1540 microversion: 2.1 time: 0.352827 Aug 03 04:35:59.141110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 649/1274] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:58 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1540 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:59.145880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:59.146650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:59.154808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.156183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.157275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.157811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.469578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:59.477625 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-12be91c0-0507-4b9d-9285-27f17337a5ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1487 microversion: 2.1 time: 0.454407 Aug 03 04:35:59.478458 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 626/1275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:59 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1487 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:35:59.483252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd547b1790>, body: {"quota_set": {"instances": 10}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:59.551120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:59.561503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:59.563697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:35:59.564982 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e16688ce-5cd8-48c0-b83d-12a3b018144d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.425735 Aug 03 04:35:59.565548 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 650/1276] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:35:59 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:35:59.585971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-09dcefbb-7f52-4153-b57f-8051438aebc9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:35:59.594541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09dcefbb-7f52-4153-b57f-8051438aebc9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.595282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09dcefbb-7f52-4153-b57f-8051438aebc9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.670113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-09dcefbb-7f52-4153-b57f-8051438aebc9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:35:59.747483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.747952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.748855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.755037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.935743 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-09dcefbb-7f52-4153-b57f-8051438aebc9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13/action" status: 202 len: 0 microversion: 2.1 time: 0.357806 Aug 03 04:35:59.941379 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 651/1277] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:35:59 2022] POST /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:35:59.955411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:35:59.956133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:35:59.963880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.964372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:35:59.965643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:35:59.966101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.017842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1335214-59a2-4f82-b549-dc9a2a6e31f9 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 329 microversion: 2.1 time: 0.538046 Aug 03 04:36:00.026299 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 627/1278] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:35:59 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 329 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:00.026299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:00.026299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:00.033784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.034235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.039141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.039141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.585272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:00.588826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:00.599351 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00613e58-d09e-4bbd-af25-237f6021f82a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.578983 Aug 03 04:36:00.600770 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 628/1279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:00 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:00.613134 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3a59a4d-47c8-4580-8a60-4a0a8b7b0011 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.660541 Aug 03 04:36:00.613134 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 652/1280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:35:59 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:00.619059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80471589-51c9-41b4-9c66-0866e92a43c6 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Calling method '.version_select at 0x7fdd54a17700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:00.626229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:00.627470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:00.638806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.639708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.642128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.643699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.964391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:00.978739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d91a71d7-905a-43f2-b26c-a79c1dd0e7b4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1539 microversion: 2.1 time: 0.363580 Aug 03 04:36:00.979561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 629/1281] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:00 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1539 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:00.987476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:00.988479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:00.995904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.996360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:00.997341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:00.997775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:01.016675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80471589-51c9-41b4-9c66-0866e92a43c6 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 371 microversion: 2.1 time: 0.411827 Aug 03 04:36:01.019000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 653/1282] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:36:00 2022] GET /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:01.031310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd547d4700>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:01.241743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:01.258338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:01.258338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:01.258338 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09c7a6c5-4efe-47c3-b467-558fb665192e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.275422 Aug 03 04:36:01.258621 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 630/1283] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:36:00 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:01.355256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:01.355713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:01.356802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:01.357187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:01.482243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e765d6d-91f5-4ee8-a1a5-c7d6783c1d3d tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 325 microversion: 2.1 time: 0.455525 Aug 03 04:36:01.494063 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 654/1284] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:36:01 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 325 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:36:01.605628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-448081151", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:01.627837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:01.631585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:01.634830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:01.635282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:01.636049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:01.636888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:01.682686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:36:02.006057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.015351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:36:02.016471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:36:02.017030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:36:02.017637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:36:02.018268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:36:02.038719 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4cdca70c-2e40-4cfa-b395-d5c9fcb866f5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.415175 Aug 03 04:36:02.042121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 655/1285] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:01 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:02.052317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.052748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.053499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:02.053630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.054606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.055274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.059285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:02.061931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.062894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.064169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.064858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.076679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:02.082565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Getting quotas for user 1f0ab2cebfac4932a1a450e4cee15682 and project 3c8035ac10db42719f85a383586df996. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:02.100528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.utils [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] ram quota exceeded for 3c8035ac10db42719f85a383586df996, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120831) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 03 04:36:02.102124 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Request method failure captured: Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 144 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsoPp65O3mUH9EXou4FYyCA-wOAJH4M8QfDYLsj4z5RcytLWYnzPW6Ru1NVnWKSL2loNtDZyCkQp_ibLZf9V470E95SvYw7W9iagnwbH_j4CQLsz7XIQ3eFstu_xMftCPPET9W303euIktFqL_Atwex28RdAPglxutu88jT1MsNHyQ Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:36:02.104633 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c8035ac10db42719f85a383586df996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c8035ac10db42719f85a383586df996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1f0ab2cebfac4932a1a450e4cee15682 Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-448081151", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} Aug 03 04:36:02.106089 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-448081151', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452'}}} Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 04:36:02.106833 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:02.107920 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.110188 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 03 04:36:02.111523 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:02.114576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:02.116030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94f9897b-0905-49f7-a4ca-0f50b224b9da tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.514679 Aug 03 04:36:02.118613 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 631/1286] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:36:01 2022] POST /compute/v2.1/servers => generated 110 bytes in 518 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:36:02.278935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.287626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb2360c1-51ae-4072-8e00-b8e1c7c06647 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.242685 Aug 03 04:36:02.288576 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 656/1287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:02.311681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-unplugged", "status": "completed", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:02.320098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.322725 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:02.322725 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:36:02.323995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.324514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.324637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.325277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.325421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.325736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.355125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3cde81d6-f386-41be-9ba3-f1deb2c45a6c tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.235202 Aug 03 04:36:02.356037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 632/1288] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:02.361448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.362329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:02.373863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.374692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.376774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.377444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.573688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.585325 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aaa7ea5d-a60a-47db-8b7a-c5b8b147b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1471 microversion: 2.1 time: 0.227915 Aug 03 04:36:02.588605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] Creating event network-vif-unplugged:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:36:02.589211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 633/1289] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:02.594112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:36:02.597267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Action: 'update', calling method: .version_select at 0x7fdd547b1040>, body: {"quota_set": {"ram": 51200}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:02.601838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2aa3a9c9-de68-4f2f-a8d1-f32fd80e3345 req-632444c6-0088-48f0-8812-d3f8ffa3de3c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.293725 Aug 03 04:36:02.602975 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 657/1290] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:02.610168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.610974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:02.623572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.623572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.623572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.623572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.808070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.808558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.809500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.810140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.870342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.882488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.884229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:02.885648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef1e6662-1cc7-4833-8fa8-ade41d120f23 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1812 microversion: 2.25 time: 0.281662 Aug 03 04:36:02.892326 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 658/1291] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1812 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:02.899413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.905346 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:02.905346 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:36:02.909676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.910143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.915896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.916521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:02.954758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8689b9f2-9647-4b30-b297-44873dd562ab tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.060824 Aug 03 04:36:02.955168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 659/1292] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:02.978993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:02.981255 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:02.981255 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:36:02.982491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:02.982954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.001093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.001795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.048012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bac62053-dab9-4c7f-b05d-c6d33124e693 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.073584 Aug 03 04:36:03.048743 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 660/1293] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:36:02 2022] GET /compute/v2.1/os-services => generated 944 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:03.061323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.065405 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:03.065405 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:36:03.066704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.067213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.068200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.068931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.099923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a991ea5-ff38-44de-bd4f-21134f964c96 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?host=n-d-826756-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.042887 Aug 03 04:36:03.101053 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 661/1294] 10.222.0.72 () {58 vars in 1194 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/os-services?host=n-d-826756-5&binary=xxx => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:36:03.106561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.110101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:03.117337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.117885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.118749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.119260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.129673 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dfe33007-87f8-4641-86ec-1568fa66fab1 tempest-QuotasAdminNegativeTest-1769794293 tempest-QuotasAdminNegativeTest-1769794293-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 200 len: 329 microversion: 2.1 time: 0.538105 Aug 03 04:36:03.141548 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 634/1295] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:36:02 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 329 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:03.151542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.151729 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:03.151729 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:36:03.156123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.157158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.158244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.159078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.206984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-401784a5-0e2a-42fd-b42d-e85549403fc0 tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.063567 Aug 03 04:36:03.207790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 635/1296] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:03.229756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c7f3bf5-7826-45e2-8102-b13263b0bfa7 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Action: 'update', calling method: .version_select at 0x7fdd54809700>, body: {"quota_set": {"ram": 0}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:03.243655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c7f3bf5-7826-45e2-8102-b13263b0bfa7 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1f0ab2cebfac4932a1a450e4cee15682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c8035ac10db42719f85a383586df996', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c7f3bf5-7826-45e2-8102-b13263b0bfa7 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Request method failure captured: Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 HTTP/1.1 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 25 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fsoPp65O3mUH9EXou4FYyCA-wOAJH4M8QfDYLsj4z5RcytLWYnzPW6Ru1NVnWKSL2loNtDZyCkQp_ibLZf9V470E95SvYw7W9iagnwbH_j4CQLsz7XIQ3eFstu_xMftCPPET9W303euIktFqL_Atwex28RdAPglxutu88jT1MsNHyQ Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:36:03.254765 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c8035ac10db42719f85a383586df996"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c8035ac10db42719f85a383586df996"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c8035ac10db42719f85a383586df996"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 3c8035ac10db42719f85a383586df996 Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1159334430 Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1f0ab2cebfac4932a1a450e4cee15682 Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-QuotasAdminNegativeTest-1159334430-project Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: {"quota_set": {"ram": 0}} Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 04:36:03.256324 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3c8035ac10db42719f85a383586df996', 'body': {'quota_set': {'ram': 0}}} Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:03.257238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.258431 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c7f3bf5-7826-45e2-8102-b13263b0bfa7 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c7f3bf5-7826-45e2-8102-b13263b0bfa7 tempest-QuotasAdminNegativeTest-1159334430 tempest-QuotasAdminNegativeTest-1159334430-project] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996" status: 403 len: 116 microversion: 2.1 time: 0.036825 Aug 03 04:36:03.261383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 636/1297] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:36:03 2022] PUT /compute/v2.1/os-quota-sets/3c8035ac10db42719f85a383586df996 => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:36:03.269237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.278572 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:03.278572 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:36:03.280336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.283038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.285047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.285550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.301412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:03.314724 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a46e88d1-f6f9-4e8d-b91b-279aa2889e8e tempest-ServicesAdminNegativeTestJSON-719536506 tempest-ServicesAdminNegativeTestJSON-719536506-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.056024 Aug 03 04:36:03.318524 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 637/1298] 10.222.0.72 () {58 vars in 1198 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:36:03.325926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.328223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:03.342763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.344132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.345507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.347278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.361205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:03.371830 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-436c480b-d741-4b72-9917-85713020a237 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.269585 Aug 03 04:36:03.385062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 662/1299] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:03.539759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:03.548555 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a5f38cb-4c11-41e5-9ad3-3ec0138abac5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.228662 Aug 03 04:36:03.552070 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 638/1300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:03.568762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1e8e9b7-3914-481d-9651-e17918e546db tempest-ServicesAdminNegativeTestJSON-395584639 tempest-ServicesAdminNegativeTestJSON-395584639-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.571911 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:03.571911 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:36:03.574008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e1e8e9b7-3914-481d-9651-e17918e546db tempest-ServicesAdminNegativeTestJSON-395584639 tempest-ServicesAdminNegativeTestJSON-395584639-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c8e5474c23354528a342e2b7fbbdbf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b869a1e2755247cab2414b3361c3d3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1e8e9b7-3914-481d-9651-e17918e546db tempest-ServicesAdminNegativeTestJSON-395584639 tempest-ServicesAdminNegativeTestJSON-395584639-project] Request method failure captured: Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fswLGni4cqcLfPpeYmH-h-ejWGM-9e-6LCkFhDBDviiR-dcD9TkrRyoeJrVBr00ilK301l95lAp-W7iaPcOnS2u2MBBvtyNg0G_jUmEAnx6JOJrl5NzcUtLIJNp3n216TdVwo9audJIRB6hdrcLEupV0Q6Vhm-WvllbErr6kfUVlOs Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b869a1e2755247cab2414b3361c3d3eb Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-395584639 Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:36:03.576047 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b869a1e2755247cab2414b3361c3d3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b869a1e2755247cab2414b3361c3d3eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b869a1e2755247cab2414b3361c3d3eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b869a1e2755247cab2414b3361c3d3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-395584639 Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b869a1e2755247cab2414b3361c3d3eb Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-395584639 Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServicesAdminNegativeTestJSON-395584639-project Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c8e5474c23354528a342e2b7fbbdbf96 Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-395584639-project Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:36:03.578373 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:36:03.579385 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 03 04:36:03.580619 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:03.583644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1e8e9b7-3914-481d-9651-e17918e546db tempest-ServicesAdminNegativeTestJSON-395584639 tempest-ServicesAdminNegativeTestJSON-395584639-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:03.584746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1e8e9b7-3914-481d-9651-e17918e546db tempest-ServicesAdminNegativeTestJSON-395584639 tempest-ServicesAdminNegativeTestJSON-395584639-project] 10.222.0.72 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.198483 Aug 03 04:36:03.585530 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 663/1301] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/os-services => generated 112 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:36:03.609987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.610696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:03.620945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.621789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.623809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.626274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.807234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:03.815150 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da715d9a-9ef6-4514-93bb-238b2c6d8252 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1468 microversion: 2.1 time: 0.209990 Aug 03 04:36:03.815915 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 639/1302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1468 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:03.836243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:03.837029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:03.851622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.852755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.853727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.854359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.916833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:03.917452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:03.929879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.934952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.935688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.935859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.936155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.936373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.937125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:03.937708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:03.950385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:03.973335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:03.980804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:04.192904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:04.230205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:04.237171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:04.242481 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-443f0015-eee0-4e17-b24f-21d945259c8e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1802 microversion: 2.25 time: 0.328231 Aug 03 04:36:04.245484 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 640/1303] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:36:03 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1802 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:04.271465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ad11a03-c6d7-452c-8285-399850652555 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '.version_select at 0x7fdd5479dd30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:04.275935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad11a03-c6d7-452c-8285-399850652555 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.276797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad11a03-c6d7-452c-8285-399850652555 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.304599 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ad11a03-c6d7-452c-8285-399850652555 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 3868 microversion: 2.25 time: 0.036582 Aug 03 04:36:04.305399 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 641/1304] 10.222.0.72 () {60 vars in 1184 bytes} [Wed Aug 3 04:36:04 2022] GET /compute/v2.1/os-migrations => generated 3868 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:04.328974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:04.330294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:04.338694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.339812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.351020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.354778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.548311 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cfeb449c-55fc-41cb-af5b-df47215ef67f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24/action" status: 202 len: 0 microversion: 2.1 time: 0.715709 Aug 03 04:36:04.549271 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 664/1305] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:36:03 2022] POST /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:36:04.568382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:04.569313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:04.576026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.576771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.578262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.578856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.723052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:36:04.743589 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d383401-f0fa-4699-b41a-05719c45bd11 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 2420 microversion: 2.25 time: 0.422243 Aug 03 04:36:04.757997 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 642/1306] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:36:04 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 2420 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:04.775268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:04.776427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:04.784491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.785298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.786338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.787123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.961406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:04.974116 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8768d81-46a7-44f6-a8fe-e52bea67e28e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.422497 Aug 03 04:36:04.975291 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 665/1307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:04 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:04.981866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:04.984410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:04.992590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.993642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:04.994768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:04.995376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:05.306470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:05.315880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4ac6a15-6059-43e8-b85c-ec7e39d46e7d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1467 microversion: 2.1 time: 0.552387 Aug 03 04:36:05.316617 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 643/1308] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:04 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1467 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:05.321575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:05.322449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:05.338781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:05.339367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:05.350204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:05.352532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:05.450396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:05.454337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a8652da-bb16-4012-b114-c5d6052add77 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.477738 Aug 03 04:36:05.454919 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 666/1309] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:04 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:05.778648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:36:05.808319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-759f8a21-e1e9-4712-9f28-e88b492c795b tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 2420 microversion: 2.25 time: 0.490214 Aug 03 04:36:05.826841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 644/1310] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:36:05 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 2420 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:36:05.996929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:05.997546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:05.999862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:06.000977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:06.011902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.019558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.020501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.021489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.022086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.027567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.029297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.029942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.085212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:06.315119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lazy-loading 'services' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:36:06.698813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6093bc35-3c4f-4419-a332-6c7949e125f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments/6413636a-1d9a-4148-b9f5-fb3132ad0d5c" status: 202 len: 0 microversion: 2.25 time: 0.710719 Aug 03 04:36:06.700040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 667/1311] 10.222.0.72 () {60 vars in 1457 bytes} [Wed Aug 3 04:36:05 2022] DELETE /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments/6413636a-1d9a-4148-b9f5-fb3132ad0d5c => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:36:06.710155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-plugged", "status": "completed", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:06.738137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.739000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.768127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] Creating event network-vif-plugged:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:36:06.776749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:36:06.787256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:06.794743 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d249e20-6e9c-4a33-8a9b-8b1831384925 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.801716 Aug 03 04:36:06.797270 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 645/1312] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:05 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:06.813046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:06.813823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:06.814954 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-655b8ca9-f6c3-4d8b-b0c9-0e5a6718909c req-4c297990-a93d-491d-96e4-4ed60c7c3898 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111725 Aug 03 04:36:06.817550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 668/1313] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:06.826406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:06.833194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:06.834203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.835454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.836927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.837533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.851827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.852519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:06.854451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:06.855090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:07.120336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:07.132338 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24707b7d-8e13-413c-a5e2-3db2e004034b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.313298 Aug 03 04:36:07.148457 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 669/1314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:06 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:07.148457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:07.153213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:07.170656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:07.171125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:07.176683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:07.177150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:07.229912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7212460-8652-44c6-9bbd-c687de3f8ee8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094296 Aug 03 04:36:07.234847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 670/1315] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:07 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:36:07.247836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:07.263060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15c5d2ee-2f39-4732-a1dc-258129287a12 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1467 microversion: 2.1 time: 0.464509 Aug 03 04:36:07.264006 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 646/1316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:06 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1467 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:07.666843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27b7271b-98db-4c85-bb16-a80093fb3618 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Action: 'create', calling method: .version_select at 0x7fdd55588670>, body: {"keypair": {"name": "tempest-keypair-1227982397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjMt/XDK4yrTPGRw2lx5rQIETGMoRTa8U0vMXlWbsKMmLUyRJzHsKWEtfeuHcjpgU77fcWNH83wLlxE311Z9S1IFk60GVvQc8NPRLHidu4310goQOsZcbYzOn+c64xSNg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:07.684601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-27b7271b-98db-4c85-bb16-a80093fb3618 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for project 8a6d1be80039482fbb9938e347e725d0. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:07.690809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-27b7271b-98db-4c85-bb16-a80093fb3618 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for user ce2d52f829e4439596c8be348bb2f24a and project 8a6d1be80039482fbb9938e347e725d0. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:07.802068 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27b7271b-98db-4c85-bb16-a80093fb3618 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266665 Aug 03 04:36:07.802677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 671/1317] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:36:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:07.824143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:07.825471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:07.840508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:07.841316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:07.846027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:07.846027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.131389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7deed05c-2ff5-4eed-a757-98fa509e5f80 req-212c20b1-c374-42e4-9945-d05c991a942a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e177ca7-4008-4345-9e66-b36e8b1e9c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "3a048de8-d942-45ac-ba50-253e71cc418f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:08.150075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7deed05c-2ff5-4eed-a757-98fa509e5f80 req-212c20b1-c374-42e4-9945-d05c991a942a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.150533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7deed05c-2ff5-4eed-a757-98fa509e5f80 req-212c20b1-c374-42e4-9945-d05c991a942a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.176290 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7deed05c-2ff5-4eed-a757-98fa509e5f80 req-212c20b1-c374-42e4-9945-d05c991a942a service nova] Creating event network-vif-unplugged:3a048de8-d942-45ac-ba50-253e71cc418f for instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c on n-h1-826756-5 Aug 03 04:36:08.185972 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7deed05c-2ff5-4eed-a757-98fa509e5f80 req-212c20b1-c374-42e4-9945-d05c991a942a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060841 Aug 03 04:36:08.188636 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 672/1318] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:36:08.198763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:08.201393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:08.212414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.218406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.221738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:08.222893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.223514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.233152 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-012f960a-8923-44cf-aac6-c6f1577435be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.416938 Aug 03 04:36:08.234418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 647/1319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:07 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:08.253940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:08.262819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:08.288171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.290526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.298131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.299378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.375594 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a2b4f54-8044-4f0e-83fd-13375144df97 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136472 Aug 03 04:36:08.376845 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 648/1320] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:08 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:36:08.392344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:08.393159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:08.403004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.403468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.404298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:08.404784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:08.669058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:08.676214 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-59fecec7-cb21-446d-b1e2-a03399a2bd9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.485346 Aug 03 04:36:08.677857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 673/1321] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:08 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:08.759382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:08.767894 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-548d935b-a8a6-4465-8ff8-d36831e10a20 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1467 microversion: 2.1 time: 0.389708 Aug 03 04:36:08.780685 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 649/1322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:08 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:08.922273 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 04:36:08.922883 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 04:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 04:36:09.258603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:09.258603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:09.272251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.272781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.273597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.273989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.389464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:09.391648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:09.409386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.418152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.419052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.419442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.511734 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b67d3540-aab9-4c8c-8d2a-850c15e53ab6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127288 Aug 03 04:36:09.519102 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 650/1323] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:09 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:36:09.580091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:09.590479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b073e39-a1e6-44b8-8f30-f79cdf88794d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.338934 Aug 03 04:36:09.606777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 674/1324] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:09 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:09.697464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:09.698767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:09.714475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.715468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.716497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.717099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.791376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:09.793384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:09.835404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.836161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:09.838198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:09.845368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:10.140905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:10.154593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8d431bd-0a71-4fe5-a658-37c703f1a724 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1533 microversion: 2.1 time: 0.367498 Aug 03 04:36:10.169746 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 675/1325] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:09 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:10.216795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:10.226247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9faa0f74-5645-400a-bdcf-456f0ea53a05 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.532854 Aug 03 04:36:10.227329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 651/1326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:09 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:10.249209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7e0125ab-d5a0-4f32-b8b9-ee919b7e2ee6 req-6a2aa515-4943-4d44-b637-fd5910ca71ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e177ca7-4008-4345-9e66-b36e8b1e9c0c", "tag": "3a048de8-d942-45ac-ba50-253e71cc418f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:10.272432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7e0125ab-d5a0-4f32-b8b9-ee919b7e2ee6 req-6a2aa515-4943-4d44-b637-fd5910ca71ab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:10.277781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7e0125ab-d5a0-4f32-b8b9-ee919b7e2ee6 req-6a2aa515-4943-4d44-b637-fd5910ca71ab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:10.305994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7e0125ab-d5a0-4f32-b8b9-ee919b7e2ee6 req-6a2aa515-4943-4d44-b637-fd5910ca71ab service nova] Creating event network-changed:3a048de8-d942-45ac-ba50-253e71cc418f for instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c on n-h1-826756-5 Aug 03 04:36:10.316073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7e0125ab-d5a0-4f32-b8b9-ee919b7e2ee6 req-6a2aa515-4943-4d44-b637-fd5910ca71ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071201 Aug 03 04:36:10.316717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 676/1327] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:10.525949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:10.528674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:10.546014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:10.550535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:10.555217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:10.555815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:10.616542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:10.617316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:10.635735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:10.640569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:10.643561 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6cbbc7e7-f8df-4b0d-bc9f-948ca138da43 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123799 Aug 03 04:36:10.644146 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 652/1328] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:10 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:36:10.645117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:10.647095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.178629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:11.179926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:11.193152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.194606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.201371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.205486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.329212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:11.342089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33d095b6-cce9-4865-bb56-2bb187e9b058 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.730418 Aug 03 04:36:11.346076 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 677/1329] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:10 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:11.355320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:11.357698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:11.371446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.374547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.375438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.375893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.821487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:11.832491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-434540ca-46f8-4ae7-864b-dafa142b2785 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1533 microversion: 2.1 time: 0.659820 Aug 03 04:36:11.837938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 653/1330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:11 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1533 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:11.844633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:11.860006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:11.877821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.878279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.879283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:11.884971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:11.923427 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9100a49c-2d06-416a-935e-fe3166ea7cbd tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083897 Aug 03 04:36:11.924879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 654/1331] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:11 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:36:12.023292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-unplugged", "status": "completed", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:12.034679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.035383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.048367 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] Creating event network-vif-unplugged:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:36:12.054792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:36:12.062066 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f45ac48b-6cba-4d44-832a-9d19097d5147 req-4b6163fd-8e38-41ae-8829-c7262a25e92a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041954 Aug 03 04:36:12.063381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 655/1332] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:36:12.066432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:12.078376 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-79617d5e-d3bd-40d8-bb22-c1d33a96ef43 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.730993 Aug 03 04:36:12.081876 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 678/1333] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:11 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:12.367500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:12.368228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:12.376231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.377053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.378054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.378592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.539973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:12.549993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9df3cd0b-3dd9-444f-9a56-eabc4b5be94f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.186750 Aug 03 04:36:12.565421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 656/1334] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:12 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:12.862016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:12.863495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:12.879094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.881842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.882890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.885117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.937688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:12.939938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:12.957142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.958639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:12.962382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:12.964252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:13.016899 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26a8c4f7-2aab-4d07-b012-19edfc625ad3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.084305 Aug 03 04:36:13.018098 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 657/1335] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:12 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:36:13.024787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-188168354", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e756010b-d011-4207-b12b-b650b0572654"}], "security_groups": [{"name": "tempest-securitygroup--885898303"}], "key_name": "tempest-keypair-1227982397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:13.119813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=50 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:13.295152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=26 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:13.322941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] validate_networks() for [('e756010b-d011-4207-b12b-b650b0572654', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:36:13.452046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:13.464454 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89d9f2d9-5b87-4a0f-abfd-ef4d51dff5d5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1533 microversion: 2.1 time: 0.608539 Aug 03 04:36:13.479944 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 679/1336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:12 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1533 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:13.488897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:13.491652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:13.501408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:13.502090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:13.503136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:13.503734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:13.946549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:13.948923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:13.950739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=17 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:13.962926 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a296c242-719c-4e12-ae5e-f912944ef560 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.481450 Aug 03 04:36:13.968517 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 680/1337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:13 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:13.986213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:13.987200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:13.995414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:13.997105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:13.997670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:13.998334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.627099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:14.636383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a841d72c-f4aa-4318-952c-fe4b5fa14699 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.666304 Aug 03 04:36:14.636973 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 681/1338] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:13 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:14.642249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:14.644571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:14.651722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.652465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.653323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.653775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.687514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a47a7e6a-a211-4d60-9b63-3a902882224e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049243 Aug 03 04:36:14.688389 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 682/1339] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:14 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:36:14.693726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:14.696637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:14.706858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.707487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.708382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.709520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.771973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for project 8a6d1be80039482fbb9938e347e725d0. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:14.777715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for user ce2d52f829e4439596c8be348bb2f24a and project 8a6d1be80039482fbb9938e347e725d0. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:14.794007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:36:14.794435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:36:14.795061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:36:14.796211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:36:14.798025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:36:14.812381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.812381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.812381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:14.812381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:14.838442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for project 8a6d1be80039482fbb9938e347e725d0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:14.852511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Getting quotas for user ce2d52f829e4439596c8be348bb2f24a and project 8a6d1be80039482fbb9938e347e725d0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:14.881639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:36:14.884651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:36:15.157998 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-120c45cc-9c27-4438-8246-8a646b452a35 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.138651 Aug 03 04:36:15.159258 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 658/1340] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:36:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:36:15.165076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:15.165990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:15.175527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.176249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.187489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.187489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.516338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:15.532784 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74475f32-259c-4ec0-abcb-09107580a480 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.365423 Aug 03 04:36:15.533621 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 659/1341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:15 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:15.539110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af2fc937-f3b2-4ac8-a774-bdbf1a093ef2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:15.539907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af2fc937-f3b2-4ac8-a774-bdbf1a093ef2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:15.643855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af2fc937-f3b2-4ac8-a774-bdbf1a093ef2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:15.650659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af2fc937-f3b2-4ac8-a774-bdbf1a093ef2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1277 microversion: 2.1 time: 0.115808 Aug 03 04:36:15.651245 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 660/1342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:15 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:15.668035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:15.668690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:15.684850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.685309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.686594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.687185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.868789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:15.888439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4cde8ccd-ec9d-4719-9128-2a836ba6b215 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1533 microversion: 2.1 time: 1.198403 Aug 03 04:36:15.890995 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 683/1343] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:14 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1533 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:15.913110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:15.916256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:15.928978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.929481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.930305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:15.930756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:15.975432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:15.984476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08a9baa4-679c-4be4-a928-ef182348671e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.322815 Aug 03 04:36:15.984887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 661/1344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:15 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:15.988565 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29314f13-a70c-401a-8d81-1cd959b565c3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.096363 Aug 03 04:36:15.989387 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 684/1345] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:36:15 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:16.558417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:16.559266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:16.573641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.583940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.585160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.586532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.673819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:16.674648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:16.684605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.684605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.689970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.691027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.843170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:16.862612 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-69373c41-5048-4cd8-92dc-ee28f3ac929e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1281 microversion: 2.1 time: 0.188066 Aug 03 04:36:16.862612 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 685/1346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:16 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:16.911259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:16.911923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:16.923426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.929356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.929356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:16.929356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:16.994912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:17.012015 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41ae02d1-1e6c-447c-b051-9851adfc5a29 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1505 microversion: 2.1 time: 0.460082 Aug 03 04:36:17.012887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 662/1347] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:16 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:17.033311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:17.034151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:17.040879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.041564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.042556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.043253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.270857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:17.282935 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8172cf8-976a-4456-8443-ceba566392ca tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1526 microversion: 2.1 time: 0.374160 Aug 03 04:36:17.285606 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 686/1348] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:16 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1526 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:17.307161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:17.307872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:17.322658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.323605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.324588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.325184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.351581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:17.360613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d5f5825-b589-4f45-802c-0ba58f3c0089 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.332080 Aug 03 04:36:17.361323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 663/1349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:17 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:17.479023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:17.487887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3abb99a9-a766-4ece-a556-910a97fe09ff tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1526 microversion: 2.1 time: 0.184538 Aug 03 04:36:17.488956 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 687/1350] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:17 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:17.509865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1898fbb-774a-4f10-95a8-67c07c206772 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:17.511118 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:36:17.511118 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:36:17.526823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-f1898fbb-774a-4f10-95a8-67c07c206772 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] HTTP exception thrown: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1898fbb-774a-4f10-95a8-67c07c206772 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Request method failure captured: Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/flavors/ef9c53d3-2a04-49e1-b9f3-0b3546d8126a HTTP/1.1 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpgfVy8Vi4_Zn7F3UOrtQ_UJD6LlpEeSPir3DAveum8mGQg7F-L6EvgcgN21lmymLXRLJY1x21TVF6mtqI9JDNrL9YS7gYg8cH--ru7aTnlJ960ibMo6t9wtQMRNchmbyVsPYaWemrh3SvZAj3rJFaoXOfZMSybYdw_l7Cw-5XsYO0 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9091afc74ced4a8ea0d6d36df10744f3 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MigrationsAdminTest-1171050231 Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:36:17.537282 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9091afc74ced4a8ea0d6d36df10744f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9091afc74ced4a8ea0d6d36df10744f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9091afc74ced4a8ea0d6d36df10744f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9091afc74ced4a8ea0d6d36df10744f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MigrationsAdminTest-1171050231 Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9091afc74ced4a8ea0d6d36df10744f3 Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MigrationsAdminTest-1171050231 Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MigrationsAdminTest-1171050231-project-admin Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0df99a4af46b47128869ba41accf575b Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MigrationsAdminTest-1171050231-project-admin Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. Aug 03 04:36:17.539123 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ef9c53d3-2a04-49e1-b9f3-0b3546d8126a'} Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:17.540071 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. Aug 03 04:36:17.541718 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:17.543846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1898fbb-774a-4f10-95a8-67c07c206772 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Returning 404 to user: Flavor ef9c53d3-2a04-49e1-b9f3-0b3546d8126a could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:17.569478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1898fbb-774a-4f10-95a8-67c07c206772 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/ef9c53d3-2a04-49e1-b9f3-0b3546d8126a" status: 404 len: 109 microversion: 2.1 time: 0.047291 Aug 03 04:36:17.570840 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 664/1351] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:36:17 2022] DELETE /compute/v2.1/flavors/ef9c53d3-2a04-49e1-b9f3-0b3546d8126a => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:36:17.729625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-44148163", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:17.756315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:17.818686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:36:17.885644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:17.886405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:17.899025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.902839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.905202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:17.905761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:17.911386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:18.091380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:18.102481 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90632a51-dee9-4c2f-bbb5-5852cb7c4139 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1329 microversion: 2.1 time: 0.217445 Aug 03 04:36:18.102481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 665/1352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:17 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:18.106002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:18.106617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:18.113796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.114512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.115468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.115906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.676838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:36:18.678992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:36:18.680804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:36:18.681324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:36:18.681810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:36:18.699267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.700130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.700782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:18.705364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.706206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.712370 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-626214c9-1d17-47bb-9c02-aa1cd1e638c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1480 microversion: 2.1 time: 0.610884 Aug 03 04:36:18.715241 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 666/1353] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:18 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1480 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:18.745685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b07e4ff9-3980-43b4-8d1f-815374a28fa3 req-b94d8bae-ddfa-4733-84ce-61bdd939a030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-plugged", "status": "completed", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:18.772798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:18.781327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:18.784250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b07e4ff9-3980-43b4-8d1f-815374a28fa3 req-b94d8bae-ddfa-4733-84ce-61bdd939a030 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.784724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b07e4ff9-3980-43b4-8d1f-815374a28fa3 req-b94d8bae-ddfa-4733-84ce-61bdd939a030 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.790441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Getting quotas for user 1f75c9c3239c4b89a6b7971eec9f1a99 and project 2752ea34ebaa422989bf3d4f13f1a103. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:18.818930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:36:18.823363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:36:18.833695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b07e4ff9-3980-43b4-8d1f-815374a28fa3 req-b94d8bae-ddfa-4733-84ce-61bdd939a030 service nova] Creating event network-vif-plugged:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:36:18.851362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b07e4ff9-3980-43b4-8d1f-815374a28fa3 req-b94d8bae-ddfa-4733-84ce-61bdd939a030 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121294 Aug 03 04:36:18.853754 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 667/1354] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:18.874153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:18.875535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:18.891794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.899505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:18.908092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:18.912588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:19.015029 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ef4c1a0-2af5-4d5e-85ce-c042c4f172d9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288918 Aug 03 04:36:19.016363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 688/1355] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:36:19.022681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb2d41ad-15df-438a-aa0e-d9bf8ff78231 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '.version_select at 0x7fdd5519d5e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:19.027848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb2d41ad-15df-438a-aa0e-d9bf8ff78231 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:19.029009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb2d41ad-15df-438a-aa0e-d9bf8ff78231 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:19.044203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb2d41ad-15df-438a-aa0e-d9bf8ff78231 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.024941 Aug 03 04:36:19.046293 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 689/1356] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:36:19 2022] GET /compute/v2.1/os-migrations => generated 3112 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:19.054083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a09a3aef-4c61-4015-b392-8b6af93061f2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:19.054997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a09a3aef-4c61-4015-b392-8b6af93061f2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:19.316043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a09a3aef-4c61-4015-b392-8b6af93061f2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:19.328016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a09a3aef-4c61-4015-b392-8b6af93061f2 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1211 microversion: 2.1 time: 0.279963 Aug 03 04:36:19.328968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 690/1357] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:19 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1211 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:19.333348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:19.333960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:19.350497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:19.350971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:19.351766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:19.354252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:20.269634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:20.269634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4dc4656-60cd-46ae-a885-3c4236d855d6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 1.375167 Aug 03 04:36:20.269634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 668/1358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:18 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:20.269634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:20.277561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:20.277561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:20.277561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:20.277561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:20.291828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:20.344760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ae6406e-5565-4498-b603-d1815f595912 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1631 microversion: 2.1 time: 1.014577 Aug 03 04:36:20.346021 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 691/1359] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:19 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1631 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:20.350587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b01a6ad2-b40d-4943-b2a9-b66992411666 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:20.351221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b01a6ad2-b40d-4943-b2a9-b66992411666 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:20.436913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b01a6ad2-b40d-4943-b2a9-b66992411666 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:20.455906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b01a6ad2-b40d-4943-b2a9-b66992411666 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1211 microversion: 2.1 time: 0.109102 Aug 03 04:36:20.457550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 692/1360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:20 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:20.463922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9c00824-a501-4ac2-a9aa-519cebd4e6e6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: .version_select at 0x7fdd550dc940>, body: {"keypair": {"name": "tempest-keypair-1209196570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQEwz6fFq8/pEDXYMolhdcXX1+whF+WSj/0Xj5S1emxSYrS+0CJU+7p9EAu5CZJfcwijoZzsFf+MIOQjqYooqAe8qplTGG+20Ass4GPFGBZON7GCtddfFaeiea2oaA3rA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:20.512360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a9c00824-a501-4ac2-a9aa-519cebd4e6e6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for project a22d07c060aa4335b68d9362ad62d31c. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:20.521447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a9c00824-a501-4ac2-a9aa-519cebd4e6e6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for user ef84ed9611c449ec8ee31cf936faeb75 and project a22d07c060aa4335b68d9362ad62d31c. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:20.722906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9c00824-a501-4ac2-a9aa-519cebd4e6e6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.264753 Aug 03 04:36:20.723649 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 693/1361] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:21.254323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:21.272419 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbd91eee-9164-41c5-a44e-bd6553ee72a1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1335 microversion: 2.1 time: 1.040504 Aug 03 04:36:21.274367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:21.275471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:21.278289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 669/1362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:20 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1335 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:21.292098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:21.293034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:21.294129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:21.296902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:21.479264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:21.479896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:21.489848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:21.503357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:21.503357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:21.511338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:21.806024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:21.825661 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc2eb3b5-e385-41cf-b56e-3d8f17abd662 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1215 microversion: 2.1 time: 0.350369 Aug 03 04:36:21.843927 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 670/1363] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:21 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:22.080042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:22.106831 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71774f6c-406d-4c01-acbf-0a70049a38c7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.831543 Aug 03 04:36:22.122078 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 694/1364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:21 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:22.302132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:22.303351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:22.316567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:22.317086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:22.317909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:22.318347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:22.547641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:22.562711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c87ae72a-05bb-42d3-bb52-85364573bd79 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1335 microversion: 2.1 time: 0.265693 Aug 03 04:36:22.567562 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 671/1365] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:22 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1335 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:22.851481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:22.852513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:22.860705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:22.861618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:22.862958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:22.863576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:23.076776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:23.088358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-446a4252-fcda-4ecd-b477-8342b6cec334 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1263 microversion: 2.1 time: 0.241819 Aug 03 04:36:23.102202 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 695/1366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:22 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:23.133273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:23.133903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:23.143705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:23.144334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:23.149556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:23.150020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:23.588350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:23.589085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:23.596440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:23.597692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:23.599035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:23.600525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:23.832472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:23.845361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-240811d1-83b7-4290-a485-0f55be98744c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.715977 Aug 03 04:36:23.848905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 672/1367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:23 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:24.102257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:24.111573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:24.112615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:24.122651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:24.122651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:24.126909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:24.131874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:24.137526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9856af45-8945-483e-89e3-3c85f9782445 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.550737 Aug 03 04:36:24.152735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 696/1368] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:23 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:24.260763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:24.272369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-291d48d1-01cc-44ce-be0a-268f752f23a9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1269 microversion: 2.1 time: 0.164943 Aug 03 04:36:24.273657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 673/1369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:24 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:24.531174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-682730285", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "da7926bc-1605-4375-ae40-4ba35e5d1b81"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:24.606047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] validate_networks() for [('da7926bc-1605-4375-ae40-4ba35e5d1b81', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:36:24.864944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:24.869914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:24.870927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:24.880968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:24.883562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:24.889257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:24.890428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:24.891051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:25.650698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:25.957634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:25.972653 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8663fdbf-941a-4505-ab2f-7908195463e2 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 1.109303 Aug 03 04:36:25.984551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 674/1370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:24 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:25.996008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:25.996649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:26.030301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:26.031183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:26.032287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:26.034135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.070315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:36:27.080679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:36:27.084001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:36:27.084001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:36:27.084001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:36:27.103179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.103561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.112788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.112788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.163552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:27.171757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for user 1ef5280a59af4ef09aa3e84ec74e1b61 and project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:27.223591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:36:27.225939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:36:27.278465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:27.313635 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79c68b47-8032-4808-89fe-df8f87761184 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 1.327837 Aug 03 04:36:27.319788 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 675/1371] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:25 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:27.332162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:27.332902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:27.361317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.361906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.364113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.364773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.499127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c017c3f-12e9-4b1b-864a-3ea78ccded8c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.079066 Aug 03 04:36:27.505715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 697/1372] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:36:27.512014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-082afc88-627e-4077-9a35-ed833458785e req-98a96d13-2ffc-40fc-9898-09ee57fe7548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4", "tag": "3fde4f72-9ca1-48e5-a086-928bf514d2ce"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:27.565092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-082afc88-627e-4077-9a35-ed833458785e req-98a96d13-2ffc-40fc-9898-09ee57fe7548 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.568576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-082afc88-627e-4077-9a35-ed833458785e req-98a96d13-2ffc-40fc-9898-09ee57fe7548 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.609981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-082afc88-627e-4077-9a35-ed833458785e req-98a96d13-2ffc-40fc-9898-09ee57fe7548 service nova] Creating event network-changed:3fde4f72-9ca1-48e5-a086-928bf514d2ce for instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 on n-h1-826756-5 Aug 03 04:36:27.625194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-082afc88-627e-4077-9a35-ed833458785e req-98a96d13-2ffc-40fc-9898-09ee57fe7548 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117831 Aug 03 04:36:27.631926 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 698/1373] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:27.643535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:27.644582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:27.668475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.670683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:27.677374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:27.677846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:28.182664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:28.193057 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6df0afdb-4ecb-4c36-b6c2-89883404b523 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.565391 Aug 03 04:36:28.195037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 699/1374] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:27 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:28.199832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9bd3fe73-4b86-4623-90ce-66f9beef51a2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:28.203487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9bd3fe73-4b86-4623-90ce-66f9beef51a2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:28.218980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:28.232025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-924dc5e8-d825-480d-a23e-45fee15bf7ce tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.908663 Aug 03 04:36:28.235011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 676/1375] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:27 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:28.345248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:28.347746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:28.352236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bd3fe73-4b86-4623-90ce-66f9beef51a2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:28.367630 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9bd3fe73-4b86-4623-90ce-66f9beef51a2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1224 microversion: 2.1 time: 0.168886 Aug 03 04:36:28.368151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:28.368641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:28.380565 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 700/1376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:28 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1224 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:28.380669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:28.380669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:28.650640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:28.666023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11bfc5c6-a275-4a24-8a90-0f4ce210623c tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.331921 Aug 03 04:36:28.667650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 677/1377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:28 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:28.970011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f96fbdcc-76bd-46b8-ad01-6b2caa7508aa req-6e262bca-fedb-42ca-bb9e-4e695cc48bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:29.047903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f96fbdcc-76bd-46b8-ad01-6b2caa7508aa req-6e262bca-fedb-42ca-bb9e-4e695cc48bcb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.050772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f96fbdcc-76bd-46b8-ad01-6b2caa7508aa req-6e262bca-fedb-42ca-bb9e-4e695cc48bcb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.072663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f96fbdcc-76bd-46b8-ad01-6b2caa7508aa req-6e262bca-fedb-42ca-bb9e-4e695cc48bcb service nova] Creating event network-changed:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:36:29.079101 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f96fbdcc-76bd-46b8-ad01-6b2caa7508aa req-6e262bca-fedb-42ca-bb9e-4e695cc48bcb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114961 Aug 03 04:36:29.080507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 701/1378] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:29.220952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:29.221626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:29.246307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.246751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.249476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.250289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.256768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:29.257498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:29.274581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.275274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.276246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.281219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.647396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:29.656629 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc74e2cc-9329-4880-90fb-89c3b7b1c9a8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.404651 Aug 03 04:36:29.658413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 702/1379] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:29 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:29.667202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:29.667859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:29.675613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:29.685649 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7350c260-4d40-4630-b62c-55a7f6d408da tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.469830 Aug 03 04:36:29.689184 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 678/1380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:29 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:29.693277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.693742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.699761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.703137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-64874179", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d3daf729-08e1-47de-b3ca-43c48307355d"}], "security_groups": [{"name": "tempest-securitygroup--2107717852"}], "key_name": "tempest-keypair-1209196570", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:29.704918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.832674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:29.858480 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7038db10-95fe-44af-97df-c9f55e19419e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1228 microversion: 2.1 time: 0.198614 Aug 03 04:36:29.864432 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 703/1381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:29 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1228 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:29.877885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:29.878781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:29.893433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.894282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:29.896927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:29.897551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:30.048583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] validate_networks() for [('d3daf729-08e1-47de-b3ca-43c48307355d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:36:30.430226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:30.443420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:30.446516 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0af02b35-500a-4eb7-a195-4458aab25c2d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.572523 Aug 03 04:36:30.447845 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 704/1382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:29 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:30.680684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:30.681770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:30.698467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:30.698944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:30.699730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:30.700229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.040924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:36:31.041454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:36:31.041832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:36:31.042511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:36:31.046329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:36:31.062301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.062828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:31.064105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.065207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.065881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.074889 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45b42a4a-b474-43ae-9f55-e713a8dae125 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.395904 Aug 03 04:36:31.074889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 705/1383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:30 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:31.078463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:31.079095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:31.085285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.086037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.087030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.087815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.102432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:36:31.108919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for user ef84ed9611c449ec8ee31cf936faeb75 and project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:36:31.127553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:36:31.130054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:36:31.325536 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d309d03a-5d85-4733-9110-14968fabf0e2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.634801 Aug 03 04:36:31.327003 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 679/1384] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:36:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:36:31.356375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:31.364881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:31.394833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.395301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.399089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.399550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.687006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:31.717778 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1fb02db8-c1dd-4b6d-b7ab-adba780da8ca tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1497 microversion: 2.1 time: 0.640347 Aug 03 04:36:31.721968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 706/1385] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:31 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1497 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:31.739708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:31.759523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:31.760352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Searching by: {'deleted': False, 'project_id': '4fb4861a8384459d891519fa39e47b4e'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:36:31.780928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.782019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.782796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:31.785406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:31.815119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:31.827381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e35f84f0-6668-404b-8592-defe330d3e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1284 microversion: 2.1 time: 0.494285 Aug 03 04:36:31.830426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 680/1386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:31 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1284 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:31.845774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ee57342-26dd-4437-b298-a0126cfd0e6e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:31.846399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ee57342-26dd-4437-b298-a0126cfd0e6e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:32.021691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:36:32.094412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ee57342-26dd-4437-b298-a0126cfd0e6e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:32.106731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ee57342-26dd-4437-b298-a0126cfd0e6e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1233 microversion: 2.1 time: 0.274638 Aug 03 04:36:32.109151 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 681/1387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:31 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1233 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:32.125100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:32.126057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:32.148981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.148981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.150545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.151136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.160289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bfc4d17e-3730-48a1-87d5-96ffb7eba562 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.436932 Aug 03 04:36:32.164797 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 707/1388] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:36:31 2022] GET /compute/v2.1/servers => generated 333 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:32.173615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:32.179977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:32.199318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.201692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.207552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.210588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.599211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:32.609226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73cbaf2e-4580-45df-ab61-3317be788883 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.440794 Aug 03 04:36:32.624344 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 708/1389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:32 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:32.629381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:32.653693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:32.655107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Searching by: {'deleted': False, 'project_id': '4fb4861a8384459d891519fa39e47b4e'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:36:32.661277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.661738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.662559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.663004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.665123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:32.673247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84c5adde-1e3f-4a01-ba3d-9204a721a4b2 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.559296 Aug 03 04:36:32.673847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 682/1390] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:32 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:32.704838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:36:32.768682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:32.772397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:32.787371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.788200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.789237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.790525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:32.814495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:32.829913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:32.830759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.220498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:33.236148 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3763fc7-4259-426f-ac6c-613dc1cef7eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 200 len: 1474 microversion: 2.1 time: 0.477948 Aug 03 04:36:33.250206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4891fd28-dfac-416b-95d8-2ae3f4c53765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.615563 Aug 03 04:36:33.250206 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 709/1391] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:36:32 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:33.253761 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 683/1392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:32 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 1474 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:33.265538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:33.276604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:33.276883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:33.276883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:33.277698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.278268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.280420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.281122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.284522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.285172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.286131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.286770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.290161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:33.455086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:33.464109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f73bb58-dffd-4ae7-934b-579396339429 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1237 microversion: 2.1 time: 0.208690 Aug 03 04:36:33.481335 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 684/1393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:33 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1237 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:33.495492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-788925356"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:33.504553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:33.520827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.521779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.524121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.526208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.802030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:33.811471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23ba0617-1a2b-412c-8325-8e873e1ab306 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 0.566934 Aug 03 04:36:33.812094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 710/1394] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:33 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:33.820527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2962c1b6-5729-48ce-9726-b9eda9b07765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:33.835212 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2962c1b6-5729-48ce-9726-b9eda9b07765 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018365 Aug 03 04:36:33.836384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 711/1395] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:36:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:33.843108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:33.843108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:33.875724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.881244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:33.882480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:33.889213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.252584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:34.265750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9057b66e-c119-4f15-a7d4-3e07a4c792f7 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13/action" status: 202 len: 0 microversion: 2.1 time: 0.782120 Aug 03 04:36:34.277963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 685/1396] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:36:33 2022] POST /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:36:34.280925 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd35f175-04ff-4657-8d97-1e02e80e7257 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.439938 Aug 03 04:36:34.281763 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 712/1397] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:33 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:34.286271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:34.286771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:34.308442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:34.308442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:34.343243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.343706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.344551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.345086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.350417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.350873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.355647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.362672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.467298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:36:34.726777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:34.740206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d69c10d-2c0e-4113-b2a2-2ae4127f4c3a tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.455858 Aug 03 04:36:34.741093 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 686/1398] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:34 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:34.750149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79f3f654-8a32-42d9-b328-45b1fb1f39a6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54809670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:34.838321 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79f3f654-8a32-42d9-b328-45b1fb1f39a6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.095382 Aug 03 04:36:34.847263 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 687/1399] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:34 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:34.852216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:34.853850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:34.861574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.864027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.864027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.864027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:34.949467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:34.963576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97a947b9-5a71-444b-8e25-cf37099b77b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1293 microversion: 2.1 time: 0.115003 Aug 03 04:36:34.966778 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 688/1400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:34 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:34.975680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:34.976360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:34.995482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:34.995940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.002175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.002746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.005853 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8a19890-6f98-4fd2-88d1-2279dc58969b tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 204 len: 0 microversion: 2.1 time: 0.722984 Aug 03 04:36:35.007734 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 713/1401] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:36:34 2022] DELETE /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:36:35.017977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:35.020060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:35.041599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.051518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.051518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.051518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.557568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:35.566895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97ebe0d3-e7f7-4b62-bd6f-8f40404a1fa7 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 0.598626 Aug 03 04:36:35.568540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 689/1402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:34 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:35.591606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:35.593666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:35.606467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.607644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.608993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.610144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.682877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:35.702827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1f7b9ea5-d912-418c-9f7a-1319dc16ea89 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1700 microversion: 2.1 time: 0.690760 Aug 03 04:36:35.703736 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 714/1403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:35 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1700 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:35.764595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:35.765202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:35.791723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.793866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:35.795814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:35.797292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:36.592108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:36.601833 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be704e0e-c32a-45e5-8151-041e7761ccc5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 1.028088 Aug 03 04:36:36.618232 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 690/1404] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:35 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:36.634813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7746e8ec-ca4d-4363-acb6-38aae187beac tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5479d0d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:36.724001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:36.724524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7746e8ec-ca4d-4363-acb6-38aae187beac tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.104571 Aug 03 04:36:36.733271 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 691/1405] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:36 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:36.737324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b338b1de-42ff-4d88-95e1-16fca3ffb7e1 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 0.978451 Aug 03 04:36:36.739880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 715/1406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:35 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:36.756987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-630e9898-a00d-4054-b1af-6eaee5159f1a req-88196266-ead6-420b-aa14-ee6c9fa73045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4", "name": "network-vif-plugged", "status": "completed", "tag": "3fde4f72-9ca1-48e5-a086-928bf514d2ce"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:36.765635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:36.766258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:36.775553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:36.781342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:36.781342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:36.781342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:36.781660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:36.785615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-630e9898-a00d-4054-b1af-6eaee5159f1a req-88196266-ead6-420b-aa14-ee6c9fa73045 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:36.787013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-630e9898-a00d-4054-b1af-6eaee5159f1a req-88196266-ead6-420b-aa14-ee6c9fa73045 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:36.804673 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-630e9898-a00d-4054-b1af-6eaee5159f1a req-88196266-ead6-420b-aa14-ee6c9fa73045 service nova] Creating event network-vif-plugged:3fde4f72-9ca1-48e5-a086-928bf514d2ce for instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 on n-h1-826756-5 Aug 03 04:36:36.811448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-630e9898-a00d-4054-b1af-6eaee5159f1a req-88196266-ead6-420b-aa14-ee6c9fa73045 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069862 Aug 03 04:36:36.815717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 716/1407] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:36.822705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:36.823581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:36.837012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:36.838168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:36.839032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:36.839531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:37.047969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:37.067382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29278dc5-2482-4566-b223-a3177abc4335 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1291 microversion: 2.1 time: 0.303471 Aug 03 04:36:37.069869 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 692/1408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:36 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1291 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:37.086174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7f561d79-e172-4a48-a14b-d6c717534d44 req-e83b271c-1de3-4d43-bc89-18e18748ed8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0edcdf-4dc5-4c2e-ab00-88c093204244", "tag": "bd2e4926-9eac-49e1-aabf-8ad092e4e457"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:37.126486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7f561d79-e172-4a48-a14b-d6c717534d44 req-e83b271c-1de3-4d43-bc89-18e18748ed8f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:37.131804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7f561d79-e172-4a48-a14b-d6c717534d44 req-e83b271c-1de3-4d43-bc89-18e18748ed8f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:37.165063 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7f561d79-e172-4a48-a14b-d6c717534d44 req-e83b271c-1de3-4d43-bc89-18e18748ed8f service nova] Creating event network-changed:bd2e4926-9eac-49e1-aabf-8ad092e4e457 for instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 on n-h1-826756-5 Aug 03 04:36:37.191045 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7f561d79-e172-4a48-a14b-d6c717534d44 req-e83b271c-1de3-4d43-bc89-18e18748ed8f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107578 Aug 03 04:36:37.191344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 693/1409] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:37.212619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:37.215240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:37.240297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:37.244343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:37.244343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:37.244343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:37.681716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:37.702504 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f274b0f-a85d-4539-847e-5ea58ecd72d2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 0.873430 Aug 03 04:36:37.709930 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 717/1410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:36 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:37.726846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:37.732176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:37.753310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:37.760065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:37.760065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:37.760065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:38.405555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:38.428559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b50cc34-2749-4818-a16e-c10efd1a8318 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1700 microversion: 2.1 time: 1.227134 Aug 03 04:36:38.428559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 694/1411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:37 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1700 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:38.433234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3640034b-5061-45a4-9b0b-573184d9da21 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5475c670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:38.445189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:38.469492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f86a4bf8-4ac5-422f-a9e6-9b6f9ee43385 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.758833 Aug 03 04:36:38.487922 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 718/1412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:37 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:38.503616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:38.503616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:38.515782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:38.517546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:38.519295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:38.520546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:38.619515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3640034b-5061-45a4-9b0b-573184d9da21 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.192439 Aug 03 04:36:38.620103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 695/1413] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:38 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:38.649655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:38.650608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:38.667882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:38.668636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:38.670539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:38.671173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.094859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:40.110596 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-670c39cc-3547-4af5-989b-742fe9b2020f tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1402 microversion: 2.1 time: 1.621187 Aug 03 04:36:40.124100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 719/1414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:38 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1402 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:40.132877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:40.134364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:40.141717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.142579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.143614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.145190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.168582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:40.213103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:40.243064 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e587cfb-0815-4b3d-a67c-6813aab8896f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 1.598700 Aug 03 04:36:40.245775 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 696/1415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:38 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:40.257332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d6f2b03b-6e3e-4f60-b90c-d500c6a4d7e6 req-a8f00fc9-a384-4df6-8d0f-8036ba7b7365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-plugged", "status": "completed", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:40.311147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d6f2b03b-6e3e-4f60-b90c-d500c6a4d7e6 req-a8f00fc9-a384-4df6-8d0f-8036ba7b7365 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.311533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d6f2b03b-6e3e-4f60-b90c-d500c6a4d7e6 req-a8f00fc9-a384-4df6-8d0f-8036ba7b7365 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.694822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:40.709586 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bace7e9e-b241-4d52-ba54-5b30f33d7038 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 0.584196 Aug 03 04:36:40.713174 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 720/1416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:40 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:40.723149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:40.724122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:40.745189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.748553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.749930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.752697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.752857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d6f2b03b-6e3e-4f60-b90c-d500c6a4d7e6 req-a8f00fc9-a384-4df6-8d0f-8036ba7b7365 service nova] Creating event network-vif-plugged:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:36:40.771001 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d6f2b03b-6e3e-4f60-b90c-d500c6a4d7e6 req-a8f00fc9-a384-4df6-8d0f-8036ba7b7365 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.523888 Aug 03 04:36:40.781559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 697/1417] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:40.795747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:40.800198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:40.817085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.818796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.822090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:40.822926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:40.963906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:40.985778 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d75faa1-23f7-4e17-a443-a33f4d271b35 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1633 microversion: 2.1 time: 0.264162 Aug 03 04:36:40.988204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 721/1418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:40 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1633 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:40.999735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-87930109-8386-4109-82f4-8ab84afda252 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5519d820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:41.078831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:41.181709 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-87930109-8386-4109-82f4-8ab84afda252 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.190621 Aug 03 04:36:41.189241 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 722/1419] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:40 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:41.195535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:41.196786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:41.218205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.218205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.223284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.227521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.341511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:41.353826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc0378c5-b19f-4757-a169-a3b6cbfd333a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1311 microversion: 2.1 time: 0.580751 Aug 03 04:36:41.376631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 698/1420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:40 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1311 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:41.378622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fff4b95d-a2b4-4745-9a33-f76dc4ef9746 req-aec153f2-c22c-4dc2-9530-1fd35f609856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7768f510-7bf4-476d-86ae-5e497506f219", "name": "network-vif-deleted", "tag": "ce3f669c-f4df-4fb6-a916-6836bb7b4ac9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:41.394422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fff4b95d-a2b4-4745-9a33-f76dc4ef9746 req-aec153f2-c22c-4dc2-9530-1fd35f609856 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.395154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fff4b95d-a2b4-4745-9a33-f76dc4ef9746 req-aec153f2-c22c-4dc2-9530-1fd35f609856 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.411633 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fff4b95d-a2b4-4745-9a33-f76dc4ef9746 req-aec153f2-c22c-4dc2-9530-1fd35f609856 service nova] Creating event network-vif-deleted:ce3f669c-f4df-4fb6-a916-6836bb7b4ac9 for instance 7768f510-7bf4-476d-86ae-5e497506f219 on n-h1-826756-5 Aug 03 04:36:41.424307 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fff4b95d-a2b4-4745-9a33-f76dc4ef9746 req-aec153f2-c22c-4dc2-9530-1fd35f609856 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057689 Aug 03 04:36:41.425442 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 699/1421] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:41.444791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:41.445859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:41.454608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.455295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.456782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.457763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.578713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:41.589951 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a89deff-6967-42ff-8ad7-7eddc184b1b0 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1589 microversion: 2.1 time: 0.398052 Aug 03 04:36:41.591717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 723/1422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:41 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1589 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:41.614968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:41.615673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:41.623020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.623725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.624826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.625491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.814555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1c07047-4a09-4055-8afd-c104ca3a16da tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204608 Aug 03 04:36:41.824599 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 724/1423] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:36:41 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:36:41.853592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:41.876538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5bc1a271-39ba-42e7-9f17-91bcc2a4f894 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 0.437342 Aug 03 04:36:41.895120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 700/1424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:41 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:41.905663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:41.906298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:41.927032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.929264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:41.935133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:41.935133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:42.101361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:42.124667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-88e675a7-8600-4785-bb5f-85d4200be425 req-7df65010-0f74-478c-a8f4-226f69b1938b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:42.163769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-88e675a7-8600-4785-bb5f-85d4200be425 req-7df65010-0f74-478c-a8f4-226f69b1938b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:42.165273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-88e675a7-8600-4785-bb5f-85d4200be425 req-7df65010-0f74-478c-a8f4-226f69b1938b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:42.189767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-88e675a7-8600-4785-bb5f-85d4200be425 req-7df65010-0f74-478c-a8f4-226f69b1938b service nova] Creating event network-changed:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h2-826756-5 Aug 03 04:36:42.199757 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-88e675a7-8600-4785-bb5f-85d4200be425 req-7df65010-0f74-478c-a8f4-226f69b1938b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373546 Aug 03 04:36:42.201725 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 725/1425] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:42.209252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:42.219923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:42.221442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:42.222818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:42.223823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:42.225709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:42.678168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:42.814966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=24 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:43.015545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:43.034199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71bef7a0-b87b-4107-974a-580e48c1cc0a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 1.129980 Aug 03 04:36:43.038264 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 701/1426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:41 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:43.063641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a7b3741-4136-4b45-9090-9a0a6fd2500f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54741280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:43.187317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d74e823c974fb4a6cd91c467470e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb4861a8384459d891519fa39e47b4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:43.192557 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a7b3741-4136-4b45-9090-9a0a6fd2500f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.150685 Aug 03 04:36:43.193728 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 702/1427] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:43 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:43.203717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:43.206268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:43.212188 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2250251f-09ee-4340-bcf9-fa2e1e7226ab tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 200 len: 1353 microversion: 2.1 time: 1.009021 Aug 03 04:36:43.213938 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 726/1428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:42 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 1353 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:43.224249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9e2be282-2d3a-4c16-82cf-3a9cc1e6de4b req-f744fffe-808c-4aaa-a92a-44a009242695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf6f5e-4e1f-421b-8529-bc0295fe7a13", "name": "network-vif-plugged", "status": "completed", "tag": "70652a52-cff6-40ac-b702-a2e8428ac96e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:43.233639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:43.234083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:43.243115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9e2be282-2d3a-4c16-82cf-3a9cc1e6de4b req-f744fffe-808c-4aaa-a92a-44a009242695 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:43.245287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9e2be282-2d3a-4c16-82cf-3a9cc1e6de4b req-f744fffe-808c-4aaa-a92a-44a009242695 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:43.253515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:43.255549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:43.312077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9e2be282-2d3a-4c16-82cf-3a9cc1e6de4b req-f744fffe-808c-4aaa-a92a-44a009242695 service nova] Creating event network-vif-plugged:70652a52-cff6-40ac-b702-a2e8428ac96e for instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 on n-h2-826756-5 Aug 03 04:36:43.330903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9e2be282-2d3a-4c16-82cf-3a9cc1e6de4b req-f744fffe-808c-4aaa-a92a-44a009242695 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115172 Aug 03 04:36:43.338036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 727/1429] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:43.359007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:43.361514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:43.378069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:43.380774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:43.381665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:43.382401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:46.032560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:46.056919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c980eab2-7d3c-425e-b124-81fcce73bb3f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 2.713854 Aug 03 04:36:46.057522 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 728/1430] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:43 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:46.082881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:46.088440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:46.089384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:46.096132 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44712d56-6755-4b94-a947-8c8313ba3f44 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1461 microversion: 2.1 time: 2.901155 Aug 03 04:36:46.113517 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 703/1431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:43 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1461 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:46.122598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:46.125927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:46.127824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:46.130024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18c60726-1ee8-451a-b04e-edbe7d28202f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd547b13a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:46.132980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.127104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:47.139234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f18987cc-80ee-4f82-a6da-1e02e4372dc4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 1.075865 Aug 03 04:36:47.139886 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 729/1432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:46 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:47.163030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:47.163803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] [instance: 7768f510-7bf4-476d-86ae-5e497506f219] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:47.182284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.182842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.183811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.184384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.260667 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] HTTP exception thrown: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Request method failure captured: Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 HTTP/1.1 Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fsKPCojQqZARnqKMeg3_qPtY5jJMyB1LOln_eC1wFppTlcnmBqZciQm8c1f11N79jN8j4wzqZQUDcXSTJ-oropQbCmwLtrFRtyIRs5FwqB0H7vRNPrRnbqf_ZQfrUxQUj84A7fTFy9q8xnTyV3_UbG8tQqx28Af9ME5j96RPQOyWHM Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 4fb4861a8384459d891519fa39e47b4e Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-1928293419 Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:36:47.263297 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4fb4861a8384459d891519fa39e47b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4fb4861a8384459d891519fa39e47b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4fb4861a8384459d891519fa39e47b4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4fb4861a8384459d891519fa39e47b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-1928293419 Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 4fb4861a8384459d891519fa39e47b4e Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-1928293419 Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-1928293419-project Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: a2d74e823c974fb4a6cd91c467470e3f Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-1928293419-project Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. Aug 03 04:36:47.265108 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '7768f510-7bf4-476d-86ae-5e497506f219'} Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:47.265944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. Aug 03 04:36:47.267298 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:36:47.268607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Returning 404 to user: Instance 7768f510-7bf4-476d-86ae-5e497506f219 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:47.268607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fd14ecd-a8fc-4942-b0ef-29df8a565a1d tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219" status: 404 len: 111 microversion: 2.1 time: 0.112808 Aug 03 04:36:47.276760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 730/1433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:47 2022] GET /compute/v2.1/servers/7768f510-7bf4-476d-86ae-5e497506f219 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:36:47.286734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:47.287373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:47.304775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.305239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.306081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.310368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.851530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbbfca4a-4867-4a85-b58f-3f42cc418034 tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1612 microversion: 2.1 time: 0.573499 Aug 03 04:36:47.852217 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 731/1434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:47 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1612 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:47.871242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:47.880647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:47.907377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.907944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:47.909410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:47.909928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:48.223398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:48.231555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-537fae17-d7a7-4bda-8e5a-5133af0b3e96 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 0.367000 Aug 03 04:36:48.232143 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 732/1435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:47 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:48.279291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e03db16f-6f91-4414-92c6-99e062c15593 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] Calling method '.version_select at 0x7fdd54dcc820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:48.423828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e03db16f-6f91-4414-92c6-99e062c15593 tempest-ServersTestJSON-1928293419 tempest-ServersTestJSON-1928293419-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887300322" status: 202 len: 0 microversion: 2.1 time: 0.172367 Aug 03 04:36:48.427631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 733/1436] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887300322 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:36:48.434855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:48.436723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:48.463067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:48.465642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:48.476191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:48.476897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.176025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:49.186257 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-109c100f-121d-495f-af56-bcfd16f7840d tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1589 microversion: 2.1 time: 0.757451 Aug 03 04:36:49.189753 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 734/1437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:48 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1589 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:49.195991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8297c518-0bb1-47ef-aeaf-8916dc6f995a req-9bd3bb87-911b-42a5-ba98-7fcef23f1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4", "tag": "3fde4f72-9ca1-48e5-a086-928bf514d2ce"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:49.206649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8297c518-0bb1-47ef-aeaf-8916dc6f995a req-9bd3bb87-911b-42a5-ba98-7fcef23f1e2a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:49.207369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8297c518-0bb1-47ef-aeaf-8916dc6f995a req-9bd3bb87-911b-42a5-ba98-7fcef23f1e2a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.224643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8297c518-0bb1-47ef-aeaf-8916dc6f995a req-9bd3bb87-911b-42a5-ba98-7fcef23f1e2a service nova] Creating event network-changed:3fde4f72-9ca1-48e5-a086-928bf514d2ce for instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 on n-h1-826756-5 Aug 03 04:36:49.238577 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8297c518-0bb1-47ef-aeaf-8916dc6f995a req-9bd3bb87-911b-42a5-ba98-7fcef23f1e2a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047554 Aug 03 04:36:49.242105 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 735/1438] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:49.248455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:49.254254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:49.256927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:49.257889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.260349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:49.261062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.333402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0df99a4af46b47128869ba41accf575b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9091afc74ced4a8ea0d6d36df10744f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:49.334357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] flavor_id is None. Assuming migration. {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 04:36:49.350836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 04:36:49.548654 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18c60726-1ee8-451a-b04e-edbe7d28202f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 3.433510 Aug 03 04:36:49.550815 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 704/1439] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:46 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 3436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:49.570845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:49.573706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:49.593292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:49.595880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.599395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:49.600086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:49.921250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1339a1bd-b71e-46d8-b521-c21e98abbd4b tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963/action" status: 202 len: 0 microversion: 2.1 time: 0.677334 Aug 03 04:36:49.930094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 736/1440] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:36:49 2022] POST /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:36:50.153387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f5af41e8-f899-43b2-86c6-bf8c920f4085 req-f228f422-a6a1-4bbf-ad3e-44a821af6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0edcdf-4dc5-4c2e-ab00-88c093204244", "name": "network-vif-plugged", "status": "completed", "tag": "bd2e4926-9eac-49e1-aabf-8ad092e4e457"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:50.229502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5af41e8-f899-43b2-86c6-bf8c920f4085 req-f228f422-a6a1-4bbf-ad3e-44a821af6d64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:50.230187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5af41e8-f899-43b2-86c6-bf8c920f4085 req-f228f422-a6a1-4bbf-ad3e-44a821af6d64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:50.305838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f5af41e8-f899-43b2-86c6-bf8c920f4085 req-f228f422-a6a1-4bbf-ad3e-44a821af6d64 service nova] Creating event network-vif-plugged:bd2e4926-9eac-49e1-aabf-8ad092e4e457 for instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 on n-h1-826756-5 Aug 03 04:36:50.349380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f5af41e8-f899-43b2-86c6-bf8c920f4085 req-f228f422-a6a1-4bbf-ad3e-44a821af6d64 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415946 Aug 03 04:36:50.369775 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 737/1441] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:50.380806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:50.385569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:50.408181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:50.410468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:50.412238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:50.414264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:51.378018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:51.390807 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e47b45b-b028-452a-b257-f2ba77b6f195 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 1.838561 Aug 03 04:36:51.400075 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 705/1442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:49 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:51.412500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:51.413218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:51.435895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:51.438482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:51.439709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:51.440165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:51.499367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:51.805134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:51.832522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c514eff-4f24-419f-a711-6c9387df587b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 1.452105 Aug 03 04:36:51.844683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 738/1443] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:50 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:51.882137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0de31b09-73d6-4390-b803-c59f433d71f3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54ecd280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:52.001619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0de31b09-73d6-4390-b803-c59f433d71f3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.150950 Aug 03 04:36:52.008960 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 739/1444] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:51 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:52.358714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:52.374760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e51a25c-883f-4684-811d-c8274aea2552 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1470 microversion: 2.1 time: 0.974448 Aug 03 04:36:52.380564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 706/1445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:51 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1470 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:52.419834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:52.422337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:52.439505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:52.440451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:52.443083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:52.443712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:52.863500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:52.864127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:52.879184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:52.880503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:52.881693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:52.882309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:53.385003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:53.397345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-60a9f7fb-3ca9-4c24-8578-92edb69508df tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1324 microversion: 2.1 time: 0.983749 Aug 03 04:36:53.409448 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 740/1446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:52 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1324 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:53.421978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47aa2cce-b1b1-4d3f-b701-e69d22e98d82 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a91430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:53.535955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:53.563156 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47aa2cce-b1b1-4d3f-b701-e69d22e98d82 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.152259 Aug 03 04:36:53.567094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 741/1447] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:53 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:53.569435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21421fe7-fbe4-4279-9248-026f34430785 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 0.707623 Aug 03 04:36:53.576817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:53.577140 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 707/1448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:52 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:53.580201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:53.609380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:53.610107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:53.611124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:53.613406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.031869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:54.051118 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-227c98fd-5770-4588-a809-96748067527c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1470 microversion: 2.1 time: 0.482682 Aug 03 04:36:54.058092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 742/1449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:53 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:54.279875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-316a4cdc-5dc1-4249-a836-240388cbf648 req-fafa37f4-ba65-4ba4-8009-fee30afee746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "name": "network-vif-plugged", "status": "completed", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:54.315604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-316a4cdc-5dc1-4249-a836-240388cbf648 req-fafa37f4-ba65-4ba4-8009-fee30afee746 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.317725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-316a4cdc-5dc1-4249-a836-240388cbf648 req-fafa37f4-ba65-4ba4-8009-fee30afee746 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.388613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-316a4cdc-5dc1-4249-a836-240388cbf648 req-fafa37f4-ba65-4ba4-8009-fee30afee746 service nova] Creating event network-vif-plugged:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h2-826756-5 Aug 03 04:36:54.420177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-316a4cdc-5dc1-4249-a836-240388cbf648 req-fafa37f4-ba65-4ba4-8009-fee30afee746 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157265 Aug 03 04:36:54.420177 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 708/1450] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:36:54.445973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:54.451088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:54.492363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.493426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.495159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.502023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.522095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:54.582968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6802a49f-82c6-4767-9aca-4afe4c45f285 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5470a670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:54.690149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6802a49f-82c6-4767-9aca-4afe4c45f285 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.112291 Aug 03 04:36:54.692863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 709/1451] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:54 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:54.739018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:54.748189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:54.780849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.781341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.782180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.782640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.890776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:54.901974 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d0ff08b-dcd8-438d-9920-a7343968a91d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.460106 Aug 03 04:36:54.912335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 743/1452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:54 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:54.934225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:54.937743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:54.955459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.956154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:54.957009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:54.957538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.257043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:55.268033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f821cb8e-25c1-4e4d-b716-4c69ed8c0232 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.341087 Aug 03 04:36:55.291019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:55.295369 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 744/1453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:54 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:55.307151 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2813591-84a0-48a4-a9bf-0618dbcc8842 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 0.615325 Aug 03 04:36:55.312262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:55.314434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:55.316423 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 710/1454] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:54 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:55.330172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.330629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.331417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.331855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.335351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a73cee3-1139-42b7-806f-c561a4557518 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1033800800", "metadata": {"": ""}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a73cee3-1139-42b7-806f-c561a4557518 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action HTTP/1.1 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 107 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:36:55.361181 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1033800800", "metadata": {"": ""}}} Aug 03 04:36:55.363131 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1033800800', 'metadata': {'': ''}}}} Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'': ''} Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:55.364084 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.365810 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a73cee3-1139-42b7-806f-c561a4557518 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a73cee3-1139-42b7-806f-c561a4557518 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action" status: 400 len: 170 microversion: 2.1 time: 0.041890 Aug 03 04:36:55.367603 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 711/1455] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Aug 3 04:36:55 2022] POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action => generated 170 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:36:55.393328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:55.393936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:55.421510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:36:55.438306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.438760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.439713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.440206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.810638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:55.829405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-943000e0-ae70-435c-93af-864bcd46be3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.443252 Aug 03 04:36:55.842217 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 712/1456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:55 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:55.849716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7d5d348-5c22-418e-aea8-657b908d457b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5470a1f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:55.882818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:55.901056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07545fa4-4e9a-4238-8388-8e81a19767d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1470 microversion: 2.1 time: 0.595259 Aug 03 04:36:55.901918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 745/1457] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:55 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1470 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:55.923715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:55.924653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:55.950835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.959403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.960558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:55.961182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:55.961485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7d5d348-5c22-418e-aea8-657b908d457b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.118088 Aug 03 04:36:55.969631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 713/1458] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:55 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:56.347305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:56.348156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:56.379812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:56.382870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:56.398474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:56.399364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:57.136121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:57.146848 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3419f4bf-c43e-446d-af5c-b851e5084d68 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 1.243158 Aug 03 04:36:57.158065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 746/1459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:55 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:57.190021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:57.190947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:57.216306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:57.217189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:57.218215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:57.218852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:57.425052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:57.451627 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93ca10d6-daea-47b1-8308-6ccb2dc4a910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1359 microversion: 2.1 time: 1.110066 Aug 03 04:36:57.454292 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 714/1460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:56 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1359 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:36:57.474088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a62e90a9-e84c-43c3-bf54-92a331b953bb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5473c430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:57.547469 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a62e90a9-e84c-43c3-bf54-92a331b953bb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 0.091153 Aug 03 04:36:57.548369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 715/1461] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:57 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:57.554371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95640fe1-9d65-44ea-a106-1ccc3daad7a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1028382785", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95640fe1-9d65-44ea-a106-1ccc3daad7a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action HTTP/1.1 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 619 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:36:57.577878 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:57.581538 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:36:57.582285 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1028382785", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 03 04:36:57.582285 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:36:57.582285 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1028382785', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 03 04:36:57.582545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:57.583396 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.584743 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:36:57.585745 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:57.586131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95640fe1-9d65-44ea-a106-1ccc3daad7a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:57.586131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95640fe1-9d65-44ea-a106-1ccc3daad7a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action" status: 400 len: 938 microversion: 2.1 time: 0.030692 Aug 03 04:36:57.589382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 716/1462] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Aug 3 04:36:57 2022] POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action => generated 938 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:36:57.595524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:57.597720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:57.606081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:57.607008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:57.608041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:57.608802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.018403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:58.030189 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b70e50d-bcdd-48af-8852-6d6ec175589f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1470 microversion: 2.1 time: 0.870504 Aug 03 04:36:58.040342 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 747/1463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:57 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1470 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:58.219098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:58.240073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd6340e2-5b27-4381-b255-302399baf891 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.647030 Aug 03 04:36:58.256740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 717/1464] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:57 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:58.273414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:58.280103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:58.295049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.297048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.298203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.299913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.479071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:58.479689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:58.487860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.488757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.489799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.490544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.528545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:58.575135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae0f2d70-3dd9-4daf-8be5-2e16a6783321 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.308265 Aug 03 04:36:58.576565 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 748/1465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:58 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:58.616320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7b08a5ff-41dc-4600-a383-56ebedc0c93c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5492c280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:58.732780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:58.744976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94d88fa1-3c07-4271-a984-940f9c8c8cca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1542 microversion: 2.1 time: 0.269426 Aug 03 04:36:58.745679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 718/1466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:58 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1542 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:58.750932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c153201-5ae8-4b08-892a-4e619b4a377c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c153201-5ae8-4b08-892a-4e619b4a377c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action HTTP/1.1 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 285 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:36:58.757422 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:36:58.758936 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:36:58.759704 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:36:58.760428 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:36:58.762568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:36:58.766143 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:36:58.766143 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:36:58.767472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c153201-5ae8-4b08-892a-4e619b4a377c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:36:58.768676 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c153201-5ae8-4b08-892a-4e619b4a377c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action" status: 400 len: 619 microversion: 2.1 time: 0.021740 Aug 03 04:36:58.773709 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 719/1467] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Aug 3 04:36:58 2022] POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:36:58.779170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:58.784170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:58.787455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.788147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.789166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:58.789779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:58.990956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4d8523f-e1ba-4c71-a49c-57f43195fab3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216110 Aug 03 04:36:58.994538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 720/1468] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:36:58 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:36:59.000918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:59.002630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:59.010445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.011074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.012355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.012936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.371845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:59.379645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8d288c6-cb76-4571-9e11-cb56d2011316 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.384210 Aug 03 04:36:59.380576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 721/1469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:58 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:59.385341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:59.386233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:59.393561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.394095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.395224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.395906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.547663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:59.557033 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-908f655f-f379-4439-b2bb-abae74d4d9fd tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.174460 Aug 03 04:36:59.568453 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 722/1470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:59 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:59.568453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:36:59.568453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:59.577088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.577649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.580417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.581125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.794582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:36:59.811237 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-20a07e4a-17b3-474e-8a8c-fc36dbb85fec tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.251619 Aug 03 04:36:59.812110 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 723/1471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:36:59 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:36:59.846216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-648062194"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:36:59.853212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:36:59.869476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.869935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:36:59.871450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:36:59.871949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.134444 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7b08a5ff-41dc-4600-a383-56ebedc0c93c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1411 microversion: 2.1 time: 7.541739 Aug 03 04:37:06.143632 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 749/1472] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:36:58 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1411 bytes in 7552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:06.148693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:06.149319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:06.158230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:06.158690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.159477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:06.159978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.330139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:06.340068 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-536db2a1-0599-4926-b600-bba8094b31fa tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.194969 Aug 03 04:37:06.341045 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 750/1473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:06 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:06.345810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-221aacd6-434c-4108-aac7-9ff9b59c083f req-b96fa662-6b2d-457f-ae59-fb07877bf192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:06.357612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-221aacd6-434c-4108-aac7-9ff9b59c083f req-b96fa662-6b2d-457f-ae59-fb07877bf192 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:06.358420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-221aacd6-434c-4108-aac7-9ff9b59c083f req-b96fa662-6b2d-457f-ae59-fb07877bf192 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.374439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-221aacd6-434c-4108-aac7-9ff9b59c083f req-b96fa662-6b2d-457f-ae59-fb07877bf192 service nova] Creating event network-changed:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h2-826756-5 Aug 03 04:37:06.379874 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-221aacd6-434c-4108-aac7-9ff9b59c083f req-b96fa662-6b2d-457f-ae59-fb07877bf192 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037555 Aug 03 04:37:06.380542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 751/1474] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:06.762745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4bac665c-b256-4be5-b099-1a28f23b1b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action" status: 202 len: 0 microversion: 2.1 time: 6.916688 Aug 03 04:37:06.762745 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 724/1475] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:36:59 2022] POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action => generated 0 bytes in 6919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:37:06.769085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1990999835"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:06.774406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:06.783385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:06.783850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.795957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:06.796527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:06.863105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Cannot 'createImage' instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 while it is in task_state image_snapshot_pending Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action HTTP/1.1 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 85 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:37:06.866445 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1990999835"}} Aug 03 04:37:06.868099 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'createImage' instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 while it is in task_state image_snapshot_pending Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1990999835'}}} Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:37:06.869056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 while it is in task_state image_snapshot_pending Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 while it is in task_state image_snapshot_pending Aug 03 04:37:06.871459 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:06.874689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 409 to user: Cannot 'createImage' instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 while it is in task_state image_snapshot_pending {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:37:06.875062 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-317b7249-83e3-4a48-9975-044a0cfe85d9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action" status: 409 len: 167 microversion: 2.1 time: 0.112071 Aug 03 04:37:06.875868 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 752/1476] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:37:06 2022] POST /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244/action => generated 167 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:37:06.886431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-736f7b5e-bdac-4247-9827-2ba826c409b9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd54851d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:07.150678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dac44def-a398-467c-a8f1-fb429e4119a6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54e86af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:07.351801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-736f7b5e-bdac-4247-9827-2ba826c409b9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/images/2df2c2d3-d0a4-490a-8f63-1e97634458b3" status: 204 len: 0 microversion: 2.1 time: 0.470500 Aug 03 04:37:07.352440 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 725/1477] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:06 2022] DELETE /compute/v2.1/images/2df2c2d3-d0a4-490a-8f63-1e97634458b3 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:37:07.362282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:07.363324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:07.373801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:07.374569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:07.376653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:07.377278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:07.412978 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dac44def-a398-467c-a8f1-fb429e4119a6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1420 microversion: 2.1 time: 0.266247 Aug 03 04:37:07.414365 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 753/1478] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:07 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:07.430244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:07.432609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:07.436719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:07.442505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:07.444977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:07.444977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:07.444977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:07.693971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:07.708062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7795cd65-72af-400d-9825-bdf7b1c99dac tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1533 microversion: 2.1 time: 0.351232 Aug 03 04:37:07.708770 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 726/1479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:07 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1533 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:07.714865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdbe2d83-6c48-4adc-a6fb-ff0b7e6d176a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54741c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:07.725733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:07.736793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb488fbf-1da6-4d3e-a196-e8e57a6270b1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.321105 Aug 03 04:37:07.738146 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 754/1480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:07 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:07.777828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cdbe2d83-6c48-4adc-a6fb-ff0b7e6d176a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 200 len: 1420 microversion: 2.1 time: 0.067804 Aug 03 04:37:07.778601 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 727/1481] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:07 2022] GET /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:07.793373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7760cf60-bed4-46af-8fc0-d5d65cbb2847 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5485e3a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:08.730308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:08.730910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:08.737775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:08.738231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:08.739123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:08.739586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:08.914570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:08.923511 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cecdc08f-0290-4f2b-b8dc-bb550809e814 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1539 microversion: 2.1 time: 0.197896 Aug 03 04:37:08.936305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 728/1482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:08 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:08.951036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:08.953239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:08.967103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:08.967862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:08.969114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:08.969808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:09.156788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:09.166175 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04fc3df2-14d0-4f52-a0c4-b8b817664eb8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.230644 Aug 03 04:37:09.166769 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 729/1483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:08 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:09.956754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:09.957719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:09.975511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:09.980634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:09.983838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:09.984410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:10.494706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:10.498339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:10.506698 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7760cf60-bed4-46af-8fc0-d5d65cbb2847 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 204 len: 0 microversion: 2.1 time: 2.718283 Aug 03 04:37:10.508191 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 755/1484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:07 2022] DELETE /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 0 bytes in 2721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:10.515176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13d04976-f76a-48b1-afd9-9b24ccfd5c3b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1539 microversion: 2.1 time: 0.569760 Aug 03 04:37:10.516004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:10.516910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:10.517920 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 730/1485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:09 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1539 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:10.526345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:10.528035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:10.529139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:10.529666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:10.530082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:10.530202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:10.545945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:10.546455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:10.547264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:10.547713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:10.582927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:37:10.869397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:10.881584 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-74cdbb5a-c544-418d-a624-14c19c7eee3c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.371738 Aug 03 04:37:10.893290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 756/1486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:10 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:11.057495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-408478bf-efdb-4bdb-8279-1e6d2ce459bf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 204 len: 0 microversion: 2.1 time: 0.538278 Aug 03 04:37:11.059873 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 731/1487] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:37:10 2022] DELETE /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:11.225754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1645021348", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:11.325739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] validate_networks() for [('c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:37:11.539510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:11.540973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:11.550586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:11.551769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:11.553272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:11.553903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:12.044103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:12.056812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c992b6d-f94a-4361-b8eb-c7d75ed88a5a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1521 microversion: 2.1 time: 0.521323 Aug 03 04:37:12.059473 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 732/1488] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:11 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:12.070405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:12.072888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:12.091774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:12.095298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:12.097130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:12.104423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:12.974100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:12.983902 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3dd71eab-cf88-428a-ab87-dc63d34000d1 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.921124 Aug 03 04:37:12.995847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 733/1489] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:12 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:12.999041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:37:12.999637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:37:13.000226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:37:13.001512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:37:13.002509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:37:13.005526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:13.006226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:13.016713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:13.017952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:13.019746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:13.020435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:13.025497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:13.028321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:13.031684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:13.035196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:13.082132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:37:13.085216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:13.096868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for user 14aa35fa1b9d4a5786b67c5a3234f571 and project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:13.123651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:37:13.132613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:37:13.393798 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6f5bd77-1b2f-4a6f-b5cf-944706d3486d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.172174 Aug 03 04:37:13.400373 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 757/1490] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:37:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:37:13.420738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3e4ea0b2-7942-4a64-8864-53acc08083c9 req-785fb4c8-1f49-4627-9815-3481cfefd17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf6f5e-4e1f-421b-8529-bc0295fe7a13", "name": "network-vif-unplugged", "status": "completed", "tag": "70652a52-cff6-40ac-b702-a2e8428ac96e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:13.443738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3e4ea0b2-7942-4a64-8864-53acc08083c9 req-785fb4c8-1f49-4627-9815-3481cfefd17b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:13.444641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3e4ea0b2-7942-4a64-8864-53acc08083c9 req-785fb4c8-1f49-4627-9815-3481cfefd17b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:13.502742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3e4ea0b2-7942-4a64-8864-53acc08083c9 req-785fb4c8-1f49-4627-9815-3481cfefd17b service nova] Creating event network-vif-unplugged:70652a52-cff6-40ac-b702-a2e8428ac96e for instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 on n-h2-826756-5 Aug 03 04:37:13.511069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3e4ea0b2-7942-4a64-8864-53acc08083c9 req-785fb4c8-1f49-4627-9815-3481cfefd17b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099811 Aug 03 04:37:13.512322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 758/1491] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:13.518340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-709013910", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4"}], "block_device_mapping_v2": [{"uuid": "18faf71b-0ede-423e-bbcb-fb5898f06748", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:13.597124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] validate_networks() for [('8248a5de-6b02-479b-b3bb-ca4f4bd7a9b4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:37:13.827464 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-226c456d-c819-4b58-a777-acc540fca08f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 204 len: 0 microversion: 2.1 time: 0.829659 Aug 03 04:37:13.831570 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 734/1492] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:37:12 2022] DELETE /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:13.837275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63df2978-2cf8-49ea-8378-459b34912f59 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:13.837987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63df2978-2cf8-49ea-8378-459b34912f59 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:13.960118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63df2978-2cf8-49ea-8378-459b34912f59 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:13.971518 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63df2978-2cf8-49ea-8378-459b34912f59 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1208 microversion: 2.1 time: 0.138530 Aug 03 04:37:13.990300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 735/1493] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:13 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1208 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:14.002234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:14.005207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:14.032580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.035280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.036365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.039121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.478221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:14.491795 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ceec463-d211-4e6b-bad9-598189b95cfd tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1527 microversion: 2.1 time: 0.500052 Aug 03 04:37:14.492734 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 736/1494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:13 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:14.521133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:14.522221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:14.525363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:37:14.528772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:37:14.529564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:37:14.530167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:37:14.530767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:37:14.550727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.552388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.553487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.554586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.555250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.555945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.560337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:14.561498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:14.605134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:14.612074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Getting quotas for user 4cb1b66854244b8197c4b1f0ccae0b0e and project 2d5eaf733df44eba92534066cb86541c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:14.719265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:37:14.722040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18faf71b-0ede-423e-bbcb-fb5898f06748',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:37:14.864533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:14.874981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0633757a-b5a0-4af8-9a6f-496a3493b435 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.372219 Aug 03 04:37:14.876017 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 737/1495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:14 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:14.999037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:15.000229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:15.010492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.015560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.015560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.015560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.170285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:15.181262 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f67edd7-a478-4729-98f2-f2504f7ab150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1212 microversion: 2.1 time: 0.187720 Aug 03 04:37:15.184636 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 738/1496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:14 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1212 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:15.195862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c4d49aa5-93fa-4a69-a1cd-d4083bdf4d1b req-b071d17d-1ac4-4933-81ee-2c1f0a81a8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddbf6f5e-4e1f-421b-8529-bc0295fe7a13", "name": "network-vif-deleted", "tag": "70652a52-cff6-40ac-b702-a2e8428ac96e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:15.228461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c4d49aa5-93fa-4a69-a1cd-d4083bdf4d1b req-b071d17d-1ac4-4933-81ee-2c1f0a81a8f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.239838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c4d49aa5-93fa-4a69-a1cd-d4083bdf4d1b req-b071d17d-1ac4-4933-81ee-2c1f0a81a8f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.270719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c4d49aa5-93fa-4a69-a1cd-d4083bdf4d1b req-b071d17d-1ac4-4933-81ee-2c1f0a81a8f4 service nova] Creating event network-vif-deleted:70652a52-cff6-40ac-b702-a2e8428ac96e for instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 on n-h2-826756-5 Aug 03 04:37:15.274675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4134a546-ae06-4f38-a9fa-502182386b03 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.760855 Aug 03 04:37:15.280637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c4d49aa5-93fa-4a69-a1cd-d4083bdf4d1b req-b071d17d-1ac4-4933-81ee-2c1f0a81a8f4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094104 Aug 03 04:37:15.281704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 759/1497] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:37:15.283634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 739/1498] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:15.294512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:15.295560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:15.433199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:15.493963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:15.493963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:15.493963 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c86234e-ff31-4b8b-9010-f8c45da4b7b2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1103 microversion: 2.25 time: 0.163401 Aug 03 04:37:15.496881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 760/1499] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:15 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1103 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:15.522296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:15.523781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:15.530605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.531453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.532436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.533075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.611151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0edcdf-4dc5-4c2e-ab00-88c093204244", "name": "network-vif-plugged", "status": "completed", "tag": "bd2e4926-9eac-49e1-aabf-8ad092e4e457"}, {"server_uuid": "2b0edcdf-4dc5-4c2e-ab00-88c093204244", "name": "network-vif-unplugged", "status": "completed", "tag": "bd2e4926-9eac-49e1-aabf-8ad092e4e457"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:15.640702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.642307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.664115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] Creating event network-vif-plugged:bd2e4926-9eac-49e1-aabf-8ad092e4e457 for instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 on n-h1-826756-5 Aug 03 04:37:15.673595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] Creating event network-vif-unplugged:bd2e4926-9eac-49e1-aabf-8ad092e4e457 for instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 on n-h1-826756-5 Aug 03 04:37:15.705374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2fe88868-4b65-411a-90de-154890788418 req-a33850f1-edba-45f9-b0ba-2dfcb80f7286 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.077688 Aug 03 04:37:15.705374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 761/1500] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:37:15.840253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:15.854869 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d301056-b998-41e7-af15-d3db3d5a9947 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1527 microversion: 2.1 time: 0.336361 Aug 03 04:37:15.866498 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 740/1501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:15 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1527 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:15.902610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:15.904328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:15.922450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.923323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:15.927549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:15.933930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.246814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.255215 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14b84fa5-815d-4402-a904-c9352155abea tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.360135 Aug 03 04:37:16.269428 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 762/1502] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:15 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:16.275411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:16.276107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:16.286675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:16.287382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.288391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:16.289280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.371822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09dbe516-44f4-4049-8925-fe6086ae23f5 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Action: 'create', calling method: .version_select at 0x7fdd54716670>, body: {"keypair": {"name": "tempest-keypair-1830289507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3ffckxCV3ev8HvlbvOZqcNNEeT23b4Cs0dvvgjsvUDu/EOKr8obbY/yqwBHetzEp+qJSwLQy4qe6jimUqTw+nzKhyFroZH2HkbbMsWlKuT4tjJtLJfkCB8/5uLS/f1nw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:16.390525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-09dbe516-44f4-4049-8925-fe6086ae23f5 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Getting quotas for project 9c11f186b92f4526a9ced1e0fde53f3f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:16.395775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-09dbe516-44f4-4049-8925-fe6086ae23f5 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Getting quotas for user 41509911d7f040cfb248d99c95c43942 and project 9c11f186b92f4526a9ced1e0fde53f3f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:16.401793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.410812 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d54e3b1-87d4-45e2-9de2-e11b6212ebb8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1260 microversion: 2.1 time: 0.140620 Aug 03 04:37:16.411935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 763/1503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:16 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:16.483883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:16.485639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:16.500696 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09dbe516-44f4-4049-8925-fe6086ae23f5 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.411422 Aug 03 04:37:16.503155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 741/1504] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:37:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:37:16.586516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:16.595180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.596064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Searching by: {'deleted': False, 'project_id': '8a6d1be80039482fbb9938e347e725d0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:37:16.614398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:16.615043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.616656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:16.618366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.696182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.745835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.753582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:16.756569 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-babdf6a6-bbff-4577-8ac2-3755c8ef6bf9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1103 microversion: 2.25 time: 0.279900 Aug 03 04:37:16.758062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 764/1505] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:16 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1103 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:37:16.801468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:37:16.882392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a2d5af3e-ca84-4bbc-ac63-e55888bef4e1 req-2a77a3ab-adf4-42f3-894b-33dc1f1eecff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0edcdf-4dc5-4c2e-ab00-88c093204244", "name": "network-vif-deleted", "tag": "bd2e4926-9eac-49e1-aabf-8ad092e4e457"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:16.930045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a2d5af3e-ca84-4bbc-ac63-e55888bef4e1 req-2a77a3ab-adf4-42f3-894b-33dc1f1eecff service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:16.933112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a2d5af3e-ca84-4bbc-ac63-e55888bef4e1 req-2a77a3ab-adf4-42f3-894b-33dc1f1eecff service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:16.982615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a2d5af3e-ca84-4bbc-ac63-e55888bef4e1 req-2a77a3ab-adf4-42f3-894b-33dc1f1eecff service nova] Creating event network-vif-deleted:bd2e4926-9eac-49e1-aabf-8ad092e4e457 for instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 on n-h1-826756-5 Aug 03 04:37:16.992935 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a2d5af3e-ca84-4bbc-ac63-e55888bef4e1 req-2a77a3ab-adf4-42f3-894b-33dc1f1eecff service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233259 Aug 03 04:37:16.994152 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 765/1506] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:17.009890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:17.019304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:17.043807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.044291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.045165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.045820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.314968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:17.329902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6f0a3df-6706-420e-93a5-2bc82461df84 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 200 len: 1309 microversion: 2.1 time: 0.324106 Aug 03 04:37:17.339689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 766/1507] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:17 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:17.348025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:17.356799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:17.374060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.377894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.379073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.386986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e27aad66-f10a-4ff2-b131-07b25de29f10 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.806335 Aug 03 04:37:17.388553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.394402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 742/1508] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:37:16 2022] GET /compute/v2.1/servers => generated 339 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:17.416128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:17.423506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:17.427639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Searching by: {'deleted': False, 'project_id': '8a6d1be80039482fbb9938e347e725d0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:37:17.443357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.453201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.454425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.455043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.494532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:37:17.557550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:17.565902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.566586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.806613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:17.827606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cfaff75b-0200-4175-a9c2-be827473bb35 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.486323 Aug 03 04:37:17.830243 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-903a6b62-6aea-41f2-8083-b0b3f65788ef tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.419460 Aug 03 04:37:17.831088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 743/1509] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:37:17 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:17.836332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:17.837104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:17.837710 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 767/1510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:17 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:17.858069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:17.860475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:17.863024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.863481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.866519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.868536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.869122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.870998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:17.871896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.873051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:17.991972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:18.002252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:18.003988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:18.013787 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aff59069-931d-4cd6-9539-df99ca26a7ef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1266 microversion: 2.1 time: 0.181343 Aug 03 04:37:18.014705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 744/1511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:17 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:18.020082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-255ee90f-a290-46df-ad13-075b6a53c626 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:18.030956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-255ee90f-a290-46df-ad13-075b6a53c626 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014839 Aug 03 04:37:18.031855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 745/1512] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:37:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:18.035201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:18.037226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:18.038767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25afea2b-18b4-4b30-be56-8c6b36ebf382 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1232 microversion: 2.25 time: 0.199996 Aug 03 04:37:18.039504 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 768/1513] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:17 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1232 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:18.359720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:18.360591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:18.384208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.388214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.391116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.391855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.402813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:18.403554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:18.416635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.419006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.422488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.422957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.432043 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 HTTP/1.1 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:37:18.438978 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:37:18.440842 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244'} Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:37:18.441783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:37:18.443404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:37:18.446543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:37:18.450669 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-48577193-6f97-4339-8cc9-bb68f58e9726 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 404 len: 111 microversion: 2.1 time: 0.096593 Aug 03 04:37:18.453587 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 746/1514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:18 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:37:18.472242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60d71adf-0379-4614-bafe-f828041a9f12 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'create', calling method: .version_select at 0x7fdd5470a3a0>, body: {"keypair": {"name": "tempest-keypair-994674505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxmsa8NAdMadBl8KWf4ZRxbuCTlOtLa5eoRAU+RFtuz3mS+J/rjxZ89DpSs7NK7gyn5RP+L6KT+xhLV3+D1ytSdBwR1cTv8Llj01oq9tCs6MVXS8Gayj6M/c/eSzZbwWg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:18.501563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-60d71adf-0379-4614-bafe-f828041a9f12 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:18.508289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-60d71adf-0379-4614-bafe-f828041a9f12 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for user 1ef5280a59af4ef09aa3e84ec74e1b61 and project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:18.535797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:37:18.634710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60d71adf-0379-4614-bafe-f828041a9f12 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168449 Aug 03 04:37:18.634710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 747/1515] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:37:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:18.856426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:18.858036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:18.874666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.875536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.876688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:18.878145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:18.912440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:19.014638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbf73958-115a-4c14-b947-14d94702dc54 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 204 len: 0 microversion: 2.1 time: 0.616032 Aug 03 04:37:19.016852 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 769/1516] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:37:18 2022] DELETE /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:19.026100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:19.026100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:19.042617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.043566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.044739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.046629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.503231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.515070 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6920a9c-ab0d-4ed7-94e9-eb87ac43e30a tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 0.663446 Aug 03 04:37:19.518571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 748/1517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:18 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:19.532003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:19.535937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:19.550612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.551417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.562391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.562539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.563849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.573426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4abfa4d4-5540-4791-a50b-145272640378 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1714 microversion: 2.1 time: 0.550583 Aug 03 04:37:19.578292 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 770/1518] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:19 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1714 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:19.593466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:19.594565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:19.605891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.607026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.608352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:19.609306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:19.761960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.773753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.780785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.782308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35140763-2371-4a70-83cc-513cd031d1ff tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1250 microversion: 2.25 time: 0.206982 Aug 03 04:37:19.783482 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 771/1519] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:19 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1250 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:19.917061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:19.926427 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60e09373-8358-4e65-871f-938b93f010e1 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.404109 Aug 03 04:37:19.936302 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 749/1520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:19 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:20.414823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2410fd98-b244-4b61-bbea-f415feb3ed49 req-0ac4a73a-438a-4489-a261-33589428fbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c314dde1-5aec-4fbf-91bb-5f3668df458a", "tag": "91b326ed-30ce-4432-bd1c-56a48b7aa83e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:20.450478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2410fd98-b244-4b61-bbea-f415feb3ed49 req-0ac4a73a-438a-4489-a261-33589428fbee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:20.452731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2410fd98-b244-4b61-bbea-f415feb3ed49 req-0ac4a73a-438a-4489-a261-33589428fbee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:20.484419 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2410fd98-b244-4b61-bbea-f415feb3ed49 req-0ac4a73a-438a-4489-a261-33589428fbee service nova] Creating event network-changed:91b326ed-30ce-4432-bd1c-56a48b7aa83e for instance c314dde1-5aec-4fbf-91bb-5f3668df458a on n-h1-826756-5 Aug 03 04:37:20.493955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2410fd98-b244-4b61-bbea-f415feb3ed49 req-0ac4a73a-438a-4489-a261-33589428fbee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082781 Aug 03 04:37:20.496478 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 772/1521] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:20.542279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:20.542960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:20.550927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:20.556671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:20.557759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:20.558563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:20.564946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:20.597460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:20.598495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:20.614050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:20.616625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:20.617647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:20.620935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:21.715887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:21.733161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c95e69e-f89c-4309-9d13-65a2d59b7ee5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1475 microversion: 2.1 time: 1.194737 Aug 03 04:37:21.734420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 750/1522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:20 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1475 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:21.749311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:21.750211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:21.757340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:21.757803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:21.758637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:21.759706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:21.946314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:21.955420 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c487fb63-0f10-4601-a0c8-d71e78176f8e tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1714 microversion: 2.1 time: 1.362974 Aug 03 04:37:21.977398 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 773/1523] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:20 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1714 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:21.999152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:21.999152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:22.002179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:22.003389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:22.004197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:22.004846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:22.924194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:22.934334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b2a364f-24f4-493e-b1fb-e30587dd4bef tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.955688 Aug 03 04:37:22.940489 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 774/1524] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:21 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:22.945748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-455360323", "imageRef": "b62302b8-a0e3-452c-ac6d-9b57202e1aea", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f9c6d066-0d2a-43e7-b9c3-f10d2c7c1be4"}], "security_groups": [{"name": "tempest-securitygroup--529663024"}], "key_name": "tempest-keypair-1830289507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:23.074868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:23.088018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:23.090551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:23.100131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4e7cc82-62c2-4905-87b7-d0ae0c31977e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1292 microversion: 2.25 time: 1.356423 Aug 03 04:37:23.100131 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 751/1525] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:21 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1292 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:23.100131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:23.100131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:23.108785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:23.111089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:23.112153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:23.113538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:23.255136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] validate_networks() for [('f9c6d066-0d2a-43e7-b9c3-f10d2c7c1be4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:37:23.646675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:23.665570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6adc05fd-5e54-4620-8879-a5c59e566a19 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1474 microversion: 2.1 time: 0.570744 Aug 03 04:37:23.669804 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 752/1526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:23 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1474 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:23.686113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:23.688099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:23.707176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:23.707631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:23.713817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:23.715733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:23.985750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:24.011568 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43c47f8b-eb9d-4649-ae89-ab363d116a82 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1647 microversion: 2.1 time: 0.337995 Aug 03 04:37:24.014818 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 753/1527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:23 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1647 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:24.042485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-unplugged", "status": "completed", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:24.095834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.097404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.150174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] Creating event network-vif-unplugged:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h1-826756-5 Aug 03 04:37:24.162469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:37:24.211004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cb49082c-69e3-4069-8611-5425f5e76b77 req-1a01778e-0453-4276-81a3-41feab685df6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194183 Aug 03 04:37:24.211646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 754/1528] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:24.229963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:24.235536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:24.249307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.251093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.252038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.253883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.423639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:37:24.427700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:37:24.428236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:37:24.428669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:37:24.429087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:37:24.457068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.457517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.458317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.458753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.485817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Getting quotas for project 9c11f186b92f4526a9ced1e0fde53f3f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:24.495448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Getting quotas for user 41509911d7f040cfb248d99c95c43942 and project 9c11f186b92f4526a9ced1e0fde53f3f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:24.510989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:37:24.514354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b62302b8-a0e3-452c-ac6d-9b57202e1aea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:37:24.724458 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-92a00e17-2573-4ba9-bb77-805f1d034ac7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.774307 Aug 03 04:37:24.725292 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 775/1529] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:37:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:37:24.734793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:24.735341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:24.757434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.758144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:24.759100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:24.769617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:25.082866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:25.112328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2ab8911-7b5c-4930-b869-20a771383a5c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.893535 Aug 03 04:37:25.130630 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 755/1530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:24 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:25.138518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:25.139636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:25.146140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:25.147562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:25.148632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:25.149284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.210374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.224604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.242530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.242530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c93808d1-c81d-453d-8e5b-2584b508ecc6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1292 microversion: 2.25 time: 1.508327 Aug 03 04:37:26.242530 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 776/1531] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:24 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1292 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:26.251453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c47b52fa-9efe-42dd-9477-27b3c9b63239 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:26.256551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c47b52fa-9efe-42dd-9477-27b3c9b63239 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:26.275358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:26.401229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c47b52fa-9efe-42dd-9477-27b3c9b63239 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.411959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c47b52fa-9efe-42dd-9477-27b3c9b63239 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1245 microversion: 2.1 time: 0.164638 Aug 03 04:37:26.413547 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 777/1532] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:26 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:26.423564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:26.428830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:26.438485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.446240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.446694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.452166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.452166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.452408 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7260bfa3-5c11-4618-9aac-9a81f9b8a1b5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1474 microversion: 2.1 time: 1.315896 Aug 03 04:37:26.456673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 756/1533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:25 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1474 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:26.475431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1bb091ae-af2d-448d-a9b6-7191d6857c24 req-391d9ead-5db4-41e1-a7cc-4914cb309bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4", "name": "network-vif-deleted", "tag": "3fde4f72-9ca1-48e5-a086-928bf514d2ce"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:26.508255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1bb091ae-af2d-448d-a9b6-7191d6857c24 req-391d9ead-5db4-41e1-a7cc-4914cb309bc2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.511585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1bb091ae-af2d-448d-a9b6-7191d6857c24 req-391d9ead-5db4-41e1-a7cc-4914cb309bc2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.547586 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1bb091ae-af2d-448d-a9b6-7191d6857c24 req-391d9ead-5db4-41e1-a7cc-4914cb309bc2 service nova] Creating event network-vif-deleted:3fde4f72-9ca1-48e5-a086-928bf514d2ce for instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 on n-h1-826756-5 Aug 03 04:37:26.558534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.558906 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1bb091ae-af2d-448d-a9b6-7191d6857c24 req-391d9ead-5db4-41e1-a7cc-4914cb309bc2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095278 Aug 03 04:37:26.559049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.561092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 757/1534] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:26.565999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lazy-loading 'fault' on Instance uuid 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:37:26.575549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-432200065", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:26.681154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] validate_networks() for [('da7926bc-1605-4375-ae40-4ba35e5d1b81', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:37:26.711248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2d52f829e4439596c8be348bb2f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6d1be80039482fbb9938e347e725d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:26.724981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8b25ca1-84e9-4b34-b444-af0e8b3206b3 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 200 len: 1367 microversion: 2.1 time: 0.304665 Aug 03 04:37:26.728160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 778/1535] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:26 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:26.737448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:26.744234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:26.751699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.754744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:26.756454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:26.757268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.280079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:27.293163 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de25701f-1f4a-44e1-90f8-56642a280a87 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.562150 Aug 03 04:37:27.294024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 779/1536] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:26 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:27.299600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:27.312453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:27.313151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.332375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] Creating event network-changed:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h1-826756-5 Aug 03 04:37:27.348359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:37:27.365545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-16e21146-93cd-4dda-8097-0aca87f0c541 req-4f95e1ee-06f6-476e-ba3d-751b0c5bb2bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069893 Aug 03 04:37:27.366733 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 780/1537] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:27.373898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:27.375515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:27.383494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:27.384543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.385834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:27.386448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.470792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:27.720980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:27.730588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:27.732106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:27.738292 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f10d64e-5a4c-462f-902f-7eb000e1bde8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1292 microversion: 2.25 time: 0.365227 Aug 03 04:37:27.738292 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 781/1538] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:27 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1292 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:27.760840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:27.761622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:27.775798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:27.776255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.777066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:27.777497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:27.955652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:27.969193 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7394b23-c0dd-468e-b3e8-6db3076e9262 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1297 microversion: 2.1 time: 0.231089 Aug 03 04:37:27.974351 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 782/1539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:27 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1297 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:27.981180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:27.988259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:28.004503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.006289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.007329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.009473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.199040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:37:28.199462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:37:28.199937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:37:28.200359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:37:28.201093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:37:28.210689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.211583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.212609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.213271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.233710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:37:28.238971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for user 1ef5280a59af4ef09aa3e84ec74e1b61 and project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:37:28.253445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:37:28.260789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:37:28.264955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:28.277038 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a78859b4-ead3-4981-82d5-c388464e4a57 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1472 microversion: 2.1 time: 0.300114 Aug 03 04:37:28.282190 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 783/1540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:27 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:28.286749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:28.287976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] [instance: 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:28.298884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.300060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.301958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.302704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.327889 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] HTTP exception thrown: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Request method failure captured: Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 HTTP/1.1 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fs33xS0tV301aVCnhoQfFFtmIsaI_jbWDClZJPgl5C5G0dBMgML5yOBJl4L7uW07lQf1KnWCpi1bwGTaugefSjIIS8Vw8a-Gm0KWQqt7BeBCdT4v50s7LrkXTPNB3IRJDsPUNfF6JGZV7_HgxsLLuxX-tvPbSlqQgfZZzCz6qcI4lM Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 8a6d1be80039482fbb9938e347e725d0 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestManualDisk-1278375951 Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:37:28.330448 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8a6d1be80039482fbb9938e347e725d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8a6d1be80039482fbb9938e347e725d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8a6d1be80039482fbb9938e347e725d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8a6d1be80039482fbb9938e347e725d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestManualDisk-1278375951 Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 8a6d1be80039482fbb9938e347e725d0 Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestManualDisk-1278375951 Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestManualDisk-1278375951-project Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ce2d52f829e4439596c8be348bb2f24a Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestManualDisk-1278375951-project Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. Aug 03 04:37:28.332148 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4'} Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:37:28.333233 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. Aug 03 04:37:28.336287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:37:28.338636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Returning 404 to user: Instance 1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:37:28.340778 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd2ccf77-bba3-49ff-8220-da791c5831db tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4" status: 404 len: 111 microversion: 2.1 time: 0.059818 Aug 03 04:37:28.345629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 784/1541] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:28 2022] GET /compute/v2.1/servers/1e0bc4ae-31e1-47ef-b53f-3aebf4d64ba4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:37:28.353112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:28.354590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:28.361820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.362382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.363284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.363796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.378645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b73863cb-f28e-45a4-a488-fa435c9f2671 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.815834 Aug 03 04:37:28.379469 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 758/1542] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:37:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:37:28.391265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3d7b2ce-e2b7-499b-9c96-5630efa01b47 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] Calling method '.version_select at 0x7fdd548a68b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:28.468586 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3d7b2ce-e2b7-499b-9c96-5630efa01b47 tempest-ServersTestManualDisk-1278375951 tempest-ServersTestManualDisk-1278375951-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227982397" status: 202 len: 0 microversion: 2.1 time: 0.081244 Aug 03 04:37:28.469579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 759/1543] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227982397 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:37:28.476289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e009ccd9-a3f8-4b38-bfbf-e7d4003916c2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:28.481301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e009ccd9-a3f8-4b38-bfbf-e7d4003916c2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:28.584745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e009ccd9-a3f8-4b38-bfbf-e7d4003916c2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:28.593468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e009ccd9-a3f8-4b38-bfbf-e7d4003916c2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1224 microversion: 2.1 time: 0.122582 Aug 03 04:37:28.620948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 760/1544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:28 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:28.642791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b52be78b-bddb-46cb-8afd-79e09e6bc2c9 req-5abacd8e-6733-46a9-abb0-289f3509b2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e331d1e-abed-4f52-970b-189348b5fff6", "tag": "ee27001f-28ce-4767-af6d-0c115227cabc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:28.673706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b52be78b-bddb-46cb-8afd-79e09e6bc2c9 req-5abacd8e-6733-46a9-abb0-289f3509b2dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.673706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b52be78b-bddb-46cb-8afd-79e09e6bc2c9 req-5abacd8e-6733-46a9-abb0-289f3509b2dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.717616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b52be78b-bddb-46cb-8afd-79e09e6bc2c9 req-5abacd8e-6733-46a9-abb0-289f3509b2dc service nova] Creating event network-changed:ee27001f-28ce-4767-af6d-0c115227cabc for instance 4e331d1e-abed-4f52-970b-189348b5fff6 on n-h1-826756-5 Aug 03 04:37:28.728169 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b52be78b-bddb-46cb-8afd-79e09e6bc2c9 req-5abacd8e-6733-46a9-abb0-289f3509b2dc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090513 Aug 03 04:37:28.729562 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 761/1545] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:28.743079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:28.758857 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5013c773-3760-42f1-a67e-939d2b676890 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.412410 Aug 03 04:37:28.759450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 785/1546] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:28 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:28.769367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:28.771996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:28.781782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.782439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.783921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:28.784642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:28.999511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:29.000175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:29.007195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:29.008159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:29.009306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:29.011458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:29.049148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:29.059087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:29.060993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:29.062501 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab6e743d-6449-4e27-91bb-59025542822d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.307279 Aug 03 04:37:29.077507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 762/1547] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:28 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:37:29.131766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:29.135810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:29.142088 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-122d67c9-3319-4031-bef8-cfe79e777466 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1303 microversion: 2.1 time: 0.150283 Aug 03 04:37:29.142664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 786/1548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:28 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:29.315386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:29.317295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:29.326774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-adf34c5b-1a46-4357-ba23-07b30d5cd21a req-290fc66d-6fcf-4508-ac59-e35f24ae758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314dde1-5aec-4fbf-91bb-5f3668df458a", "name": "network-vif-plugged", "status": "completed", "tag": "91b326ed-30ce-4432-bd1c-56a48b7aa83e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:29.349211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:29.350090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:29.356574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:29.357227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:29.374492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-adf34c5b-1a46-4357-ba23-07b30d5cd21a req-290fc66d-6fcf-4508-ac59-e35f24ae758f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:29.376163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-adf34c5b-1a46-4357-ba23-07b30d5cd21a req-290fc66d-6fcf-4508-ac59-e35f24ae758f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:29.425194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-adf34c5b-1a46-4357-ba23-07b30d5cd21a req-290fc66d-6fcf-4508-ac59-e35f24ae758f service nova] Creating event network-vif-plugged:91b326ed-30ce-4432-bd1c-56a48b7aa83e for instance c314dde1-5aec-4fbf-91bb-5f3668df458a on n-h1-826756-5 Aug 03 04:37:29.465119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-adf34c5b-1a46-4357-ba23-07b30d5cd21a req-290fc66d-6fcf-4508-ac59-e35f24ae758f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128925 Aug 03 04:37:29.470918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 787/1549] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:37:29.618765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-79c12ea3-a536-4fb4-949c-370a3c9b3f72 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:29.620707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-79c12ea3-a536-4fb4-949c-370a3c9b3f72 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:30.036663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-79c12ea3-a536-4fb4-949c-370a3c9b3f72 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:30.046201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-79c12ea3-a536-4fb4-949c-370a3c9b3f72 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1224 microversion: 2.1 time: 0.432240 Aug 03 04:37:30.049424 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 788/1550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:29 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1224 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:30.054710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:30.059739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:30.063370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.064114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:30.065082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.065968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:30.498706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:30.522675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6625f9d7-fb3b-4705-8dcd-9d25e59c6112 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1472 microversion: 2.1 time: 1.223280 Aug 03 04:37:30.539407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 763/1551] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:29 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1472 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:30.559543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:30.560892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:30.568368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.569544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:30.570894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.571707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:30.673831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:30.687800 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-189dd512-52ca-4d2e-b794-219f414f1534 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.636952 Aug 03 04:37:30.691585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 789/1552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:30 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:30.746370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:30.748719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:30.763612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.768212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:30.768212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:30.768212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.065761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:31.074169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c949f14c-7d0b-4623-ae9c-c464cdf171e8 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1303 microversion: 2.1 time: 0.381168 Aug 03 04:37:31.080228 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 790/1553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:30 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1303 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:31.098482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:31.100807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:31.126720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.127281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.128128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.128595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.160246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:31.176256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:31.178362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:31.185646 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5990c613-d362-4832-9755-de5974fe5894 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.638758 Aug 03 04:37:31.185646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 764/1554] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:30 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:31.320812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:31.334761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2fe9f77-1b0e-4630-a910-b36e4139da49 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1220 microversion: 2.1 time: 0.252203 Aug 03 04:37:31.341234 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 791/1555] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:31 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1220 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:31.555319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:31.558788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:31.566392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.567378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.568475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.569298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.716551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:31.717659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:31.734992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.743881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:31.743881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:31.743881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.062625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:32.070461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-735bc1fb-dd25-4821-b3bb-b32510287ada tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1469 microversion: 2.1 time: 0.520873 Aug 03 04:37:32.071045 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 765/1556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:31 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:32.100855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:32.101904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:32.113886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.114532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.115498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.116101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.272777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:32.287424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8743df6f-7f22-419f-aed8-1381a4fdc1b4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1308 microversion: 2.1 time: 0.577044 Aug 03 04:37:32.293842 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 792/1557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:31 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:32.305719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:32.307826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:32.320060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.321027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.322124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.323145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.672175 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1589740-da94-4097-91d1-017a555f33a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "POST /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963/action" status: 202 len: 0 microversion: 2.1 time: 0.576782 Aug 03 04:37:32.676553 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 766/1558] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:37:32 2022] POST /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:37:32.694785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:32.700212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:32.715272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.719557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.720693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:32.723890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:32.796361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:33.211882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:33.221287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5323e08-320b-4f8e-b918-f34997e996e4 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.926119 Aug 03 04:37:33.224901 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 793/1559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:32 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:33.230550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:33.237169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:33.251433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:33.252317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:33.257974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:33.258534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:33.774757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:33.792350 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80270c4f-0645-4c36-b911-49dc5d99cc71 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1294 microversion: 2.1 time: 0.564842 Aug 03 04:37:33.793244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:33.793880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 794/1560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:33 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1294 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:33.817775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:33.818705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:33.820107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:33.823804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:33.829957 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e2f85ca-320a-476d-9e41-7d077a0c94e8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 1.148894 Aug 03 04:37:33.833807 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 767/1561] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:32 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:33.841192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:33.841734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:33.842587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:33.843036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:33.846706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-plugged", "status": "completed", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:33.873432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:33.875363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:33.906965 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] Creating event network-vif-plugged:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h1-826756-5 Aug 03 04:37:33.930226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:37:33.966473 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-59efe601-56a1-415e-9953-3309e067f0e7 req-530ccd73-2df8-436d-ab48-32e00b760ef1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129060 Aug 03 04:37:33.967680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 768/1562] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:33.987154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:33.987930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:33.995793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.000309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.000309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.000309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.220862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:34.237050 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35aab133-e40b-48d1-9354-09382e806fd0 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.433805 Aug 03 04:37:34.237050 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 795/1563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:33 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:34.250477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:34.251608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:34.259302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.261138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.262346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.263060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.475801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:34.544171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:34.558495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d58931e7-a060-431b-8761-61e280394ddf tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1487 microversion: 2.1 time: 0.586319 Aug 03 04:37:34.559964 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 769/1564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:33 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1487 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:34.586471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:34.587024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:34.600674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.605975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.605975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.605975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.649264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lazy-loading 'flavor' on Instance uuid c314dde1-5aec-4fbf-91bb-5f3668df458a {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:37:34.650268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:34.660141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab2c81d8-5882-447d-82ef-7de199bcc73c tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.413634 Aug 03 04:37:34.676498 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 796/1565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:34 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:34.815850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:34.817095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:34.826673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.827149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.828171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.828643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.936297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:34.945625 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41c3f0a8-974a-4c4d-93b4-4c0cc66a56e3 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1282 microversion: 2.1 time: 0.135401 Aug 03 04:37:34.950725 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 797/1566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:34 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:34.956132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:34.956910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:34.976435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.976929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:34.978194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:34.978917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.020385 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-136c53bd-ad5d-41dc-ade1-2f6198fc0e00 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a/action" status: 202 len: 0 microversion: 2.1 time: 0.438346 Aug 03 04:37:35.024565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 770/1567] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:37:34 2022] POST /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:37:35.056066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:35.059266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:35.069304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.077979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.080424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.080896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.334062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.357461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.361892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.365996 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8736ac22-2e05-4710-9c74-b60edb137bfc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.413033 Aug 03 04:37:35.379670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 798/1568] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:34 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:35.386859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.388659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:35.389376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:35.396798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1c12d9fb-08d9-48db-a3e9-ae471328a055 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1495 microversion: 2.1 time: 0.369925 Aug 03 04:37:35.397646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 771/1569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:35 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1495 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:35.403096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.403711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.404585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.405031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.628198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.641542 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9dbe7c66-f0f4-4e37-ac2c-d4a1c698dfc8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.263044 Aug 03 04:37:35.642511 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 799/1570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:35 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:35.682504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:35.683177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:35.718121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.718724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.719737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.720028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.922909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:35.936037 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f90c963e-aab3-481c-8f97-e14d356eeabf tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.257935 Aug 03 04:37:35.937257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 772/1571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:35 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:35.977676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:35.979052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:35.986676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.986794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:35.987654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:35.988093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.303303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:36.318002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f17d5264-0994-4d65-a7ef-14b0c4309ad6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.353959 Aug 03 04:37:36.319335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 800/1572] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:35 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:36.393756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:36.395064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:36.404351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.405442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.406981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.407852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.427535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:36.429045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:36.444509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.453336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.457925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.458738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.724295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:36.726097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:36.739277 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c563396b-e9ba-40c2-b1e9-b795c850f69f tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1495 microversion: 2.1 time: 0.313739 Aug 03 04:37:36.739443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:36.739579 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 801/1573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:36 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1495 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:36.739693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:36.739693 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-329df150-c48e-4c99-aa51-019d54f87b02 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.349047 Aug 03 04:37:36.740480 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 773/1574] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:36 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:36.741528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:36.742176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:36.748881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.749335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.750108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.750543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.958256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:36.958810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:36.973444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.974304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.975299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:36.975904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:36.983023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:37.005295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d7985673-f9cf-4b22-b9ab-42393e774782 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.267669 Aug 03 04:37:37.040778 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 802/1575] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:36 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:37.318351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:37.330476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-36cd5d7e-5c91-41e0-9d20-8ac950e5186a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.376577 Aug 03 04:37:37.342577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:37.342577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:37.357623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 774/1576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:36 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:37.360689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.361638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.362693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.363199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.422034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-657dec0f-6eee-4331-98b8-5a9a347a5531 req-a3242bd4-17d0-4d92-80b2-69de6ac532fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc2d56c-d691-4263-9ff5-4f405c41927c", "tag": "c3f39f32-a60b-42ab-ac9f-ab3897b01cf7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:37.437086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-657dec0f-6eee-4331-98b8-5a9a347a5531 req-a3242bd4-17d0-4d92-80b2-69de6ac532fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.437627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-657dec0f-6eee-4331-98b8-5a9a347a5531 req-a3242bd4-17d0-4d92-80b2-69de6ac532fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.485076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-657dec0f-6eee-4331-98b8-5a9a347a5531 req-a3242bd4-17d0-4d92-80b2-69de6ac532fe service nova] Creating event network-changed:c3f39f32-a60b-42ab-ac9f-ab3897b01cf7 for instance bdc2d56c-d691-4263-9ff5-4f405c41927c on n-h2-826756-5 Aug 03 04:37:37.491593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-657dec0f-6eee-4331-98b8-5a9a347a5531 req-a3242bd4-17d0-4d92-80b2-69de6ac532fe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075638 Aug 03 04:37:37.492770 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 775/1577] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:37:37.659344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:37.668370 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c033af60-128c-42e8-9fc0-53d693e9d51c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.332556 Aug 03 04:37:37.693592 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 803/1578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:37 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:37.764823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:37.765644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:37.768254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:37.768943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:37.784526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.784985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.785774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.786208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.796826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.797492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:37.798332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:37.803211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.222675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:38.234786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.242167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.246044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.249742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac02719f-eef7-451b-975f-ac89a31c4127 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.490593 Aug 03 04:37:38.271352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.272437 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88367a8a-5696-48f7-afe9-8e64f7cec2a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 200 len: 1478 microversion: 2.1 time: 0.516748 Aug 03 04:37:38.272631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 804/1579] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:37 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:37:38.273412 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 776/1580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:37 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 1478 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:38.278295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:38.279104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:38.285783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.287168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.287418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.288007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.299920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-173901269"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:38.303947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:38.313920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:38.326368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.332598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.332598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.332598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.451605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.465101 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3514223-2911-47c8-9e6f-478c4b9f079b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.190279 Aug 03 04:37:38.466316 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 805/1581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:38 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:38.472633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:38.473250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:38.481214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.481667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.482677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.483282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.592495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=20 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:38.755497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:38.757901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7605407d-2a40-4181-90eb-fd27018a7a79 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.288276 Aug 03 04:37:38.759871 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 806/1582] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:38 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:38.765025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:38.765957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:38.772715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.773506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.774594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:38.777117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:38.951700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff9b17ef-21b8-43f6-8ac9-fd7188a106a4 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a/action" status: 202 len: 0 microversion: 2.1 time: 0.632459 Aug 03 04:37:38.951700 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 777/1583] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:37:38 2022] POST /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 03 04:37:38.956801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8a033c2-b527-4a96-a494-6e239281a118 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54819790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:39.081875 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8a033c2-b527-4a96-a494-6e239281a118 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1437 microversion: 2.1 time: 0.129468 Aug 03 04:37:39.084986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 778/1584] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:38 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:39.124787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:39.149064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce1184f6-4086-46e2-8f71-68d5e4474dfa tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.376884 Aug 03 04:37:39.149064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 807/1585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:38 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:39.280571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:39.281711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:39.294394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.295884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.297722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.299135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.504389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:39.507791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:39.549281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.549840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.555762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.557409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.660622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:39.673504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:39.675342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:39.677320 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cdcfc0b4-656a-43a1-99d5-d5b90f9e1479 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.402129 Aug 03 04:37:39.678091 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 779/1586] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:39 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:39.781346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:39.784973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:39.808077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.809246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.813082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:39.813735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:39.928252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:39.940190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-87b85f66-dcfa-4be7-94db-e3d6838fa6e9 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.455616 Aug 03 04:37:39.948653 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 808/1587] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:39 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:39.967513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-38c3dbc3-0882-466d-be17-08569309816a req-de755446-0ba7-4a37-af9a-8dc1cd67663e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d57099d-0a46-4f93-acd2-59bbc8e08fef", "tag": "ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:40.001691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-38c3dbc3-0882-466d-be17-08569309816a req-de755446-0ba7-4a37-af9a-8dc1cd67663e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:40.010823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-38c3dbc3-0882-466d-be17-08569309816a req-de755446-0ba7-4a37-af9a-8dc1cd67663e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:40.049396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=26 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:40.052213 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-38c3dbc3-0882-466d-be17-08569309816a req-de755446-0ba7-4a37-af9a-8dc1cd67663e service nova] Creating event network-changed:ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d for instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef on n-h1-826756-5 Aug 03 04:37:40.076089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-38c3dbc3-0882-466d-be17-08569309816a req-de755446-0ba7-4a37-af9a-8dc1cd67663e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123635 Aug 03 04:37:40.080071 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 809/1588] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:40.104177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97374d17-00cf-413e-937a-1e85c9d5c36c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54f92430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:40.226880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:40.243541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97374d17-00cf-413e-937a-1e85c9d5c36c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1437 microversion: 2.1 time: 0.147782 Aug 03 04:37:40.251831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 810/1589] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:40 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1437 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:40.260139 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a124be06-c964-476e-ad4c-8728ce0e25e2 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.459423 Aug 03 04:37:40.261952 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 780/1590] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:39 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:40.263888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:40.273373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:40.305149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:40.306257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:40.307275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:40.308013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:40.626782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:40.638186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de220348-b4f2-4913-b075-252ae53c5e67 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.384658 Aug 03 04:37:40.639258 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 811/1591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:40 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:40.704170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:40.707781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:40.763181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:40.770337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:40.773355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:40.776050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:40.994357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:40.997326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:41.054597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:41.056925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:41.057999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:41.058590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:41.063324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:41.077895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:41.083039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:41.084635 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af69b987-36c3-4e5c-96f0-be18a14ea1db tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.384994 Aug 03 04:37:41.101154 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 781/1592] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:40 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:41.261136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c21ffdc-bec4-4cdf-a7d0-ddc3d5aaa8cc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54a65ee0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:41.768248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:41.782867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ddc5a57c-a2ed-4e26-9437-17d2011cc03f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.810563 Aug 03 04:37:41.784869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 812/1593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:40 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:41.795546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:41.801060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:41.815274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:41.815725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:41.818815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:41.819271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.223310 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c21ffdc-bec4-4cdf-a7d0-ddc3d5aaa8cc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1437 microversion: 2.1 time: 0.968033 Aug 03 04:37:42.231566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 782/1594] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:41 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1437 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:37:42.243149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:42.246084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:42.246740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:42.256089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc572d2f-2558-4736-921c-57ecd031ac63 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.467011 Aug 03 04:37:42.257351 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 813/1595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:41 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:42.263201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:42.264217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:42.273422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.273898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.277160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.280889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.286225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.286225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.286225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.286225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.820439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:42.829309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:42.836922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:42.853659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ce5dde8-b574-43de-8622-17213971ab50 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.608582 Aug 03 04:37:42.853942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:42.854063 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 783/1596] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:42 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:42.854165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83e9eef5-4c3f-41e3-b8f6-b7983624edb2 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.585387 Aug 03 04:37:42.854165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 814/1597] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:42 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:42.854165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-unplugged", "status": "completed", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:42.854430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-01820b63-f9a9-4240-b2ea-9c73d21960d0 req-133eea9d-ad74-440f-9bfa-c6cd65f63ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e331d1e-abed-4f52-970b-189348b5fff6", "name": "network-vif-plugged", "status": "completed", "tag": "ee27001f-28ce-4767-af6d-0c115227cabc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:42.885038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.885992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.890888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-01820b63-f9a9-4240-b2ea-9c73d21960d0 req-133eea9d-ad74-440f-9bfa-c6cd65f63ea7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.891355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-01820b63-f9a9-4240-b2ea-9c73d21960d0 req-133eea9d-ad74-440f-9bfa-c6cd65f63ea7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.917297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:42.929871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] Creating event network-vif-unplugged:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:37:42.940048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:37:42.940572 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-01820b63-f9a9-4240-b2ea-9c73d21960d0 req-133eea9d-ad74-440f-9bfa-c6cd65f63ea7 service nova] Creating event network-vif-plugged:ee27001f-28ce-4767-af6d-0c115227cabc for instance 4e331d1e-abed-4f52-970b-189348b5fff6 on n-h1-826756-5 Aug 03 04:37:42.952740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-01820b63-f9a9-4240-b2ea-9c73d21960d0 req-133eea9d-ad74-440f-9bfa-c6cd65f63ea7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107115 Aug 03 04:37:42.956241 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 784/1598] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:42.964938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:42.966414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:42.976451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-baae8972-d64a-4d6b-9e61-3ac85ca7330b req-fb5e89e0-45d0-46e2-96df-fa1c00e0ea9e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127043 Aug 03 04:37:42.977570 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 815/1599] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:42.982233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.988216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:42.988216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:42.988216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:43.242773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72afc838-7736-4a26-ba57-39812c1cfb8c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54615430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:43.255233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:43.268845 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fa58559-55c3-4875-8338-87fce09ac6a6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.310535 Aug 03 04:37:43.272108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 785/1600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:42 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:43.287729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:43.288809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:43.300658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:43.303275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:43.309901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:43.310932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:43.657374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:43.669051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ed8caf49-510e-4e76-9fc8-65bb755cdb4d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.393074 Aug 03 04:37:43.669685 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 786/1601] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:43 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:43.896354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:43.897540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:43.927502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:43.929199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:43.930265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:43.947888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:44.417038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:44.426906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:44.428898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:44.430262 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c09bb5c4-9aa3-4277-8dba-044da95659b8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.541131 Aug 03 04:37:44.431566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 787/1602] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:43 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:37:44.437738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:44.438861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:44.458944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:44.459624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:44.460710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:44.463456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:44.939509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:44.955463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-42ae54d5-485c-4d36-b8be-0cbcbd914d55 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.516302 Aug 03 04:37:44.973631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 788/1603] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:44 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:45.007828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:45.013741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:45.033350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:45.033854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:45.035427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:45.035880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:45.494680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:45.508630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de10a538-65f9-4779-a875-6b1696eff0f7 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.509557 Aug 03 04:37:45.542664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 789/1604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:44 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:45.555628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:45.566615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:45.586918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:45.590897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:45.595281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:45.596133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:45.970281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:45.979845 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88ae9f2a-d23e-4483-8d88-19b17b2cefd3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.434031 Aug 03 04:37:46.007745 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 790/1605] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:45 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:46.007745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:46.012063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:46.039361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:46.041572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:46.070874 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] Creating event network-changed:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:37:46.092405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 04:37:46.116864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a59023b3-d443-451c-a9c4-30583a1ddcc2 req-f21ca6d5-6811-47cd-8547-07f4ee1fefca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131030 Aug 03 04:37:46.118276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 791/1606] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:46.130890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:46.132227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:46.144841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:46.150762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:46.151872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:46.152532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:46.548169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:46.578896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:46.582403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:46.584150 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db80abe3-92fe-4dfd-9b36-5e19ded04096 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1280 microversion: 2.25 time: 0.463677 Aug 03 04:37:46.606061 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 792/1607] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:46 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1280 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:46.626346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:46.630015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:46.647936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:46.655613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:46.660945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:46.661659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:47.280951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:47.299710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0cf4509a-3293-48bf-9cbe-c09a9fb38f9d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.679429 Aug 03 04:37:47.299710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 793/1608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:46 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:47.320421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b89c77bd-5250-4f07-b88d-06342a0f1e64 req-5b5ea3ce-ff8a-4914-ad78-29e52816750a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314dde1-5aec-4fbf-91bb-5f3668df458a", "name": "network-vif-plugged", "status": "completed", "tag": "91b326ed-30ce-4432-bd1c-56a48b7aa83e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:47.350586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b89c77bd-5250-4f07-b88d-06342a0f1e64 req-5b5ea3ce-ff8a-4914-ad78-29e52816750a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:47.351574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b89c77bd-5250-4f07-b88d-06342a0f1e64 req-5b5ea3ce-ff8a-4914-ad78-29e52816750a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:47.373705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b89c77bd-5250-4f07-b88d-06342a0f1e64 req-5b5ea3ce-ff8a-4914-ad78-29e52816750a service nova] Creating event network-vif-plugged:91b326ed-30ce-4432-bd1c-56a48b7aa83e for instance c314dde1-5aec-4fbf-91bb-5f3668df458a on n-h1-826756-5 Aug 03 04:37:47.390474 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b89c77bd-5250-4f07-b88d-06342a0f1e64 req-5b5ea3ce-ff8a-4914-ad78-29e52816750a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077543 Aug 03 04:37:47.390474 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 794/1609] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:47.393899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:47.395659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:47.407845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:47.409262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:47.410522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:47.424978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:47.927689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:47.942794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d8d26da-d9c3-41cd-ac77-d53d1ac3a0c4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.552572 Aug 03 04:37:47.946114 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 795/1610] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:47 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:47.951443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:47.952586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:47.974399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:47.974859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:47.975665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:47.976096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.267549 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d59e63bb-990e-4132-bf78-452e8ebd4055 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1811 microversion: 2.1 time: 0.319688 Aug 03 04:37:48.272565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 796/1611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:47 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1811 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:48.283689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:48.284582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:48.293032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.293926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.295879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.297064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.572133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:48.588078 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c376e1e4-b548-4659-bfe3-ce5f8ec8cc9e tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.309020 Aug 03 04:37:48.588078 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 797/1612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:48 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:48.603742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:48.604479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:48.620515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.631721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.631721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.631721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.944308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:48.959749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:48.959749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:48.963840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf2bc003-44a3-4591-a7e7-0d505c1a13e1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1476 microversion: 2.25 time: 0.376206 Aug 03 04:37:48.963840 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 798/1613] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:48 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:48.985144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:48.987961 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:37:48.987961 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:37:48.989299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.995622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:48.995622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:48.995622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:49.019944 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d37ed8f-a0ad-4955-ad42-c736f2dd0cc1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046693 Aug 03 04:37:49.039608 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 799/1614] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:37:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:49.054360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:49.056713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:49.078079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:49.079832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:49.081322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:49.081322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:49.550386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:49.558516 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b0b974f3-059a-443a-b4fa-ecac67341a54 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.515538 Aug 03 04:37:49.559108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 800/1615] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:49 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:49.563811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:49.564618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:49.573561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:49.574315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:49.575799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:49.576335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:49.749963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:49.759848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-444a9340-d4b1-4138-b569-ecfabafe0c26 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1468 microversion: 2.1 time: 0.198698 Aug 03 04:37:49.772297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 801/1616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:49 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1468 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:50.266984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:50.271377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:50.279232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:50.280814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:50.281869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:50.283069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:50.566873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 4e331d1e-abed-4f52-970b-189348b5fff6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:37:50.575700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:50.599907 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb8f5ea6-caa9-4021-a4e4-00a065cf445d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1968 microversion: 2.25 time: 0.836791 Aug 03 04:37:50.601605 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 802/1617] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:49 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1968 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:50.615587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:50.616545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:50.633432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:50.635539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:50.643570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:50.643570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:50.855702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:50.870596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8767830b-9e11-4730-b448-0a8c2ae55883 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.264144 Aug 03 04:37:50.884317 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 803/1618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:50 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:50.899238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ce1f519a-effa-448e-8e6f-d7697d40ceae req-57846f48-364c-43a5-a85b-bdc865ba170a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d57099d-0a46-4f93-acd2-59bbc8e08fef", "name": "network-vif-plugged", "status": "completed", "tag": "ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:50.919106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ce1f519a-effa-448e-8e6f-d7697d40ceae req-57846f48-364c-43a5-a85b-bdc865ba170a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:50.919624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ce1f519a-effa-448e-8e6f-d7697d40ceae req-57846f48-364c-43a5-a85b-bdc865ba170a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:50.980236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ce1f519a-effa-448e-8e6f-d7697d40ceae req-57846f48-364c-43a5-a85b-bdc865ba170a service nova] Creating event network-vif-plugged:ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d for instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef on n-h1-826756-5 Aug 03 04:37:50.989847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ce1f519a-effa-448e-8e6f-d7697d40ceae req-57846f48-364c-43a5-a85b-bdc865ba170a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115116 Aug 03 04:37:50.990469 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 804/1619] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:51.018888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:51.021199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:51.050174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.052502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.053934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.054393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.422446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:51.433614 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1fdf35d-23e2-4e4d-b156-afcd629ae687 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1324 microversion: 2.1 time: 0.441919 Aug 03 04:37:51.444677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 805/1620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:50 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:51.456972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:51.458317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:51.466664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.467318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.468413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.469012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.703954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 4e331d1e-abed-4f52-970b-189348b5fff6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:37:51.720812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80b48d36-2c5e-400e-968c-62f128f6099d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1968 microversion: 2.25 time: 0.274705 Aug 03 04:37:51.721783 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 806/1621] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:37:51 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1968 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:37:51.726484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:51.727845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:51.738741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.739593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.740662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.741187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.935060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:51.951671 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04d8f18f-292d-4af0-a705-77e5ed361255 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1461 microversion: 2.1 time: 0.225153 Aug 03 04:37:51.951944 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 807/1622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:51 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1461 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:51.977785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:51.977785 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:37:51.977785 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:37:51.977785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.978304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:51.984186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:51.984186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.047633 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca4620fa-0e4c-4f8f-9991-23f29ef4263d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.070234 Aug 03 04:37:52.047633 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 808/1623] 10.222.0.72 () {60 vars in 1217 bytes} [Wed Aug 3 04:37:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:37:52.047633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:52.047633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:52.069701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.074341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.074341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.074341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.340519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:52.361030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2dbc1d1a-76f0-4965-b37a-5d2013f54a59 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.323772 Aug 03 04:37:52.364958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 809/1624] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:52 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:52.384303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:52.385705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:52.392509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.393193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.394159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.395122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.755829 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b41e2747-2db4-4922-a964-9e37b2aab1de tempest-MigrationsAdminTest-1171050231 tempest-MigrationsAdminTest-1171050231-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1612 microversion: 2.1 time: 0.389198 Aug 03 04:37:52.757168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 810/1625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:52 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1612 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:52.767940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": "auto"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:52.777278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:52.800609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.802412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.802412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:52.808454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:52.846210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'flavor' on Instance uuid 4e331d1e-abed-4f52-970b-189348b5fff6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:37:52.860776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120831) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:37:52.888525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=79 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:52.935883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=53 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:37:57.338125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b6b967c-246e-4a3a-9034-e6f9fe77dc0f tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6/action" status: 202 len: 0 microversion: 2.25 time: 4.579561 Aug 03 04:37:57.339377 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 811/1626] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:37:52 2022] POST /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6/action => generated 0 bytes in 4581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:57.344527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:57.349384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:57.370551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:57.371037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:57.371867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:57.372388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:57.649842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:37:57.662604 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a541e669-cb28-4b94-a530-f0107922d24d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1520 microversion: 2.1 time: 0.322086 Aug 03 04:37:57.664160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 812/1627] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:57 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:37:57.710116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1bee60b-18d8-4ff9-ab51-42c222418b6f", "device": "/dev/xvdb"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:57.720009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:57.736518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:57.737010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:57.737927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:57.738372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.025236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13652979-5f2a-4d59-befd-30cb812b5dd0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.358718 Aug 03 04:37:59.026323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 813/1628] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:37:57 2022] POST /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 194 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:59.050887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:59.052736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:59.069647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:59.072298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.073316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:59.074431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.135017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:37:59.603264 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1be9ee7-349b-4c55-8ac0-7dd06c72b631 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 204 len: 0 microversion: 2.1 time: 0.575212 Aug 03 04:37:59.605079 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 814/1629] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:37:59 2022] DELETE /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:37:59.610609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc2d56c-d691-4263-9ff5-4f405c41927c", "name": "network-vif-plugged", "status": "completed", "tag": "c3f39f32-a60b-42ab-ac9f-ab3897b01cf7"}, {"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-plugged", "status": "completed", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:37:59.661250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:59.661702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.722494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] Creating event network-vif-plugged:c3f39f32-a60b-42ab-ac9f-ab3897b01cf7 for instance bdc2d56c-d691-4263-9ff5-4f405c41927c on n-h2-826756-5 Aug 03 04:37:59.731108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] Creating event network-vif-plugged:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:37:59.752734 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e54beed0-3b03-45e4-bdbc-1b1764b08872 req-dbe9dd95-fdb0-42b3-9238-e949ec11d9d9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.143113 Aug 03 04:37:59.759285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 815/1630] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:37:59.777355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:37:59.782253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:37:59.808521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:59.808983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.809839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:37:59.810410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:37:59.831833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:00.119529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:00.131486 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf748cdc-b444-4ddf-8384-ada97f73022d tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.366102 Aug 03 04:38:00.137239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 816/1631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:37:59 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:00.145915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:00.153607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:00.175650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:00.176194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:00.182045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:00.184550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:00.589928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:00.622370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:00.624718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:00.626513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71a99937-79be-4614-ba69-7a06464c4d91 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.487892 Aug 03 04:38:00.639817 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 817/1632] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:00 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:00.663630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:00.665124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:00.673991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:00.674778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:00.675863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:00.676604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:00.952467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:00.981005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd35a21a-5b38-43f9-97e0-e2e2d3905d3e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1520 microversion: 2.1 time: 0.302881 Aug 03 04:38:00.981005 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 818/1633] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:00 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:00.981005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:00.981005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:00.981005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:00.981956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:01.000838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:01.006546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:01.344140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:01.359158 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-858fb25f-4981-48f3-9b92-20b660ef0ef4 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1467 microversion: 2.1 time: 0.393777 Aug 03 04:38:01.361579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 819/1634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:00 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1467 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:01.369165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1374085702"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:01.386877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:01.405097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:01.407237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:01.411255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:01.411954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:01.988233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:02.118417 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72afc838-7736-4a26-ba57-39812c1cfb8c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1437 microversion: 2.1 time: 18.882041 Aug 03 04:38:02.122000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 816/1635] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:37:43 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1437 bytes in 18888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:02.134711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:02.135770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:02.158946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:02.159849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:02.161150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:02.161775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:02.629065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:02.642089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f9667aca-f03a-445d-8bd7-0cc1429435d9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1370 microversion: 2.1 time: 0.518926 Aug 03 04:38:02.646724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 817/1636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:02 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1370 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:02.654008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:02.655338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:02.663877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:02.664716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:02.665689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:02.666294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:03.044253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:03.055634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:03.057594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:03.061787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c9e05fd-fc2d-4908-bf67-7c7b8d28b8f8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.413663 Aug 03 04:38:03.068100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 818/1637] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:02 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:03.084486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:03.087754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:03.105547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:03.105547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:03.106221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:03.106383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:03.333929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-217af2b4-738b-4696-a632-55c696398d57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef/action" status: 202 len: 0 microversion: 2.1 time: 1.960686 Aug 03 04:38:03.336723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 820/1638] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:38:01 2022] POST /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef/action => generated 0 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:38:03.351006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7840826-3a03-49c7-9be9-591fd037b985 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54936b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:03.473068 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7840826-3a03-49c7-9be9-591fd037b985 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1437 microversion: 2.1 time: 0.133957 Aug 03 04:38:03.474100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 821/1639] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:03 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1437 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:03.485010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e3668a8-9b93-49eb-983a-a7bbe9d8e34e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd5495bee0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:03.486366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:03.500971 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-494a200a-08eb-455f-a77a-821ac98bcd4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1467 microversion: 2.1 time: 0.428731 Aug 03 04:38:03.516099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 819/1640] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:03 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1467 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:03.667821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:03.671533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:03.710423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:03.712911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:03.724820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:03.725916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.043439 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e3668a8-9b93-49eb-983a-a7bbe9d8e34e tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2" status: 204 len: 0 microversion: 2.1 time: 0.568034 Aug 03 04:38:04.045207 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 822/1641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:03 2022] DELETE /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:04.055708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-18ba1dc9-2c4c-4d1a-a797-cb7c2eb2aa91 req-0cb143ed-7216-42c5-89b8-02d1245734bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50913bc4-cb92-46d6-b98f-d1e46516a963", "name": "network-vif-deleted", "tag": "db753519-5fc9-49a6-9e36-701062465426"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:04.095918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18ba1dc9-2c4c-4d1a-a797-cb7c2eb2aa91 req-0cb143ed-7216-42c5-89b8-02d1245734bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.103454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18ba1dc9-2c4c-4d1a-a797-cb7c2eb2aa91 req-0cb143ed-7216-42c5-89b8-02d1245734bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.125506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-18ba1dc9-2c4c-4d1a-a797-cb7c2eb2aa91 req-0cb143ed-7216-42c5-89b8-02d1245734bb service nova] Creating event network-vif-deleted:db753519-5fc9-49a6-9e36-701062465426 for instance 50913bc4-cb92-46d6-b98f-d1e46516a963 on n-h2-826756-5 Aug 03 04:38:04.131864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:04.142197 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49d53f05-84e1-48f9-956b-254bd313b1d7 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1555 microversion: 2.1 time: 0.479094 Aug 03 04:38:04.142985 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 820/1642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:03 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1555 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:04.149469 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-18ba1dc9-2c4c-4d1a-a797-cb7c2eb2aa91 req-0cb143ed-7216-42c5-89b8-02d1245734bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100525 Aug 03 04:38:04.150437 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 823/1643] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:04.157833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-660a8350-8382-42d8-ab65-cd2924fe01f9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd54808820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.161672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.175107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:04.190663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-660a8350-8382-42d8-ab65-cd2924fe01f9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Image not found. Aug 03 04:38:04.195862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.196675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.198824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-660a8350-8382-42d8-ab65-cd2924fe01f9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2 HTTP/1.1 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:04.201080 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2379813a-faf1-4312-85e1-77cd3028eee2'} Aug 03 04:38:04.203394 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:04.204485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2379813a-faf1-4312-85e1-77cd3028eee2 Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:04.205768 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2379813a-faf1-4312-85e1-77cd3028eee2 could not be found. Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:04.207341 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:04.216687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-660a8350-8382-42d8-ab65-cd2924fe01f9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:04.219295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-660a8350-8382-42d8-ab65-cd2924fe01f9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2" status: 404 len: 62 microversion: 2.1 time: 0.070004 Aug 03 04:38:04.219295 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 821/1644] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:04.220448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.241319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.242258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:04.256516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.256516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.256516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.259005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.474429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb033338-e58d-4497-80b1-fead0f44b372 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255220 Aug 03 04:38:04.474429 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 822/1645] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:04.493614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.495281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:04.519309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.527435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.534127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:04.543682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:04.547803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.548309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.550182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:04.552842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab78e647-a0dd-46fd-9409-b4cd96abd517 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.401067 Aug 03 04:38:04.557119 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 824/1646] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:04.572943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7970179a-919c-4638-bff0-3a0003cc530a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54936b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.649535 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7970179a-919c-4638-bff0-3a0003cc530a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1446 microversion: 2.1 time: 0.079942 Aug 03 04:38:04.650602 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 825/1647] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:04.655593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:04.656560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:04.678774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.679505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.680892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.681573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.785963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:04.790596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:04.791153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lazy-loading 'fault' on Instance uuid 50913bc4-cb92-46d6-b98f-d1e46516a963 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:04.953647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:04.963659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75f0c97c-986c-4a6b-b3e0-09b1ffa6aa86 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 200 len: 1301 microversion: 2.1 time: 0.311750 Aug 03 04:38:04.973369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 826/1648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 1301 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:04.978547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3611a316-62c4-4fe3-a1d3-c0fd85d2cbc5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd549109d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:05.080000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:05.092630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3611a316-62c4-4fe3-a1d3-c0fd85d2cbc5 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 200 len: 1446 microversion: 2.1 time: 0.114150 Aug 03 04:38:05.093931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 827/1649] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 1446 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:05.095194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44e0815b-4e80-4d2b-af73-fb3eb8992aa4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1532 microversion: 2.1 time: 0.619434 Aug 03 04:38:05.096046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 823/1650] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:04 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1532 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:05.108230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b961e3b3-a474-4570-a966-00081d0c6a83 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5495b0d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:05.583677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:05.584962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:05.598550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:05.599007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:05.599832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:05.600293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:05.862218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:05.892424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:05.894235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:05.898603 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6eb232ba-2f52-4a2b-a814-c861f443d9dc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.316445 Aug 03 04:38:05.898603 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 824/1651] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:05 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:06.059731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:06.062801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 50913bc4-cb92-46d6-b98f-d1e46516a963] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:06.079987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.081051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.082157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.082956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.101744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] HTTP exception thrown: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Request method failure captured: Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 HTTP/1.1 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpfTwe2TbUNj7wOEZyZ6WFd-_O2IHqdEGMKi2wSR_S1i8a-qA23P-b9IQtm3FPYw_gBgME-I0jHJb0yo9Y4NAb6Z_UJy-wlJhPw93FGOrshRKMdthmt2Oj6i8_K8kW_ppWE2eDbizuymWU7Qq68PpYsZf9vFaLGgdTp53O7EnvUSRg Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:06.104066 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f75c9c3239c4b89a6b7971eec9f1a99 Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. Aug 03 04:38:06.110996 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '50913bc4-cb92-46d6-b98f-d1e46516a963'} Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:06.111892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. Aug 03 04:38:06.113329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:06.114606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Returning 404 to user: Instance 50913bc4-cb92-46d6-b98f-d1e46516a963 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:06.114606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9f1afd8-826c-47f3-a28c-9374c4be182f tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963" status: 404 len: 111 microversion: 2.1 time: 0.062658 Aug 03 04:38:06.116354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 825/1652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:06 2022] GET /compute/v2.1/servers/50913bc4-cb92-46d6-b98f-d1e46516a963 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:06.123774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:06.124694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:06.133487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.137566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.137566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.137566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.170425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:06.606271 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6568cd5c-c3fe-4070-ab8d-1c4996b5aae8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 204 len: 0 microversion: 2.1 time: 0.487806 Aug 03 04:38:06.611713 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 826/1653] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:06 2022] DELETE /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:06.631288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:06.643490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:06.663419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.664817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.666240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.666948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.761401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b961e3b3-a474-4570-a966-00081d0c6a83 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 204 len: 0 microversion: 2.1 time: 1.654653 Aug 03 04:38:06.762763 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 828/1654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:05 2022] DELETE /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 0 bytes in 1660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:06.767836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:06.770066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:06.779295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.780339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.781385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.782221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.963255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:06.973555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-60b35864-b35d-4ced-bbba-b9b5c265c6a0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1538 microversion: 2.1 time: 0.362909 Aug 03 04:38:06.975319 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 827/1655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:06 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1538 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:06.982462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:06.989047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:06.991935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.992846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:06.999241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:06.999368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:07.017379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:07.032910 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5f65b83-1337-43ba-a2ca-993038d0a0fe tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1532 microversion: 2.1 time: 0.268786 Aug 03 04:38:07.033514 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 829/1656] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:06 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1532 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:07.038080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:07.038688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:07.057407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:07.057883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:07.058740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:07.059191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:07.094950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:07.384325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:07.402088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:07.404131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:07.406466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-48ad4b71-c6fb-4164-aa7f-15a96224a8d4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.371109 Aug 03 04:38:07.409011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 830/1657] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:07 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:07.516502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8ecb4912-12d3-4977-9fff-8b7cd1bf167b req-b4c2dc34-975a-475e-8179-53162f1e7ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc2d56c-d691-4263-9ff5-4f405c41927c", "tag": "c3f39f32-a60b-42ab-ac9f-ab3897b01cf7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:07.542194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8ecb4912-12d3-4977-9fff-8b7cd1bf167b req-b4c2dc34-975a-475e-8179-53162f1e7ddb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:07.547979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8ecb4912-12d3-4977-9fff-8b7cd1bf167b req-b4c2dc34-975a-475e-8179-53162f1e7ddb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:07.568081 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b62f1b22-978a-42ff-b033-ae39210ee61e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 204 len: 0 microversion: 2.1 time: 0.590272 Aug 03 04:38:07.569176 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 828/1658] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:06 2022] DELETE /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:07.592193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8ecb4912-12d3-4977-9fff-8b7cd1bf167b req-b4c2dc34-975a-475e-8179-53162f1e7ddb service nova] Creating event network-changed:c3f39f32-a60b-42ab-ac9f-ab3897b01cf7 for instance bdc2d56c-d691-4263-9ff5-4f405c41927c on n-h2-826756-5 Aug 03 04:38:07.606623 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8ecb4912-12d3-4977-9fff-8b7cd1bf167b req-b4c2dc34-975a-475e-8179-53162f1e7ddb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091302 Aug 03 04:38:07.611298 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 831/1659] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:38:07.788004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1199834345", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:07.894716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] validate_networks() for [('c5a8ec40-ea05-4646-9e9c-eb20a8d5d55e', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:38:07.997622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:08.001860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:08.015719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:08.016658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:08.020817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:08.020817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:08.607046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:08.626676 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70679601-6bd6-459e-b639-c53da15a1621 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1538 microversion: 2.1 time: 0.633768 Aug 03 04:38:08.629395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 832/1660] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:07 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1538 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:08.639380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:08.644540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:08.661599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:08.662055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:08.669078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:08.672527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.224409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:09.239930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:38:09.240590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:38:09.241087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:38:09.241602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:38:09.241993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf4250ee-5a09-4ea2-b727-1c6c4af815f8 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1532 microversion: 2.1 time: 0.610762 Aug 03 04:38:09.243014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:38:09.245847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 833/1661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:08 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1532 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:09.258812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:09.260864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:09.265620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.266202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.267226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.267767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.283127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.285754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.285754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.285754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.306347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:38:09.314096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Getting quotas for user 14aa35fa1b9d4a5786b67c5a3234f571 and project 107bce041cef4b7c96c471bd18f6d2a9. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:38:09.329504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:38:09.333002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:38:09.500727 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b682bf21-32a0-43a2-8652-a0c1d2a3095d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716853 Aug 03 04:38:09.502700 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 829/1662] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:38:09.518369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef71295a-fce8-493a-abad-ea360f050f7a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:09.530982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef71295a-fce8-493a-abad-ea360f050f7a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:09.593977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:09.610218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:09.613627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:09.615117 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2999982c-d3e7-4dbb-8f9f-ae5e6c687283 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.368056 Aug 03 04:38:09.620990 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 834/1663] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:09 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:09.658272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:09.659119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:09.697546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.697546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.697546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:09.697546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:09.719453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef71295a-fce8-493a-abad-ea360f050f7a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:09.728043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef71295a-fce8-493a-abad-ea360f050f7a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1208 microversion: 2.1 time: 0.216083 Aug 03 04:38:09.733883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 830/1664] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:09 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1208 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:10.265916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:10.272828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:10.283746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:10.284117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:10.284999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:10.289261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:10.629548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:10.641668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f5457ae-e194-4869-bc1b-0d0e74672846 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1533 microversion: 2.1 time: 0.994271 Aug 03 04:38:10.662820 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 835/1665] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:09 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1533 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:10.682792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d1085342-8c6c-4ab3-8b25-10e1789a6b34 req-f0eff9e8-4b3f-4fb9-9bcb-24b6b3b9ac56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314dde1-5aec-4fbf-91bb-5f3668df458a", "name": "network-vif-unplugged", "status": "completed", "tag": "91b326ed-30ce-4432-bd1c-56a48b7aa83e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:10.722866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d1085342-8c6c-4ab3-8b25-10e1789a6b34 req-f0eff9e8-4b3f-4fb9-9bcb-24b6b3b9ac56 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:10.723761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d1085342-8c6c-4ab3-8b25-10e1789a6b34 req-f0eff9e8-4b3f-4fb9-9bcb-24b6b3b9ac56 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:10.791946 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d1085342-8c6c-4ab3-8b25-10e1789a6b34 req-f0eff9e8-4b3f-4fb9-9bcb-24b6b3b9ac56 service nova] Creating event network-vif-unplugged:91b326ed-30ce-4432-bd1c-56a48b7aa83e for instance c314dde1-5aec-4fbf-91bb-5f3668df458a on n-h1-826756-5 Aug 03 04:38:10.807466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d1085342-8c6c-4ab3-8b25-10e1789a6b34 req-f0eff9e8-4b3f-4fb9-9bcb-24b6b3b9ac56 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143175 Aug 03 04:38:10.808787 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 836/1666] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:10.814311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:10.839126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:10.870603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:10.884826 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc0400ca-a439-4be2-8976-6d5dad755997 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1532 microversion: 2.1 time: 0.623229 Aug 03 04:38:10.902411 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 831/1667] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:10 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1532 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:10.902842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:10.903396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:10.906792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:10.910684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:10.915423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1aeae93a-5e60-42b4-8002-56ed8c3ef385 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:10.947517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1aeae93a-5e60-42b4-8002-56ed8c3ef385 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:11.228504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1aeae93a-5e60-42b4-8002-56ed8c3ef385 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:11.236801 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1aeae93a-5e60-42b4-8002-56ed8c3ef385 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1208 microversion: 2.1 time: 0.334703 Aug 03 04:38:11.411415 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 832/1668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:10 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1208 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:11.411415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-946168676", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "1e7ffef4-1367-4963-ab04-531befb7591b"}, {"uuid": "f3e39e77-9ab7-4a6f-a652-68716fd4b363"}, {"uuid": "1e7ffef4-1367-4963-ab04-531befb7591b"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:11.414269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:11.416584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:11.419432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:11.425933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5320fbd-db5e-490d-ae10-2ef7c302afef tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.615618 Aug 03 04:38:11.430684 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 837/1669] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:10 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:11.455667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] validate_networks() for [('1e7ffef4-1367-4963-ab04-531befb7591b', None, None, None, None, None), ('f3e39e77-9ab7-4a6f-a652-68716fd4b363', None, None, None, None, None), ('1e7ffef4-1367-4963-ab04-531befb7591b', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:38:11.497738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d5dfcce8-7b3f-48ab-9b99-c8e63f9d837b req-2b96f219-65f9-4d9c-962e-04bbeb3f621b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314dde1-5aec-4fbf-91bb-5f3668df458a", "name": "network-vif-deleted", "tag": "91b326ed-30ce-4432-bd1c-56a48b7aa83e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:11.511121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d5dfcce8-7b3f-48ab-9b99-c8e63f9d837b req-2b96f219-65f9-4d9c-962e-04bbeb3f621b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:11.511853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d5dfcce8-7b3f-48ab-9b99-c8e63f9d837b req-2b96f219-65f9-4d9c-962e-04bbeb3f621b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:11.516831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:11.533882 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d5dfcce8-7b3f-48ab-9b99-c8e63f9d837b req-2b96f219-65f9-4d9c-962e-04bbeb3f621b service nova] Creating event network-vif-deleted:91b326ed-30ce-4432-bd1c-56a48b7aa83e for instance c314dde1-5aec-4fbf-91bb-5f3668df458a on n-h1-826756-5 Aug 03 04:38:11.534068 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d5dfcce8-7b3f-48ab-9b99-c8e63f9d837b req-2b96f219-65f9-4d9c-962e-04bbeb3f621b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040680 Aug 03 04:38:11.541053 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 838/1670] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:38:11.671887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:11.672685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:11.689859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:11.710413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:11.711709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:11.712927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:11.713577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.136648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:12.157009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6c9c3e7-235b-4e3b-8605-90c0bb78c885 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1520 microversion: 2.1 time: 0.487065 Aug 03 04:38:12.176205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 839/1671] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:11 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1520 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:12.194044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4f0dc31b-f8a0-48c8-850c-2aeb9f982e2f req-f52b0675-ee72-4d93-b06e-7e7305566d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "877076b6-ab04-4dce-a6e4-1a00041c8d24", "name": "network-vif-deleted", "tag": "402faff9-2f61-490e-8ea3-7a810d1480e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:12.223417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4f0dc31b-f8a0-48c8-850c-2aeb9f982e2f req-f52b0675-ee72-4d93-b06e-7e7305566d12 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.228174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4f0dc31b-f8a0-48c8-850c-2aeb9f982e2f req-f52b0675-ee72-4d93-b06e-7e7305566d12 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.255323 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4f0dc31b-f8a0-48c8-850c-2aeb9f982e2f req-f52b0675-ee72-4d93-b06e-7e7305566d12 service nova] Creating event network-vif-deleted:402faff9-2f61-490e-8ea3-7a810d1480e4 for instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 on n-h1-826756-5 Aug 03 04:38:12.263740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4f0dc31b-f8a0-48c8-850c-2aeb9f982e2f req-f52b0675-ee72-4d93-b06e-7e7305566d12 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085859 Aug 03 04:38:12.265100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 840/1672] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:12.305023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:12.305767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:12.333400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.335011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.342918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.343394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.424719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.425632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.426367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lazy-loading 'fault' on Instance uuid 877076b6-ab04-4dce-a6e4-1a00041c8d24 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:12.491459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:12.500245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-882f0a64-4c8b-450a-b4f7-a76146120379 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 200 len: 1368 microversion: 2.1 time: 0.209852 Aug 03 04:38:12.509740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 841/1673] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:12 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:12.519353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:12.520731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:12.531794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.533343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.534015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:12.534667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:12.566147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:13.224287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47b549b2-c686-4dcc-b5f1-17d2865c1a2c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 204 len: 0 microversion: 2.1 time: 0.710005 Aug 03 04:38:13.232049 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 842/1674] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:12 2022] DELETE /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:13.275060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:13.276004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:13.306939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:13.307842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:13.308952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:13.309562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:13.539782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:13.562852 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73c47ff8-d676-43fd-bfcd-e068af3e127b tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1268 microversion: 2.1 time: 0.324148 Aug 03 04:38:13.575945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 843/1675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:13 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1268 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:13.584775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:13.585424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:13.603624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:13.607698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:13.611520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:13.611520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.069075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:38:14.070911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:38:14.071666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:38:14.072329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:38:14.073114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:38:14.083834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:14.092801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.093701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.101335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:14.102677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.103252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.103836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:14.105993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-36cb787e-f1a0-43c1-ab62-4afd93ef3611 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.531270 Aug 03 04:38:14.107105 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 844/1676] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:13 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:14.114330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-abc52a8a-f58c-4157-a35b-345e01964f35 req-ee945192-fc73-4907-ab31-2c12c6e5a43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d57099d-0a46-4f93-acd2-59bbc8e08fef", "name": "network-vif-plugged", "status": "completed", "tag": "ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:14.149833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abc52a8a-f58c-4157-a35b-345e01964f35 req-ee945192-fc73-4907-ab31-2c12c6e5a43d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.150588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abc52a8a-f58c-4157-a35b-345e01964f35 req-ee945192-fc73-4907-ab31-2c12c6e5a43d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.151493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Getting quotas for project 27e9f6d5dd60435f8bf8cfd56d500e7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:38:14.164940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Getting quotas for user 07c40946ced64a83ac98d6205e212ed4 and project 27e9f6d5dd60435f8bf8cfd56d500e7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:38:14.177119 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-abc52a8a-f58c-4157-a35b-345e01964f35 req-ee945192-fc73-4907-ab31-2c12c6e5a43d service nova] Creating event network-vif-plugged:ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d for instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef on n-h1-826756-5 Aug 03 04:38:14.193477 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-abc52a8a-f58c-4157-a35b-345e01964f35 req-ee945192-fc73-4907-ab31-2c12c6e5a43d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081361 Aug 03 04:38:14.196191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:38:14.198445 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 845/1677] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:14.200720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:38:14.216961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:14.219305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:14.257346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.257346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.258152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.258295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.524919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3814ef82-9fda-4d8a-a1b6-e447fa206455 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.265365 Aug 03 04:38:14.527000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:14.527970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 833/1678] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:38:14.539533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:14.542761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 877076b6-ab04-4dce-a6e4-1a00041c8d24] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:14.549885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.550712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.551738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.552579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] HTTP exception thrown: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Request method failure captured: Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 HTTP/1.1 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpfTwe2TbUNj7wOEZyZ6WFd-_O2IHqdEGMKi2wSR_S1i8a-qA23P-b9IQtm3FPYw_gBgME-I0jHJb0yo9Y4NAb6Z_UJy-wlJhPw93FGOrshRKMdthmt2Oj6i8_K8kW_ppWE2eDbizuymWU7Qq68PpYsZf9vFaLGgdTp53O7EnvUSRg Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:14.573288 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f75c9c3239c4b89a6b7971eec9f1a99 Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. Aug 03 04:38:14.574950 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '877076b6-ab04-4dce-a6e4-1a00041c8d24'} Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:14.575998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. Aug 03 04:38:14.577683 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:14.578970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Returning 404 to user: Instance 877076b6-ab04-4dce-a6e4-1a00041c8d24 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:14.578970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-11af02c7-c6fa-4a42-97b7-97a980121b4d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24" status: 404 len: 111 microversion: 2.1 time: 0.043330 Aug 03 04:38:14.579254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7e85efe-3ead-4cdd-8092-67280589ae57 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1526 microversion: 2.1 time: 0.372018 Aug 03 04:38:14.582194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 834/1679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:14 2022] GET /compute/v2.1/servers/877076b6-ab04-4dce-a6e4-1a00041c8d24 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:14.588199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-998932a2-ee3d-4883-976e-93da07d0fc40 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:14.589370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-998932a2-ee3d-4883-976e-93da07d0fc40 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:14.591587 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 846/1680] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:14 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1526 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:14.619596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:14.619596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:14.619596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.619596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.620302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:14.620302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:14.715071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-998932a2-ee3d-4883-976e-93da07d0fc40 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:14.722619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-998932a2-ee3d-4883-976e-93da07d0fc40 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1212 microversion: 2.1 time: 0.138963 Aug 03 04:38:14.726758 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 835/1681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:14 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:14.734530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b695fb3a-1490-4178-a000-666dc7ac509c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '.version_select at 0x7fdd546234c0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:15.004006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b695fb3a-1490-4178-a000-666dc7ac509c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676407734" status: 202 len: 0 microversion: 2.1 time: 0.274816 Aug 03 04:38:15.009148 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 836/1682] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:38:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676407734 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:38:15.109905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:15.118579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bfd3b36f-2bb7-4782-a113-8601e6afbef8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.512341 Aug 03 04:38:15.125480 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 847/1683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:14 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:15.139067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:15.139678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:15.167762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:15.168329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:15.169245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:15.169872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:15.616196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:15.617439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:15.617797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:15.624578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:15.625042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:15.625815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:15.626238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:15.629774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:15.634211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:15.640372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8f65fbd-8920-48f1-ac84-b179630b02d0 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.501818 Aug 03 04:38:15.659024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 837/1684] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:15 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:15.747248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c58f3f8f-0f88-4d7e-80e7-894f8feb0278 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:15.748147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c58f3f8f-0f88-4d7e-80e7-894f8feb0278 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:15.855167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c58f3f8f-0f88-4d7e-80e7-894f8feb0278 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:15.863125 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c58f3f8f-0f88-4d7e-80e7-894f8feb0278 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1212 microversion: 2.1 time: 0.120506 Aug 03 04:38:15.863714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 838/1685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:15 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1212 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:15.989768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:16.005238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bd3ee70-c8a8-499d-afd4-1a711d3626b4 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1526 microversion: 2.1 time: 0.392781 Aug 03 04:38:16.005841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 848/1686] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:15 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1526 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:16.150220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:16.151860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:16.173290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.173290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.173290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.173290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.173940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:16.236927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-701d4601-4203-4636-ae21-3a0f52759a1e req-bd663bfe-e750-440a-b7f7-844c798f8d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d57099d-0a46-4f93-acd2-59bbc8e08fef", "name": "network-vif-unplugged", "status": "completed", "tag": "ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:16.251218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-701d4601-4203-4636-ae21-3a0f52759a1e req-bd663bfe-e750-440a-b7f7-844c798f8d1b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.252129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-701d4601-4203-4636-ae21-3a0f52759a1e req-bd663bfe-e750-440a-b7f7-844c798f8d1b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.267110 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-701d4601-4203-4636-ae21-3a0f52759a1e req-bd663bfe-e750-440a-b7f7-844c798f8d1b service nova] Creating event network-vif-unplugged:ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d for instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef on n-h1-826756-5 Aug 03 04:38:16.275192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-701d4601-4203-4636-ae21-3a0f52759a1e req-bd663bfe-e750-440a-b7f7-844c798f8d1b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042042 Aug 03 04:38:16.280477 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 849/1687] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:16.355971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:16.393186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3db3f953-e86a-4229-a53b-32a0f5439ec6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.229604 Aug 03 04:38:16.393186 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 839/1688] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:16 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:16.443795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7225ad84-e328-4a55-942c-a65680bf9040 req-293905bc-073e-4051-b2bc-40ec057791f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d57099d-0a46-4f93-acd2-59bbc8e08fef", "name": "network-vif-deleted", "tag": "ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:16.486223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7225ad84-e328-4a55-942c-a65680bf9040 req-293905bc-073e-4051-b2bc-40ec057791f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.486678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7225ad84-e328-4a55-942c-a65680bf9040 req-293905bc-073e-4051-b2bc-40ec057791f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.528889 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7225ad84-e328-4a55-942c-a65680bf9040 req-293905bc-073e-4051-b2bc-40ec057791f7 service nova] Creating event network-vif-deleted:ba8bccd8-56ce-4a03-adcf-f5d3a751ed9d for instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef on n-h1-826756-5 Aug 03 04:38:16.535571 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7225ad84-e328-4a55-942c-a65680bf9040 req-293905bc-073e-4051-b2bc-40ec057791f7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111326 Aug 03 04:38:16.541264 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 850/1689] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:16.591761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:16.592288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:16.598589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.599332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.600309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.601062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.645126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:16.670829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:16.672385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:16.690425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.708486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.711337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.711337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.917956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:16.927069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:16.930430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:16.936494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54ee6f0e-db52-47a6-9dbe-092283e2512a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.269667 Aug 03 04:38:16.942691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 851/1690] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:16 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:16.942691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:16.943168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:16.950031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.950476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:16.951268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:16.951899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.042462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:17.051811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f392a91-0115-400e-9941-987ec98f03a7 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1216 microversion: 2.1 time: 0.113474 Aug 03 04:38:17.053103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 852/1691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:16 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:17.058774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:17.059394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:17.065821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.066577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.067536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.068158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.106633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.107115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.107535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lazy-loading 'fault' on Instance uuid 6d57099d-0a46-4f93-acd2-59bbc8e08fef {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:17.150671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:17.158531 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eae353cb-ae9b-4e4b-8db0-c76505dbb302 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 200 len: 1314 microversion: 2.1 time: 0.104394 Aug 03 04:38:17.159161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 853/1692] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:17 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:17.229096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9e78f773-6084-4939-b265-47201cf2366d req-5edbb560-6b68-4a00-b45f-0320f2f27061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "323f47e3-f889-4a29-9913-3646bb1bf5b8", "tag": "996be256-87e5-456d-a39c-0e49e2a378d6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:17.239347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9e78f773-6084-4939-b265-47201cf2366d req-5edbb560-6b68-4a00-b45f-0320f2f27061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.239816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9e78f773-6084-4939-b265-47201cf2366d req-5edbb560-6b68-4a00-b45f-0320f2f27061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.261336 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9e78f773-6084-4939-b265-47201cf2366d req-5edbb560-6b68-4a00-b45f-0320f2f27061 service nova] Creating event network-changed:996be256-87e5-456d-a39c-0e49e2a378d6 for instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 on n-h2-826756-5 Aug 03 04:38:17.274084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9e78f773-6084-4939-b265-47201cf2366d req-5edbb560-6b68-4a00-b45f-0320f2f27061 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049071 Aug 03 04:38:17.276320 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 854/1693] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:17.278486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:17.400497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:17.404282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:17.408474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.408985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.409778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.410372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.468525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7d039a4-caa3-41af-a545-2ddc9ae783f6 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 204 len: 0 microversion: 2.1 time: 0.878853 Aug 03 04:38:17.469366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 840/1694] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:16 2022] DELETE /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 0 bytes in 882 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:17.479777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:17.480533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:17.488654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.489113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.490153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.490873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.592592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:17.618255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ade10a34-b8a7-4385-b755-50694e5688eb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.209291 Aug 03 04:38:17.618255 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 855/1695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:17 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:17.662335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:17.670217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7815218-9666-4673-8a1f-e0c4bffa09ad tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1468 microversion: 2.1 time: 0.196453 Aug 03 04:38:17.670888 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 841/1696] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:17 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:17.963358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:17.964214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:17.971238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.971693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.972493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:17.972933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:17.995933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:18.074000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:18.074706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:18.081182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.081629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.082398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.082833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.114761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:18.123664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:18.125970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:18.127265 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7c8418e-471f-45c4-a9d7-6a8e327e1d4a tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.168432 Aug 03 04:38:18.127933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 856/1697] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:17 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:18.153083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:18.160904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49fe4753-6d4e-4288-81bd-ee0b1e1fbe3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1264 microversion: 2.1 time: 0.091722 Aug 03 04:38:18.161475 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 842/1698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:18 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:18.182270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:18.182899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:18.189080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.189539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.190312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.190758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.205150 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef HTTP/1.1 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:18.206816 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:18.208652 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '6d57099d-0a46-4f93-acd2-59bbc8e08fef'} Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:18.209670 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:18.211921 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:18.213414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:18.213414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb551a51-7660-4782-80c9-1b54628310d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 404 len: 111 microversion: 2.1 time: 0.030341 Aug 03 04:38:18.213414 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 857/1699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:18 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:18.314293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-628293497", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:18.369990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] validate_networks() for [('da7926bc-1605-4375-ae40-4ba35e5d1b81', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:38:18.639185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:18.640135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:18.649806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.650537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.651427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:18.651879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:18.988972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.004920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a93d444-90ca-4103-9c14-d7a90041af44 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.372405 Aug 03 04:38:19.010657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 858/1700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:18 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:19.017099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:19.018506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:19.027562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.027869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:38:19.028134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:38:19.028763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.028912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:38:19.029343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:38:19.030268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:38:19.030686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.031346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.044100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.044917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.045961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.046596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.066203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:38:19.072181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Getting quotas for user 1ef5280a59af4ef09aa3e84ec74e1b61 and project d54bc45a4deb4fdbb34486c0dee35849. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:38:19.090865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:38:19.094344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:38:19.245432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.253274 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc52bfd8-2d58-4b33-9c5b-60710c06744d tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1468 microversion: 2.1 time: 0.246199 Aug 03 04:38:19.253888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 859/1701] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:19 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:19.260126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:19.260355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:19.267275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.267741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.268552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.269001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.490242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.495835 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b24f937f-4bec-4ce5-a52c-56cff9259e8b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.185854 Aug 03 04:38:19.497484 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 843/1702] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:38:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:38:19.498052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.499826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.502143 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-32fbfcd8-5734-4d0c-869c-b2272d8433c4 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.246472 Aug 03 04:38:19.502963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 860/1703] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:19 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:19.504793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:19.505653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:19.515146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.515931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.516994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:19.517676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:19.528824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-463d7071-4849-4705-acc1-18f18fa919ef tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:19.529470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-463d7071-4849-4705-acc1-18f18fa919ef tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:19.653288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-463d7071-4849-4705-acc1-18f18fa919ef tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.660163 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-463d7071-4849-4705-acc1-18f18fa919ef tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1224 microversion: 2.1 time: 0.138091 Aug 03 04:38:19.673735 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 861/1704] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:19 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1224 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:19.677215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:19.686403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c3f9700-3ba2-421f-8024-bdbe31a107d3 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1270 microversion: 2.1 time: 0.187191 Aug 03 04:38:19.687525 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 844/1705] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:19 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:20.030405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:20.031698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:20.046348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.050413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.051925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.054228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.276436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:20.277305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:20.285518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.286156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.287110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.287720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.464516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:20.472609 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e802639-7626-44ad-bff7-27d49e15b8be tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.446362 Aug 03 04:38:20.473198 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 862/1706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:20 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:20.531215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:20.531854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:20.537937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.538525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.539296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.539728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.578230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:20.594225 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8406c1a1-261f-4355-a501-97c3f553e616 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1468 microversion: 2.1 time: 0.320991 Aug 03 04:38:20.596381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 845/1707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:20 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:20.681703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ff25c9da-87f4-454a-bc50-a32be151d70d req-82a0e736-1b5a-4425-a7cd-d7e3fce66838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b7a2c1-2404-4a23-a372-6d98770a14db", "name": "network-vif-deleted", "tag": "c00d5808-88f0-4a7f-802c-eaee5d14fba0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:20.710745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ff25c9da-87f4-454a-bc50-a32be151d70d req-82a0e736-1b5a-4425-a7cd-d7e3fce66838 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.711452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ff25c9da-87f4-454a-bc50-a32be151d70d req-82a0e736-1b5a-4425-a7cd-d7e3fce66838 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.730611 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ff25c9da-87f4-454a-bc50-a32be151d70d req-82a0e736-1b5a-4425-a7cd-d7e3fce66838 service nova] Creating event network-vif-deleted:c00d5808-88f0-4a7f-802c-eaee5d14fba0 for instance 04b7a2c1-2404-4a23-a372-6d98770a14db on n-h2-826756-5 Aug 03 04:38:20.736374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ff25c9da-87f4-454a-bc50-a32be151d70d req-82a0e736-1b5a-4425-a7cd-d7e3fce66838 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059809 Aug 03 04:38:20.738072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 846/1708] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:38:20.745953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-761a79bc-c19d-4eee-9cd4-3a2ebb17ff0f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:20.749084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-761a79bc-c19d-4eee-9cd4-3a2ebb17ff0f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:20.879528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-761a79bc-c19d-4eee-9cd4-3a2ebb17ff0f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:20.888190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-761a79bc-c19d-4eee-9cd4-3a2ebb17ff0f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1224 microversion: 2.1 time: 0.148484 Aug 03 04:38:20.889059 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 847/1709] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:20 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:20.895071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:20.895958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:20.903995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.904843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.905865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:20.906451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:20.992904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.002172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.003785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.006035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-583a7d17-72b0-418c-ae8e-1ccd90fe3fd3 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.478024 Aug 03 04:38:21.012337 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 863/1710] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:20 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:21.025801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:21.026612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:21.035660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.036900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.037720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.038802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.157168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.167897 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41b97fee-90b0-4951-91b8-ff1b9a1373ba tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1312 microversion: 2.1 time: 0.276576 Aug 03 04:38:21.169312 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 848/1711] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:20 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:21.298688 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9ee41984-2068-4f13-b920-3deac012d4e8 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1857 microversion: 2.1 time: 0.289769 Aug 03 04:38:21.299312 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 864/1712] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:21 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1857 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:21.320203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-5", "block_migration": true, "disk_over_commit": false}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:21.322772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:21.330115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.334096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.334096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.334096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.358884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lazy-loading 'flavor' on Instance uuid 82bb2fcb-cf43-444a-87f4-bbca57d65276 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:21.370844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Going to try to live migrate instance to n-h1-826756-5 {{(pid=120832) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:38:21.509652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:21.510623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:21.536022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.536568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.543621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.543621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.689578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.698338 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c40127b-984b-4e50-ae2d-10354dced150 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.207814 Aug 03 04:38:21.698942 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 865/1713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:21 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:21.715994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:21.721352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:21.722927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.723427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.724688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.724688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.756582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.757079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.757529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lazy-loading 'fault' on Instance uuid 04b7a2c1-2404-4a23-a372-6d98770a14db {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:21.797556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:21.805761 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d80138ba-f61d-4224-846e-086e03da7208 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1302 microversion: 2.1 time: 0.094773 Aug 03 04:38:21.806344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 866/1714] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:21 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:21.912286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:21.919996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:21.927111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.927720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:21.929489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:21.930477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.332979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:22.341789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e58473fa-d128-4761-a6c4-871e2caa8313 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1276 microversion: 2.1 time: 0.433472 Aug 03 04:38:22.342400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 867/1715] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:21 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1276 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:22.355516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:22.356147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:22.363620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.364178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.365217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.365747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.577118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:22.593121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:22.595064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:22.596523 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef5169a8-6ed8-4ffa-a110-64ec2f77e68b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.253183 Aug 03 04:38:22.597271 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 868/1716] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:22 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:22.602370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:22.603197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:22.617900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.618356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.619144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.619587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.875543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:22.886120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d4f03dc-1cc6-48eb-b307-4b15cb9fcc5d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1333 microversion: 2.1 time: 0.287596 Aug 03 04:38:22.887615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 869/1717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:22 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1333 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:22.893656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:22.895707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:22.909296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.909751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:22.910532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:22.911101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.183344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.197828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7cc84b04-cb06-450e-baf2-b19eba63287a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.308304 Aug 03 04:38:23.198509 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 870/1718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:22 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:23.207956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:23.212163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:23.228448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.228448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.230001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.230473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.264434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.268675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.268675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lazy-loading 'fault' on Instance uuid 04b7a2c1-2404-4a23-a372-6d98770a14db {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:23.320325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.332331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27885956-2593-4cfd-873b-24c9be1073f5 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 200 len: 1302 microversion: 2.1 time: 0.132248 Aug 03 04:38:23.332991 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 871/1719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:23 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:23.368877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:23.369506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:23.376134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.376904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.377702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.378150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.448842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.456455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77e739ef-f904-453e-89b1-186f7a34fc82 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1282 microversion: 2.1 time: 0.093104 Aug 03 04:38:23.457048 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 872/1720] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:23 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:23.620552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:23.621236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:23.638164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.639094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.639592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.640042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.876814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.886955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.888893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:23.890195 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cdf88fdf-53de-4d03-881e-f8ff1039c7c6 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.274281 Aug 03 04:38:23.891308 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 873/1721] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:23 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:23.910285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:23.911337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:23.919599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.920071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.920884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:23.921326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:23.926928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:24.118888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:24.128424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43d48bdc-08ea-4132-b214-89dc1e34ddbc tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.223364 Aug 03 04:38:24.129194 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 874/1722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:23 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:24.220228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:24.222442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:24.229393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.229730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.230519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.230961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.504599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:24.513636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40e9b75a-cd93-44f5-be3c-5bb8bc55b300 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.298073 Aug 03 04:38:24.514360 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 875/1723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:24 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:24.533917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:24.534556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: 04b7a2c1-2404-4a23-a372-6d98770a14db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:24.541426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.541891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.542884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.543336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.567451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] HTTP exception thrown: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Request method failure captured: Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db HTTP/1.1 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fpfTwe2TbUNj7wOEZyZ6WFd-_O2IHqdEGMKi2wSR_S1i8a-qA23P-b9IQtm3FPYw_gBgME-I0jHJb0yo9Y4NAb6Z_UJy-wlJhPw93FGOrshRKMdthmt2Oj6i8_K8kW_ppWE2eDbizuymWU7Qq68PpYsZf9vFaLGgdTp53O7EnvUSRg Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:24.569112 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1f75c9c3239c4b89a6b7971eec9f1a99 Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. Aug 03 04:38:24.571810 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '04b7a2c1-2404-4a23-a372-6d98770a14db'} Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:24.572714 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. Aug 03 04:38:24.575148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:24.583978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Returning 404 to user: Instance 04b7a2c1-2404-4a23-a372-6d98770a14db could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:24.583978 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4419c32e-9930-4a98-ae31-06a7fc693f93 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db" status: 404 len: 111 microversion: 2.1 time: 0.041508 Aug 03 04:38:24.583978 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 876/1724] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:24 2022] GET /compute/v2.1/servers/04b7a2c1-2404-4a23-a372-6d98770a14db => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:24.583978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:24.583978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:24.584535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.584535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.585566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.585893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.789897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:24.798614 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29f491e4-5b0e-422f-8aa4-38f23bce0654 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.225573 Aug 03 04:38:24.812836 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 877/1725] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:24 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:24.819139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:24.819790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:24.826173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.827703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.828600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:24.829272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:24.859224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:25.267981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:25.522823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63595810-2c77-4ef3-bb6b-084331ee8040 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 204 len: 0 microversion: 2.1 time: 0.708363 Aug 03 04:38:25.524340 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 878/1726] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:24 2022] DELETE /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:25.533611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ab0b77f3-ff94-473f-ab69-e0a1dc1672c7 req-77cbd60d-9436-49ad-bccd-12d2afabe908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "tag": "228ad446-936b-4371-ad44-7730d8616e77"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:25.546630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab0b77f3-ff94-473f-ab69-e0a1dc1672c7 req-77cbd60d-9436-49ad-bccd-12d2afabe908 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.547078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab0b77f3-ff94-473f-ab69-e0a1dc1672c7 req-77cbd60d-9436-49ad-bccd-12d2afabe908 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.561280 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ab0b77f3-ff94-473f-ab69-e0a1dc1672c7 req-77cbd60d-9436-49ad-bccd-12d2afabe908 service nova] Creating event network-changed:228ad446-936b-4371-ad44-7730d8616e77 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:25.567371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ab0b77f3-ff94-473f-ab69-e0a1dc1672c7 req-77cbd60d-9436-49ad-bccd-12d2afabe908 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041488 Aug 03 04:38:25.568128 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 879/1727] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:25.573200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:25.573902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:25.580159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.580662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.581438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.581882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.592520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9723a3a4-f193-4bca-a9d0-4b4e96bdaada tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/action" status: 202 len: 0 microversion: 2.1 time: 4.276513 Aug 03 04:38:25.593442 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 849/1728] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:38:21 2022] POST /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/action => generated 0 bytes in 4278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:38:25.600807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:25.601851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:25.608997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.609947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.610769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.611373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.831328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:25.836209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:25.840751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:25.842406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:25.843680 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6dc95056-dad1-4df1-a0a2-0128028776f7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.274510 Aug 03 04:38:25.844251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 880/1729] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:25 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:25.844411 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b8298ef-1d99-42a2-877e-e22a1a795a43 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.249536 Aug 03 04:38:25.849168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 850/1730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:25 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:25.849328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5c01190f-3683-48e5-a2a2-10ed7d3ff6e1 req-3d394f59-b1e4-417b-9a23-5aaedce9c626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3011a3-c011-4841-a2df-394badbcce23", "tag": "d23be8de-0cf3-44f0-b07e-3f8f8c0f3470"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:25.854277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:25.855187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:25.861824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.862350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.863164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.863638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.873283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5c01190f-3683-48e5-a2a2-10ed7d3ff6e1 req-3d394f59-b1e4-417b-9a23-5aaedce9c626 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.873283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5c01190f-3683-48e5-a2a2-10ed7d3ff6e1 req-3d394f59-b1e4-417b-9a23-5aaedce9c626 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.885178 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5c01190f-3683-48e5-a2a2-10ed7d3ff6e1 req-3d394f59-b1e4-417b-9a23-5aaedce9c626 service nova] Creating event network-changed:d23be8de-0cf3-44f0-b07e-3f8f8c0f3470 for instance 1d3011a3-c011-4841-a2df-394badbcce23 on n-h1-826756-5 Aug 03 04:38:25.889933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5c01190f-3683-48e5-a2a2-10ed7d3ff6e1 req-3d394f59-b1e4-417b-9a23-5aaedce9c626 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044364 Aug 03 04:38:25.890938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 881/1731] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:25.898467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:25.899385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:25.905835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.906283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:25.907095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:25.907534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.089085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:26.096956 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15820531-1fc6-4186-a578-b25cf164608e tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1469 microversion: 2.1 time: 0.247999 Aug 03 04:38:26.097652 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 851/1732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:25 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:26.103406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:26.104023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:26.104172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:26.113221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.113221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.113221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.113221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.114471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d09039b-e92a-4666-9a3e-b8d15275b4b3 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 0.221876 Aug 03 04:38:26.115066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 882/1733] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:25 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:26.119725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:26.120362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:26.130871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.131317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.132366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.132827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.369237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:26.375653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:26.380073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c6d578d-d6a4-4b56-aabf-0e273d214843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.280751 Aug 03 04:38:26.389417 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 852/1734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:26 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:26.389556 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ee56da5-a2df-450c-91e7-4d26c41c30d0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.268605 Aug 03 04:38:26.389556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 883/1735] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:26 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:26.591342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-75b8e128-018c-469e-9df0-172c4d23737e req-94b24973-5449-4a0c-bbab-03800da3a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323f47e3-f889-4a29-9913-3646bb1bf5b8", "name": "network-vif-plugged", "status": "completed", "tag": "996be256-87e5-456d-a39c-0e49e2a378d6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:26.602906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-75b8e128-018c-469e-9df0-172c4d23737e req-94b24973-5449-4a0c-bbab-03800da3a6ee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.603853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-75b8e128-018c-469e-9df0-172c4d23737e req-94b24973-5449-4a0c-bbab-03800da3a6ee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.623360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-75b8e128-018c-469e-9df0-172c4d23737e req-94b24973-5449-4a0c-bbab-03800da3a6ee service nova] Creating event network-vif-plugged:996be256-87e5-456d-a39c-0e49e2a378d6 for instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 on n-h2-826756-5 Aug 03 04:38:26.633816 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-75b8e128-018c-469e-9df0-172c4d23737e req-94b24973-5449-4a0c-bbab-03800da3a6ee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049011 Aug 03 04:38:26.634436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 853/1736] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:38:26.868319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:26.868975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:26.872325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:26.875171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:26.884417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.885264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.886065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.886539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.887223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.889549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:26.890792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:26.891712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:27.704686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:27.713031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c250ebe3-bb2f-4002-9f5d-b57cba8bb7b5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.845127 Aug 03 04:38:27.714072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 854/1737] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:26 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:27.718706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:27.719473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:27.726310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:27.726839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:27.727680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:27.728185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:27.734201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:27.840134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:27.848826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:27.851030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:27.852578 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76d3cda7-fe54-4f5f-8829-f796169b1251 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.989100 Aug 03 04:38:27.852898 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 884/1738] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:26 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:27.857494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:27.862459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:27.865214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:27.865696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:27.867154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:27.868516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:28.705276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:28.713158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54e5c7ba-814d-405c-9620-21607f5c8600 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1469 microversion: 2.1 time: 0.997940 Aug 03 04:38:28.715626 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 855/1739] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:27 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1469 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:28.720806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:28.721923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:28.729737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:28.730464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:28.731254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:28.731697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:28.844620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:28.854145 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-490d351e-9d23-4121-94f5-443ac1b2f249 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1308 microversion: 2.1 time: 1.000203 Aug 03 04:38:28.854822 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 885/1740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:27 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1308 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:28.859998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:28.860846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:28.868039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:28.868536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:28.869382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:28.869829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.058796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:29.353534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:29.365636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d0edcd5-ecec-43f4-933c-639bccc5a469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.647799 Aug 03 04:38:29.379879 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 856/1741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:28 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:29.379879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "tag": "77f86bfa-b9ac-4011-8ce4-21fc12235c45"}, {"server_uuid": "4e331d1e-abed-4f52-970b-189348b5fff6", "name": "network-vif-unplugged", "status": "completed", "tag": "ee27001f-28ce-4767-af6d-0c115227cabc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:29.388181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:29.389053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.405406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] Creating event network-changed:77f86bfa-b9ac-4011-8ce4-21fc12235c45 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:29.406089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] Creating event network-vif-unplugged:ee27001f-28ce-4767-af6d-0c115227cabc for instance 4e331d1e-abed-4f52-970b-189348b5fff6 on n-h1-826756-5 Aug 03 04:38:29.413955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-23d2c33e-b102-4739-8d97-c560524b61fb req-5dddaf3e-4293-4f06-b8ad-e62ace62f423 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.044880 Aug 03 04:38:29.414906 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 857/1742] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:29.422369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:29.423384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:29.435086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:29.435824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.438778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:29.439521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.440725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:29.452115 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bca721c5-b8d5-4561-a351-c7624e80337a tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.596089 Aug 03 04:38:29.461366 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 886/1743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:28 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:29.485172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:29.485801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:29.504518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:29.504976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.505767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:29.506207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:29.659813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:30.110772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.119827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76b5662f-fbf0-40e4-b488-11707f844a4b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.703447 Aug 03 04:38:30.120455 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 858/1744] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:29 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:30.122938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.125698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:30.126595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:30.133499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.133911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.134390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.135412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.136251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.136672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.137905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b09ebe96-d3c2-413d-b996-2cf09e30053f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.663593 Aug 03 04:38:30.138933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 887/1745] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:29 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:30.144041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:30.146087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:30.157215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.158515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.159710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.161782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.515881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.526116 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6492ce2-0cbf-46e5-b734-77b44845591c tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1427 microversion: 2.1 time: 0.404425 Aug 03 04:38:30.527031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 859/1746] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:30 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1427 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:30.532084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:30.532975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:30.540515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.543837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.543837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.543837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.604102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.612079 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07b754ff-5a2f-4c0f-9854-1855e5e27f0c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1487 microversion: 2.1 time: 0.472066 Aug 03 04:38:30.624342 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 888/1747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:30 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1487 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:30.624342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:30.624342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:30.632144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.632752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.633615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.634153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.797597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.815174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4e98c23-576d-49c2-83e5-651f0457f682 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.286713 Aug 03 04:38:30.819113 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 860/1748] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:30 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:30.828186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2047488761"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:30.831635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:30.857809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.858376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.859245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:30.859759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:30.888439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=28 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:30.899646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:30.908107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c08e7ff4-3585-4d6b-8cb1-64949555c63c tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.294069 Aug 03 04:38:30.909498 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 889/1749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:30 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:31.141438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.142131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:31.154882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.155335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.157718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.157718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.337692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:31.346524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-562c6e5c-6351-4ac7-a362-1bc66e6c1255 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.208785 Aug 03 04:38:31.347464 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 890/1750] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:31.354628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.355362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:31.363416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.364241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.365327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.365857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.370739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:31.512568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e93cd595-5525-4fb7-bb26-a7cfba304ae9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "POST /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8/action" status: 202 len: 0 microversion: 2.1 time: 0.691899 Aug 03 04:38:31.519600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 861/1751] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:38:30 2022] POST /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:38:31.526714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e331d1e-abed-4f52-970b-189348b5fff6", "tag": "ee27001f-28ce-4767-af6d-0c115227cabc"}, {"server_uuid": "a6f9d777-b044-4bf0-a264-a382c4a049b7", "name": "network-vif-deleted", "tag": "3f626651-d5f6-4102-ad1b-12dba52c2ac7"}, {"name": "network-changed", "server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "tag": "ef115f15-f6c7-4320-a4d5-3071ac9e875b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:31.539057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.539781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.555713 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Creating event network-changed:ee27001f-28ce-4767-af6d-0c115227cabc for instance 4e331d1e-abed-4f52-970b-189348b5fff6 on n-h1-826756-5 Aug 03 04:38:31.556469 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Creating event network-vif-deleted:3f626651-d5f6-4102-ad1b-12dba52c2ac7 for instance a6f9d777-b044-4bf0-a264-a382c4a049b7 on n-h1-826756-5 Aug 03 04:38:31.557171 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] Creating event network-changed:ef115f15-f6c7-4320-a4d5-3071ac9e875b for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:31.565516 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f5ae765b-969a-4f6d-8eb7-d53b22725ab2 req-42647ab6-02c7-4b18-9fa3-9bc298144d46 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.043987 Aug 03 04:38:31.566391 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 862/1752] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:31.573080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54bacd3a-e6de-42d5-ae59-f50d1593fcf0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd545d7790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.604928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:31.615891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:31.617499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:31.622948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5681e6e-b55c-4bc9-9347-462badc31d9f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.273713 Aug 03 04:38:31.623869 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 891/1753] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:31.632014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.639024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:31.646414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.647805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.648799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.649440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.657255 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54bacd3a-e6de-42d5-ae59-f50d1593fcf0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590" status: 200 len: 1412 microversion: 2.1 time: 0.089397 Aug 03 04:38:31.658647 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 863/1754] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:31.673659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-142342c9-4d30-47ab-8c6d-7b549aa720a0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54581e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.719123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.723872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.724429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lazy-loading 'fault' on Instance uuid a6f9d777-b044-4bf0-a264-a382c4a049b7 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:31.745963 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-142342c9-4d30-47ab-8c6d-7b549aa720a0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590" status: 200 len: 1412 microversion: 2.1 time: 0.077938 Aug 03 04:38:31.747485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 864/1755] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:31.762405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c28d602-026b-4fe9-9ba8-166055217511 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd545c5a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.798440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75c9c3239c4b89a6b7971eec9f1a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2752ea34ebaa422989bf3d4f13f1a103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:31.810430 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3014da0f-0922-459d-b238-0981b30aee81 tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 200 len: 1303 microversion: 2.1 time: 0.185450 Aug 03 04:38:31.813210 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 892/1756] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 1303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:31.844628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:31.845512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:31.852503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.852980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:31.853744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:31.854177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.126041 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c28d602-026b-4fe9-9ba8-166055217511 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590" status: 204 len: 0 microversion: 2.1 time: 0.368532 Aug 03 04:38:32.126697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 865/1757] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:31 2022] DELETE /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:32.132367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:32.133238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:32.140901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.141606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.142672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.143360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.214935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:32.223674 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99bb71e8-be29-4955-b0c3-c93f59b3b8e9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.383391 Aug 03 04:38:32.229844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 893/1758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:31 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:32.235512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afe49f01-d899-43dd-975b-c28e32cab804 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd5497c5e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:32.263741 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-afe49f01-d899-43dd-975b-c28e32cab804 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Image not found. Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afe49f01-d899-43dd-975b-c28e32cab804 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 HTTP/1.1 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:32.266162 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590'} Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:32.268062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 Aug 03 04:38:32.269282 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:32.271161 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 could not be found. Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:32.273719 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afe49f01-d899-43dd-975b-c28e32cab804 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:32.275510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-afe49f01-d899-43dd-975b-c28e32cab804 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590" status: 404 len: 62 microversion: 2.1 time: 0.037090 Aug 03 04:38:32.282272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 894/1759] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:38:32 2022] GET /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:32.282272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:32.282272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:32.296254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.296933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.297913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.298675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.617788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:32.633133 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50120810-ea61-483d-a273-3d29eba3263d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.504771 Aug 03 04:38:32.635994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 866/1760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:32 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:32.644854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:32.647802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:32.659203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.670402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.671355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.671816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.684304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:32.707725 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e2238f4-b7f1-4abe-8bba-0ff232dad0b9 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1499 microversion: 2.1 time: 0.434108 Aug 03 04:38:32.708665 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 895/1761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:32 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1499 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:32.721415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:32.722268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:32.729254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.729944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:32.730897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:32.731522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.143086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.152324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba4e0160-a0ab-40aa-a8b2-d6e309cedecf tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.512553 Aug 03 04:38:33.152915 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 867/1762] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:32 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:33.168767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.171342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:33.172150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] [instance: a6f9d777-b044-4bf0-a264-a382c4a049b7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:33.179511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.180224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.181229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.181367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.181972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.183378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.185901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db81bb33-8e56-409d-b1a0-54a4d60fe7c1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.473972 Aug 03 04:38:33.186771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 896/1763] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:32 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:33.215669 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] HTTP exception thrown: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Request method failure captured: Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 HTTP/1.1 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fpfTwe2TbUNj7wOEZyZ6WFd-_O2IHqdEGMKi2wSR_S1i8a-qA23P-b9IQtm3FPYw_gBgME-I0jHJb0yo9Y4NAb6Z_UJy-wlJhPw93FGOrshRKMdthmt2Oj6i8_K8kW_ppWE2eDbizuymWU7Qq68PpYsZf9vFaLGgdTp53O7EnvUSRg Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:33.217517 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2752ea34ebaa422989bf3d4f13f1a103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2752ea34ebaa422989bf3d4f13f1a103 Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MigrationsAdminTest-809817021 Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f75c9c3239c4b89a6b7971eec9f1a99 Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MigrationsAdminTest-809817021-project Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. Aug 03 04:38:33.219272 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a6f9d777-b044-4bf0-a264-a382c4a049b7'} Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:33.220398 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. Aug 03 04:38:33.222525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:33.223744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] Returning 404 to user: Instance a6f9d777-b044-4bf0-a264-a382c4a049b7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:33.223744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7703226-7e84-40a0-8674-32d2f27d958b tempest-MigrationsAdminTest-809817021 tempest-MigrationsAdminTest-809817021-project] 10.222.0.72 "GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7" status: 404 len: 111 microversion: 2.1 time: 0.051574 Aug 03 04:38:33.223744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 868/1764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:33 2022] GET /compute/v2.1/servers/a6f9d777-b044-4bf0-a264-a382c4a049b7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:33.255546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:33.257199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:33.264681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.265647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.266691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.268430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.482824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.495774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3993abf2-b812-4d7c-b158-a1a6d32648f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.246366 Aug 03 04:38:33.496953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 897/1765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:33 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:33.662200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:33.664122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:33.671796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.677775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.677775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.677775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.730709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:33.731582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:33.746434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.746906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.747915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:33.748544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:33.959789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:33.970282 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28ce09bc-cddb-473d-a5bd-b26adfdf77ba tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.312541 Aug 03 04:38:33.971657 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 869/1766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:33 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:34.092211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.109232 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51e6f1b5-2ffd-4ba0-a1b4-e1dc64f7b3e6 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1505 microversion: 2.1 time: 0.382487 Aug 03 04:38:34.110551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 898/1767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:33 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:34.175933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:34.179117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:34.200732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.205807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.208659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.211256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:34.211875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:34.212326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.224383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.237262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.238262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.239484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.581981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.592316 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d0478bc-54c4-4a6a-818d-e61f1b0f1fa6 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.421874 Aug 03 04:38:34.596496 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 870/1768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:34 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:34.603780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:34.604856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:34.616316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.617120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.617786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.618844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:34.619241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:34.627061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.629630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.631699 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-421dbd71-b73f-4ab3-b7be-44a48a8d8b66 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.423898 Aug 03 04:38:34.644656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 899/1769] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:34 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:34.807769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:34.816787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a325380-97cc-4c3f-b60f-5bd78df38fe9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.218943 Aug 03 04:38:34.817650 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 871/1770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:34 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:34.993046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:34.993593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:35.000675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.001134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.001932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.002378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.132754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:35.133385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:35.140754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.141337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.142153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.142789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.142916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:35.152517 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-850aa369-08e5-4f86-8dd8-41ee0ccc1ad5 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.164374 Aug 03 04:38:35.153348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 900/1771] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:34 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:35.283676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:35.295967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fa66c7c-53aa-4b55-b406-dcea74a52a03 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1505 microversion: 2.1 time: 0.168072 Aug 03 04:38:35.296540 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 872/1772] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:35 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:35.619599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:35.620987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:35.628707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.629532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.630574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.631810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.657106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:35.657731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:35.668605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.669065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:35.670038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:35.670553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.102776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.109951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.115685 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0b9b29b-4483-4a09-8a4c-e6a2e25cc292 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.499835 Aug 03 04:38:36.117637 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 901/1773] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:35 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:36.125048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.127252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:36.128105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:36.130376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.135036 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-088f34de-b61e-4566-9384-4222d3c2ff78 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.481708 Aug 03 04:38:36.136432 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 873/1774] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:35 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:36.139097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.142508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-088d5d5c-2231-4b29-8ef8-a2cd674cd3ac req-9f724bed-2986-4dbf-903a-389197cf5bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3011a3-c011-4841-a2df-394badbcce23", "name": "network-vif-plugged", "status": "completed", "tag": "d23be8de-0cf3-44f0-b07e-3f8f8c0f3470"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:36.150003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.157619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-088d5d5c-2231-4b29-8ef8-a2cd674cd3ac req-9f724bed-2986-4dbf-903a-389197cf5bbe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.158329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-088d5d5c-2231-4b29-8ef8-a2cd674cd3ac req-9f724bed-2986-4dbf-903a-389197cf5bbe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.158751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.163496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.175246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-088d5d5c-2231-4b29-8ef8-a2cd674cd3ac req-9f724bed-2986-4dbf-903a-389197cf5bbe service nova] Creating event network-vif-plugged:d23be8de-0cf3-44f0-b07e-3f8f8c0f3470 for instance 1d3011a3-c011-4841-a2df-394badbcce23 on n-h1-826756-5 Aug 03 04:38:36.181173 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-088d5d5c-2231-4b29-8ef8-a2cd674cd3ac req-9f724bed-2986-4dbf-903a-389197cf5bbe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043298 Aug 03 04:38:36.182368 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 874/1775] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:36.201172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:36.202868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:36.215154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.216827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.218101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.218754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.648957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.662155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.670738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84e19791-eb3e-4dc9-8e13-3fd1f89dcda9 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.486812 Aug 03 04:38:36.673531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 875/1776] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:36 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:36.674705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-461af1de-057a-40aa-b735-770df94073a7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.555700 Aug 03 04:38:36.683422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:36.689328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:36.702838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.705277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.707604 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 902/1777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:36 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:36.708451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:36.711406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:36.724034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:36.907649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:36.916400 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac9b38af-b2a0-4f47-b328-6b170d8a6877 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1500 microversion: 2.1 time: 0.239156 Aug 03 04:38:36.919290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 876/1778] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:36 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:37.141804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:37.142712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:37.151369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.152024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.153427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.154049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.166915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:37.168480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:37.185881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.186622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.188011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.188665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.437745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:37.441669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:37.452400 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e43ae7c6-ec8a-4d3a-86cb-0349445e4f37 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.314881 Aug 03 04:38:37.453437 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 903/1779] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:37 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:37.460925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:37.468322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:37.468322 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9df4959-40a6-4e80-afd0-78d55e8cd11b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.306071 Aug 03 04:38:37.468322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 877/1780] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:37 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:37.699260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:37.707341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:37.708609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:37.710900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:37.730560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.731356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.732950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.734537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.734981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.736015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:37.737007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:37.737605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.033717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:38.040373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:38.043763 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d7b592d8-97c3-4a08-904c-58f13cd16c72 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.342450 Aug 03 04:38:38.044368 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 878/1781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:37 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:38.048677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0d39e66-e1dd-42c1-b26b-30bb105c1579 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1324 microversion: 2.1 time: 0.354905 Aug 03 04:38:38.049278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.049423 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 904/1782] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:37 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:38.055767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:38.057219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.057676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.058471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.064100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.218990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:38.228561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6515d9d-6e89-442b-b6dc-26c58fdeb20d tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1487 microversion: 2.1 time: 0.182593 Aug 03 04:38:38.229330 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 879/1783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:38 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1487 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:38.252550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.253338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:38.275571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.279764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.281273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.282308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.323930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:38.481284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.481923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:38.488442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.489338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.490491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.491433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.742746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:38.752210 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ac19ce0-ad1f-4551-872c-6dac17871a5e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.274858 Aug 03 04:38:38.753490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 880/1784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:38 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:38.760332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.761269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:38.768415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.769206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.770178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:38.770900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:38.902964 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43610b95-3f7e-4eb6-8c40-62bf8025f481 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 204 len: 0 microversion: 2.1 time: 0.635250 Aug 03 04:38:38.902964 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 905/1785] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:38 2022] DELETE /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:38.909787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-199a0e51-3909-416c-bf3a-860792cc4041 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd54851670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.970943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-199a0e51-3909-416c-bf3a-860792cc4041 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Image not found. Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-199a0e51-3909-416c-bf3a-860792cc4041 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 HTTP/1.1 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:38.973153 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590'} Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:38.975439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 to delete Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.976803 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 could not be found. Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:38.978347 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-199a0e51-3909-416c-bf3a-860792cc4041 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:38.979896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-199a0e51-3909-416c-bf3a-860792cc4041 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590" status: 404 len: 62 microversion: 2.1 time: 0.071371 Aug 03 04:38:38.982837 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 906/1786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:38 2022] DELETE /compute/v2.1/images/c7f43e0a-fd5b-465a-8a9a-dd97c2e4f590 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:38.990270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:38.991098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:38.999505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.000541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.001385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.001897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.002568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.013650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.015545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.017335 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-59d15f65-545f-4bef-95d5-3c4396ec1170 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.262355 Aug 03 04:38:39.029010 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 881/1787] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:38 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:39.038972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:39.042540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:39.074280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:39.074900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:39.081295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.081762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.082521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.082960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.269871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.288700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.compute.api [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Instance is already in deleting state, ignoring this request Aug 03 04:38:39.289560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb87c52c-af1b-4b72-88a3-769f910735f8 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 204 len: 0 microversion: 2.1 time: 0.305637 Aug 03 04:38:39.290699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 907/1788] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:38 2022] DELETE /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:39.290985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8757e3ab-e999-47ba-ae08-fd7460e02e19 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.220618 Aug 03 04:38:39.304972 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 882/1789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:39 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:39.316296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:39.316296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:39.328593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:39.329688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:39.329872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.331770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.332807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.333421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.337616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:39.344022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.346360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.348750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.350560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.597339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.605555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b460148f-b7ef-46dd-bfd9-8e81c66ee6cb tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1493 microversion: 2.1 time: 0.298988 Aug 03 04:38:39.606437 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 883/1790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:39 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1493 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:39.621987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.634578 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2debbd8-a040-44e1-8c2a-993f8660f3f2 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1521 microversion: 2.1 time: 0.342355 Aug 03 04:38:39.635177 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 908/1791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:39 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:39.668734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:39.669265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:39.675433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.675886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.676811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.677283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.706032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:39.778496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:39.779437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:39.787919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.788433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.789315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:39.789711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:39.964529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:39.972056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5af74be8-2fbd-42d6-817d-c0cc0c02f675 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.202514 Aug 03 04:38:39.972656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 909/1792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:39 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:40.099917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54a65ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:40.166210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.166705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.175711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fab4fbbb-0c95-44a8-8bbf-51ffca24432d tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 204 len: 0 microversion: 2.1 time: 0.502460 Aug 03 04:38:40.175857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.175857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.176094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 884/1793] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:39 2022] DELETE /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:40.176094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.176094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:40.181741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.182194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.182965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.183398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.320580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.331510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.331510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.332777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18df0964-8b4b-4207-996f-9166891be9ea tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.162649 Aug 03 04:38:40.346248 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 885/1794] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:40.346248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.346248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:40.346248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.346774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.346774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.346774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.354891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-573be01f-2c24-4808-bde6-d480986f3752 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630" status: 200 len: 240 microversion: 2.36 time: 0.381176 Aug 03 04:38:40.355776 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 910/1795] 10.222.0.72 () {62 vars in 1303 bytes} [Wed Aug 3 04:38:39 2022] PUT /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630 => generated 240 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:40.366300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.367071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:40.374062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.374613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.379322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.379322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.556809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.564750 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0dac2458-53ae-4343-b573-19e1cded8d63 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1527 microversion: 2.1 time: 0.230033 Aug 03 04:38:40.565332 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 886/1796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1527 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:40.570608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Calling method '.version_select at 0x7fdd545f0ee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.575878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.592231 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbf2c2df-dbc9-4ef5-b64c-24e7a604ba68 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.235081 Aug 03 04:38:40.592884 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 911/1797] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:40.629262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.630287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:40.637180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.637741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.638675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.639302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.656111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.656660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.657511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.657948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.677520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1a455c8-d393-4b4b-b64d-607fb17e5d3a tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630/detail" status: 200 len: 672 microversion: 2.36 time: 0.110933 Aug 03 04:38:40.678436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 887/1798] 10.222.0.72 () {60 vars in 1304 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630/detail => generated 672 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:40.777214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:40.784891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-738d6e6a-f475-41c5-b29f-5f9cb1b1b57c tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1493 microversion: 2.1 time: 0.160772 Aug 03 04:38:40.785786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 912/1799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:40.923231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54a91430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:40.992148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.992742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.994073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:40.994552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:40.994963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:40.995603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:41.002297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.002758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.003885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.004167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.030076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.036429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.036429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.036429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.166725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:41.174462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e4d6d9f-73e0-4b73-b9c6-bec3af99d0a1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.185509 Aug 03 04:38:41.175045 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 913/1800] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:40 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:41.372773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:41.372773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:41.378537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.379322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.381996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.385004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.391208 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27b69c1b-1b6d-43a1-a000-d180a3d67dc8 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630?user_id=4781e675692743f6b4cc0226c03422db" status: 200 len: 240 microversion: 2.36 time: 0.473341 Aug 03 04:38:41.397907 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 888/1801] 10.222.0.72 () {62 vars in 1384 bytes} [Wed Aug 3 04:38:40 2022] PUT /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630?user_id=4781e675692743f6b4cc0226c03422db => generated 240 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:41.403300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58e12632-fc3c-46d2-bc2a-5a60704a3fa0 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] Calling method '.version_select at 0x7fdd545d25e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:41.503287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58e12632-fc3c-46d2-bc2a-5a60704a3fa0 tempest-QuotasAdminTestV236-1983505889 tempest-QuotasAdminTestV236-1983505889-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630?user_id=4781e675692743f6b4cc0226c03422db" status: 200 len: 282 microversion: 2.36 time: 0.103685 Aug 03 04:38:41.504688 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 889/1802] 10.222.0.72 () {60 vars in 1364 bytes} [Wed Aug 3 04:38:41 2022] GET /compute/v2.1/os-quota-sets/41766e9ad17f4884b850df5b344e2630?user_id=4781e675692743f6b4cc0226c03422db => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:41.588805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:41.589695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:41.598957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.600413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.601422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.602061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.796741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:41.809816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:41.812105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:41.813636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3c93c56-1e5c-4bc2-88a7-3c5a9cb36776 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.458490 Aug 03 04:38:41.814939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 914/1803] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:41 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:41.821443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:41.822608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:41.837442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.837738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:41.839334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:41.839943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.284434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:42.294801 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c7bf81b-4f4a-41a5-a549-46b97afc9297 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1527 microversion: 2.1 time: 0.711871 Aug 03 04:38:42.296186 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 890/1804] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:41 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1527 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:42.301651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:42.303396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:42.312195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.319175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.319175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.319175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.498326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:42.505964 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a44b108-e827-4e5f-8d79-84b760c9cd6e tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1451 microversion: 2.1 time: 0.208235 Aug 03 04:38:42.509059 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 891/1805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:42 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:42.514015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-bad3a0d0-e65a-4181-9100-88ca48c28903 req-7c87f811-4684-45b2-a1fd-9f520843968d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-plugged", "status": "completed", "tag": "ef115f15-f6c7-4320-a4d5-3071ac9e875b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:42.526082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bad3a0d0-e65a-4181-9100-88ca48c28903 req-7c87f811-4684-45b2-a1fd-9f520843968d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.527790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bad3a0d0-e65a-4181-9100-88ca48c28903 req-7c87f811-4684-45b2-a1fd-9f520843968d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.545402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-bad3a0d0-e65a-4181-9100-88ca48c28903 req-7c87f811-4684-45b2-a1fd-9f520843968d service nova] Creating event network-vif-plugged:ef115f15-f6c7-4320-a4d5-3071ac9e875b for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:42.554668 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-bad3a0d0-e65a-4181-9100-88ca48c28903 req-7c87f811-4684-45b2-a1fd-9f520843968d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043517 Aug 03 04:38:42.556234 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 892/1806] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:42.565453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:42.566496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:42.577155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.578564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.580597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.581497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.605183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:42.622534 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97cccf04-0f2c-4cc9-be7a-cf24baa3e19e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.806075 Aug 03 04:38:42.624780 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 915/1807] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:41 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:42.642482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7bb896d4-5e6d-4fe2-8aa2-e96fde37f819 req-93dac4f9-2603-4456-bea1-e70514eafa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "323f47e3-f889-4a29-9913-3646bb1bf5b8", "name": "network-vif-deleted", "tag": "996be256-87e5-456d-a39c-0e49e2a378d6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:42.656570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7bb896d4-5e6d-4fe2-8aa2-e96fde37f819 req-93dac4f9-2603-4456-bea1-e70514eafa52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.657345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7bb896d4-5e6d-4fe2-8aa2-e96fde37f819 req-93dac4f9-2603-4456-bea1-e70514eafa52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.670941 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7bb896d4-5e6d-4fe2-8aa2-e96fde37f819 req-93dac4f9-2603-4456-bea1-e70514eafa52 service nova] Creating event network-vif-deleted:996be256-87e5-456d-a39c-0e49e2a378d6 for instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 on n-h2-826756-5 Aug 03 04:38:42.676811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7bb896d4-5e6d-4fe2-8aa2-e96fde37f819 req-93dac4f9-2603-4456-bea1-e70514eafa52 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046955 Aug 03 04:38:42.681669 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 916/1808] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:42.839625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:42.840971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:42.857654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.858464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.859522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:42.860189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:42.876584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:42.878899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:42.889141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fdb85527-abc4-4cef-bbf2-a1d7b2d3a4ee tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.331343 Aug 03 04:38:42.889733 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 893/1809] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:42 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:43.051986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:43.061351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:43.067320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:43.067320 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c25a95d0-d26c-4411-89fe-f99b80d7750d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1486 microversion: 2.25 time: 0.229674 Aug 03 04:38:43.067320 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 917/1810] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:42 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1486 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:43.280798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-48cccd4f-2102-4908-ada7-6d0f5863750e req-4d0769a5-d14a-4eb9-bde0-461da3766c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3011a3-c011-4841-a2df-394badbcce23", "name": "network-vif-deleted", "tag": "d23be8de-0cf3-44f0-b07e-3f8f8c0f3470"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:43.292963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-48cccd4f-2102-4908-ada7-6d0f5863750e req-4d0769a5-d14a-4eb9-bde0-461da3766c20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.293519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-48cccd4f-2102-4908-ada7-6d0f5863750e req-4d0769a5-d14a-4eb9-bde0-461da3766c20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.305721 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-48cccd4f-2102-4908-ada7-6d0f5863750e req-4d0769a5-d14a-4eb9-bde0-461da3766c20 service nova] Creating event network-vif-deleted:d23be8de-0cf3-44f0-b07e-3f8f8c0f3470 for instance 1d3011a3-c011-4841-a2df-394badbcce23 on n-h1-826756-5 Aug 03 04:38:43.310824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-48cccd4f-2102-4908-ada7-6d0f5863750e req-4d0769a5-d14a-4eb9-bde0-461da3766c20 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033731 Aug 03 04:38:43.311927 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 894/1811] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:43.319047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:43.322151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:43.326015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.326661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.327642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.328077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.408536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:43.419296 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cef1173f-d19c-42ef-9eb2-ee06e8b4998b tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1485 microversion: 2.1 time: 0.104175 Aug 03 04:38:43.420437 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 918/1812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:43 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:43.534192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:43.535575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:43.558222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.558993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.559793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.560240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.629953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.631275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.633003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lazy-loading 'fault' on Instance uuid 323f47e3-f889-4a29-9913-3646bb1bf5b8 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:43.653386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:43.659041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:43.673043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.675373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.680711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.682020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.794369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14aa35fa1b9d4a5786b67c5a3234f571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '107bce041cef4b7c96c471bd18f6d2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:43.803416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93457292-5dcc-416d-bb69-ea70a4b607af tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 200 len: 1298 microversion: 2.1 time: 0.273771 Aug 03 04:38:43.805614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 895/1813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:43 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 1298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:43.911248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:43.912160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:43.920516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.922200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:43.922200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:43.922800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.112580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.123670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2883f5b3-bdcf-468c-9c94-48f0f70df9a6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.481084 Aug 03 04:38:44.136912 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 919/1814] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:43 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:44.151037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.151750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:44.160532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:44.164149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.165667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.167297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.167850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.465304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.480659 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ca0a131-e6fe-4563-b26a-37564b7fc281 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.567856 Aug 03 04:38:44.480659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 896/1815] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:43 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:44.480659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.481566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:44.490069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.490575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.491357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.491845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.710273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.710756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.711025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lazy-loading 'fault' on Instance uuid 1d3011a3-c011-4841-a2df-394badbcce23 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:44.727361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.740647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.742827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.744580 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c8e9959-cd63-4d05-9d96-550569a9a27e tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1476 microversion: 2.25 time: 0.618719 Aug 03 04:38:44.745729 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 920/1816] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:44 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:44.752603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-plugged", "status": "completed", "tag": "228ad446-936b-4371-ad44-7730d8616e77"}, {"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-plugged", "status": "completed", "tag": "77f86bfa-b9ac-4011-8ce4-21fc12235c45"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:44.764769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.765514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.780230 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] Creating event network-vif-plugged:228ad446-936b-4371-ad44-7730d8616e77 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:44.781125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] Creating event network-vif-plugged:77f86bfa-b9ac-4011-8ce4-21fc12235c45 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:44.787541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-696beb1d-0c99-47fa-9d35-b7d0fd395924 req-5e35ec79-6b2b-4540-bf75-4b0c567e115d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039857 Aug 03 04:38:44.788569 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 921/1817] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:44.794288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09610f82-c6ff-47aa-b1dd-94bbc987fef1 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '.version_select at 0x7fdd54791310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.799161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09610f82-c6ff-47aa-b1dd-94bbc987fef1 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.810543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09610f82-c6ff-47aa-b1dd-94bbc987fef1 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.820480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef5280a59af4ef09aa3e84ec74e1b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54bc45a4deb4fdbb34486c0dee35849', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:44.830360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43bdfff4-e28b-4250-922f-9131c528ebd0 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 200 len: 1314 microversion: 2.1 time: 0.354015 Aug 03 04:38:44.834605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 897/1818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:44 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:44.844247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09610f82-c6ff-47aa-b1dd-94bbc987fef1 tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 3452 microversion: 2.25 time: 0.054256 Aug 03 04:38:44.852656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 922/1819] 10.222.0.72 () {60 vars in 1184 bytes} [Wed Aug 3 04:38:44 2022] GET /compute/v2.1/os-migrations => generated 3452 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:44.855455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.856494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: 323f47e3-f889-4a29-9913-3646bb1bf5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:44.873691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.875528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.876072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.876578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:44.898631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.898631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.898842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.898842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.898842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:44.899563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 HTTP/1.1 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:44.922259 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. Aug 03 04:38:44.924150 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '323f47e3-f889-4a29-9913-3646bb1bf5b8'} Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:44.925115 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. Aug 03 04:38:44.928639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.931312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance 323f47e3-f889-4a29-9913-3646bb1bf5b8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:44.931312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ef80de1-4fd3-44a1-bb6a-4cafda44d8f0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8" status: 404 len: 111 microversion: 2.1 time: 0.084751 Aug 03 04:38:44.931312 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 898/1820] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:44 2022] GET /compute/v2.1/servers/323f47e3-f889-4a29-9913-3646bb1bf5b8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:44.935399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-774306e3-000f-496a-a328-a6381299424a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd545e65e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-774306e3-000f-496a-a328-a6381299424a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Image not found. Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-774306e3-000f-496a-a328-a6381299424a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 HTTP/1.1 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:44.979084 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd0a591e1-dd9b-4c00-9285-818277f1d754'} Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:44.980869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d0a591e1-dd9b-4c00-9285-818277f1d754 to delete Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.982110 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d0a591e1-dd9b-4c00-9285-818277f1d754 could not be found. Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:44.983696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-774306e3-000f-496a-a328-a6381299424a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-774306e3-000f-496a-a328-a6381299424a tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754" status: 404 len: 62 microversion: 2.1 time: 0.043711 Aug 03 04:38:44.986207 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 899/1821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:44 2022] DELETE /compute/v2.1/images/d0a591e1-dd9b-4c00-9285-818277f1d754 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:44.987616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:44.987616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:44.998238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.001683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.001683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.001683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.034154 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a HTTP/1.1 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:45.063176 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.064854 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c314dde1-5aec-4fbf-91bb-5f3668df458a'} Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:45.065700 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.067055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.074928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:45.076250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a48cc3e-b078-4f81-80f1-959ebc374e56 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 404 len: 111 microversion: 2.1 time: 0.094302 Aug 03 04:38:45.077511 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 900/1822] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:44 2022] DELETE /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:38:45.095072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:45.096013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: c314dde1-5aec-4fbf-91bb-5f3668df458a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:45.105532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.106451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.107560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.108259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.139806 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a HTTP/1.1 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:45.143195 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.145073 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c314dde1-5aec-4fbf-91bb-5f3668df458a'} Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:45.146137 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. Aug 03 04:38:45.148522 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.154573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance c314dde1-5aec-4fbf-91bb-5f3668df458a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:45.154573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52c53dfa-91f5-458d-9a17-337003362b51 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a" status: 404 len: 111 microversion: 2.1 time: 0.067734 Aug 03 04:38:45.154573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 901/1823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:45 2022] GET /compute/v2.1/servers/c314dde1-5aec-4fbf-91bb-5f3668df458a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:45.160929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:45.162194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:45.174735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.175311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.186367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.189324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.862274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] Lazy-loading 'services' on Instance uuid 4e331d1e-abed-4f52-970b-189348b5fff6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:45.881087 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c197fa0a-732e-4f2d-82f0-66cb684b6b4d tempest-LiveAutoBlockMigrationV225Test-1807444254 tempest-LiveAutoBlockMigrationV225Test-1807444254-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1968 microversion: 2.25 time: 1.014349 Aug 03 04:38:45.897720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 923/1824] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:44 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1968 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:45.897720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb812445-affc-4fae-a09a-ba98ed8d0bbc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd547129d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:45.921791 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-eb812445-affc-4fae-a09a-ba98ed8d0bbc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Image not found. Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb812445-affc-4fae-a09a-ba98ed8d0bbc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 HTTP/1.1 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:45.931572 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fb8db5bc-0686-4366-a05d-52710adacde9'} Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:45.933194 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fb8db5bc-0686-4366-a05d-52710adacde9 to delete Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.934277 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb8db5bc-0686-4366-a05d-52710adacde9 could not be found. Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:45.935674 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb812445-affc-4fae-a09a-ba98ed8d0bbc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb812445-affc-4fae-a09a-ba98ed8d0bbc tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9" status: 404 len: 62 microversion: 2.1 time: 0.042813 Aug 03 04:38:45.937681 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 924/1825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:45 2022] DELETE /compute/v2.1/images/fb8db5bc-0686-4366-a05d-52710adacde9 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:45.938743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:45.940165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:45.940971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:45.949948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.950610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.951777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.952788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.957356 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28585723-9aec-4b1c-acd3-06dfd788e938 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.802480 Aug 03 04:38:45.957949 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 902/1826] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:45 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:45.974968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:45.975887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 1d3011a3-c011-4841-a2df-394badbcce23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:45.988376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.989004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:45.990673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:45.991292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.013401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 HTTP/1.1 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.014959 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. Aug 03 04:38:46.016798 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1d3011a3-c011-4841-a2df-394badbcce23'} Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.017781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. Aug 03 04:38:46.019408 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.021287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 1d3011a3-c011-4841-a2df-394badbcce23 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.021287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9db1f1d9-39c6-40aa-a148-cfc1517d7124 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23" status: 404 len: 111 microversion: 2.1 time: 0.057120 Aug 03 04:38:46.021287 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 903/1827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:45 2022] GET /compute/v2.1/servers/1d3011a3-c011-4841-a2df-394badbcce23 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.024372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.024922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.032137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.032890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.033860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.034458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.056654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 HTTP/1.1 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.058483 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.060228 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'ddbf6f5e-4e1f-421b-8529-bc0295fe7a13'} Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.061287 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.062691 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.066126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.067193 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a810565-b52d-4549-8c5e-4ff7e5d46f36 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 404 len: 111 microversion: 2.1 time: 0.047909 Aug 03 04:38:46.067990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 904/1828] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.073658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.074450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.083061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.084482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.085697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.086643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.118067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:46.486938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:46.504887 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe1413fa-6257-464b-a078-caab6969c6f1 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1354 microversion: 2.1 time: 0.571977 Aug 03 04:38:46.505585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 925/1829] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:45 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1354 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:46.510445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-57dd461a-06f9-4266-9874-5bf3cc1afd0b req-f3150df3-724c-4ea5-835e-350dad49b722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "name": "network-vif-unplugged", "status": "completed", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:46.528407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57dd461a-06f9-4266-9874-5bf3cc1afd0b req-f3150df3-724c-4ea5-835e-350dad49b722 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.528881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57dd461a-06f9-4266-9874-5bf3cc1afd0b req-f3150df3-724c-4ea5-835e-350dad49b722 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.542913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-57dd461a-06f9-4266-9874-5bf3cc1afd0b req-f3150df3-724c-4ea5-835e-350dad49b722 service nova] Creating event network-vif-unplugged:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h2-826756-5 Aug 03 04:38:46.548801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-57dd461a-06f9-4266-9874-5bf3cc1afd0b req-f3150df3-724c-4ea5-835e-350dad49b722 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041600 Aug 03 04:38:46.549434 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 926/1830] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:46.555240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b450a8f8-5529-42ff-aacf-5563d7fd7208 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd547ebaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.588854 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b450a8f8-5529-42ff-aacf-5563d7fd7208 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Image not found. Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b450a8f8-5529-42ff-aacf-5563d7fd7208 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2 HTTP/1.1 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:46.590934 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2379813a-faf1-4312-85e1-77cd3028eee2'} Aug 03 04:38:46.592711 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2379813a-faf1-4312-85e1-77cd3028eee2 to delete Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.593820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2379813a-faf1-4312-85e1-77cd3028eee2 could not be found. Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.595327 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:46.597127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.599669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b450a8f8-5529-42ff-aacf-5563d7fd7208 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.601686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b450a8f8-5529-42ff-aacf-5563d7fd7208 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2" status: 404 len: 62 microversion: 2.1 time: 0.051161 Aug 03 04:38:46.607503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 927/1831] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/images/2379813a-faf1-4312-85e1-77cd3028eee2 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:46.607809 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fa35216-6586-46a1-b977-0394863d83aa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 204 len: 0 microversion: 2.25 time: 0.535570 Aug 03 04:38:46.607809 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 905/1832] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:38:46.613325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.614252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.624692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.625016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.625224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.630419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: ddbf6f5e-4e1f-421b-8529-bc0295fe7a13] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.630610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.630819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.637515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.638066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.638850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.639457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.644194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:46.653522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 HTTP/1.1 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:46.655058 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.656868 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ddbf6f5e-4e1f-421b-8529-bc0295fe7a13'} Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.657860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. Aug 03 04:38:46.659422 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.662410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.663112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.663700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75a7aca4-2222-49b9-8c9e-f0ed2d153732 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13" status: 404 len: 111 microversion: 2.1 time: 0.059510 Aug 03 04:38:46.664792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 928/1833] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:46 2022] GET /compute/v2.1/servers/ddbf6f5e-4e1f-421b-8529-bc0295fe7a13 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef HTTP/1.1 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.668280 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.670616 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6d57099d-0a46-4f93-acd2-59bbc8e08fef'} Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.671606 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.673368 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.675318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.675318 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1047dbaf-f227-4cef-adfc-1d8f44216045 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 404 len: 111 microversion: 2.1 time: 0.065434 Aug 03 04:38:46.676985 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 906/1834] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.677177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.677733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.681491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eca2128f-9811-4698-835c-d65d2b8c2708 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '.version_select at 0x7fdd551ba8b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.684874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.685522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.686651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.687093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.713126 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-eca2128f-9811-4698-835c-d65d2b8c2708 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Image not found. Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eca2128f-9811-4698-835c-d65d2b8c2708 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 HTTP/1.1 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.716495 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'e29d755a-4119-45ec-be4e-7e50996dc159'} Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.726032 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e29d755a-4119-45ec-be4e-7e50996dc159 to delete Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.727047 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e29d755a-4119-45ec-be4e-7e50996dc159 could not be found. Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.729696 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eca2128f-9811-4698-835c-d65d2b8c2708 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eca2128f-9811-4698-835c-d65d2b8c2708 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159" status: 404 len: 62 microversion: 2.1 time: 0.041367 Aug 03 04:38:46.732813 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 907/1835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/images/e29d755a-4119-45ec-be4e-7e50996dc159 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:46.740391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.741453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 6d57099d-0a46-4f93-acd2-59bbc8e08fef] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.750757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.751185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.752361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.753563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.783420 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef HTTP/1.1 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.785405 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.787197 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6d57099d-0a46-4f93-acd2-59bbc8e08fef'} Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.788168 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. Aug 03 04:38:46.790028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.793750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 6d57099d-0a46-4f93-acd2-59bbc8e08fef could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.795468 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97c0d8e5-bc8b-44a0-aec8-15e91e935815 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef" status: 404 len: 111 microversion: 2.1 time: 0.074088 Aug 03 04:38:46.796655 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 908/1836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:46 2022] GET /compute/v2.1/servers/6d57099d-0a46-4f93-acd2-59bbc8e08fef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.803379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:46.804518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:46.814419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.815241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.817612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:46.818549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:46.841434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 HTTP/1.1 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:46.849556 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:46.851496 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd36e1b37-606b-4a4f-a778-0a4f1d8c42e5'} Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:46.852638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:46.854097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:46.855669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:46.855669 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-497dc098-98fe-45e5-aa3b-a87c2072d014 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 404 len: 111 microversion: 2.1 time: 0.053837 Aug 03 04:38:46.855669 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 909/1837] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:46.858120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-610db989-3fca-469b-b27e-22910330ec80 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd5477d4c0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:47.006612 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-610db989-3fca-469b-b27e-22910330ec80 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994674505" status: 202 len: 0 microversion: 2.1 time: 0.152743 Aug 03 04:38:47.009319 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 910/1838] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:38:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994674505 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:38:47.015883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:47.017987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] [instance: d36e1b37-606b-4a4f-a778-0a4f1d8c42e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:47.036683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.039908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.041034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.045756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.090091 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] HTTP exception thrown: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Request method failure captured: Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 HTTP/1.1 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frRFW2IKNgAqshMarhJWFBPeF9IckbLzLGZKi9fhFUzTYp162nedlbr_teoT6fEQRF-55_QG7r7UIenHmtk8PTMSsfrE0qzAoid8rF1FGvKSq79zq6dVOwlv6MlvEh2D9WxYKUDnS49hPgTpm4qK1jlz6hwcB6cTAggXUDnjgQdq4w Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:47.094582 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/107bce041cef4b7c96c471bd18f6d2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesTestJSON-889782901 Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 107bce041cef4b7c96c471bd18f6d2a9 Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesTestJSON-889782901 Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 14aa35fa1b9d4a5786b67c5a3234f571 Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesTestJSON-889782901-project Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:47.096568 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd36e1b37-606b-4a4f-a778-0a4f1d8c42e5'} Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:47.097656 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. Aug 03 04:38:47.099638 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:47.104289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] Returning 404 to user: Instance d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:47.104289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ae69e6e-d5ba-483b-890c-e04d0c0829c0 tempest-ImagesTestJSON-889782901 tempest-ImagesTestJSON-889782901-project] 10.222.0.72 "GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5" status: 404 len: 111 microversion: 2.1 time: 0.091660 Aug 03 04:38:47.113643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 911/1839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:47 2022] GET /compute/v2.1/servers/d36e1b37-606b-4a4f-a778-0a4f1d8c42e5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:47.129762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:47.133553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:47.147752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:47.150587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.151311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.152397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.153579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.237362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:47.264831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:47.266276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:47.267488 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3af69a4d-7345-420f-b8cf-72a234601813 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1482 microversion: 2.25 time: 0.601538 Aug 03 04:38:47.275935 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 929/1840] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:46 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1482 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:47.527793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:47.528455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:47.535955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.542988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.543978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.544473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.878605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:47.888684 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ccb2ae7b-f95a-42dd-83a0-53dbdc856b5b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.779727 Aug 03 04:38:47.899778 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 912/1841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:47 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:47.902854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:47.917074 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-adc78473-6ad7-4814-ba41-b2401a677482 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1805 microversion: 2.1 time: 0.393268 Aug 03 04:38:47.917680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 930/1842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:47 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1805 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:47.945073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:47.945537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:47.955467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.955920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:47.964022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:47.964534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.021838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec458dac-b73f-4fa4-8226-79136d965657 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97/ips" status: 200 len: 219 microversion: 2.1 time: 0.082448 Aug 03 04:38:48.033720 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 913/1843] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:38:47 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97/ips => generated 219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:48.040401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:48.040907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:48.050871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.051324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.052212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.052635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.109886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:38:48.295081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:48.296033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:48.334897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.337431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.340386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.340846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.678700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-831f5559-daa3-4e2f-88b5-3814332dda66 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 204 len: 0 microversion: 2.1 time: 0.643134 Aug 03 04:38:48.683767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 931/1844] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:48 2022] DELETE /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:38:48.703779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:48.712330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2e306d3f-0478-461a-ac15-7856468f69f6 req-18a766b8-417a-437a-a019-57ccde79d34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:48.733229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:48.733229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:48.733229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1278621-5898-4ea7-be85-2d9ffb513958 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1482 microversion: 2.25 time: 0.429706 Aug 03 04:38:48.733515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 914/1845] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:48 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1482 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:48.733515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:48.733515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:48.740338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2e306d3f-0478-461a-ac15-7856468f69f6 req-18a766b8-417a-437a-a019-57ccde79d34f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.741028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2e306d3f-0478-461a-ac15-7856468f69f6 req-18a766b8-417a-437a-a019-57ccde79d34f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.749285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.749691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.750496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.751082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.758144 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2e306d3f-0478-461a-ac15-7856468f69f6 req-18a766b8-417a-437a-a019-57ccde79d34f service nova] Creating event network-changed:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h2-826756-5 Aug 03 04:38:48.763410 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2e306d3f-0478-461a-ac15-7856468f69f6 req-18a766b8-417a-437a-a019-57ccde79d34f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060391 Aug 03 04:38:48.764025 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 932/1846] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:48.920184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:48.920920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:48.932138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.932991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:48.933975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:48.934796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.012067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:49.027795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c16c626-967c-441a-89e2-08d020596b61 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1811 microversion: 2.1 time: 0.297793 Aug 03 04:38:49.027795 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 915/1847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:48 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1811 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:49.198479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:49.208040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-67f77002-784b-4b6f-9b16-8e27617b4988 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.292446 Aug 03 04:38:49.211871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 933/1848] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:48 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:49.326297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-922f6654-a9f7-4f45-88ef-2f917ac8f3a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '.version_select at 0x7fdd545a15e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:49.369691 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-922f6654-a9f7-4f45-88ef-2f917ac8f3a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Image not found. Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-922f6654-a9f7-4f45-88ef-2f917ac8f3a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/2df2c2d3-d0a4-490a-8f63-1e97634458b3 HTTP/1.1 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:49.376872 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2df2c2d3-d0a4-490a-8f63-1e97634458b3'} Aug 03 04:38:49.378734 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2df2c2d3-d0a4-490a-8f63-1e97634458b3 to delete Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.379808 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2df2c2d3-d0a4-490a-8f63-1e97634458b3 could not be found. Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:49.382886 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:38:49.386997 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.390280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-922f6654-a9f7-4f45-88ef-2f917ac8f3a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:49.392976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-922f6654-a9f7-4f45-88ef-2f917ac8f3a6 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/images/2df2c2d3-d0a4-490a-8f63-1e97634458b3" status: 404 len: 62 microversion: 2.1 time: 0.071043 Aug 03 04:38:49.397621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 916/1849] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:49 2022] DELETE /compute/v2.1/images/2df2c2d3-d0a4-490a-8f63-1e97634458b3 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:38:49.405752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:49.406686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:49.417253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.419292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.420751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.422023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.442328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 HTTP/1.1 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:49.445116 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.447302 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244'} Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:49.448168 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.451158 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.453025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:49.454086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea8a05f9-7984-4551-85af-2d5e784d4d5f tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 404 len: 111 microversion: 2.1 time: 0.052214 Aug 03 04:38:49.455189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 934/1850] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:38:49 2022] DELETE /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:49.467307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:49.469463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] [instance: 2b0edcdf-4dc5-4c2e-ab00-88c093204244] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:49.477530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.478954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.478954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.479190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.496776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] HTTP exception thrown: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Request method failure captured: Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 HTTP/1.1 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftIy9-XKvpTokLrhrCcQsxrCQMSevAJEogtGlw5GMPBGv-2ivppKlLjpAxesxITH4kh58onc4Rajr3_34hQ9UHdinpTMZMVznqh2T6pOEuBsymbGJ0FWBpziiw7cs89SPxXBUYphP4rcAhCiQXMA_A8DBME3R4XnTrz0nMQieQF4FM Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:38:49.498010 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d54bc45a4deb4fdbb34486c0dee35849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d54bc45a4deb4fdbb34486c0dee35849 Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-428688568 Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1ef5280a59af4ef09aa3e84ec74e1b61 Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-428688568-project Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.499531 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2b0edcdf-4dc5-4c2e-ab00-88c093204244'} Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:49.500441 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. Aug 03 04:38:49.501969 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:38:49.504486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] Returning 404 to user: Instance 2b0edcdf-4dc5-4c2e-ab00-88c093204244 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:49.504486 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ca6f885-7328-4cd4-8b12-ae11dd438b31 tempest-ImagesOneServerNegativeTestJSON-428688568 tempest-ImagesOneServerNegativeTestJSON-428688568-project] 10.222.0.72 "GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244" status: 404 len: 111 microversion: 2.1 time: 0.038885 Aug 03 04:38:49.504486 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 917/1851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:49 2022] GET /compute/v2.1/servers/2b0edcdf-4dc5-4c2e-ab00-88c093204244 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:38:49.749870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:49.751253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:49.760353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.760962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:49.761765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:49.762205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:50.043614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:50.044198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:50.063936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:50.064578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:50.065358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:50.065812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:50.164169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:50.180129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:50.181697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:50.193813 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b99cff3a-d22f-4813-b4c0-34efb8bb9f80 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1265 microversion: 2.25 time: 0.439623 Aug 03 04:38:50.195152 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 935/1852] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:49 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1265 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:50.237193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:50.241290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:50.252594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:50.252594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:50.252594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:50.252594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:50.253846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:50.339010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:50.924517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:50.954185 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68b2786a-7359-4267-ada6-fc1eb2c5028f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.720669 Aug 03 04:38:50.955059 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 936/1853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:50 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:50.960551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce3a7915-da61-4901-a0c2-0e67982c432e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Action: 'create', calling method: .version_select at 0x7fdd545f71f0>, body: {"keypair": {"name": "tempest-keypair-340200873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQs1EfpN+kKzrCYbl+8n8IS4zPbfMEGuWUZLX7iJus3HdeaA6Q+gp2LTXVjjAZ8YLrW13DTRzbYL0G/RAG9un2VCkSxVT54/+2rFHH6NCB6oXTAD2zLejVZdIERZ7CuCg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:51.010384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ce3a7915-da61-4901-a0c2-0e67982c432e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Getting quotas for project 37c98112c887420bbbcabf877421d0fb. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:38:51.015696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ce3a7915-da61-4901-a0c2-0e67982c432e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Getting quotas for user d96499f359754477bb86641588910734 and project 37c98112c887420bbbcabf877421d0fb. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:38:51.044658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=7 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:51.099777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:51.107033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c7f1768-1a3e-40ce-b14e-1d2f1fe6faf2 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1811 microversion: 2.1 time: 1.067569 Aug 03 04:38:51.107626 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 918/1854] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:50 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1811 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:51.135646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dfe12456-a678-42c7-9cbe-9b22e8f477b8 req-74cf9593-c960-49a1-add0-56c87233f425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e331d1e-abed-4f52-970b-189348b5fff6", "name": "network-vif-deleted", "tag": "ee27001f-28ce-4767-af6d-0c115227cabc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:51.154314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dfe12456-a678-42c7-9cbe-9b22e8f477b8 req-74cf9593-c960-49a1-add0-56c87233f425 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.155712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dfe12456-a678-42c7-9cbe-9b22e8f477b8 req-74cf9593-c960-49a1-add0-56c87233f425 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.163076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce3a7915-da61-4901-a0c2-0e67982c432e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.206089 Aug 03 04:38:51.164356 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 937/1855] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:38:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:38:51.170266 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dfe12456-a678-42c7-9cbe-9b22e8f477b8 req-74cf9593-c960-49a1-add0-56c87233f425 service nova] Creating event network-vif-deleted:ee27001f-28ce-4767-af6d-0c115227cabc for instance 4e331d1e-abed-4f52-970b-189348b5fff6 on n-h2-826756-5 Aug 03 04:38:51.176395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dfe12456-a678-42c7-9cbe-9b22e8f477b8 req-74cf9593-c960-49a1-add0-56c87233f425 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044147 Aug 03 04:38:51.177555 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 919/1856] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:51.220923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:51.222372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:51.240162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.242720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.246335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.248646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.299516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:51.411138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Action: 'update', calling method: .version_select at 0x7fdd547eba60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:51.494847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:51.501304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:51.515117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:51.527699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:51.530403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9488e4af-cafc-4a8e-820a-70ad076e6c82 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1265 microversion: 2.25 time: 0.316272 Aug 03 04:38:51.566068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 920/1857] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:51 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1265 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:38:51.577079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.578008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.581509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.582184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.746657 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ed88ab2-78cb-4e43-893d-a20f0ac1b04d tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098" status: 200 len: 148 microversion: 2.57 time: 0.580915 Aug 03 04:38:51.752247 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 938/1858] 10.222.0.72 () {62 vars in 1303 bytes} [Wed Aug 3 04:38:51 2022] PUT /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098 => generated 148 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:51.763722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Calling method '.version_select at 0x7fdd545a1280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:51.894654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.897927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.900111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:51.902083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:51.954777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8bda4c2d-73f4-483a-9e97-a0ad7b37b1e2 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098/detail" status: 200 len: 463 microversion: 2.57 time: 0.194727 Aug 03 04:38:51.956702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 921/1859] 10.222.0.72 () {60 vars in 1304 bytes} [Wed Aug 3 04:38:51 2022] GET /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098/detail => generated 463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:51.980743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:51.981441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:52.004725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:52.004725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:52.007010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:52.007683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:52.152065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:52.154721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:52.164024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:52.165188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:52.165980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:52.166601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:52.997350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:53.008975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-976321ea-3e6b-4b91-af4e-33b8bf8beb3e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 1.032605 Aug 03 04:38:53.010733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 939/1860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:51 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:53.024386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54809430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:53.110363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:53.119957 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1cb18c3a-bd56-4d64-b78f-0fae59faad63 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1790 microversion: 2.1 time: 0.991317 Aug 03 04:38:53.135229 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 922/1861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:52 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1790 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:38:53.144175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:53.149158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:53.154365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.154821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.155615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.156289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.159445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.162041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.170526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.173466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.215949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.232189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.232189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.232189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.325936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:53.335686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:53.350803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:53.352100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2b1e128-5f3e-4ead-b833-e8d1f81a573b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1265 microversion: 2.25 time: 0.217310 Aug 03 04:38:53.354007 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 923/1862] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:53 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:53.366944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-888bfd53-ae81-46fa-af37-9e4d08c32a0f req-25a5c657-f533-4be1-85f6-5413a438ed9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-deleted", "tag": "77f86bfa-b9ac-4011-8ce4-21fc12235c45"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:53.393846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-888bfd53-ae81-46fa-af37-9e4d08c32a0f req-25a5c657-f533-4be1-85f6-5413a438ed9d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:53.394589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-888bfd53-ae81-46fa-af37-9e4d08c32a0f req-25a5c657-f533-4be1-85f6-5413a438ed9d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:53.398772 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61911f2c-2ee5-47ef-a86f-2e920d37ba19 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098?user_id=1c027c3ab2b442d1b7dc23a882908bf9" status: 200 len: 148 microversion: 2.57 time: 0.386301 Aug 03 04:38:53.399437 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 940/1863] 10.222.0.72 () {62 vars in 1384 bytes} [Wed Aug 3 04:38:53 2022] PUT /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098?user_id=1c027c3ab2b442d1b7dc23a882908bf9 => generated 148 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:53.410874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae189224-858a-4cfb-a333-b3d0788042e1 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] Calling method '.version_select at 0x7fdd546d4f70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:53.419831 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-888bfd53-ae81-46fa-af37-9e4d08c32a0f req-25a5c657-f533-4be1-85f6-5413a438ed9d service nova] Creating event network-vif-deleted:77f86bfa-b9ac-4011-8ce4-21fc12235c45 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:53.425871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-888bfd53-ae81-46fa-af37-9e4d08c32a0f req-25a5c657-f533-4be1-85f6-5413a438ed9d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070396 Aug 03 04:38:53.426823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 924/1864] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:53.545452 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae189224-858a-4cfb-a333-b3d0788042e1 tempest-QuotasAdminTestV257-1000264690 tempest-QuotasAdminTestV257-1000264690-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098?user_id=1c027c3ab2b442d1b7dc23a882908bf9" status: 200 len: 190 microversion: 2.57 time: 0.138477 Aug 03 04:38:53.552705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 941/1865] 10.222.0.72 () {60 vars in 1364 bytes} [Wed Aug 3 04:38:53 2022] GET /compute/v2.1/os-quota-sets/6e82a50937484dc9ae73b734ff5e4098?user_id=1c027c3ab2b442d1b7dc23a882908bf9 => generated 190 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:38:54.035589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:54.036966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:54.049064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.049561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:54.050380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.050829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:54.144667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:54.145300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:54.165227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.166801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:54.166801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.167093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:54.667610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:54.679888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:54.680561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e295caaa-2225-44fc-bfd4-199ab940e046 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.649243 Aug 03 04:38:54.694080 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 925/1866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:54 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:54.707009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-558c8263-9423-450a-9cfe-1b3fe8be5680 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1611 microversion: 2.1 time: 0.567159 Aug 03 04:38:54.707858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:54.710696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:54.721656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 942/1867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:54 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1611 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:54.732881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.736511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:54.746165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:54.746904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:55.038073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:55.052850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:55.057747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:55.061375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf17f491-b8aa-4e27-84ec-383d90745eaa tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1265 microversion: 2.25 time: 0.367946 Aug 03 04:38:55.065074 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 926/1868] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:54 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1265 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:55.471911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-569f2883-d55c-4587-9aef-1c5a8fd2ad0e req-35cd3747-853b-41dd-a6dc-ca50c55a4e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-deleted", "tag": "ef115f15-f6c7-4320-a4d5-3071ac9e875b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:55.506464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-569f2883-d55c-4587-9aef-1c5a8fd2ad0e req-35cd3747-853b-41dd-a6dc-ca50c55a4e49 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:55.506464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-569f2883-d55c-4587-9aef-1c5a8fd2ad0e req-35cd3747-853b-41dd-a6dc-ca50c55a4e49 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:55.530545 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-569f2883-d55c-4587-9aef-1c5a8fd2ad0e req-35cd3747-853b-41dd-a6dc-ca50c55a4e49 service nova] Creating event network-vif-deleted:ef115f15-f6c7-4320-a4d5-3071ac9e875b for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:55.548423 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-569f2883-d55c-4587-9aef-1c5a8fd2ad0e req-35cd3747-853b-41dd-a6dc-ca50c55a4e49 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076669 Aug 03 04:38:55.548423 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 943/1869] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:38:55.708639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:55.709470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:55.720211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:55.720691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:55.721487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:55.721924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:55.733671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:55.737952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:55.755534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:55.756525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:55.759340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:55.760244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:56.261764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:56.271223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb32e754-fcde-420b-b257-eceb4d931753 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1454 microversion: 2.1 time: 0.542230 Aug 03 04:38:56.276297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 944/1870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:55 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1454 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:56.285045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:56.286760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:56.293282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:56.294104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:56.295129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:56.295803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:56.333479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:56.335767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:56.336713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:56.337414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lazy-loading 'fault' on Instance uuid 4e331d1e-abed-4f52-970b-189348b5fff6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:56.340463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:56.360443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf1b5776-0c77-42e6-a042-9decd6026910 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.651382 Aug 03 04:38:56.362829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 927/1871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:55 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:56.474827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:56.488858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:56.492383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:56.496989 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4472372d-a422-459c-b9fb-67b034a2b951 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 200 len: 1270 microversion: 2.25 time: 0.212784 Aug 03 04:38:56.496989 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 945/1872] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:56 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:38:57.196690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1836527967", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f61eb4e1-d02a-4c23-b699-210158c2c7c6"}, {"port": "bf6f257e-172b-42d6-a2f0-8889f14b6084", "tag": "port-1"}, {"port": "6b74cc07-e241-4c68-8440-f66e97b11599", "tag": "port-2"}, {"uuid": "e710cbde-8164-4986-bcfe-9419ad7e08e8", "tag": "net-1"}, {"uuid": "e710cbde-8164-4986-bcfe-9419ad7e08e8"}, {"uuid": "4eaad101-8aa8-4ef2-83a7-e889173dd4e2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4eaad101-8aa8-4ef2-83a7-e889173dd4e2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "54c47bdb-d290-448a-ae8b-156eeaa03f61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d622ed84-763c-4ca5-96ad-ba355ba30620", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "cc8db25e-0a33-4bc7-8846-bbb4c6c8a392", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--195543093"}], "key_name": "tempest-keypair-340200873", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:57.296506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:57.298239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:57.315812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.317094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.319289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.324060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.399679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.400153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.400941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lazy-loading 'fault' on Instance uuid 31b793e3-9393-4972-9843-b83aed64bb97 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:38:57.488874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:57.501187 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f717284-b68a-4575-9fe7-59eb05e0f627 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 200 len: 1302 microversion: 2.1 time: 0.211427 Aug 03 04:38:57.501802 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 946/1873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:57 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 1302 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:57.512526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:57.514925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:57.524324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.524866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.525652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.526087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.541075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] validate_networks() for [('f61eb4e1-d02a-4c23-b699-210158c2c7c6', None, None, None, None, None), (None, None, 'bf6f257e-172b-42d6-a2f0-8889f14b6084', None, None, None), (None, None, '6b74cc07-e241-4c68-8440-f66e97b11599', None, None, None), ('e710cbde-8164-4986-bcfe-9419ad7e08e8', None, None, None, None, None), ('e710cbde-8164-4986-bcfe-9419ad7e08e8', None, None, None, None, None), ('4eaad101-8aa8-4ef2-83a7-e889173dd4e2', '10.2.2.100', None, None, None, None), ('4eaad101-8aa8-4ef2-83a7-e889173dd4e2', '10.2.2.200', None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:38:57.953417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:38:57.962380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0b22bad5-835e-4027-a4fc-ba2032a81398 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.459516 Aug 03 04:38:57.963055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 947/1874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:57 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:38:57.968170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:57.969115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 4e331d1e-abed-4f52-970b-189348b5fff6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:57.976877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.978049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.979451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:57.980160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:57.985347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:38:58.003238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] HTTP exception thrown: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Request method failure captured: Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 HTTP/1.1 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fopyUSHLWT1Sl_pHcUs3TikTgX2oY2_kL4yH04lVUdTuYmm53UayLfvqEO9CSUXPjjKQlJVs7m1aNaI-BcVTg7ECA0ZHnxIkPo-xSXbUV_we7qWwKtkXOxkS9TVD5YcT2RHlIFE3TStChqaaCA--Lru_I3ovLNZiHb6CDhLutG4-Jw Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:58.005800 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4cb1b66854244b8197c4b1f0ccae0b0e Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. Aug 03 04:38:58.007440 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4e331d1e-abed-4f52-970b-189348b5fff6'} Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:58.008888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. Aug 03 04:38:58.010357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.022654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Returning 404 to user: Instance 4e331d1e-abed-4f52-970b-189348b5fff6 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:58.023828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-252ad681-6acb-40e1-8d7b-ffc6f665847d tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6" status: 404 len: 111 microversion: 2.25 time: 0.059387 Aug 03 04:38:58.028386 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 948/1875] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:38:57 2022] GET /compute/v2.1/servers/4e331d1e-abed-4f52-970b-189348b5fff6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:38:58.033155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-41f1fc41-20a9-494b-9d94-8797097fa2b0 req-a7dd78b1-822d-4c06-85e0-37b1f1c68966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b793e3-9393-4972-9843-b83aed64bb97", "name": "network-vif-deleted", "tag": "228ad446-936b-4371-ad44-7730d8616e77"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:58.045619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41f1fc41-20a9-494b-9d94-8797097fa2b0 req-a7dd78b1-822d-4c06-85e0-37b1f1c68966 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:58.046068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41f1fc41-20a9-494b-9d94-8797097fa2b0 req-a7dd78b1-822d-4c06-85e0-37b1f1c68966 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:58.059805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-41f1fc41-20a9-494b-9d94-8797097fa2b0 req-a7dd78b1-822d-4c06-85e0-37b1f1c68966 service nova] Creating event network-vif-deleted:228ad446-936b-4371-ad44-7730d8616e77 for instance 31b793e3-9393-4972-9843-b83aed64bb97 on n-h1-826756-5 Aug 03 04:38:58.066098 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-41f1fc41-20a9-494b-9d94-8797097fa2b0 req-a7dd78b1-822d-4c06-85e0-37b1f1c68966 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035992 Aug 03 04:38:58.068058 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 949/1876] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:38:58.528525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:38:58.529302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:38:58.539186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:58.539911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:58.540951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:38:58.541587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:38:58.574426 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 HTTP/1.1 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:38:58.579421 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:38:58.581254 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '31b793e3-9393-4972-9843-b83aed64bb97'} Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:38:58.582285 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:38:58.584495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:38:58.587750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:38:58.590540 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1589c8a9-592a-4a88-b8f1-8d309efd5e3d tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 404 len: 111 microversion: 2.1 time: 0.066314 Aug 03 04:38:58.604723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 950/1877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:38:58 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:38:59.153544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-708157294", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:38:59.242990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:39:00.182880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:00.183464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:00.184126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:00.184671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:00.185797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:00.208462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:00.211427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:00.212638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:00.214659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:00.241406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Getting quotas for project c8e013af773c43fd9064cc23f0ee9ab0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:00.247081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Getting quotas for user c081e7792c674e9fabc7bcff0f21c1a7 and project c8e013af773c43fd9064cc23f0ee9ab0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:00.266003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:39:00.268687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:39:00.414406 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7577685c-281e-46f2-a0f7-8f947c55552b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748297 Aug 03 04:39:00.415159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 951/1878] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:39:00.425543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:00.426916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:00.441922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:00.442585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:00.445251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:00.445896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:01.681326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:01.706489 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-10e93416-918d-4272-bb14-9868d0c13469 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 1.278412 Aug 03 04:39:01.707184 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 952/1879] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:00 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:01.723695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d51d41d2-bd9d-4db6-bdd0-e76ee475c1c7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:01.723695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d51d41d2-bd9d-4db6-bdd0-e76ee475c1c7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:01.938404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d51d41d2-bd9d-4db6-bdd0-e76ee475c1c7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:01.950515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d51d41d2-bd9d-4db6-bdd0-e76ee475c1c7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1216 microversion: 2.1 time: 0.235397 Aug 03 04:39:01.953206 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 953/1880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:01 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:02.171482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:02.738237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:02.739665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:02.749516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:02.750337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:02.751485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:02.752568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:02.767248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:03.457952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:03.484480 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90355d9e-5f27-4f4c-b7ec-4c540c2e9ea6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.750263 Aug 03 04:39:03.487191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 954/1881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:02 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:39:03.513094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:03.513850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:03.542014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:03.542488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:03.543296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:03.547903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:03.722590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:03.732770 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d95f5475-e097-42d6-b179-9c55ae6dcac7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1212 microversion: 2.1 time: 0.244323 Aug 03 04:39:03.733376 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 955/1882] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:03 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1212 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:04.512767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:04.514356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:04.527248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:04.533035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:04.540596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:04.540596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:05.376921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:05.392255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b195538c-a2f1-4f75-aaee-80c3ca53cce0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1716 microversion: 2.1 time: 0.883105 Aug 03 04:39:05.395237 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 956/1883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:04 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1716 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:39:05.420030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:05.421866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:05.468151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:05.469257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:05.471246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:05.474635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:05.753324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:05.762677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-252cc8d0-ac95-4044-9697-a1ce3dcc8a34 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1274 microversion: 2.1 time: 0.358710 Aug 03 04:39:05.763550 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 957/1884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:05 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:05.769543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:05.771006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:05.781244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:05.789072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:05.789072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:05.789072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:05.874191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:39:06.345587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=37 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:06.423892 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cfd2b686-4f86-423f-bb3b-4d8636da021c tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 204 len: 0 microversion: 2.25 time: 0.658794 Aug 03 04:39:06.429243 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 958/1885] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:39:05 2022] DELETE /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:39:06.434886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1de4c1b4-ff7c-492c-a335-e9c4109db60c"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:06.437897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:06.445088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:06.445802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:06.446805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:06.447436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:06.642612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:06.643041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:06.643594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:06.644109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:06.644665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:06.656084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:06.656971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:06.658041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:06.658771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:06.686849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Getting quotas for project 37c98112c887420bbbcabf877421d0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:06.696725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Getting quotas for user d96499f359754477bb86641588910734 and project 37c98112c887420bbbcabf877421d0fb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:06.931588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:39:06.934394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='54c47bdb-d290-448a-ae8b-156eeaa03f61',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d622ed84-763c-4ca5-96ad-ba355ba30620',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc8db25e-0a33-4bc7-8846-bbb4c6c8a392',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:39:08.287769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9fb17742-8fb4-4141-8634-69e524d96ca9 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "POST /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.856249 Aug 03 04:39:08.289495 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 959/1886] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:39:06 2022] POST /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments => generated 194 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:08.562386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1549601515", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:08.645261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:08.646251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:08.647011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:08.647598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:08.648176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:08.657711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:08.658462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:08.659498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:08.660114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:08.683294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Getting quotas for project 306c5a93b4da49b1aaa98da764b68920. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:08.688763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Getting quotas for user 4a62d639def44d9bb39925dd2b2a5293 and project 306c5a93b4da49b1aaa98da764b68920. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:08.706272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:39:08.710393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:39:08.954929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04bc2050-f17a-4428-bd69-a85ee2244fe5 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.662621 Aug 03 04:39:08.957276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 960/1887] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:39:08.967588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:08.970568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:09.012769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.014158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.017387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.035105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.201967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c61437c-5661-4a84-a985-240392840495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.011256 Aug 03 04:39:09.203660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 928/1888] 10.222.0.72 () {62 vars in 1189 bytes} [Wed Aug 3 04:38:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 12014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:39:09.209500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:09.214025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:09.219233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.219963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.221690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.222374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.442833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:09.458378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:09.471529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:09.475858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56f4e3f3-8023-4f7e-8688-894f4a47262f tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1662 microversion: 2.25 time: 0.270684 Aug 03 04:39:09.482280 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 929/1889] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:09 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1662 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:09.499627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:09.516919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:09.553503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.565261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.567566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:09.575475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:09.796049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:09.823808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8d66857-5483-4dbe-b079-004f71234725 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1706 microversion: 2.1 time: 0.864159 Aug 03 04:39:09.826577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 961/1890] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:08 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1706 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:09.855415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:09.862908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:09.996547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.011904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91932911-6f9b-4231-bb72-a8f5793d2cc6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 0.526078 Aug 03 04:39:10.013151 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 930/1891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:09 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:10.026666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:10.028297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:10.276354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.291162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.296891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.324846 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3ea6528-2e5c-4cc9-bb6a-5537b610528b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "PUT /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1359 microversion: 2.75 time: 0.474973 Aug 03 04:39:10.325561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 962/1892] 10.222.0.72 () {62 vars in 1297 bytes} [Wed Aug 3 04:39:09 2022] PUT /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:10.351452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0101d71e-3adf-4ef8-9672-0810ddc4e354 req-852377f8-c614-4e41-9da8-100554b3a936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2a3e04-9b62-42d5-9a8f-e095cb0413f1", "name": "network-vif-deleted", "tag": "b58469d7-31f2-490f-97cb-f7f3954c2c39"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:10.399981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0101d71e-3adf-4ef8-9672-0810ddc4e354 req-852377f8-c614-4e41-9da8-100554b3a936 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:10.413571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0101d71e-3adf-4ef8-9672-0810ddc4e354 req-852377f8-c614-4e41-9da8-100554b3a936 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:10.449526 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0101d71e-3adf-4ef8-9672-0810ddc4e354 req-852377f8-c614-4e41-9da8-100554b3a936 service nova] Creating event network-vif-deleted:b58469d7-31f2-490f-97cb-f7f3954c2c39 for instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 on n-h2-826756-5 Aug 03 04:39:10.464935 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0101d71e-3adf-4ef8-9672-0810ddc4e354 req-852377f8-c614-4e41-9da8-100554b3a936 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136892 Aug 03 04:39:10.473303 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 963/1893] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:10.485392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d5e80ae-3943-45ad-879e-978794a7e2c7 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '.version_select at 0x7fdd54809430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:10.493907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.504987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d5e80ae-3943-45ad-879e-978794a7e2c7 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:10.504987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d5e80ae-3943-45ad-879e-978794a7e2c7 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:10.508175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.509760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.510994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5537ba7-b918-4afe-a1a1-ca9d42f6becb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1285 microversion: 2.42 time: 0.494013 Aug 03 04:39:10.511974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 931/1894] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:10 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1285 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:10.518631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:10.519560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:10.532161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d5e80ae-3943-45ad-879e-978794a7e2c7 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.057172 Aug 03 04:39:10.533035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 964/1895] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:39:10 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:10.563017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-911198323", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "5e5ccbf6-a580-4ab1-aace-f2faae20a415"}, {"uuid": "3e5f66de-268a-4778-a16e-6a000358290c"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:10.688923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] validate_networks() for [('5e5ccbf6-a580-4ab1-aace-f2faae20a415', None, None, None, None, None), ('3e5f66de-268a-4778-a16e-6a000358290c', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:39:10.961430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.974469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:10.977835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:11.009398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ecd2fac9-f8be-4da4-8c52-f2d979bff20e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1359 microversion: 2.75 time: 0.496103 Aug 03 04:39:11.035753 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 932/1896] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:10 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1359 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:11.065025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:11.066129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:11.081434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.084260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.085834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.088901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.142233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.143296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.144184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lazy-loading 'fault' on Instance uuid 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:39:11.365693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:11.380474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:11.386355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:11.388688 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ac0c2f2-b8ec-49ad-8daf-b26000a16e37 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 200 len: 1374 microversion: 2.25 time: 0.351410 Aug 03 04:39:11.389466 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 933/1897] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:11 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 1374 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:11.425060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:11.425600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:11.435461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.436231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.437471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.438161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.851175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fdea101-a9f6-4481-b717-315a5563acde tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1857 microversion: 2.1 time: 0.437585 Aug 03 04:39:11.861674 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 934/1898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:11 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1857 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:11.867757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:11.872407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:11.890082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.890773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:11.891806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:11.892479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.395357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:12.418462 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65eeef9c-e8ab-4c31-bd8e-3b5b429aee42 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 0.564864 Aug 03 04:39:12.419469 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 935/1899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:11 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:12.435084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:12.435992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:12.479673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.480300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.485340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.485875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.726343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:12.744205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:12.746612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:12.748253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0170c886-2f41-42dd-8f31-69db39708337 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1527 microversion: 2.42 time: 0.319504 Aug 03 04:39:12.768035 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 936/1900] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:12 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1527 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:12.774012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:12.774557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:12.774896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:12.775313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:12.775986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:12.776385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:12.778606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:12.790032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.790811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.791233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.791864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.792537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.792786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.795639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:12.796326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:12.844137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Getting quotas for project 27e9f6d5dd60435f8bf8cfd56d500e7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:12.854409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Getting quotas for user 07c40946ced64a83ac98d6205e212ed4 and project 27e9f6d5dd60435f8bf8cfd56d500e7a. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:12.868639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:39:12.871251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:39:13.106878 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13bbb7d5-f257-4d0a-9d71-7bd31dd18c1b tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1857 microversion: 2.1 time: 0.336979 Aug 03 04:39:13.109903 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 937/1901] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:12 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1857 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:13.115236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e173d704-1cad-4de8-9881-b10b0ae663e5 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.577630 Aug 03 04:39:13.116097 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 965/1902] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:39:13.124721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.125891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:13.129641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.130266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:13.137767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:13.139321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.140804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.143520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.144156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.148072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.150814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.152114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.155484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.184524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] HTTP exception thrown: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Request method failure captured: Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 HTTP/1.1 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fopyUSHLWT1Sl_pHcUs3TikTgX2oY2_kL4yH04lVUdTuYmm53UayLfvqEO9CSUXPjjKQlJVs7m1aNaI-BcVTg7ECA0ZHnxIkPo-xSXbUV_we7qWwKtkXOxkS9TVD5YcT2RHlIFE3TStChqaaCA--Lru_I3ovLNZiHb6CDhLutG4-Jw Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:39:13.211969 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4cb1b66854244b8197c4b1f0ccae0b0e Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. Aug 03 04:39:13.214167 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9d2a3e04-9b62-42d5-9a8f-e095cb0413f1'} Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:39:13.215075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. Aug 03 04:39:13.218119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:39:13.220922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Returning 404 to user: Instance 9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:39:13.220922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a16be213-e851-4377-acf6-9a20fa046ff7 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1" status: 404 len: 111 microversion: 2.25 time: 0.094438 Aug 03 04:39:13.226549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 966/1903] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:13 2022] GET /compute/v2.1/servers/9d2a3e04-9b62-42d5-9a8f-e095cb0413f1 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:39:13.231481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4c251fa9-919e-4671-944c-7d1acc9b1b8d req-96691b85-8c4d-42f2-823c-c6bc2a3b7483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:13.270138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4c251fa9-919e-4671-944c-7d1acc9b1b8d req-96691b85-8c4d-42f2-823c-c6bc2a3b7483 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.270499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4c251fa9-919e-4671-944c-7d1acc9b1b8d req-96691b85-8c4d-42f2-823c-c6bc2a3b7483 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.299486 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4c251fa9-919e-4671-944c-7d1acc9b1b8d req-96691b85-8c4d-42f2-823c-c6bc2a3b7483 service nova] Creating event network-changed:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:39:13.317035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4c251fa9-919e-4671-944c-7d1acc9b1b8d req-96691b85-8c4d-42f2-823c-c6bc2a3b7483 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086098 Aug 03 04:39:13.317035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 967/1904] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:13.323417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ca0807f-b4ff-4130-bcca-145f39cac527 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.324118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ca0807f-b4ff-4130-bcca-145f39cac527 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:13.416753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:13.433174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:13.438581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:13.465496 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e191c36b-29aa-4ce7-a053-b71249506942 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1411 microversion: 2.75 time: 0.354405 Aug 03 04:39:13.466815 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 938/1905] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:13 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1411 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:13.480920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa4efbce-2272-409f-9c85-d8742c3fdf24 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '.version_select at 0x7fdd545a1310>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.518095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ca0807f-b4ff-4130-bcca-145f39cac527 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:13.534762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ca0807f-b4ff-4130-bcca-145f39cac527 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1212 microversion: 2.1 time: 0.206594 Aug 03 04:39:13.534762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 968/1906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:13 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1212 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:13.534762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.534762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:13.546604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.547325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.551276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.551925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.663571 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa4efbce-2272-409f-9c85-d8742c3fdf24 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567280295" status: 204 len: 0 microversion: 2.25 time: 0.192670 Aug 03 04:39:13.666791 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 939/1907] 10.222.0.72 () {60 vars in 1259 bytes} [Wed Aug 3 04:39:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567280295 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:39:13.682835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:13.687143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:13.738900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.745358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.745358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:13.747239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:13.855409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lazy-loading 'services' on Instance uuid 82bb2fcb-cf43-444a-87f4-bbca57d65276 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:39:14.421700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73640f74-da17-4da9-9c88-9bdc81aa115d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments/b1bee60b-18d8-4ff9-ab51-42c222418b6f" status: 202 len: 0 microversion: 2.1 time: 0.892727 Aug 03 04:39:14.423256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 969/1908] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:39:13 2022] DELETE /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments/b1bee60b-18d8-4ff9-ab51-42c222418b6f => generated 0 bytes in 895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:39:14.437669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:14.438388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:14.448495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:14.448951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:14.449781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:14.450269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:14.830522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:14.846367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cea878b-c449-4c48-a144-9ab03a6ebea8 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 1.178077 Aug 03 04:39:14.847408 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 940/1909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:13 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:14.851955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:14.862548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:14.875548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:14.876017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:14.878670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:14.879160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:14.950080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:14.957808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:14.958710 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52e66fb8-1db2-409c-a0c8-717634c23457 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110077 Aug 03 04:39:14.963939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 941/1910] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:14 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:14.980506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:14.983034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:14.998110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:15.012517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:15.021237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:15.022555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:15.023551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:15.024804 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-681635e3-3be5-4f8d-a9fc-5a4976dd8900 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1583 microversion: 2.42 time: 0.600249 Aug 03 04:39:15.025636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:15.026164 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 970/1911] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:14 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1583 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:15.031881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:15.032878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:15.049693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:15.050430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:15.053937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:15.054619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.590872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:16.618311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db3b915f-31b6-4832-b7cc-60cc2860d194 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1216 microversion: 2.1 time: 1.590683 Aug 03 04:39:16.619918 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 971/1912] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:15 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1216 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:16.630835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:16.633666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:16.638883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:16.646064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:16.651893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:16.658821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.662153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.666685 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b74681d6-dc3c-4d82-8838-e7096a45f2d0 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1417 microversion: 2.75 time: 1.697708 Aug 03 04:39:16.666836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.666836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.686584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 942/1913] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:14 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1417 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:16.696686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:16.704880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:16.720050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:16.723933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.726401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.729890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.730638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.839502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8dbd6502-21e0-4b6d-b885-c8b38ed07396 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150548 Aug 03 04:39:16.840116 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 943/1914] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:16 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:16.846916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:16.848159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:16.858060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.858527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:16.859369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:16.860079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:17.275310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:17.298114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:17.303957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:17.309259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6eba275-a107-42e2-9d45-7d9912f1ab4c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1593 microversion: 2.42 time: 0.465541 Aug 03 04:39:17.311135 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 944/1915] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:16 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1593 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:17.449213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:17.465939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8c5a688-e50a-46c4-9a48-416ac6355d8a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 0.838444 Aug 03 04:39:17.469953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 972/1916] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:16 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:17.640741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:17.653747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:17.657063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:17.662782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:17.663745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:17.666819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:17.713425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:17.714602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:17.730039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:17.730739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:17.731744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:17.733298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.044069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.055190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.065161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.084256 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2943bfc8-8847-4fa2-85ad-c618c0e56eff tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1438 microversion: 2.75 time: 0.395036 Aug 03 04:39:18.097065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 973/1917] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:17 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1438 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:39:18.121686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:18.123940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:18.137253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.139617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.141425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.142115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.201513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.223741 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a53552e7-e986-4fe2-90e4-f715c363e8e4 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1270 microversion: 2.1 time: 0.587281 Aug 03 04:39:18.225083 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 945/1918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:17 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1270 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:18.231168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:18.234532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e83afc5-b94f-42bb-bba2-78038e7d7f69 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131085 Aug 03 04:39:18.236166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:18.238535 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 974/1919] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:18 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:18.249748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:18.256909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.256909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.256909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.256909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.349813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:18.350448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:18.372217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.376696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.377810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.378595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.524210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:18.525954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:18.526371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:18.526797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:18.527213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:18.643697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:18.660091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.679394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.694402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:18.698925 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41ca60ec-162a-438e-975d-afc6c5b3a491 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1593 microversion: 2.42 time: 0.357669 Aug 03 04:39:18.708348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 975/1920] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:18 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1593 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:39:18.733718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:18.734967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:18.748003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.758236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.765996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.766725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.916226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:18.943287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.944034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:18.950402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:18.950896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.129182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.141047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.142611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.155912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-08d897c6-cbb5-4d03-9b11-579bb0599586 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "POST /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2/action" status: 202 len: 1495 microversion: 2.75 time: 0.929329 Aug 03 04:39:19.156611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 946/1921] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:39:18 2022] POST /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2/action => generated 1495 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 04:39:19.196387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:19.196387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:19.211824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.211824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.212049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.212519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.297488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:39:19.328371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.341686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-545c0f15-143d-4d69-b8d6-800a639a9d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 0.632104 Aug 03 04:39:19.348973 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 976/1922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:18 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:19.354261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:19.357851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:19.375680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.375680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.377050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.377600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.513632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.542699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.546098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:19.559463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35ed0e37-150f-4f60-8eb6-14e5dca6eb56 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.208487 Aug 03 04:39:19.571416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 977/1923] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:19 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:19.722193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44670993-8cd4-4d20-9c0f-4ee5d1688c4a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59d62430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-730292084", "description": "tempest-description-1594846109"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:19.824699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24dbe10c-2a4f-43fb-9d19-9ee45483625b tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 204 len: 0 microversion: 2.25 time: 0.637368 Aug 03 04:39:19.826314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 947/1924] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:39:19 2022] DELETE /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:39:19.834058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:19.835162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:19.844154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.846097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.847246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:19.847897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:19.981565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:20.021450 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c116d40-4767-4921-a5ff-c953fd7d9c4e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1270 microversion: 2.1 time: 0.182122 Aug 03 04:39:20.021450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 948/1925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:19 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:20.035445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:20.038244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:20.045981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.046661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.053182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.053182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.085503 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2074d4e2-5c85-4630-8965-0fa9be3f66a1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057910 Aug 03 04:39:20.086668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 949/1926] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:20 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:20.091710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:20.092553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:20.103036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.103587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.104806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.105212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.685291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:20.707310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:20.710727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:20.724132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4dab6748-0ae3-4eda-8e04-be43b82e260b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1660 microversion: 2.42 time: 0.624361 Aug 03 04:39:20.725420 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 950/1927] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:20 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1660 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:20.733404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:20.734266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:20.747002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.749361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.750820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.751573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.769810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44670993-8cd4-4d20-9c0f-4ee5d1688c4a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.204926 Aug 03 04:39:20.771301 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 978/1928] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:39:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:20.776690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7ee4b57f-2bd9-49cb-80d8-7daebc0aa70c req-3a6b0330-ea78-43a4-a474-27446388adb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-plugged", "status": "completed", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:20.814754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7ee4b57f-2bd9-49cb-80d8-7daebc0aa70c req-3a6b0330-ea78-43a4-a474-27446388adb5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.815496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7ee4b57f-2bd9-49cb-80d8-7daebc0aa70c req-3a6b0330-ea78-43a4-a474-27446388adb5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.837310 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7ee4b57f-2bd9-49cb-80d8-7daebc0aa70c req-3a6b0330-ea78-43a4-a474-27446388adb5 service nova] Creating event network-vif-plugged:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:39:20.846289 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7ee4b57f-2bd9-49cb-80d8-7daebc0aa70c req-3a6b0330-ea78-43a4-a474-27446388adb5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073247 Aug 03 04:39:20.847827 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 979/1929] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:20.872026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:20.873381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:20.890993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.892184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.893802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:20.895689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:20.970831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:21.897994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:21.906428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:21.907942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:21.909174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d29d738-d981-41bd-853a-bcd45d326dd9 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1548 microversion: 2.25 time: 1.182573 Aug 03 04:39:21.910043 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 951/1930] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:20 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1548 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:21.924574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:21.925761 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-06333454-611f-493a-a063-53ea2c2f3877 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1316 microversion: 2.1 time: 1.075911 Aug 03 04:39:21.926662 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 980/1931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:20 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1316 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:21.931257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:21.931874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:21.938326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:21.939023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:21.940029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:21.941343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:21.949670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a8e3d26-db7a-40c2-bd1c-df0b42cc39dd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd54716dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-76277670", "description": "tempest-description-73098870"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:22.147363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:22.162230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:22.165249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:22.173523 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3c0f7ba3-fc01-4fd7-9187-38120a418086 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.246417 Aug 03 04:39:22.174586 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 952/1932] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:21 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:22.181993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:22.182846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:22.190048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.190510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.192111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.193685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.595503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:22.613167 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e75fc46b-84fe-4089-9082-a51c0de97c62 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1312 microversion: 2.1 time: 0.437271 Aug 03 04:39:22.614344 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 953/1933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:22 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:22.619097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:22.630357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:22.637073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.644804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.646337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.646337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.728672 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-086af314-5cfb-49d1-8f76-3c1c34b8dd6a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109019 Aug 03 04:39:22.735200 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 954/1934] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:22 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:39:22.753817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:22.759718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:22.778829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.781913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.782662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:22.783159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:22.821850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:23.176301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.187266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.188730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.190033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cfda11d9-9f10-4ff9-8ef8-54aab0685f59 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1660 microversion: 2.42 time: 0.453604 Aug 03 04:39:23.191562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 955/1935] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:22 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1660 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:23.196124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-55c77d60-6845-437b-ae58-05ab276b26cf req-8ee2db37-9faa-487e-80db-0e2108cd0135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b7e1fa-9f95-45d4-b085-db34072d201f", "name": "network-vif-deleted", "tag": "03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:23.208004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-55c77d60-6845-437b-ae58-05ab276b26cf req-8ee2db37-9faa-487e-80db-0e2108cd0135 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.208489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-55c77d60-6845-437b-ae58-05ab276b26cf req-8ee2db37-9faa-487e-80db-0e2108cd0135 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.239627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-55c77d60-6845-437b-ae58-05ab276b26cf req-8ee2db37-9faa-487e-80db-0e2108cd0135 service nova] Creating event network-vif-deleted:03c7fd56-61b1-4e6c-a4f1-c4d2b2e15021 for instance f3b7e1fa-9f95-45d4-b085-db34072d201f on n-h1-826756-5 Aug 03 04:39:23.250756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-55c77d60-6845-437b-ae58-05ab276b26cf req-8ee2db37-9faa-487e-80db-0e2108cd0135 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057107 Aug 03 04:39:23.255364 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 956/1936] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:23.282757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:23.282757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:23.293407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a8e3d26-db7a-40c2-bd1c-df0b42cc39dd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 1.365408 Aug 03 04:39:23.294026 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 981/1937] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:39:21 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:23.300191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:23.301405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.301624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:23.301951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.309073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.309073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.319567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.320326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.321323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.321940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.438960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.453899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.455902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.456976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-850fc7b9-04de-4e60-907c-5d19a3651858 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 200 len: 1332 microversion: 2.25 time: 0.200168 Aug 03 04:39:23.470558 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 957/1938] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:23 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:23.470558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:23.470558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:23.487159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.487840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.488615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:23.489059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:23.522828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=52 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:23.784306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.795831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.807313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:23.826881 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9bb8cfdf-1d8e-4e72-9ebc-84361c0f3a3c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.367808 Aug 03 04:39:23.828337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 958/1939] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:23 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:23.834517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1594079483", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d0de1745-9dcf-4c4e-9255-5fa0f18bb121"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:23.940114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] validate_networks() for [('d0de1745-9dcf-4c4e-9255-5fa0f18bb121', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:39:23.976438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:24.006375 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1a97abb-96ff-436f-8de5-810f16934ab6 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1466 microversion: 2.1 time: 0.709921 Aug 03 04:39:24.006629 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 982/1940] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:23 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1466 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:24.011943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:24.012588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:24.046571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:24.047035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:24.047902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:24.056861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:24.526539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:24.539585 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-558b4310-cae0-4da5-b749-6a78ca648b31 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.531835 Aug 03 04:39:24.552900 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 983/1941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:24 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:24.556672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-475439180", "metadata": {"image_type": "test"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:24.559948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:24.569189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:24.569854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:24.570867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:24.571467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:24.639427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Getting quotas for project c8e013af773c43fd9064cc23f0ee9ab0. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:24.645729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Getting quotas for user c081e7792c674e9fabc7bcff0f21c1a7 and project c8e013af773c43fd9064cc23f0ee9ab0. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:25.116019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:25.116693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:25.117910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:25.118403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:25.119760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:25.133417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.145001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.152635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.152635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.176851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Getting quotas for project cf2b285affb34cb8b6c589a68e658714. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:39:25.184488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Getting quotas for user 55543d8f640640039b72d044a49ba779 and project cf2b285affb34cb8b6c589a68e658714. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:39:25.201610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:39:25.205104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:39:25.225163 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7446b6e3-8d62-45b0-a9ad-f594aec99e15 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "POST /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3/action" status: 202 len: 0 microversion: 2.1 time: 0.658727 Aug 03 04:39:25.226736 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 984/1942] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:39:24 2022] POST /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:39:25.239220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:25.245146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:25.265554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.266189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.267956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.270201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.398111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41ea658a-d53c-4715-85c8-b3d8aae17ff9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568530 Aug 03 04:39:25.399531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 959/1943] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:39:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:39:25.405544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:25.408677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: f3b7e1fa-9f95-45d4-b085-db34072d201f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:25.414285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.415220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.416248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.416968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.472824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] HTTP exception thrown: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Request method failure captured: Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f HTTP/1.1 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fopyUSHLWT1Sl_pHcUs3TikTgX2oY2_kL4yH04lVUdTuYmm53UayLfvqEO9CSUXPjjKQlJVs7m1aNaI-BcVTg7ECA0ZHnxIkPo-xSXbUV_we7qWwKtkXOxkS9TVD5YcT2RHlIFE3TStChqaaCA--Lru_I3ovLNZiHb6CDhLutG4-Jw Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:39:25.474858 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4cb1b66854244b8197c4b1f0ccae0b0e Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. Aug 03 04:39:25.476691 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f3b7e1fa-9f95-45d4-b085-db34072d201f'} Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:39:25.477577 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. Aug 03 04:39:25.481031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:25.483563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Returning 404 to user: Instance f3b7e1fa-9f95-45d4-b085-db34072d201f could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:39:25.483563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd5df782-eac5-4ed7-88d9-cc2871da4cf5 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f" status: 404 len: 111 microversion: 2.25 time: 0.075657 Aug 03 04:39:25.483563 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 960/1944] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:25 2022] GET /compute/v2.1/servers/f3b7e1fa-9f95-45d4-b085-db34072d201f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:39:25.486890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:25.487592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:25.495368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.495992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.497031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:25.497580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:25.990071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:25.999489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.001310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.006937 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d12d2763-d8fe-494f-bad6-cb88d9dceb5c tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.523931 Aug 03 04:39:26.018127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 961/1945] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:25 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:26.025268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-670d77fc-9e9f-4740-8af8-55803912e518 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd545d70d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:26.088406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.102319 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-670d77fc-9e9f-4740-8af8-55803912e518 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 0.082240 Aug 03 04:39:26.104698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.108415 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 962/1946] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:26 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:26.113694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.115142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74c2b261-5490-4ad9-af9a-f2994e9b76e7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1706 microversion: 2.42 time: 0.886894 Aug 03 04:39:26.115904 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 985/1947] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:25 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1706 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:26.118298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e3ab12f4-ca16-47b0-a3b3-ac0e76d8b4c4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:26.118937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e3ab12f4-ca16-47b0-a3b3-ac0e76d8b4c4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:26.129348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:26.129857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:26.144498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.145321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.146494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.147274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.186712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:39:26.198773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e3ab12f4-ca16-47b0-a3b3-ac0e76d8b4c4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.221330 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e3ab12f4-ca16-47b0-a3b3-ac0e76d8b4c4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1216 microversion: 2.1 time: 0.107043 Aug 03 04:39:26.223311 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 963/1948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:26 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:26.229066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:26.230160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:26.241061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.242268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.246685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.247269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.269437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:26.426123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:26.577015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:26.585998 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-770efe6f-af86-4ee5-bfdf-5540e7b341a9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.361205 Aug 03 04:39:26.587000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 964/1949] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:26 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:26.608833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ee3c2aaa-2f57-4548-8de6-6c2c9f0dd9bd req-981e14ac-2e52-411a-b595-259273045921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "tag": "868c8708-e342-45bf-8d39-49d94e8033db"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:26.657861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ee3c2aaa-2f57-4548-8de6-6c2c9f0dd9bd req-981e14ac-2e52-411a-b595-259273045921 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.658321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ee3c2aaa-2f57-4548-8de6-6c2c9f0dd9bd req-981e14ac-2e52-411a-b595-259273045921 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.686324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ee3c2aaa-2f57-4548-8de6-6c2c9f0dd9bd req-981e14ac-2e52-411a-b595-259273045921 service nova] Creating event network-changed:868c8708-e342-45bf-8d39-49d94e8033db for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:39:26.686324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ee3c2aaa-2f57-4548-8de6-6c2c9f0dd9bd req-981e14ac-2e52-411a-b595-259273045921 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094355 Aug 03 04:39:26.686324 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 965/1950] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:26.783156 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4cf5bff4-1dab-46d5-8e9a-213684b90065 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "DELETE /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 204 len: 0 microversion: 2.25 time: 0.664083 Aug 03 04:39:26.783834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 986/1951] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:39:26 2022] DELETE /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:39:26.807638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:26.808763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:26.818948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.820378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:26.821404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:26.822060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.034044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:27.034797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:27.043487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.045034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.046157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.046659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.293157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.314217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.314217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.318491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d16d37e-0d84-43d8-9431-0a1955f3aeea tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.289229 Aug 03 04:39:27.335725 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 987/1952] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:27 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:39:27.343593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d644808a-c4de-40c4-a2f0-c6bdd0039edc tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd547ebd30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:27.405280 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d644808a-c4de-40c4-a2f0-c6bdd0039edc tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 0.067260 Aug 03 04:39:27.405722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 988/1953] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:27 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:27.417952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:27.418591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:27.421800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.437489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.437949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.438741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.439187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.440586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.445163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.447967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2e6ce24-e0ea-45f0-b717-9d1a87d520f1 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1563 microversion: 2.25 time: 0.645179 Aug 03 04:39:27.450377 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 966/1954] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:26 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1563 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:27.459710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:27.463382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:27.473578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.474295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.475181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.475705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.732817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:27.751200 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36de3323-e710-4e72-aa1f-df190d63f9cd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1220 microversion: 2.1 time: 0.298121 Aug 03 04:39:27.770914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 967/1955] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:27 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1220 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:27.787781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:27.795197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:27.795197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.800791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:27.803164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:27.803628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.087185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.110928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.113665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.114933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2dc8f515-0620-4ab3-ba46-a1f8054e7043 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1752 microversion: 2.42 time: 0.708281 Aug 03 04:39:28.115631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 989/1956] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:27 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1752 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:28.183059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.190569 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bfe3650a-07f6-4a6f-b316-36e628997f79 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.410603 Aug 03 04:39:28.191149 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 968/1957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:27 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:28.266042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-de12222d-9a01-4ec8-90ad-6d958b5eb8a9 req-0ae246f5-c7e5-46ce-ac00-699cbfe7d41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb574-1303-4419-8af0-786d2e30d27a", "name": "network-vif-deleted", "tag": "fac16e13-d03b-4b3d-a9e5-086317c05d62"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:28.277205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-de12222d-9a01-4ec8-90ad-6d958b5eb8a9 req-0ae246f5-c7e5-46ce-ac00-699cbfe7d41d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.277663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-de12222d-9a01-4ec8-90ad-6d958b5eb8a9 req-0ae246f5-c7e5-46ce-ac00-699cbfe7d41d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.294326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-de12222d-9a01-4ec8-90ad-6d958b5eb8a9 req-0ae246f5-c7e5-46ce-ac00-699cbfe7d41d service nova] Creating event network-vif-deleted:fac16e13-d03b-4b3d-a9e5-086317c05d62 for instance 146eb574-1303-4419-8af0-786d2e30d27a on n-h2-826756-5 Aug 03 04:39:28.299287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-de12222d-9a01-4ec8-90ad-6d958b5eb8a9 req-0ae246f5-c7e5-46ce-ac00-699cbfe7d41d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037135 Aug 03 04:39:28.303247 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 990/1958] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:28.349084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:28.349709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:28.356800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.357258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.358046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.358834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.421937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ccf15f0-4e95-43c9-9f26-8d4fdfac48e0 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59cd50d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:28.474949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.486923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.489061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.491977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ccf15f0-4e95-43c9-9f26-8d4fdfac48e0 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 0.074440 Aug 03 04:39:28.494408 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 991/1959] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:28 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:39:28.509094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:28.513668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:28.523632 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28b5443f-262f-4eb6-98c3-afb421934525 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.170010 Aug 03 04:39:28.529322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 969/1960] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:28 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:39:28.535665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.536533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.537600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.540135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.741272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.750648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.752551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cb1b66854244b8197c4b1f0ccae0b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d5eaf733df44eba92534066cb86541c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:28.754642 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54f37e52-cbe6-489a-912b-214ad392abdc tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 200 len: 1346 microversion: 2.25 time: 0.258876 Aug 03 04:39:28.756647 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 992/1961] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:28 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 1346 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:28.777584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:28.778532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:28.799051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.800563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:28.802214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:28.802483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:29.083487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:29.095969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-948a616f-7c04-46e2-b53a-cd7830345787 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1276 microversion: 2.1 time: 0.322224 Aug 03 04:39:29.109243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 970/1962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:28 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:39:29.142840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:29.144039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:29.152579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:29.153031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:29.153811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:29.154248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:29.218321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:29.219373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:29.227381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:29.231982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:29.231982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:29.231982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.142935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.162901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.170260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.179720 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4faaf459-8d81-416a-abce-ad9715aa186f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1798 microversion: 2.42 time: 1.036890 Aug 03 04:39:30.185220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 993/1963] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:29 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1798 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:30.196446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f26ba543-aa3e-40a6-94ea-35564ad67b48 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d6cc10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:30.274163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.289900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31e44b80-708b-48c8-b392-2041d9ba5393 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 1.081513 Aug 03 04:39:30.293812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 971/1964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:29 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:30.306298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:30.307020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:30.324847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.326437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.329265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.330664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.489343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.503398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.505661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:30.524487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4170ce9d-0f30-4626-ae70-419d862156ec tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.227677 Aug 03 04:39:30.526061 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 972/1965] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:30 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:30.549327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:30.551035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] [instance: 146eb574-1303-4419-8af0-786d2e30d27a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:30.574571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.575040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.575888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.576370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.623493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] HTTP exception thrown: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Request method failure captured: Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a HTTP/1.1 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fopyUSHLWT1Sl_pHcUs3TikTgX2oY2_kL4yH04lVUdTuYmm53UayLfvqEO9CSUXPjjKQlJVs7m1aNaI-BcVTg7ECA0ZHnxIkPo-xSXbUV_we7qWwKtkXOxkS9TVD5YcT2RHlIFE3TStChqaaCA--Lru_I3ovLNZiHb6CDhLutG4-Jw Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.25 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:39:30.627078 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2d5eaf733df44eba92534066cb86541c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2d5eaf733df44eba92534066cb86541c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2d5eaf733df44eba92534066cb86541c Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-967358194 Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4cb1b66854244b8197c4b1f0ccae0b0e Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-967358194-project Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. Aug 03 04:39:30.629024 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '146eb574-1303-4419-8af0-786d2e30d27a'} Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:39:30.630378 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. Aug 03 04:39:30.632056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:39:30.633637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] Returning 404 to user: Instance 146eb574-1303-4419-8af0-786d2e30d27a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:39:30.633637 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a54dd0f-1916-44bc-a3de-61855135c9d8 tempest-LiveAutoBlockMigrationV225Test-967358194 tempest-LiveAutoBlockMigrationV225Test-967358194-project] 10.222.0.72 "GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a" status: 404 len: 111 microversion: 2.25 time: 0.094920 Aug 03 04:39:30.633637 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 973/1966] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:30 2022] GET /compute/v2.1/servers/146eb574-1303-4419-8af0-786d2e30d27a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:39:30.633637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:30.634139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:30.652656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.655094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:30.656255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:30.656910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:31.306655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:31.326734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3700ba5-caba-495f-9a31-e77f593d3902 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1274 microversion: 2.1 time: 0.697351 Aug 03 04:39:31.329645 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 974/1967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:30 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1274 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:31.344993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-834aa7d0-7f09-4ac9-822f-a67b46ac4809 req-2ad75a76-d0c8-43c9-8c52-0be8c2953102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "tag": "f1682a82-a930-4b8c-9044-c0f8ef3206e3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:31.401073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-834aa7d0-7f09-4ac9-822f-a67b46ac4809 req-2ad75a76-d0c8-43c9-8c52-0be8c2953102 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:31.405020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-834aa7d0-7f09-4ac9-822f-a67b46ac4809 req-2ad75a76-d0c8-43c9-8c52-0be8c2953102 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:31.451725 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-834aa7d0-7f09-4ac9-822f-a67b46ac4809 req-2ad75a76-d0c8-43c9-8c52-0be8c2953102 service nova] Creating event network-changed:f1682a82-a930-4b8c-9044-c0f8ef3206e3 for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:39:31.458670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-834aa7d0-7f09-4ac9-822f-a67b46ac4809 req-2ad75a76-d0c8-43c9-8c52-0be8c2953102 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125976 Aug 03 04:39:31.460578 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 975/1968] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:31.473105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:31.474010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:31.492158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:31.496368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:31.497266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:31.498654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:32.279761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:32.279761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:32.279963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:32.279963 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9131173e-f45d-4b92-b6d4-d8a5468ed5a0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1798 microversion: 2.42 time: 0.808970 Aug 03 04:39:32.279963 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 976/1969] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:31 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1798 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:32.284445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:32.285072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:32.316157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:32.316819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:32.317523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:32.317958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:32.897587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:32.906133 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff3e5836-7e48-4376-8aed-5776fa02637a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.627496 Aug 03 04:39:32.909055 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 977/1970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:32 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:32.916909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:32.916909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:32.935441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:32.937413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:32.938102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:32.939071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:32.941268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:33.067975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:33.078676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:33.083581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:33.098101 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-679c969b-fe10-48f9-b06d-07aabad3bd35 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.187655 Aug 03 04:39:33.099304 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 978/1971] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:32 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:33.110458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7f4c70e3-519c-4b36-a288-9f111f7ea28b req-ce417064-5422-40e9-9008-c11d9f189d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-plugged", "status": "completed", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:33.131437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7f4c70e3-519c-4b36-a288-9f111f7ea28b req-ce417064-5422-40e9-9008-c11d9f189d59 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:33.137097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7f4c70e3-519c-4b36-a288-9f111f7ea28b req-ce417064-5422-40e9-9008-c11d9f189d59 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:33.160966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7f4c70e3-519c-4b36-a288-9f111f7ea28b req-ce417064-5422-40e9-9008-c11d9f189d59 service nova] Creating event network-vif-plugged:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:39:33.163959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7f4c70e3-519c-4b36-a288-9f111f7ea28b req-ce417064-5422-40e9-9008-c11d9f189d59 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062061 Aug 03 04:39:33.170004 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 979/1972] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:33.181512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:33.182506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:33.189817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:33.191078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:33.192393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:33.193344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:34.229103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:34.255490 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ba2c72c-4527-4a6f-b00a-332006b96fc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 1.075980 Aug 03 04:39:34.261968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 980/1973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:33 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:34.281583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:34.307041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:34.327836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:34.330068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:34.351198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:34.352044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:34.463285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b61e396-e24a-4492-822f-363f8509e0af tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198605 Aug 03 04:39:34.464284 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 981/1974] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:34 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:34.469465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:34.470356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:34.485705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:34.486508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:34.490158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:34.490922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:35.132959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:35.147322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:35.162300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:35.163755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b97676b-6467-4e16-bc1e-fae2975d1eb7 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1844 microversion: 2.42 time: 0.698220 Aug 03 04:39:35.171804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 982/1975] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:34 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1844 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:35.180826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:35.186938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:35.195686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:35.220812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:35.221779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:35.225947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:35.232877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:36.215193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:36.633139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:36.653193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:36.669489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3cc1a352-5d33-41e1-8a3f-025e5af47ece tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 1.495347 Aug 03 04:39:36.702267 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 983/1976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:35 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:36.726162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:36.727563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:36.749779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:36.750369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:36.754847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:36.755651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:37.056149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:37.074359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:37.088700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:37.117597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0505170a-0e0c-4b43-a378-a7cb5cd14b8a tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.401753 Aug 03 04:39:37.122897 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 984/1977] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:36 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:37.137062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:37.147862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:37.177211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:37.180076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:37.189101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:37.192852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:37.422701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lazy-loading 'services' on Instance uuid bdc2d56c-d691-4263-9ff5-4f405c41927c {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:39:38.124786 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-876f8d93-4443-40a6-b34d-097ec4e1a349 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments/1de4c1b4-ff7c-492c-a335-e9c4109db60c" status: 202 len: 0 microversion: 2.1 time: 1.000073 Aug 03 04:39:38.133738 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 985/1978] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:39:37 2022] DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments/1de4c1b4-ff7c-492c-a335-e9c4109db60c => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:39:38.167019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:38.167019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:38.200164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:38.201491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:38.201639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:38.217463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:39.024605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:39.054698 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52c40b64-31cd-4153-a4a1-4e47842d951e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.915243 Aug 03 04:39:39.069516 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 986/1979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:38 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:39.085040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:39.086793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:39.131202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:39.134991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:39.135850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:39.136329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:39.148777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:40.050705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:40.092429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:40.094075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:40.098388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c958e89-d5e3-4574-8942-5141a342e97d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1844 microversion: 2.42 time: 1.027251 Aug 03 04:39:40.099697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 987/1980] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:39 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1844 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:40.104746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-76b993e2-ddbf-483b-be69-f060e2f0dc39 req-26c9e331-b6ff-42ad-82ab-59356df42fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6461964-1030-4ecb-9a84-51505a6bfa23", "tag": "b2dd659f-bcd2-4d9c-8e12-e047606a00b9"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:40.130406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-76b993e2-ddbf-483b-be69-f060e2f0dc39 req-26c9e331-b6ff-42ad-82ab-59356df42fd8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:40.131237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-76b993e2-ddbf-483b-be69-f060e2f0dc39 req-26c9e331-b6ff-42ad-82ab-59356df42fd8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:40.147922 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-76b993e2-ddbf-483b-be69-f060e2f0dc39 req-26c9e331-b6ff-42ad-82ab-59356df42fd8 service nova] Creating event network-changed:b2dd659f-bcd2-4d9c-8e12-e047606a00b9 for instance d6461964-1030-4ecb-9a84-51505a6bfa23 on n-h1-826756-5 Aug 03 04:39:40.149896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:40.157163 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-76b993e2-ddbf-483b-be69-f060e2f0dc39 req-26c9e331-b6ff-42ad-82ab-59356df42fd8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055928 Aug 03 04:39:40.162729 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 988/1981] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:40.167458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:40.168753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:40.177896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:40.178634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:40.179690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:40.180410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:40.775039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:40.783615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2127c304-a643-490d-9731-af566f1d4a6e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.623851 Aug 03 04:39:40.804299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 989/1982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:40 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:40.804299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:40.804299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:40.839118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:40.839686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:40.840588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:40.843046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:41.096334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:41.111174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:41.113840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:41.131705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be5bc2bd-a67d-4c42-8f9d-3bae91bc4475 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.341118 Aug 03 04:39:41.136421 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 990/1983] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:40 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:41.142247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:41.146762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:41.160311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:41.160777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:41.161550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:41.168306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:41.590094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:41.599326 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-706d761a-05d2-422a-9d3f-3c1f977cea80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.461709 Aug 03 04:39:41.616988 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 991/1984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:41 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:41.631083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:41.633060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:41.654447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:41.654904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:41.658258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:41.658870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:43.017424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:43.061207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:43.061207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:43.065716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c18d0786-c6b5-4c45-9012-ac4f9e06d3dd tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1865 microversion: 2.42 time: 1.447156 Aug 03 04:39:43.092904 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 992/1985] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:41 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1865 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:43.113085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:43.132657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:43.132657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:43.132657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:43.147220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:43.148040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:43.832170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:43.855206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4aea5105-691c-4c13-989b-df6c3988ee0a tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.763273 Aug 03 04:39:43.856686 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 993/1986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:43 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:43.870272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:43.873036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:43.889505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:43.893189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:43.894482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:43.898519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.006287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.016580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.018975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.026121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8320bfc-dcc2-4071-9ea8-15ebde249cfa tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.167333 Aug 03 04:39:44.027537 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 994/1987] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:43 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:44.033439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "c36f89be-660c-419c-bf69-4a19d016dfc3"}, {"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "bf6f257e-172b-42d6-a2f0-8889f14b6084"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:44.053470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.057128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.083796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] Creating event network-changed:c36f89be-660c-419c-bf69-4a19d016dfc3 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:44.084827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] Creating event network-changed:bf6f257e-172b-42d6-a2f0-8889f14b6084 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:44.095439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b948d8f9-a395-4e14-a067-d943ff659f06 req-72eb2f09-00ce-4181-879f-929adf5c9f80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066277 Aug 03 04:39:44.102040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 995/1988] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:44.125867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:44.127207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:44.145517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.146286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.147307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.148057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.350321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.367217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5080aedb-da55-42e0-be60-110462aae5ef tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.263756 Aug 03 04:39:44.368986 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 996/1989] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:44 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:44.376078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6ea09914-2ace-4ffb-bc93-d2c760d683f1 req-f19121f0-10cb-416d-af96-9276b92a6884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "name": "network-vif-plugged", "status": "completed", "tag": "868c8708-e342-45bf-8d39-49d94e8033db"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:44.388004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6ea09914-2ace-4ffb-bc93-d2c760d683f1 req-f19121f0-10cb-416d-af96-9276b92a6884 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.389347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6ea09914-2ace-4ffb-bc93-d2c760d683f1 req-f19121f0-10cb-416d-af96-9276b92a6884 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.415244 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6ea09914-2ace-4ffb-bc93-d2c760d683f1 req-f19121f0-10cb-416d-af96-9276b92a6884 service nova] Creating event network-vif-plugged:868c8708-e342-45bf-8d39-49d94e8033db for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:39:44.423409 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6ea09914-2ace-4ffb-bc93-d2c760d683f1 req-f19121f0-10cb-416d-af96-9276b92a6884 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052079 Aug 03 04:39:44.423409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 997/1990] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:44.452648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:44.456996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:44.472909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.473813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.475031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:44.477630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:44.969609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.988522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.992603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:44.995834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d39b434d-ddbd-444c-a54e-8fb64c5058e2 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.563086 Aug 03 04:39:45.013952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 998/1991] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:44 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:45.020708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:45.022110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:45.030133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.030990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:45.035508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.036473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:45.280550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:45.316087 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5285c3cd-e062-47be-889e-0e6d8b7ade7b tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.286250 Aug 03 04:39:45.331893 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 999/1992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:45 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:45.331893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:45.331893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:45.337292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.338024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:45.346984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.347457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:45.518301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:45.532244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:45.534063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:45.554421 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73b7e69d-08c0-4138-ae47-a479ee8215bb tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.235705 Aug 03 04:39:45.555025 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1000/1993] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:45 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:45.616760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:45.620633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:45.652227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.666822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:45.669434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:45.671160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:46.005214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:46.013064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:46.025994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27113907-c220-4fbf-8f7d-4955233ffec8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.452888 Aug 03 04:39:46.025994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1001/1994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:45 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:46.043647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:46.049138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:46.063055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:46.063524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:46.064459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:46.065035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:46.741150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:46.757625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:46.762093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:46.766824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9abb2897-bc69-44bf-aff2-e3baffc432e0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.732284 Aug 03 04:39:46.772238 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1002/1995] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:46 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:46.798053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:46.806453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:46.824430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:46.826182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:46.828968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:46.829619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:47.334233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:47.342838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d11a0ddb-b9e0-451c-abbe-2edff71815de tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.569336 Aug 03 04:39:47.349358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1003/1996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:46 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:47.356385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f0acdc43-2e18-4d09-abf1-e170193c9d96 req-6815f429-d913-470d-8ded-3e1e921551c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "6b74cc07-e241-4c68-8440-f66e97b11599"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:47.389065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f0acdc43-2e18-4d09-abf1-e170193c9d96 req-6815f429-d913-470d-8ded-3e1e921551c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:47.389065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f0acdc43-2e18-4d09-abf1-e170193c9d96 req-6815f429-d913-470d-8ded-3e1e921551c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:47.413010 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f0acdc43-2e18-4d09-abf1-e170193c9d96 req-6815f429-d913-470d-8ded-3e1e921551c2 service nova] Creating event network-changed:6b74cc07-e241-4c68-8440-f66e97b11599 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:47.428957 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f0acdc43-2e18-4d09-abf1-e170193c9d96 req-6815f429-d913-470d-8ded-3e1e921551c2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073198 Aug 03 04:39:47.430682 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1004/1997] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:47.443821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:47.458145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:47.497758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:47.498243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:47.504541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:47.505386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:47.831875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:47.858734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:47.858734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:47.865259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed24a4f9-68d9-4dc8-814f-66dcd88e722b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.433078 Aug 03 04:39:47.872326 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1005/1998] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:47 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:47.872326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-259e855a-2812-4c30-bbf8-046ef0e5dd28 req-6af53c8d-f443-42f9-b1eb-87110457a39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "name": "network-vif-plugged", "status": "completed", "tag": "f1682a82-a930-4b8c-9044-c0f8ef3206e3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:47.919426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-259e855a-2812-4c30-bbf8-046ef0e5dd28 req-6af53c8d-f443-42f9-b1eb-87110457a39a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:47.930206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-259e855a-2812-4c30-bbf8-046ef0e5dd28 req-6af53c8d-f443-42f9-b1eb-87110457a39a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:47.992821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-259e855a-2812-4c30-bbf8-046ef0e5dd28 req-6af53c8d-f443-42f9-b1eb-87110457a39a service nova] Creating event network-vif-plugged:f1682a82-a930-4b8c-9044-c0f8ef3206e3 for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:39:48.015764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-259e855a-2812-4c30-bbf8-046ef0e5dd28 req-6af53c8d-f443-42f9-b1eb-87110457a39a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144537 Aug 03 04:39:48.021468 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1006/1999] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:48.041878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:48.045373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:48.092652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:48.095948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:48.097015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:48.098551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:48.748792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:48.763560 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fdc742b-226d-4d15-b704-68ef4dd5bee2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.740516 Aug 03 04:39:48.777974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1007/2000] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:48 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:48.787727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:48.790232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:48.807699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:48.809938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:48.816134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:48.817347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:49.410213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:49.629785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:49.629785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:49.629785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-087298b7-5058-4dfa-9574-e613ca1b02a3 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.655748 Aug 03 04:39:49.632168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1008/2001] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:48 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:49.632168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:49.632168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:49.632168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:49.632767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:49.632767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:49.632767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:49.841009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:49.849197 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ebe1f64-0851-40d7-b54b-d882da9e864e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1333 microversion: 2.1 time: 0.409637 Aug 03 04:39:49.856641 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1009/2002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:49 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1333 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:49.869346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:49.870117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:49.882181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:49.882181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:49.882181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:49.882181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:49.995550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:50.013353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:50.015913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:50.034861 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-daf803cc-cbed-46f2-ba23-ab4f61cbb127 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.181843 Aug 03 04:39:50.035714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1010/2003] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:49 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:50.050667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dc4ee35a-03c0-4dd2-b77c-18d6cb50d049 req-fdc602be-b94a-4906-97c4-e431210de70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "a4a7926b-4815-4e3e-aac5-029768cff70d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:50.071687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f26ba543-aa3e-40a6-94ea-35564ad67b48 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 19.885237 Aug 03 04:39:50.079734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc4ee35a-03c0-4dd2-b77c-18d6cb50d049 req-fdc602be-b94a-4906-97c4-e431210de70a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.082419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc4ee35a-03c0-4dd2-b77c-18d6cb50d049 req-fdc602be-b94a-4906-97c4-e431210de70a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.088749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 994/2004] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:30 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 19903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:50.106288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:50.109625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:50.118004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dc4ee35a-03c0-4dd2-b77c-18d6cb50d049 req-fdc602be-b94a-4906-97c4-e431210de70a service nova] Creating event network-changed:a4a7926b-4815-4e3e-aac5-029768cff70d for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:50.123961 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dc4ee35a-03c0-4dd2-b77c-18d6cb50d049 req-fdc602be-b94a-4906-97c4-e431210de70a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087262 Aug 03 04:39:50.124889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1011/2005] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:50.137304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5eb6cb7b-db11-4cbb-9d90-22bf71d4184d req-545d750a-59df-4060-af3d-556f7e7fb4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6461964-1030-4ecb-9a84-51505a6bfa23", "name": "network-vif-plugged", "status": "completed", "tag": "b2dd659f-bcd2-4d9c-8e12-e047606a00b9"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:50.141456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.141456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.152598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.153193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.169755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5eb6cb7b-db11-4cbb-9d90-22bf71d4184d req-545d750a-59df-4060-af3d-556f7e7fb4da service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.170513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5eb6cb7b-db11-4cbb-9d90-22bf71d4184d req-545d750a-59df-4060-af3d-556f7e7fb4da service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.190358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5eb6cb7b-db11-4cbb-9d90-22bf71d4184d req-545d750a-59df-4060-af3d-556f7e7fb4da service nova] Creating event network-vif-plugged:b2dd659f-bcd2-4d9c-8e12-e047606a00b9 for instance d6461964-1030-4ecb-9a84-51505a6bfa23 on n-h1-826756-5 Aug 03 04:39:50.209090 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5eb6cb7b-db11-4cbb-9d90-22bf71d4184d req-545d750a-59df-4060-af3d-556f7e7fb4da service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081191 Aug 03 04:39:50.213337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1012/2006] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:50.650314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:50.651028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:50.666849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.666849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.666849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.666849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.836056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:50.851153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4506017a-23dc-4ba0-bcc7-453f4cfd2e1d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 0.761107 Aug 03 04:39:50.859976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 995/2007] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:50 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:50.888948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:50.890280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:50.919479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.922073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:50.923173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:50.926012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.052514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.077838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.088738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.088738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2970a92-b0a3-4cdf-bce6-16e95deb92ae tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.441652 Aug 03 04:39:51.113220 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1013/2008] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:50 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:39:51.120733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:51.135259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:51.145568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.146026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.147476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.148113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.366170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.381501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.384209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.411638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d20b176-a0bc-4964-941b-a7d47e66d4b7 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1447 microversion: 2.75 time: 0.297111 Aug 03 04:39:51.415026 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1014/2009] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:51 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1447 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:51.437616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12e15f45-672b-419e-ab57-6ffe715f91fb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d22550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:51.461809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:51.470994 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c8cb96f-7d4d-4f57-aa04-620b72f88843 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1668 microversion: 2.1 time: 0.597748 Aug 03 04:39:51.484792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 996/2010] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:50 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1668 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:51.494139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:51.494569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:51.502834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.502834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.502834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.508529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.526382 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12e15f45-672b-419e-ab57-6ffe715f91fb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 0.110026 Aug 03 04:39:51.527291 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1015/2011] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:51 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:51.557065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec90f419-0227-4f02-8d95-4fb4445558ce tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e/ips" status: 200 len: 179 microversion: 2.1 time: 0.067006 Aug 03 04:39:51.557677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 997/2012] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:39:51 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e/ips => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:51.569287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:51.570007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:51.593860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.598711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.600044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.601075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.648939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:39:51.892004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:51.896808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:51.915148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.915641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:51.919096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:51.921853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.130602 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac18387d-d47a-42cb-8015-f23596d4a426 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "DELETE /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 204 len: 0 microversion: 2.1 time: 0.564864 Aug 03 04:39:52.132769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1016/2013] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:39:51 2022] DELETE /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:39:52.145186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:52.153161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:52.168036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.169386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.173999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.173999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.244053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e28e8c3-13e9-4ea8-9d75-00957ac7081a tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109196 Aug 03 04:39:52.250108 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1017/2014] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:52 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:39:52.275013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:52.275779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:52.282616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:52.297288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.297837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.301766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.302260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.883001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:52.890800 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-333beb50-947a-4832-8aa1-4ae9b580d356 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1316 microversion: 2.1 time: 1.008311 Aug 03 04:39:52.905145 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 998/2015] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:51 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1316 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:52.911178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:52.915854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:52.919171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.919839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:52.920850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:52.921468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.061406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.080795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.082965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.086421 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5bee6e9a-0c3e-436e-a05e-5fea80be7435 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.825820 Aug 03 04:39:53.098223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1018/2016] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:52 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:53.120913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:53.130251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:53.140002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.141247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.142311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.143184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.211361 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5573d77-c1ee-422a-8f0f-f526e3eadf11 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111556 Aug 03 04:39:53.213501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1019/2017] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:39:53 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:39:53.222730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:53.228981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:53.241072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.243034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.245103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.249643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.307207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:39:53.408241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.417387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.421878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.435285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f915287-381f-4bb6-818f-8b32c753149d tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1453 microversion: 2.75 time: 0.216312 Aug 03 04:39:53.439956 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1020/2018] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:53 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:53.452241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0cafb121-99c1-44ef-b22b-ab70c5a35af3 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59cefee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:53.495435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:53.515239 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66cf3b89-b031-431e-8747-55d6153d5612 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1674 microversion: 2.1 time: 0.606378 Aug 03 04:39:53.518486 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 999/2019] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:52 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1674 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:53.526679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d8d2f9f2-6fc7-4e45-8e24-7babaf3e0cf7 req-d99693d5-8a9e-44e9-a782-e58f6b5d1252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "42ba03bc-4060-4d5a-99ff-f682a6a88a07"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:53.545872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0cafb121-99c1-44ef-b22b-ab70c5a35af3 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1423 microversion: 2.1 time: 0.104267 Aug 03 04:39:53.549557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1021/2020] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:53 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:53.552504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8d2f9f2-6fc7-4e45-8e24-7babaf3e0cf7 req-d99693d5-8a9e-44e9-a782-e58f6b5d1252 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.553164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8d2f9f2-6fc7-4e45-8e24-7babaf3e0cf7 req-d99693d5-8a9e-44e9-a782-e58f6b5d1252 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.558707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:53.562438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:53.580205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d8d2f9f2-6fc7-4e45-8e24-7babaf3e0cf7 req-d99693d5-8a9e-44e9-a782-e58f6b5d1252 service nova] Creating event network-changed:42ba03bc-4060-4d5a-99ff-f682a6a88a07 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:53.583120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.583669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.586181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.589142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.595619 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d8d2f9f2-6fc7-4e45-8e24-7babaf3e0cf7 req-d99693d5-8a9e-44e9-a782-e58f6b5d1252 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075492 Aug 03 04:39:53.596894 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1000/2021] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:53.644236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:39:53.917882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:53.922305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:53.938766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.955592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:53.960072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:53.964971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.115726 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57c80d94-4ac5-46f3-86cc-b4fffef081b3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 204 len: 0 microversion: 2.1 time: 0.564551 Aug 03 04:39:54.116353 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1022/2022] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:39:53 2022] DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:39:54.125978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:54.126831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:54.141358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.143028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.143904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.144376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.811144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:54.838898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-343e1d32-1f5b-4ce8-9cf8-61c154178f4d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1504 microversion: 2.1 time: 0.925604 Aug 03 04:39:54.844034 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1001/2023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:53 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1504 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:39:54.851723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:54.852887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:54.863579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.864683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.865745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.866424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.917716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:54.928171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:54.930005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:54.931030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35df115b-7386-42f2-9318-9f0dcb2a8495 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.810096 Aug 03 04:39:54.933756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1023/2024] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:54 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:54.936949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:54.937579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:54.948617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.949070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:54.949847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:54.950284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.186013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:55.226904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:55.226904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:55.242119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3df18e49-96d6-4d5b-af64-ad9622057d7e tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1453 microversion: 2.75 time: 0.308785 Aug 03 04:39:55.242739 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1024/2025] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:54 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1453 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:55.264862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:55.265801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:55.273276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.274027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.274993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.275623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.298993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:55.306913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82b320a1-d5dc-4d07-97de-8f4ef051bc09 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1679 microversion: 2.1 time: 0.459672 Aug 03 04:39:55.307506 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1002/2026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:54 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:55.348743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-688f761f-43b4-4aba-9cf3-36d7d4b57aac tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c944c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:55.417886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-688f761f-43b4-4aba-9cf3-36d7d4b57aac tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1432 microversion: 2.1 time: 0.080758 Aug 03 04:39:55.418513 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1003/2027] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:55 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1432 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:55.431989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-730292084"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:55.432563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:55.444571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.445457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.447107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.447768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.559809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:55.571198 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff4765e2-193e-40c7-bd1f-cd371084d378 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1674 microversion: 2.1 time: 0.317685 Aug 03 04:39:55.587783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1025/2028] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:55 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1674 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:55.594052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb5d1c03-e062-4361-88bd-f98e1f1f5085 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59dc5b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:55.676892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb5d1c03-e062-4361-88bd-f98e1f1f5085 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 200 len: 1432 microversion: 2.1 time: 0.087438 Aug 03 04:39:55.689527 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Adding security group 7fa09c0d-143d-4990-a091-349b3bf4e423 to port b2dd659f-bcd2-4d9c-8e12-e047606a00b9 Aug 03 04:39:55.695571 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1026/2029] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:55 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 1432 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:55.700852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3d286a8a-635f-41f2-8c50-756b872c7c25 req-c2564326-a40c-4a08-9f17-d95ca283a1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "10a26f5b-9fa0-437a-a4c4-238615286fc1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:55.712451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3d286a8a-635f-41f2-8c50-756b872c7c25 req-c2564326-a40c-4a08-9f17-d95ca283a1fd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.713406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3d286a8a-635f-41f2-8c50-756b872c7c25 req-c2564326-a40c-4a08-9f17-d95ca283a1fd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.746705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3d286a8a-635f-41f2-8c50-756b872c7c25 req-c2564326-a40c-4a08-9f17-d95ca283a1fd service nova] Creating event network-changed:10a26f5b-9fa0-437a-a4c4-238615286fc1 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:55.758006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3d286a8a-635f-41f2-8c50-756b872c7c25 req-c2564326-a40c-4a08-9f17-d95ca283a1fd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060855 Aug 03 04:39:55.762832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1027/2030] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:55.774082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:55.776525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:55.788529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.789187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:55.796071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:55.796725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:56.821713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:56.837900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f14b3ede-f94c-4aed-9ea8-75a4a58a560a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1466 microversion: 2.1 time: 1.072553 Aug 03 04:39:56.841460 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1028/2031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:55 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1466 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:56.867630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:56.868538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:56.879867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:56.880637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:56.881609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:56.882508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:57.457714 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0996e61d-6118-4165-98eb-8a8f56d461e1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/action" status: 202 len: 0 microversion: 2.1 time: 2.037907 Aug 03 04:39:57.463324 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1004/2032] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:39:55 2022] POST /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/action => generated 0 bytes in 2044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:39:57.468672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:57.471612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:57.493995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:57.494964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:57.496006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:57.496683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:57.757527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:57.770850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:57.772435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:57.804138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc38682c-0ab2-4beb-8f8e-155c1535240b tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1438 microversion: 2.75 time: 0.336626 Aug 03 04:39:57.804138 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1005/2033] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:57 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1438 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:57.810002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:57.810938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:57.820730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:57.821310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:57.822301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:57.822988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.025565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:58.039696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:58.043194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:58.045766 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae5cd350-637e-4f87-9953-aa36bd797ef9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 1.182503 Aug 03 04:39:58.046926 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1029/2034] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:56 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:39:58.137095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:58.151023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb71fd7b-af87-46fe-ac9b-223d54180879 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1679 microversion: 2.1 time: 0.345293 Aug 03 04:39:58.152670 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1006/2035] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:57 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1679 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:58.163492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:58.165443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:58.188612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.190151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.191404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.192044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.279293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f6e7fb1-58b0-4853-8bfe-5f37bcc62f7d tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] Calling method '.version_select at 0x7fdd59c87820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:58.280176 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:39:58.280176 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:39:58.285871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07c40946ced64a83ac98d6205e212ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e9f6d5dd60435f8bf8cfd56d500e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:39:58.293710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cd5489a5-33c4-43d4-bd31-42e8f3622d78 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 200 len: 1611 microversion: 2.1 time: 0.138346 Aug 03 04:39:58.301309 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f6e7fb1-58b0-4853-8bfe-5f37bcc62f7d tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.249589 Aug 03 04:39:58.302226 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1030/2036] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:39:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:58.308934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1007/2037] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:39:58 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 1611 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:39:58.309504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13cca37c-4e38-403b-9bd3-4aade81c6c20 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d25c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:58.323262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-76277670"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:58.323809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:58.331224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.337072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.337072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.337072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.385884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13cca37c-4e38-403b-9bd3-4aade81c6c20 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464" status: 200 len: 784 microversion: 2.1 time: 0.082544 Aug 03 04:39:58.386742 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1031/2038] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:39:58 2022] GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:58.490893 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Adding security group bdd3a856-9750-4344-89ca-59a283a28042 to port b2dd659f-bcd2-4d9c-8e12-e047606a00b9 Aug 03 04:39:58.568388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:58.573681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:58.582202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.583232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.584316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:58.585029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:58.764386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:39:58.766505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:39:58.766505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:39:58.766505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:39:58.766505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:39:59.185572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:59.193656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.194429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.195434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.195930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.408456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:39:59.428977 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-570aa02b-db5d-4a93-a6e6-46b1fe011eb2 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2/action" status: 202 len: 1942 microversion: 2.75 time: 1.040958 Aug 03 04:39:59.430507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1032/2039] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:39:58 2022] POST /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2/action => generated 1942 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 04:39:59.455713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "name": "network-vif-deleted", "tag": "868c8708-e342-45bf-8d39-49d94e8033db"}, {"name": "network-changed", "server_uuid": "d6461964-1030-4ecb-9a84-51505a6bfa23", "tag": "b2dd659f-bcd2-4d9c-8e12-e047606a00b9"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:59.466813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.467271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.493792 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c063a09c-9a3f-4766-a67f-0dc328c4faaf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/action" status: 202 len: 0 microversion: 2.1 time: 1.183468 Aug 03 04:39:59.494429 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1008/2040] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:39:58 2022] POST /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/action => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:39:59.499257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8152589a-f832-43f5-81bb-b9790abeca36 tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] Action: 'update', calling method: .version_select at 0x7fdd54712dc0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:59.503742 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:39:59.503742 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:39:59.510422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] Creating event network-vif-deleted:868c8708-e342-45bf-8d39-49d94e8033db for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:39:59.511093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] Creating event network-changed:b2dd659f-bcd2-4d9c-8e12-e047606a00b9 for instance d6461964-1030-4ecb-9a84-51505a6bfa23 on n-h1-826756-5 Aug 03 04:39:59.530253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9f2f6e85-55e2-4600-9e64-657a0d8bd83c req-f1152f35-9590-486b-8e99-e8b77e14790d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080426 Aug 03 04:39:59.531280 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1033/2041] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:59.564932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd12f482-15ce-49cb-94ab-58dc8e626dfb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:59.576093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd12f482-15ce-49cb-94ab-58dc8e626dfb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039018 Aug 03 04:39:59.577777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1034/2042] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:39:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:59.583741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b1a24aed-dbcc-42f5-b664-9d97fe10f2f3 req-b17a825e-db99-4ed2-8c8c-b18ec39edfe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "9684d68a-347d-42e1-9399-678e11531af5"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:59.598042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b1a24aed-dbcc-42f5-b664-9d97fe10f2f3 req-b17a825e-db99-4ed2-8c8c-b18ec39edfe9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.598962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b1a24aed-dbcc-42f5-b664-9d97fe10f2f3 req-b17a825e-db99-4ed2-8c8c-b18ec39edfe9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.616023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b1a24aed-dbcc-42f5-b664-9d97fe10f2f3 req-b17a825e-db99-4ed2-8c8c-b18ec39edfe9 service nova] Creating event network-changed:9684d68a-347d-42e1-9399-678e11531af5 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:39:59.624175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b1a24aed-dbcc-42f5-b664-9d97fe10f2f3 req-b17a825e-db99-4ed2-8c8c-b18ec39edfe9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044633 Aug 03 04:39:59.625772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1035/2043] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:59.650953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5ab72f2a-2973-487f-b8b1-915d96a94833 req-9b6402ee-f01c-4cfd-860b-f38c03c137c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-unplugged", "status": "completed", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:39:59.676841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5ab72f2a-2973-487f-b8b1-915d96a94833 req-9b6402ee-f01c-4cfd-860b-f38c03c137c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.677469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5ab72f2a-2973-487f-b8b1-915d96a94833 req-9b6402ee-f01c-4cfd-860b-f38c03c137c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.692045 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5ab72f2a-2973-487f-b8b1-915d96a94833 req-9b6402ee-f01c-4cfd-860b-f38c03c137c3 service nova] Creating event network-vif-unplugged:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:39:59.700576 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5ab72f2a-2973-487f-b8b1-915d96a94833 req-9b6402ee-f01c-4cfd-860b-f38c03c137c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071900 Aug 03 04:39:59.701573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1036/2044] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:39:59.710599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:39:59.711701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:39:59.723002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.726729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:39:59.726729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:39:59.726729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.288114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:00.299274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:00.306663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:00.306663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13dda36e-294f-46c6-a3d6-76612ff4fe4b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1886 microversion: 2.42 time: 0.598740 Aug 03 04:40:00.306663 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1037/2045] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:39:59 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1886 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:00.307020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:00.307838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:00.323408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.323910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.325180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.325629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.361713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.362516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.363023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lazy-loading 'fault' on Instance uuid bdc2d56c-d691-4263-9ff5-4f405c41927c {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:00.414852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41509911d7f040cfb248d99c95c43942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c11f186b92f4526a9ced1e0fde53f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:00.424961 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e7f293cc-10d1-4496-9dae-d8761f70e246 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 200 len: 1331 microversion: 2.1 time: 0.121714 Aug 03 04:40:00.425969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1038/2046] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:00 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:00.434348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:00.435352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:00.442771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.443310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.444161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.444707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.461643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e HTTP/1.1 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:00.471722 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:00.473792 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dc5d8d17-4c22-4a62-ba72-50d3fd0f547e'} Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:00.474830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:00.476651 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:00.478104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:00.478104 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d57b471-bd8c-402b-84ec-6f2fafc577e9 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 404 len: 111 microversion: 2.1 time: 0.038434 Aug 03 04:40:00.478104 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1039/2047] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:00 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:00.480713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:00.481531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:00.489609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.490911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.492743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.494370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.605848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:00.614197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:00.638716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f0352da-e026-4a0c-a23e-f665e065f424 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.167977 Aug 03 04:40:00.662269 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1040/2048] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:00 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:00.665960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:00.668770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:00.680402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.681252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.687569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:00.688236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:00.891668 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52813783-8054-4bc5-9dbe-1f54160def54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.237563 Aug 03 04:40:00.892331 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1041/2049] 10.222.0.72 () {58 vars in 1293 bytes} [Wed Aug 3 04:40:00 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23/os-security-groups => generated 1154 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:00.897145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8042ba69-26c5-4e68-b9d3-ed58a0b4e8f3 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c87a60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:01.456501 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8152589a-f832-43f5-81bb-b9790abeca36 tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.958908 Aug 03 04:40:01.465824 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1009/2050] 10.222.0.72 () {60 vars in 1206 bytes} [Wed Aug 3 04:39:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:01.471457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f096b6b-9b86-406a-85e5-aa1ab9627bb5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59d28550>, body: {"security_group": {"name": " tempest-securitygroup -748048245 ", "description": "tempest-description-1414423966"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:02.238413 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f096b6b-9b86-406a-85e5-aa1ab9627bb5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.771036 Aug 03 04:40:02.239035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1010/2051] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:01 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:02.243927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:02.244611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:02.252524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.252968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.253745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.254177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.607887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:02.618340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:02.620345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:02.638170 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e41e16f-af4e-413d-8757-21e6da097d28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.398005 Aug 03 04:40:02.638766 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1011/2052] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:02 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:02.644643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:02.648010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:02.661371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.661842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.662658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.663099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.711231 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] HTTP exception thrown: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Request method failure captured: Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c HTTP/1.1 Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ftNDUYQ3s1qxo3f2fUsGeA77WrH2I2f7eO-npaISqcxhxr-ATVwHzmytvSzPQvplk_KIMTk4zyzayObvOvFH3grxGr3-uxMGjLBBIaRPjBRYxSScH_XX7Y2Xwb6da8UVCkjXVnCUhxaYBq_2XOR9YlRQ2Lgd-Qb1_-WvpnMqN5xUqc Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:02.713544 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 41509911d7f040cfb248d99c95c43942 Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:02.715433 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'bdc2d56c-d691-4263-9ff5-4f405c41927c'} Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:02.716671 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:02.718346 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:02.721036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Returning 404 to user: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:02.722226 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2fd94ba-7b14-43ff-8470-b3a389cca545 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 404 len: 111 microversion: 2.1 time: 0.082336 Aug 03 04:40:02.723404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1012/2053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:02 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:02.728549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f64693a-d7f8-4611-807f-ea07a6f77a0a tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] Calling method '.version_select at 0x7fdd59c94430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:02.729615 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:40:02.729615 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:40:02.742466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f64693a-d7f8-4611-807f-ea07a6f77a0a tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017655 Aug 03 04:40:02.743730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1013/2054] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 04:40:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:02.748816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5d8d17-4c22-4a62-ba72-50d3fd0f547e", "name": "network-vif-deleted", "tag": "f1682a82-a930-4b8c-9044-c0f8ef3206e3"}, {"name": "network-changed", "server_uuid": "d6461964-1030-4ecb-9a84-51505a6bfa23", "tag": "b2dd659f-bcd2-4d9c-8e12-e047606a00b9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:02.765493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.765937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.780539 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] Creating event network-vif-deleted:f1682a82-a930-4b8c-9044-c0f8ef3206e3 for instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e on n-h1-826756-5 Aug 03 04:40:02.781095 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] Creating event network-changed:b2dd659f-bcd2-4d9c-8e12-e047606a00b9 for instance d6461964-1030-4ecb-9a84-51505a6bfa23 on n-h1-826756-5 Aug 03 04:40:02.788560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-981c4dd5-b304-4995-8558-c2ad4152de77 req-83d30203-d85e-46ad-92e0-0b529df20520 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043205 Aug 03 04:40:02.789860 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1014/2055] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:02.797550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d54d2a5e-923d-43d7-abcf-90d5540a943a req-f6784354-4813-47e3-9f55-8797e83833fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc2d56c-d691-4263-9ff5-4f405c41927c", "name": "network-vif-deleted", "tag": "c3f39f32-a60b-42ab-ac9f-ab3897b01cf7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:02.810155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d54d2a5e-923d-43d7-abcf-90d5540a943a req-f6784354-4813-47e3-9f55-8797e83833fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.810899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d54d2a5e-923d-43d7-abcf-90d5540a943a req-f6784354-4813-47e3-9f55-8797e83833fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.837823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d54d2a5e-923d-43d7-abcf-90d5540a943a req-f6784354-4813-47e3-9f55-8797e83833fe service nova] Creating event network-vif-deleted:c3f39f32-a60b-42ab-ac9f-ab3897b01cf7 for instance bdc2d56c-d691-4263-9ff5-4f405c41927c on n-h2-826756-5 Aug 03 04:40:02.844060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d54d2a5e-923d-43d7-abcf-90d5540a943a req-f6784354-4813-47e3-9f55-8797e83833fe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052438 Aug 03 04:40:02.844809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1015/2056] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:02.851325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:02.852056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:02.859296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.859747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:02.861165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:02.861870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:03.040227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:03.061485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1282a73d-3654-46ca-ae4d-beac87e2fc98 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.215149 Aug 03 04:40:03.079849 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1016/2057] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:02 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:03.093670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f55777a0-05bc-4ea3-9f11-95be182532d1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd54791310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:03.140835 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8042ba69-26c5-4e68-b9d3-ed58a0b4e8f3 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "DELETE /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 204 len: 0 microversion: 2.1 time: 2.247200 Aug 03 04:40:03.144629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1042/2058] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:00 2022] DELETE /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 0 bytes in 2252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:40:03.150053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-62179ef1-7546-4cef-86dc-8d6c334f9be3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '.version_select at 0x7fdd59e86940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:03.208225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f55777a0-05bc-4ea3-9f11-95be182532d1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1" status: 200 len: 223 microversion: 2.1 time: 0.120478 Aug 03 04:40:03.208849 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1017/2059] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:40:03 2022] GET /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 => generated 223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:03.214566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edc6d9a4-2c16-4914-a67c-bbf3e4767b6f tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] Action: 'update', calling method: .version_select at 0x7fdd59d36f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:03.224902 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:40:03.224902 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:40:03.298351 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-62179ef1-7546-4cef-86dc-8d6c334f9be3 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830289507" status: 202 len: 0 microversion: 2.1 time: 0.151641 Aug 03 04:40:03.299888 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1043/2060] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830289507 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:03.325456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49a62f53-14e0-49e6-8374-1af7f9e99548 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59cefee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:03.357784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-49a62f53-14e0-49e6-8374-1af7f9e99548 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] HTTP exception thrown: Image not found. Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49a62f53-14e0-49e6-8374-1af7f9e99548 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Request method failure captured: Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b HTTP/1.1 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fviUX_i_8akS5qag2jlKr1erz01np2s3Uo1xffRUN1CR81h6AmikmLfBt6nhKwS98baorPu9KHVXqT4otHTbYHLiyHWUTmwKOX-z-ipKJkpVVBFOOHBkOIqssW_xiWxtxKSbGl0j9ER9-vjZakssMX3qNHODQz-C10fJlREv0mvlG0 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:03.361000 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c081e7792c674e9fabc7bcff0f21c1a7 Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '746ec698-6d88-4ef2-8bd5-f45fdcca5a0b'} Aug 03 04:40:03.362807 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:40:03.364035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 746ec698-6d88-4ef2-8bd5-f45fdcca5a0b Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:40:03.365642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 746ec698-6d88-4ef2-8bd5-f45fdcca5a0b could not be found. Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:03.368447 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49a62f53-14e0-49e6-8374-1af7f9e99548 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:03.370121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49a62f53-14e0-49e6-8374-1af7f9e99548 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 404 len: 62 microversion: 2.1 time: 0.062240 Aug 03 04:40:03.371654 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1044/2061] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:03 2022] GET /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:40:03.373870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-971a4d4b-e289-47fc-afb8-d5580419bf20 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59dfcf70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:03.863856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-971a4d4b-e289-47fc-afb8-d5580419bf20 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1" status: 202 len: 0 microversion: 2.1 time: 0.497467 Aug 03 04:40:03.868375 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1045/2062] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:40:03 2022] DELETE /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:03.875000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-629819400"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:03.878981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:03.886165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:03.886736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:03.887594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:03.888249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:04.230915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=17,nova_api:INSERT=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:04.732206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46796d6e-5ee9-4a8a-9a6f-c8969b166c23 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "POST /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3/action" status: 202 len: 0 microversion: 2.1 time: 0.862174 Aug 03 04:40:04.741982 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1046/2063] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:40:03 2022] POST /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:40:04.748129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:04.752490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:04.757342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:04.757795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:04.758647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:04.759094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:04.985210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:04.995373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:04.996931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:04.998404 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4ac7520-1b86-43ae-aaa3-480fae35c494 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.255107 Aug 03 04:40:04.998955 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1047/2064] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:04 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:05.004168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59e739d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.026918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:40:05.027529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:40:05.028064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.028064 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 HTTP/1.1 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:05.030101 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.031805 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1'} Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:05.033967 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:40:05.035357 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.036716 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-7ac625f3-c62f-4af1-b34e-57ebc7f7c5b8'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a768841e-e42b-449d-943f-220b35da11ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1" status: 404 len: 194 microversion: 2.1 time: 0.031456 Aug 03 04:40:05.038286 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1048/2065] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:40:04 2022] GET /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:05.039229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.039229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:05.045942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.046398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.047204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.047673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.118229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:05.135429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-debeae3f-dd63-4c96-a753-3618bf4ca7ad tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.101145 Aug 03 04:40:05.136002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1049/2066] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:05 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:05.141052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.141052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:05.147811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.148263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.149732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.149854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.167016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e HTTP/1.1 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:05.168627 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.170450 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dc5d8d17-4c22-4a62-ba72-50d3fd0f547e'} Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:05.171736 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.173738 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.175842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:05.175842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12583386-04a1-455b-8b12-8e8219ca61ae tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "DELETE /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 404 len: 111 microversion: 2.1 time: 0.033052 Aug 03 04:40:05.175842 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1050/2067] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:40:05 2022] DELETE /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:05.175842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f822047b-be95-44ac-8a71-cb5245c14bdd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d22280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.234966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f822047b-be95-44ac-8a71-cb5245c14bdd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.063392 Aug 03 04:40:05.243512 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1051/2068] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:05 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:05.247727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20f1eedf-aaba-4c41-a108-826d86e511a2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59e6eb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-71270742", "description": "tempest-description-254120875"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:05.609538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edc6d9a4-2c16-4914-a67c-bbf3e4767b6f tempest-QuotaClassesAdminTestJSON-1945742777 tempest-QuotaClassesAdminTestJSON-1945742777-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 2.399600 Aug 03 04:40:05.619681 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1018/2069] 10.222.0.72 () {60 vars in 1206 bytes} [Wed Aug 3 04:40:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:05.643054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.643054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: dc5d8d17-4c22-4a62-ba72-50d3fd0f547e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:05.651317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.653072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.654366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.655158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.695738 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e HTTP/1.1 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:05.701532 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.709370 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'dc5d8d17-4c22-4a62-ba72-50d3fd0f547e'} Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:05.710768 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. Aug 03 04:40:05.713454 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.715147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance dc5d8d17-4c22-4a62-ba72-50d3fd0f547e could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:05.715147 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0af84a4-c7aa-46d3-8483-b42db8b53430 tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e" status: 404 len: 111 microversion: 2.1 time: 0.085352 Aug 03 04:40:05.715147 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1019/2070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:05 2022] GET /compute/v2.1/servers/dc5d8d17-4c22-4a62-ba72-50d3fd0f547e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:05.721368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.721867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:05.740376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.740735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.741606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.742058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.758227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 HTTP/1.1 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:05.760810 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.762481 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '31b793e3-9393-4972-9843-b83aed64bb97'} Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:05.763897 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.765612 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.770033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:05.772228 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e551389a-e018-4a16-828d-a18143222f9e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "DELETE /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 404 len: 111 microversion: 2.1 time: 0.058522 Aug 03 04:40:05.775782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1020/2071] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:40:05 2022] DELETE /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:40:05.780682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20f1eedf-aaba-4c41-a108-826d86e511a2 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.542858 Aug 03 04:40:05.782772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1052/2072] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:05 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:05.789427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:05.790358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] [instance: 31b793e3-9393-4972-9843-b83aed64bb97] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:05.795690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf41f98a-0c63-4ded-a4d9-5e83cca111ea tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59e570d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2076991786", "description": "tempest-description-780890039"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:05.796940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.797722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.799070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:05.799773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:05.841790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] HTTP exception thrown: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Request method failure captured: Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 HTTP/1.1 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fur_G-vGfsnnwusvrfZtzD3TVlIbt7u9JUFm6WCu8AGOnqzY2eyDvde5v5tj0mEMK795lqhhCTeCfuvNf1Kutn01Bw6IaToFdKb_dpnOtMBBK-XDStoddUKrhXT5tzLHj4ctlOhjWS4_JWGpdz9sDNJZP68kQgNtTJ4k3TH4kIFtA4 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:05.845292 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27e9f6d5dd60435f8bf8cfd56d500e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27e9f6d5dd60435f8bf8cfd56d500e7a Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestMultiNic-1194462787 Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07c40946ced64a83ac98d6205e212ed4 Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestMultiNic-1194462787-project Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.847112 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '31b793e3-9393-4972-9843-b83aed64bb97'} Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:05.848180 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. Aug 03 04:40:05.850634 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:05.852717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] Returning 404 to user: Instance 31b793e3-9393-4972-9843-b83aed64bb97 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:05.853134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a52eb031-93d7-4179-a003-b53d69151f8e tempest-ServersTestMultiNic-1194462787 tempest-ServersTestMultiNic-1194462787-project] 10.222.0.72 "GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97" status: 404 len: 111 microversion: 2.1 time: 0.068470 Aug 03 04:40:05.853795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1021/2073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:05 2022] GET /compute/v2.1/servers/31b793e3-9393-4972-9843-b83aed64bb97 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:06.022817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:06.024971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:06.036851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:06.038051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:06.039422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:06.040336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:06.379658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:06.379658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:06.387503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:06.389321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:06.390723 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ae9bb76-f850-48cd-92bb-07d5ff2b58cf tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.372269 Aug 03 04:40:06.399663 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1022/2074] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:06 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:06.399663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:06.399663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:06.415428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:06.416298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:06.417315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:06.417984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:06.456041 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf41f98a-0c63-4ded-a4d9-5e83cca111ea tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.659948 Aug 03 04:40:06.456041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1053/2075] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:06.457851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4992036-ece2-439c-ae22-f7e4e763aba5 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d25d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:06.508520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:06.527512 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4992036-ece2-439c-ae22-f7e4e763aba5 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.074060 Aug 03 04:40:06.533685 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1054/2076] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:06 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:06.540741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af6a274a-2db8-4dfd-af60-0f6b9aff5d62 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59e58b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-683051473", "description": "tempest-description-939814440"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:06.558375 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6565a401-1424-4ba1-8b25-afc99039316e tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.164735 Aug 03 04:40:06.558856 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1023/2077] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:06 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:07.421645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2093923666", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d3daf729-08e1-47de-b3ca-43c48307355d"}], "block_device_mapping_v2": [{"uuid": "42b76ede-791c-4d1b-8caf-6e0e950ca716", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:07.462715 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af6a274a-2db8-4dfd-af60-0f6b9aff5d62 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.932277 Aug 03 04:40:07.464165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1055/2078] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:07.469593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:07.470744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:07.485085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:07.489398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:07.491944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:07.493191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:07.498015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] validate_networks() for [('d3daf729-08e1-47de-b3ca-43c48307355d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:40:07.850934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:07.862427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:07.864879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:07.866049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a31d0a4-ddb7-4b49-aec0-efc77ed0ae82 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.400865 Aug 03 04:40:07.869161 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1056/2079] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:07 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:07.871461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-557bedbf-dfc3-4dcf-b93d-56128cc4a066 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59e735e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:08.299930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:08.409007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:40:08.409631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:40:08.410120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:40:08.410535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:40:08.410951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:40:08.421415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:08.422077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:08.423644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:08.424438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:08.447740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:08.455230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Getting quotas for user ef84ed9611c449ec8ee31cf936faeb75 and project a22d07c060aa4335b68d9362ad62d31c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:08.513653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-557bedbf-dfc3-4dcf-b93d-56128cc4a066 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups" status: 200 len: 1826 microversion: 2.1 time: 0.645847 Aug 03 04:40:08.514233 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1057/2080] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:40:07 2022] GET /compute/v2.1/os-security-groups => generated 1826 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:08.533393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8d34707-7124-4472-aa46-5b6c430a4a9a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c870d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:08.554308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:40:08.557119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42b76ede-791c-4d1b-8caf-6e0e950ca716',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:08.625927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8d34707-7124-4472-aa46-5b6c430a4a9a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.110218 Aug 03 04:40:08.640323 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1058/2081] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:08 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:08.645663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:08.646283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:08.665618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:08.666330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:08.667307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:08.667910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:08.820730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:08.843377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3dc7a890-daca-48cf-bd69-774c9c27d8fb tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.201799 Aug 03 04:40:08.844062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1059/2082] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:08 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:08.851634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e314419a-81d7-4741-8e40-401140cb5917 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd545a1700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.208393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d035adc-2028-42d4-a1b8-62037d67c9b5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791459 Aug 03 04:40:09.213276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1024/2083] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:40:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:40:09.224719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.228655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:09.261490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:09.263578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:09.265815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:09.267894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:09.639297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e314419a-81d7-4741-8e40-401140cb5917 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277" status: 202 len: 0 microversion: 2.1 time: 0.783093 Aug 03 04:40:09.639297 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1060/2084] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:40:08 2022] DELETE /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:09.639297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba2e6965-db90-4beb-908d-031c03a70897 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.643251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba2e6965-db90-4beb-908d-031c03a70897 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:09.824889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba2e6965-db90-4beb-908d-031c03a70897 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:09.834461 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba2e6965-db90-4beb-908d-031c03a70897 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1053 microversion: 2.1 time: 0.201786 Aug 03 04:40:09.835281 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1061/2085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:09 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1053 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:09.852589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59c87e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.922280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:09.945322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:40:09.946169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 6cc82a41-e096-42bf-a76f-1752a021a277 not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:40:09.947302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.947302 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277 HTTP/1.1 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:09.949563 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.951196 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6cc82a41-e096-42bf-a76f-1752a021a277'} Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:09.952121 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:40:09.953477 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.958055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-49f48026-7bcf-44ee-b7d5-0c80e80b53cd'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:09.960955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72e28b6f-67a0-4176-92ab-5b5f697dae54 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277" status: 404 len: 194 microversion: 2.1 time: 0.115545 Aug 03 04:40:09.963239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:09.964191 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1062/2086] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:40:09 2022] GET /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277 => generated 194 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:09.964419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:09.966185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f0d4d427-8996-4059-94ea-d3e769d23e40 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd545a1280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.966399 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64bcce42-4758-4e5b-b722-75c0cede53f5 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.745755 Aug 03 04:40:09.967277 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1025/2087] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:09 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:09.975574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:09.980484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:10.007913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:10.008487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:10.014572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:10.017376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:10.140466 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f0d4d427-8996-4059-94ea-d3e769d23e40 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.186782 Aug 03 04:40:10.150360 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1063/2088] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:09 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:10.155512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd5daabd-6ab3-45fd-a729-ac975c5f74e0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59e588b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:10.181299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:10.216401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f940a195-2927-4bf5-badd-f3fe7725ec70 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.247707 Aug 03 04:40:10.217325 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1026/2089] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:09 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:10.755925 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd5daabd-6ab3-45fd-a729-ac975c5f74e0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f" status: 202 len: 0 microversion: 2.1 time: 0.604026 Aug 03 04:40:10.763450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1064/2090] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:40:10 2022] DELETE /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:10.764790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59d36ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:10.845374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group caafd85d-c491-4aa9-af09-9cbd12583b6f not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f HTTP/1.1 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:10.849649 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.852902 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'caafd85d-c491-4aa9-af09-9cbd12583b6f'} Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:10.854578 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:40:10.856691 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.860525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] Aug 03 04:40:10.862949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:10.868994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:10.869986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:10.870526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:40:10.870526 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-24ce5419-844f-4a1b-be8e-1b2739061af2'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:10.874039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea5d76fd-aa36-453b-9223-3d5f9c689fad tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f" status: 404 len: 194 microversion: 2.1 time: 0.111839 Aug 03 04:40:10.878877 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1027/2091] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:40:10 2022] GET /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:10.883471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-454ebacb-5ffd-4b3b-9c7f-becd631df321 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59c66d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:10.895219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:10.895699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:10.901312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:10.901772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.101971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:11.110396 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc2f214d-2c36-43f1-8c9b-b2ed1eb33956 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1103 microversion: 2.1 time: 0.250715 Aug 03 04:40:11.116473 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1065/2092] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:10 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1103 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:11.128653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4406f67f-7246-473d-ac19-92f1805b92cd req-35726c30-4d8a-4462-8a23-f0ccc2772357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-plugged", "status": "completed", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:11.195422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4406f67f-7246-473d-ac19-92f1805b92cd req-35726c30-4d8a-4462-8a23-f0ccc2772357 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:11.198840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4406f67f-7246-473d-ac19-92f1805b92cd req-35726c30-4d8a-4462-8a23-f0ccc2772357 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.246677 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4406f67f-7246-473d-ac19-92f1805b92cd req-35726c30-4d8a-4462-8a23-f0ccc2772357 service nova] Creating event network-vif-plugged:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:40:11.268366 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4406f67f-7246-473d-ac19-92f1805b92cd req-35726c30-4d8a-4462-8a23-f0ccc2772357 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144613 Aug 03 04:40:11.272478 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1066/2093] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:11.297490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:11.298199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:11.316993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:11.317449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.318251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:11.318679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.702542 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-454ebacb-5ffd-4b3b-9c7f-becd631df321 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19" status: 202 len: 0 microversion: 2.1 time: 0.822493 Aug 03 04:40:11.703202 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1028/2094] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:40:10 2022] DELETE /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19 => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:40:11.709705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-624a1130-edd7-445d-a7cd-6a6b2dad060f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c668b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:11.762933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:11.793466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:11.800256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:11.801528 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a03a011f-d991-4478-80ea-785c071c441f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.530348 Aug 03 04:40:11.802092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1067/2095] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:11 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:11.809456 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-624a1130-edd7-445d-a7cd-6a6b2dad060f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.104337 Aug 03 04:40:11.818969 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1029/2096] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:11 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:11.824214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd548095e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:11.829707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:11.830365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:11.837114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:11.838038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.839056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:11.839665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:11.861575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:40:11.862208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 88707a39-aaf4-4114-9f9d-178b491bfc19 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:40:11.862823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.862823 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19 HTTP/1.1 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:11.864764 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.866429 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '88707a39-aaf4-4114-9f9d-178b491bfc19'} Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:11.867395 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:40:11.868770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.871028 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-41079394-eb91-4771-9e6c-3f20d4edc4e0'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db1d6edb-a1a0-47e0-a34b-8c4f43aa8103 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19" status: 404 len: 194 microversion: 2.1 time: 0.047098 Aug 03 04:40:11.872943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1030/2097] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:40:11 2022] GET /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:11.879217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af93b432-8e6c-4611-a65d-52573bb73cb3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59d620d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:12.067109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:12.136508 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f053c883-3fe9-4405-88d2-d4ce1b0173de tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.313836 Aug 03 04:40:12.142302 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1068/2098] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:11 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:12.152587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:12.153515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:12.182223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.183042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.184685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.185343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.374528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:12.380461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af93b432-8e6c-4611-a65d-52573bb73cb3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.505457 Aug 03 04:40:12.380863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1031/2099] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:40:11 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:12.393884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7b12f01c-cdbb-4a68-ad42-12efef69e209 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1151 microversion: 2.1 time: 0.250018 Aug 03 04:40:12.396117 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1069/2100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:12 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1151 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:12.397866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0c245f3-2c74-4338-aa4d-3e6597a076c9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59d28550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1925919019", "description": "tempest-description-306055048"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:12.638600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:12.639164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:12.651573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.652043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.652875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.653389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.705543 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] HTTP exception thrown: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Request method failure captured: Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c HTTP/1.1 Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftNDUYQ3s1qxo3f2fUsGeA77WrH2I2f7eO-npaISqcxhxr-ATVwHzmytvSzPQvplk_KIMTk4zyzayObvOvFH3grxGr3-uxMGjLBBIaRPjBRYxSScH_XX7Y2Xwb6da8UVCkjXVnCUhxaYBq_2XOR9YlRQ2Lgd-Qb1_-WvpnMqN5xUqc Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:12.706784 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 41509911d7f040cfb248d99c95c43942 Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.708443 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'bdc2d56c-d691-4263-9ff5-4f405c41927c'} Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:12.709338 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.711570 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.714119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Returning 404 to user: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:12.714119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff53558f-7e0b-419f-add5-68d1d883ae3f tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 404 len: 111 microversion: 2.1 time: 0.073635 Aug 03 04:40:12.720691 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1070/2101] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:40:12 2022] DELETE /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:12.725818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:12.730739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] [instance: bdc2d56c-d691-4263-9ff5-4f405c41927c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:12.740701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:12.742634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.744381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.745424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:12.753013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:12.780492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] HTTP exception thrown: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Request method failure captured: Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c HTTP/1.1 Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ftNDUYQ3s1qxo3f2fUsGeA77WrH2I2f7eO-npaISqcxhxr-ATVwHzmytvSzPQvplk_KIMTk4zyzayObvOvFH3grxGr3-uxMGjLBBIaRPjBRYxSScH_XX7Y2Xwb6da8UVCkjXVnCUhxaYBq_2XOR9YlRQ2Lgd-Qb1_-WvpnMqN5xUqc Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:12.784180 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9c11f186b92f4526a9ced1e0fde53f3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9c11f186b92f4526a9ced1e0fde53f3f Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1753835351 Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 41509911d7f040cfb248d99c95c43942 Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1753835351-project Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.785793 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'bdc2d56c-d691-4263-9ff5-4f405c41927c'} Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:12.786675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. Aug 03 04:40:12.788097 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:12.791709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] Returning 404 to user: Instance bdc2d56c-d691-4263-9ff5-4f405c41927c could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:12.791709 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-557dcb99-89ac-488c-a6d0-af88033cf1a6 tempest-AttachSCSIVolumeTestJSON-1753835351 tempest-AttachSCSIVolumeTestJSON-1753835351-project] 10.222.0.72 "GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c" status: 404 len: 111 microversion: 2.1 time: 0.065485 Aug 03 04:40:12.796434 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1071/2102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:12 2022] GET /compute/v2.1/servers/bdc2d56c-d691-4263-9ff5-4f405c41927c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:13.268523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1463234654", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:13.406150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:40:13.574044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0c245f3-2c74-4338-aa4d-3e6597a076c9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.180596 Aug 03 04:40:13.575328 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1032/2103] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:40:13.580813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c696683-ac27-4571-815f-22a4e8791386 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c0a3a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:13.686231 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c696683-ac27-4571-815f-22a4e8791386 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.109570 Aug 03 04:40:13.686911 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1033/2104] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:13 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:13.707813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:13.708539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:13.736761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:13.737472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:13.738379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:13.738916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:14.933025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:14.964216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:14.969687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:14.970847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd349ffa-0c08-4671-b3c5-ab7045f2325c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 1.282711 Aug 03 04:40:14.980644 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1034/2105] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:13 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:14.993249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:14.994440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:15.018157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.019064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.019968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.021993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.129548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:40:15.134898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:40:15.134898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:40:15.134898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:40:15.134898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:40:15.162064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.164980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.166596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.170206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.217481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:15.243196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:15.290324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:15.327878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:40:15.331640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:15.346084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09d1af61-8d45-44ce-922c-5a0334e9dd54 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.363837 Aug 03 04:40:15.347055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1035/2106] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:14 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:15.367205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:15.367914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:15.636372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.636372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.636372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:15.636372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:15.638318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:15.638318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ecb40332-7225-4876-8832-3fba45030aef tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1211 microversion: 2.1 time: 0.220924 Aug 03 04:40:15.638318 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1036/2107] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:15 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:15.638318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1276ac7-a72a-4a77-863f-e09c3d38074d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd59c66b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-525461365", "description": "tempest-description-1655247256"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:16.003834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c050857-f7a9-4fee-bb42-263af83da327 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.195223 Aug 03 04:40:16.005359 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1072/2108] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:40:16.010444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a3d0926-1d91-48c8-99c2-5824e2be5d14 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd545a1ca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:16.150493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a3d0926-1d91-48c8-99c2-5824e2be5d14 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.143689 Aug 03 04:40:16.153841 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1073/2109] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:16 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:16.176848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:16.177721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:16.194332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:16.194807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:16.197276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:16.198128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:16.869340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:16.885812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:16.887388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:16.893302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a564633-6546-4bf5-967c-0cb4fed8fce0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.732142 Aug 03 04:40:16.895390 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1074/2110] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:16 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:16.904766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18a6c1a6-69f0-43fe-8e84-2d105e295a10 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:16.909328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18a6c1a6-69f0-43fe-8e84-2d105e295a10 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:17.150458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18a6c1a6-69f0-43fe-8e84-2d105e295a10 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:17.165117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18a6c1a6-69f0-43fe-8e84-2d105e295a10 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1217 microversion: 2.1 time: 0.264936 Aug 03 04:40:17.169277 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1075/2111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:16 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:17.194926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:17.199422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:17.239313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:17.239313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:17.239313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:17.239313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:17.276282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d1276ac7-a72a-4a77-863f-e09c3d38074d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.690099 Aug 03 04:40:17.277479 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1037/2112] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:40:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:17.283770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:17.284752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:17.315141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:17.320464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:17.321529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:17.323019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:17.959380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:17.991683 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34cbf9ea-3ea0-448a-a9f3-467dc5ae3560 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.820367 Aug 03 04:40:17.995384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1076/2113] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:17 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:18.001785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e57b1ea6-254e-43b7-902d-84d963e8f33f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59e589d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:18.061940 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e57b1ea6-254e-43b7-902d-84d963e8f33f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.065134 Aug 03 04:40:18.063970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1077/2114] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:17 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:18.069774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-524823085", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d0de1745-9dcf-4c4e-9255-5fa0f18bb121"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:18.142555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] validate_networks() for [('d0de1745-9dcf-4c4e-9255-5fa0f18bb121', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:40:18.193851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:18.206221 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9f3f521-09df-4ce6-a883-08fdac4c47e0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1211 microversion: 2.1 time: 0.927277 Aug 03 04:40:18.207172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1038/2115] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:17 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1211 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:18.212664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:18.222050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:18.230412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:18.231191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:18.233356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:18.234121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:18.432604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:18.476038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:19.047904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:19.072362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:19.080412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:19.082075 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-001d6673-f798-445a-b547-37dd3cb7c490 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.873544 Aug 03 04:40:19.087911 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1039/2116] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:18 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:19.094479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:19.095459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:19.107834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.107834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.107834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.108815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.382715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:40:19.383745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:40:19.384483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:40:19.385097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:40:19.385698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:40:19.410939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.411708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.412753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.413486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.424341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:19.455479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Getting quotas for project cf2b285affb34cb8b6c589a68e658714. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:19.478910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Getting quotas for user 55543d8f640640039b72d044a49ba779 and project cf2b285affb34cb8b6c589a68e658714. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:19.503097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:19.506833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:40:19.513150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:19.517563 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c687f94-4a14-498f-b95d-6fbb0574edc6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1213 microversion: 2.1 time: 0.428372 Aug 03 04:40:19.543701 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1040/2117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:19 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1213 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:19.551059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:19.555800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:19.567897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.573333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.576779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.579261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.771679 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c056d14e-b0c4-446d-a1fb-890060b514f5 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705524 Aug 03 04:40:19.779274 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1078/2118] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:40:19.785381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ea1d8b6-1da9-409e-a185-fffe7f98bbd7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59cd8790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:19.835721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:19.865466 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ea1d8b6-1da9-409e-a185-fffe7f98bbd7 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.084481 Aug 03 04:40:19.872837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c18081b0-feaa-4923-8180-bf5d852a6914 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.326514 Aug 03 04:40:19.876659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1079/2119] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:19 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:19.891342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a93ac802-cf85-4057-9e73-e578cfc0f5b6 req-fdcce104-28b2-41e4-8acb-f0a2e73494d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7db61f-e37d-456c-86e2-324f0ff8ae27", "tag": "0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:19.891928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1041/2120] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:19 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:19.913940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:19.914573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:19.917442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a93ac802-cf85-4057-9e73-e578cfc0f5b6 req-fdcce104-28b2-41e4-8acb-f0a2e73494d7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.918177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a93ac802-cf85-4057-9e73-e578cfc0f5b6 req-fdcce104-28b2-41e4-8acb-f0a2e73494d7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.920768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.921436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.928019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:19.928774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:19.936435 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a93ac802-cf85-4057-9e73-e578cfc0f5b6 req-fdcce104-28b2-41e4-8acb-f0a2e73494d7 service nova] Creating event network-changed:0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e for instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 on n-h1-826756-5 Aug 03 04:40:19.943313 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a93ac802-cf85-4057-9e73-e578cfc0f5b6 req-fdcce104-28b2-41e4-8acb-f0a2e73494d7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064663 Aug 03 04:40:19.944523 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1080/2121] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:19.995868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b30ef1d-f3ca-4724-8d51-83d72f3f4601 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:19.999582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2b30ef1d-f3ca-4724-8d51-83d72f3f4601 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:20.276688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2b30ef1d-f3ca-4724-8d51-83d72f3f4601 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:20.294920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2b30ef1d-f3ca-4724-8d51-83d72f3f4601 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1215 microversion: 2.1 time: 0.346529 Aug 03 04:40:20.296178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1081/2122] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:19 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1215 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:20.310421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:20.311313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:20.320223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:20.320969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:20.322528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:20.323135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:20.806228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:20.816082 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-784b8fb3-8939-4706-bd2e-35929c222e8b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1211 microversion: 2.1 time: 0.922940 Aug 03 04:40:20.816711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1042/2123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:19 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1211 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:20.822988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:20.823589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:20.836032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:20.841248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:20.841248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:20.841248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.083706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:21.103295 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44ef1697-6f8a-4a94-893e-9c8dcc294069 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1287 microversion: 2.1 time: 0.284626 Aug 03 04:40:21.108417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:21.110577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1043/2124] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:20 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1287 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:21.117174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-becd6638-e35b-450e-aa61-8e68185a2d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c94310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:21.134311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:21.135949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:21.137306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c37f1ae-5713-4e25-a762-f90348c232f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.838709 Aug 03 04:40:21.140852 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1082/2125] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:20 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:21.153346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:21.153951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:21.194129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-becd6638-e35b-450e-aa61-8e68185a2d21 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.082052 Aug 03 04:40:21.195502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.195980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.196443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1044/2126] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:21 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:21.196822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.205122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.321066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:21.324795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:21.334892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.335531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.337501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.338488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.370828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:21.467058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-32419d26-a4a2-4223-adad-551693ac6447 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.323823 Aug 03 04:40:21.468247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1083/2127] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:21 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:21.760048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:21.760048 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f236d14c-e726-4d93-b394-8e8bfb6f848e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1219 microversion: 2.1 time: 0.311410 Aug 03 04:40:21.760048 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1045/2128] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:21 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1219 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:21.840255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:21.841264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:21.856433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.858099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:21.858986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:21.860113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:22.138715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:22.139577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:22.168409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:22.170710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:22.176632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:22.177790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:22.495408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:22.507535 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0dff7d6e-1548-4be0-882b-0608f44cf00c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1275 microversion: 2.1 time: 0.373468 Aug 03 04:40:22.508160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1046/2129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:22 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:22.524808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:22.525663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:22.534409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:22.535071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:22.536859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:22.537848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:22.844727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:22.854044 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-485b0fb9-ffbf-4279-a0c4-a85c235d77c2 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1211 microversion: 2.1 time: 1.018654 Aug 03 04:40:22.869964 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1084/2130] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:21 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1211 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:22.876656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae8f418c-fa58-4629-b8e4-f194fbbdf2cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59e570d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:22.956446 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae8f418c-fa58-4629-b8e4-f194fbbdf2cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.084693 Aug 03 04:40:22.957411 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1085/2131] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:22 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:22.974100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:22.975317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:22.980693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:22.985017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:23.005067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:23.007100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:23.008484 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca084a0d-5cb9-4622-b0b7-f34c2744196c tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.499089 Aug 03 04:40:23.010655 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1047/2132] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:22 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:23.013366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.014004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.016809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.017395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.024287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:23.025249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:23.035413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.040621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.041654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.042955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.254535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:23.255824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:23.267150 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30113b78-c053-45b7-9ab1-ea40f5022413 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1211 microversion: 2.1 time: 0.254676 Aug 03 04:40:23.273549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1048/2133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:23 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:23.289953 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2883313c-161f-4d40-88f5-3251724fe442 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.330664 Aug 03 04:40:23.290881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1086/2134] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:22 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:23.532392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:23.533211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:23.545521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.546053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.548162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.548964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.717033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:23.728352 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74977938-06ea-4230-97fc-131fb11d20d3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1275 microversion: 2.1 time: 0.202370 Aug 03 04:40:23.729467 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1049/2135] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:23 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:23.883222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:23.884389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:23.900305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.906486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.909472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:23.912120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:23.974694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-295ef256-cfbb-4a7f-a0bf-081c94a18ebd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd54809b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:24.064710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-295ef256-cfbb-4a7f-a0bf-081c94a18ebd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.094146 Aug 03 04:40:24.068090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1050/2136] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:23 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:24.085358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:24.085974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:24.125618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.126269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:24.137316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.137781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:24.457305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:24.468368 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be18d50d-a93b-4d51-bb26-f8009e57521b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.595877 Aug 03 04:40:24.471427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1087/2137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:23 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:24.483559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:24.485268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:24.504657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.505515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:24.510827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.511590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:24.790903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:24.802269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3839d538-6fb3-4a2d-83c6-54e932d970ae tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1275 microversion: 2.1 time: 0.329290 Aug 03 04:40:24.816710 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1088/2138] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:24 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:24.822353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:24.823895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:24.831293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.832103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:24.833148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:24.833807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.039906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:25.098815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e50d226-c808-473a-9cec-dea00e78c231 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.280702 Aug 03 04:40:25.103154 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1089/2139] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:24 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:25.112586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:25.114020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:25.122856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.124344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.126757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.126757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.245882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.283347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.285555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.289932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cd20ce47-2299-4acb-8037-cc0521ebd105 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 1.219893 Aug 03 04:40:25.303161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1051/2140] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:24 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:25.325202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c0cc236-5a25-4fe3-a02f-6d056140c5fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c75e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:25.404424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c0cc236-5a25-4fe3-a02f-6d056140c5fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.095653 Aug 03 04:40:25.405327 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1052/2141] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:25 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:25.493717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:25.496254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:25.512429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.513281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.514361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.515328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.684764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.699944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7e1ce7c-cf8c-47be-8993-a22ef7f4ec06 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.595236 Aug 03 04:40:25.715404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1090/2142] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:25 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:25.799529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.810588 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a416517a-3ff8-438b-a96d-6869c2a527dd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.320850 Aug 03 04:40:25.824002 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1053/2143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:25 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:25.831451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:25.832091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:25.844104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.844596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.855082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:25.855082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:25.972541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:25.980459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43f889cc-54ec-4618-ba30-38a7a17a82d7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1273 microversion: 2.1 time: 0.154486 Aug 03 04:40:25.981046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1091/2144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:25 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:26.130456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:26.131113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:26.153793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.154596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.155644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.157856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.321582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:26.322708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:26.330675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:26.342512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.343805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.344983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.345580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.377315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea80a4e2-0e8f-4c48-90a3-f93dfa64b60d tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.248074 Aug 03 04:40:26.397816 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1054/2145] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:26 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:26.421432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5113b254-4091-49be-8fb2-4e76ba54f96f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d36160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:26.494345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5113b254-4091-49be-8fb2-4e76ba54f96f tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.077788 Aug 03 04:40:26.503778 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1055/2146] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:26 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:26.724370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:26.735337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:26.738323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:26.795839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.799914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:26.800168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.801082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.804115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:26.807326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.818019 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e234eba3-65f4-4ae5-91c2-3f59ba4eba28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.497019 Aug 03 04:40:26.822000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1092/2147] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:26 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:40:26.837058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:26.838042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:26.850667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.852960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:26.857185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:26.858055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.352174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:27.361718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:27.367564 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-885c1251-d3c3-49d6-9db3-50cd701ed51c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.635840 Aug 03 04:40:27.370626 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1056/2148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:26 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:27.375814 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61c43938-d0ac-4301-af86-8e287073ab94 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.547196 Aug 03 04:40:27.380579 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1093/2149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:26 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:27.386208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:27.393249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:27.396312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9a904122-2bb4-4b66-b089-68ffb4aa43e4 req-befb44e5-7fb5-49fa-8111-ff43ca6f910e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ebaa9e-c7c2-4d30-857a-3c9ad0086337", "tag": "dee67ab2-e809-44c2-858d-caf6c658dc85"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:27.418746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.419208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.419638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9a904122-2bb4-4b66-b089-68ffb4aa43e4 req-befb44e5-7fb5-49fa-8111-ff43ca6f910e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.420229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.420712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9a904122-2bb4-4b66-b089-68ffb4aa43e4 req-befb44e5-7fb5-49fa-8111-ff43ca6f910e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.424617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.446222 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9a904122-2bb4-4b66-b089-68ffb4aa43e4 req-befb44e5-7fb5-49fa-8111-ff43ca6f910e service nova] Creating event network-changed:dee67ab2-e809-44c2-858d-caf6c658dc85 for instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 on n-h1-826756-5 Aug 03 04:40:27.460393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9a904122-2bb4-4b66-b089-68ffb4aa43e4 req-befb44e5-7fb5-49fa-8111-ff43ca6f910e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086600 Aug 03 04:40:27.461658 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1057/2150] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:27.476090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:27.477528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:27.488041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.494182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.495258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.495921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.815472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:27.896182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7dfb5c8e-e9d3-4e1f-912a-474f74c4ae96 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.432743 Aug 03 04:40:27.905099 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1058/2151] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:27 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:27.914071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6af79389-b025-4f4e-8106-85e86bc5c83a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c0a040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:27.935998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:27.947874 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ca87023-8123-4c6a-9001-1a0c011d289b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.565848 Aug 03 04:40:27.950990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1094/2152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:27 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:27.961728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:27.963528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:27.981763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.982400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:27.983375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:27.986081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.046713 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6af79389-b025-4f4e-8106-85e86bc5c83a tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.141707 Aug 03 04:40:28.049979 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1059/2153] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:27 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:28.243901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:28.261367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:28.263631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:28.265894 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb189c8f-0efa-406d-8d2f-a1ff488be85b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.312913 Aug 03 04:40:28.266944 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1095/2154] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:27 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:28.392045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:28.394081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:28.404080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:28.408041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:28.429045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.429502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.434328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.434974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.444627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.445088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.470881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.471270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.796859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:28.805278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b22a7163-4ba6-4348-8ad8-0c22b9bee8cc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.418097 Aug 03 04:40:28.815632 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1060/2155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:28 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:28.819621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:28.832838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82df24a0-2980-455a-bc02-cb5002303df7 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.433818 Aug 03 04:40:28.834288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1096/2156] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:28 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:28.932792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:28.933399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:28.939434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:28.941637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.942269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.943220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.943827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.977166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:28.977974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:28.990815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.991395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:28.992308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:28.992830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.025655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:29.044667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a8b3037c-d6e5-4767-9e3d-c6b2a44f6517 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.115464 Aug 03 04:40:29.059799 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1061/2157] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:28 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:29.071871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e33217ea-10e4-466a-b203-ca7bcb5095a2 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59d43e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:29.168114 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e33217ea-10e4-466a-b203-ca7bcb5095a2 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.103701 Aug 03 04:40:29.176982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1062/2158] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:29 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:29.288218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:29.292545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:29.293165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:29.303465 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc9a2d10-bebe-4450-95f5-9b03e812b802 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.323257 Aug 03 04:40:29.304582 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1097/2159] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:28 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:29.306198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.306687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.307483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.307930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.571646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:29.586545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:29.592579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:29.596029 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab348cfa-056a-43bf-9c57-697ac62e4a09 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.308926 Aug 03 04:40:29.597982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1063/2160] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:29 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:40:29.828143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:29.831713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:29.839189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:29.841838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.842550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.844654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.845328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.851243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:29.859553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:29.860355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:29.872528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.876535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:29.877874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:29.878538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.282944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:30.374016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:30.385253 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bd699a4-8795-49f5-ba36-d91b39b5db4e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.530570 Aug 03 04:40:30.388646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1064/2161] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:29 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:30.397072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:30.397667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:30.415030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.415483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.416299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.416812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.500395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:30.535882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ddae98f4-cd9e-41bd-82be-aff073d40450 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.712719 Aug 03 04:40:30.536846 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1098/2162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:29 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:30.547697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2cd41a9b-5bb1-4806-8358-87a5fed66e20 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd545e6160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:30.620185 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2cd41a9b-5bb1-4806-8358-87a5fed66e20 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.079716 Aug 03 04:40:30.624397 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1099/2163] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:30 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:30.643756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:30.658564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:30.659234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:30.676210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.676742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.677558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.678005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.690063 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c93c15b-34eb-4766-bd5e-c50a96f93977 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.300248 Aug 03 04:40:30.708383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1065/2164] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:30 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:30.725823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d59620fe-927c-489f-81b4-5d94dfed88bb req-b227c723-8f85-42f0-8bbe-f79b27579eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705d83b8-26c6-4b03-bc01-d58b2b74a5d4", "tag": "2ad6144a-0114-4c97-9d9c-11c2ae22a8fc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:30.743270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d59620fe-927c-489f-81b4-5d94dfed88bb req-b227c723-8f85-42f0-8bbe-f79b27579eeb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.747168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d59620fe-927c-489f-81b4-5d94dfed88bb req-b227c723-8f85-42f0-8bbe-f79b27579eeb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.774848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d59620fe-927c-489f-81b4-5d94dfed88bb req-b227c723-8f85-42f0-8bbe-f79b27579eeb service nova] Creating event network-changed:2ad6144a-0114-4c97-9d9c-11c2ae22a8fc for instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 on n-h2-826756-5 Aug 03 04:40:30.781514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d59620fe-927c-489f-81b4-5d94dfed88bb req-b227c723-8f85-42f0-8bbe-f79b27579eeb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070786 Aug 03 04:40:30.783049 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1066/2165] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:30.789235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:30.801671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:30.809592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.810043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:30.811707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:30.812254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:31.816430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:31.833470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:31.837847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:31.842134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-833d88ee-41ad-47c1-ae2b-e227fb8eda97 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 1.056167 Aug 03 04:40:31.846939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1067/2166] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:30 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:31.851839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:31.858166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:31.870249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:31.877795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:31.878881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:31.879469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.129319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:32.143057 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1c0c39f-bff8-46b3-a419-feae885575a3 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 1.517145 Aug 03 04:40:32.145152 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1100/2167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:30 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:32.164577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:32.167300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:32.183832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.186078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.187130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.189292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.344725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:32.352721 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05befb84-e05b-4e5c-8ba5-3055d6e1a95f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.504413 Aug 03 04:40:32.371860 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1068/2168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:31 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:32.395272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2df5a424-2467-4fca-aba4-ca828b56781d tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd59c75310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:32.484394 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2df5a424-2467-4fca-aba4-ca828b56781d tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1428 microversion: 2.1 time: 0.100156 Aug 03 04:40:32.485199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1069/2169] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:32 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:32.505000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:32.505898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:32.512910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.513713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.514703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.517148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.569085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:32.806402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:32.812046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:32.823879 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b03b932a-91f7-4b63-a81c-484409533c04 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.675789 Aug 03 04:40:32.827109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1101/2170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:32 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:32.853941 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d97883b7-c041-4c0a-a974-10d5505c1a9b tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1929 microversion: 2.75 time: 0.367205 Aug 03 04:40:32.854533 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1070/2171] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:32 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1929 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:32.869523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:32.870411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:32.884605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.885062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:32.897451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:32.898201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:33.166595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:33.167226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:33.182178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:33.182639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:33.188885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:33.188885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:33.434072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:33.458631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:33.461406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:33.465074 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88a41df3-da69-42cc-a8c9-d7b0085ca15b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.599265 Aug 03 04:40:33.473584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1102/2172] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:32 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:33.483478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:33.485478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:33.500111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:33.505443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:33.506562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:33.507163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:33.891793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:33.902621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c9cff5f-10c8-415f-92eb-719a3e3b505d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.740196 Aug 03 04:40:33.903756 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1071/2173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:33 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:33.911152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-acd69eea-d746-42f9-b972-21ea06b313a0 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd540e23a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:33.946850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:33.972258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-acd69eea-d746-42f9-b972-21ea06b313a0 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1437 microversion: 2.1 time: 0.067160 Aug 03 04:40:33.972881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1072/2174] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:33 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1437 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:33.976235 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f80fea0-8cd4-4cef-9717-8c76cf46731f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.502633 Aug 03 04:40:33.976235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1103/2175] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:33 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:33.985883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:33.988469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:33.991186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:33.993271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:34.001254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.002119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.003086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.003786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.034008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.035811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.036676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.037122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.165274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:34.240647 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a6b1a3c4-039c-4abf-8471-b6f329cb3c92 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1935 microversion: 2.75 time: 0.256332 Aug 03 04:40:34.241223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1073/2176] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:33 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1935 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:34.264169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5057ae8-1e1b-4837-8f4e-5f28b87a74ff tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd540ce5e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:34.364331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5057ae8-1e1b-4837-8f4e-5f28b87a74ff tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 200 len: 1437 microversion: 2.1 time: 0.118325 Aug 03 04:40:34.374577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1074/2177] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:34 2022] GET /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:34.391114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:34.392700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:34.401587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.402046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.404029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.404029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.413191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:34.422647 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a76f8018-bd73-447e-919e-4e4332478951 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.447131 Aug 03 04:40:34.428670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1104/2178] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:33 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:34.491725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:34.492369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:34.500446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.500958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.501840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:34.502643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:34.831949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:34.844183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79f1c597-663a-4279-9013-fc16e688166b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1466 microversion: 2.1 time: 0.465739 Aug 03 04:40:34.845532 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1075/2179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:34 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1466 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:34.870276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc1e29c7-2945-4cfa-ad86-e8c5551a4439 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd540ce550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:34.965098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:34.982337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:34.985586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:34.987510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05adac73-d333-46e6-88ca-bbe2f4e7f19a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.500033 Aug 03 04:40:34.988661 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1105/2180] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:34 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:34.999943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:34.999943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:35.019342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:35.023308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.023765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.025083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.025527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.399739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:35.409910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45e701d8-c09a-43f8-94fd-4c39dabdb019 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.419702 Aug 03 04:40:35.411067 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1106/2181] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:34 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:35.433461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:35.439377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:35.470271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.470741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.472810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.473179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.719251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:35.730249 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10fce9c9-a798-4ecf-8c76-edd3dd6a8d8f tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.307953 Aug 03 04:40:35.731464 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1107/2182] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:35 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:35.737816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:35.738581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:35.746102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.747084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.748032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.748667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.909173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:35.934303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d6f119f-c7f1-4334-9f77-0726a7b5de07 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1935 microversion: 2.75 time: 0.201481 Aug 03 04:40:35.950651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1108/2183] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:35 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1935 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:35.963172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:35.967899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:35.981828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.982642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:35.983998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:35.984880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:36.248200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:36.257642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46c88fcc-3719-44f3-9fce-e2c39db564af tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.305254 Aug 03 04:40:36.258531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1109/2184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:35 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:36.540062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-934801494", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "118c64a4-e221-48ce-95f6-fb94798e11b4"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:36.597956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] validate_networks() for [('118c64a4-e221-48ce-95f6-fb94798e11b4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:40:36.699769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc1e29c7-2945-4cfa-ad86-e8c5551a4439 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "DELETE /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87" status: 204 len: 0 microversion: 2.1 time: 1.833469 Aug 03 04:40:36.700381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1076/2185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:34 2022] DELETE /compute/v2.1/images/f1d09eaf-5067-4353-8ec0-264e709d6a87 => generated 0 bytes in 1835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:40:36.705382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:36.706181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:36.723239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:36.723747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:36.724639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:36.725186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.359523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:37.369438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:37.371465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:37.372912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f388c863-1fe9-47e0-ac9e-8d6a4abfcf28 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.671599 Aug 03 04:40:37.373557 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1077/2186] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:36 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:37.379438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:37.380577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:37.388223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.388988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.390934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.391486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.625406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:40:37.628205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:40:37.628205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:40:37.628205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:40:37.628205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:40:37.638073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.638537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.639355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.640163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.654069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:37.662315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Getting quotas for project 5fe1099a770b485d9c51f08b0cfaf2a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:37.663578 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0baffb4d-365d-49f1-8624-83ed66999be1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.288045 Aug 03 04:40:37.664516 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1078/2187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:37 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:37.669383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c3a40af-ad08-47e8-b1d2-79ec7aa428fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '.version_select at 0x7fdd540e04c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:37.670019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Getting quotas for user 68e1dcf753c44395a22a8b2bf24f85a0 and project 5fe1099a770b485d9c51f08b0cfaf2a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:37.687339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:40:37.693250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:37.714943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-3c3a40af-ad08-47e8-b1d2-79ec7aa428fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] HTTP exception thrown: Image not found. Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c3a40af-ad08-47e8-b1d2-79ec7aa428fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Request method failure captured: Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b HTTP/1.1 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fviUX_i_8akS5qag2jlKr1erz01np2s3Uo1xffRUN1CR81h6AmikmLfBt6nhKwS98baorPu9KHVXqT4otHTbYHLiyHWUTmwKOX-z-ipKJkpVVBFOOHBkOIqssW_xiWxtxKSbGl0j9ER9-vjZakssMX3qNHODQz-C10fJlREv0mvlG0 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:37.718222 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c081e7792c674e9fabc7bcff0f21c1a7 Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: exception: Image not found. Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '746ec698-6d88-4ef2-8bd5-f45fdcca5a0b'} Aug 03 04:40:37.719574 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 746ec698-6d88-4ef2-8bd5-f45fdcca5a0b to delete Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:37.720367 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 746ec698-6d88-4ef2-8bd5-f45fdcca5a0b could not be found. Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:37.721481 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:40:37.722625 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:37.730586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c3a40af-ad08-47e8-b1d2-79ec7aa428fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Returning 404 to user: Image not found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:37.732568 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c3a40af-ad08-47e8-b1d2-79ec7aa428fa tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "DELETE /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b" status: 404 len: 62 microversion: 2.1 time: 0.067040 Aug 03 04:40:37.737593 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1079/2188] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:37 2022] DELETE /compute/v2.1/images/746ec698-6d88-4ef2-8bd5-f45fdcca5a0b => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:40:37.743017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:37.743874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:37.752090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.752573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.753350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.753783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.849081 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57a63e95-6b9d-496a-aa13-06f31ab09763 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.588958 Aug 03 04:40:37.849765 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1110/2189] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:40:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:40:37.869377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:37.869945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:37.898453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.898916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.899727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:37.900176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:37.933243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:37.946387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff6336f7-2dcc-483f-abde-61b04b6a06f6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.208039 Aug 03 04:40:37.947060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1080/2190] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:37 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:37.978559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:37.983029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:38.014209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.015254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.017793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.019604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.082270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] Lazy-loading 'services' on Instance uuid 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:38.118638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ced3761-d7ed-4a7d-a9a9-52fc5cd8b186 tempest-ServersAdmin275Test-773595910 tempest-ServersAdmin275Test-773595910-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1920 microversion: 2.75 time: 0.260833 Aug 03 04:40:38.120026 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1111/2191] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:37 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1920 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:38.153812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-03fe3ab3-62f4-41c8-a819-15206d97825d req-0ccb41ba-d258-40ec-a5a2-3fa34be34c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ebaa9e-c7c2-4d30-857a-3c9ad0086337", "name": "network-vif-plugged", "status": "completed", "tag": "dee67ab2-e809-44c2-858d-caf6c658dc85"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:38.185698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-03fe3ab3-62f4-41c8-a819-15206d97825d req-0ccb41ba-d258-40ec-a5a2-3fa34be34c7f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.186159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-03fe3ab3-62f4-41c8-a819-15206d97825d req-0ccb41ba-d258-40ec-a5a2-3fa34be34c7f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.220894 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-03fe3ab3-62f4-41c8-a819-15206d97825d req-0ccb41ba-d258-40ec-a5a2-3fa34be34c7f service nova] Creating event network-vif-plugged:dee67ab2-e809-44c2-858d-caf6c658dc85 for instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 on n-h1-826756-5 Aug 03 04:40:38.231086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-03fe3ab3-62f4-41c8-a819-15206d97825d req-0ccb41ba-d258-40ec-a5a2-3fa34be34c7f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106752 Aug 03 04:40:38.231760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1112/2192] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:38.242252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:38.248954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:38.260995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.261621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.269567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.270857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.305259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:40:38.365162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:38.373430 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff7fc448-6019-4467-b9f0-b96f1fa60c2b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.423195 Aug 03 04:40:38.374089 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1081/2193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:37 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:38.390718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:38.392628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:38.465673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:38.475221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:38.477219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:38.478335 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05c792e8-e974-4398-a9fa-324a5695eb6d tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1258 microversion: 2.21 time: 0.103336 Aug 03 04:40:38.483049 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1082/2194] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:38 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1258 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:38.484020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:38.484386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:38.491495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.491955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.492774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.493224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.524732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:40:38.706382 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a31195d-fbab-4f6e-851f-58182921faeb tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 204 len: 0 microversion: 2.1 time: 0.471195 Aug 03 04:40:38.708092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1113/2195] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:40:38 2022] DELETE /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:40:38.720467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:38.720467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:38.726700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.726919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.728945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:38.731507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:38.983485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:38.991218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:38.998469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.004804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.009837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20ef54f3-5c4b-4411-b0c5-5bcbbab189f1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.298605 Aug 03 04:40:39.013675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1114/2196] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:38 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:39.020308 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0aaa7bd-0cbc-4be6-a5c7-3c11e14894f9 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 204 len: 0 microversion: 2.75 time: 0.540140 Aug 03 04:40:39.021445 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1083/2197] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:40:38 2022] DELETE /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:40:39.028809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.030237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.034722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.038820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.044028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.044554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.045342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.048792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.056856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.057529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.058566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.059230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.343956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.347602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.354882 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce03b451-8208-4b6f-b590-86a3709ae373 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1472 microversion: 2.1 time: 0.331891 Aug 03 04:40:39.355012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6092c1a-0499-42bb-a58d-3d4b3f0ed897 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.337720 Aug 03 04:40:39.355753 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1084/2198] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:39.360620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.360982 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1115/2199] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:39.361378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.367510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.368029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.368896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.369367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.373248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.374010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.380844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.381321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.382108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.382546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.478993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.491087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.492682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.498544 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdd762c4-a9d9-41e5-8420-0472aacba9dd tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1444 microversion: 2.75 time: 0.135615 Aug 03 04:40:39.509112 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1116/2200] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:39.515990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.517067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.523782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.524247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.525074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:39.525517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:39.551583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.559603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f836e5e-c3a7-4ed2-9a7a-1763de75b632 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.202854 Aug 03 04:40:39.560185 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1085/2201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:39.574588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:39.575192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:39.636499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.645472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.648757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.652314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63fba11a-491f-43d6-b3e7-4f1f00d0fc98 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1258 microversion: 2.21 time: 0.090858 Aug 03 04:40:39.654305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1086/2202] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:39.709283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:39.730960 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5975794a-90f0-4a45-9ac9-386024ea4887 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1317 microversion: 2.1 time: 0.230619 Aug 03 04:40:39.731778 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1117/2203] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:39 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:40.041114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.041728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.048323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.048781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.049562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.050004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.247567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.257068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.258572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.259724 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24127d0e-eddb-4fd5-956e-c79062933ed9 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.222566 Aug 03 04:40:40.260304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1087/2204] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:40.317708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7db61f-e37d-456c-86e2-324f0ff8ae27", "name": "network-vif-plugged", "status": "completed", "tag": "0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e"}, {"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-unplugged", "status": "completed", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "c36f89be-660c-419c-bf69-4a19d016dfc3"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "6b74cc07-e241-4c68-8440-f66e97b11599"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "9684d68a-347d-42e1-9399-678e11531af5"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:40.331284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.331735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.347641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Creating event network-vif-plugged:0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e for instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 on n-h1-826756-5 Aug 03 04:40:40.348165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Creating event network-vif-unplugged:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:40:40.348701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Creating event network-vif-plugged:c36f89be-660c-419c-bf69-4a19d016dfc3 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:40.349872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Creating event network-vif-plugged:6b74cc07-e241-4c68-8440-f66e97b11599 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:40.350376 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] Creating event network-vif-plugged:9684d68a-347d-42e1-9399-678e11531af5 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:40.361258 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-30f76416-f9b0-442e-8c51-bf83e12d9d44 req-0f2c9a6f-75ab-4a94-8d33-4363479062fb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.047435 Aug 03 04:40:40.361865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1118/2205] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:40.377443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.377763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.378359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.378617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.385305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.385476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.389894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.389997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.389997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.390233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.390322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.390413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.632173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.637531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.641760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e7a371ef-5eb5-49b0-964f-f4208af81755 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1472 microversion: 2.1 time: 0.268174 Aug 03 04:40:40.651860 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1119/2206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1472 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:40.658669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.659296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.660691 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9ce5d5a-2058-470d-9cf1-d52882da3e96 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.287322 Aug 03 04:40:40.662062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1088/2207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:40.667235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.668279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.674975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.674975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.677385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.678240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.680091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.680739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.681666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.682250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.843885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.854698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.856622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a62d639def44d9bb39925dd2b2a5293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306c5a93b4da49b1aaa98da764b68920', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:40.863864 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e3b38256-0b34-469c-bc57-7aae847d1299 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 200 len: 1444 microversion: 2.75 time: 0.210557 Aug 03 04:40:40.864589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1120/2208] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 1444 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:40.869625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:40.870457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:40.877641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.878334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:40.879397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:40.880016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.034103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.050880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.056074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.058107 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c903625d-cbc7-4ee6-8177-2087dd341077 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1262 microversion: 2.21 time: 0.192165 Aug 03 04:40:41.059374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1121/2209] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1262 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:41.063695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.070784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:41.071752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:41.080977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79ef7664-a07f-4baf-9bb6-211c977e0847 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.417601 Aug 03 04:40:41.081805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.081916 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1089/2210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:40 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:41.082499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.083592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.084293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.283776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:41.285170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:41.292766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.293464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.294392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.294977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.584551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.594491 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a87f57f0-5bbc-4e9b-ab18-99d2e01498bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1466 microversion: 2.1 time: 0.533544 Aug 03 04:40:41.608979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1122/2211] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:41 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1466 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:41.662138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.665895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:41.672458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.673965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.675271 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ef20af2-c34c-46cc-bba0-f1589e890c41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.396184 Aug 03 04:40:41.696576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1090/2212] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:41 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:40:41.698553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:41.699341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:41.707167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.707770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.708917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.709551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.867200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:41.868913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:41.878633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.879809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.880982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.881694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.945761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:41.955359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-099ba08f-46b8-4b11-bd83-4f93572b9e36 tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1472 microversion: 2.1 time: 0.261440 Aug 03 04:40:41.956456 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1091/2213] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:41 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:41.961341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:41.962394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:41.969316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.970072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:41.971266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:41.971700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.270125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:42.281828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9d9b162-4442-47e0-860e-6b58436896cf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.322608 Aug 03 04:40:42.291056 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1092/2214] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:41 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:42.301240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:42.302064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] [instance: 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:42.311021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.317658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.318830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.319546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.337606 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] HTTP exception thrown: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Request method failure captured: Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 HTTP/1.1 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fvnQZm4y2oKe4bfrQGoj8AqNuuncdN7HIr5n4Gm7ZDZzy2gltxrU80NYyhSn2iB-VTyQXFVh1DuXa1fLvoV1X7h7SwzmS-DGr3LyUfQp0pB5DizaDXcFqZ_DRmwp99bPhVXyZbvQ_d3ICH3m_pQdHhGKHJbIqN8H1phpYvB1xiX5N4 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.75 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 306c5a93b4da49b1aaa98da764b68920 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdmin275Test-1958396627 Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:42.339764 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/306c5a93b4da49b1aaa98da764b68920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/306c5a93b4da49b1aaa98da764b68920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_306c5a93b4da49b1aaa98da764b68920"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/306c5a93b4da49b1aaa98da764b68920"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdmin275Test-1958396627 Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 306c5a93b4da49b1aaa98da764b68920 Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdmin275Test-1958396627 Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdmin275Test-1958396627-project Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4a62d639def44d9bb39925dd2b2a5293 Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdmin275Test-1958396627-project Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. Aug 03 04:40:42.341178 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2'} Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:42.342482 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. Aug 03 04:40:42.343942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:42.347439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] Returning 404 to user: Instance 5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:42.348990 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-720ff055-08e3-4bfe-8cb5-ff03f12ff397 tempest-ServersAdmin275Test-1958396627 tempest-ServersAdmin275Test-1958396627-project] 10.222.0.72 "GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2" status: 404 len: 111 microversion: 2.75 time: 0.056637 Aug 03 04:40:42.353254 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1093/2215] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:42 2022] GET /compute/v2.1/servers/5fb0bc6f-0558-432f-9e66-0b02f1e0e4d2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:40:42.359864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:42.360755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:42.368175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.372337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.372337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.372337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.473239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:42.483948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:42.486240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:42.500435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba045f71-4b0a-49cd-9150-a27c1c960864 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1310 microversion: 2.21 time: 0.133611 Aug 03 04:40:42.500435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1094/2216] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:42 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:42.500435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:42.500435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:42.503541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.504675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.505728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.506379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.562033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18d1290a-bfec-42e1-8c89-d58d2335ae0f tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1617 microversion: 2.1 time: 0.948728 Aug 03 04:40:42.566544 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1123/2217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:41 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1617 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:40:42.584412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9a2e9950-aa11-4048-aeb6-1ebfed471de4 req-024a3b4f-1cbe-4108-9db5-6d5d148a7084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3", "name": "network-vif-deleted", "tag": "d08081fc-e647-46a1-840e-00aba6a68451"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:42.610435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9a2e9950-aa11-4048-aeb6-1ebfed471de4 req-024a3b4f-1cbe-4108-9db5-6d5d148a7084 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.611300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9a2e9950-aa11-4048-aeb6-1ebfed471de4 req-024a3b4f-1cbe-4108-9db5-6d5d148a7084 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.673774 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9a2e9950-aa11-4048-aeb6-1ebfed471de4 req-024a3b4f-1cbe-4108-9db5-6d5d148a7084 service nova] Creating event network-vif-deleted:d08081fc-e647-46a1-840e-00aba6a68451 for instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 on n-h1-826756-5 Aug 03 04:40:42.723301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9a2e9950-aa11-4048-aeb6-1ebfed471de4 req-024a3b4f-1cbe-4108-9db5-6d5d148a7084 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122271 Aug 03 04:40:42.724578 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1124/2218] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:42.738684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "a4a7926b-4815-4e3e-aac5-029768cff70d"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "bf6f257e-172b-42d6-a2f0-8889f14b6084"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "42ba03bc-4060-4d5a-99ff-f682a6a88a07"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:42.766623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.767598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.788345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Creating event network-vif-plugged:a4a7926b-4815-4e3e-aac5-029768cff70d for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:42.788345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Creating event network-vif-plugged:bf6f257e-172b-42d6-a2f0-8889f14b6084 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:42.788345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] Creating event network-vif-plugged:42ba03bc-4060-4d5a-99ff-f682a6a88a07 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:42.790179 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-20b42f41-470e-4fb5-996e-cc97f0235d0b req-780690f0-5ebf-4db1-a244-ae5804fb70c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.064016 Aug 03 04:40:42.790946 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1125/2219] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:42.797817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: .version_select at 0x7fdd5459a4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1014700388", "policies": ["affinity"]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:42.817689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:42.824981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:42.880853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:42.891326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff9a2a0a-b9ae-49a6-8c1a-6b082a71f01b tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1199 microversion: 2.1 time: 0.398772 Aug 03 04:40:42.891856 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1095/2220] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:42 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1199 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:42.902164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:42.908743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:42.921556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.923966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.925031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:42.926575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:42.995288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:43.005897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:43.028220 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c37abf6-c7ea-4e03-8384-5e2a65b3cbd2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.235170 Aug 03 04:40:43.029508 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1126/2221] 10.222.0.72 () {60 vars in 1174 bytes} [Wed Aug 3 04:40:42 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:43.036890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:43.038082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:43.047153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.047884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.055691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.055691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.110730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.115708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.117211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lazy-loading 'fault' on Instance uuid 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:43.260345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c081e7792c674e9fabc7bcff0f21c1a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e013af773c43fd9064cc23f0ee9ab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.275836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9d7fc8d-0a41-4afd-a769-1659604da4cd tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 200 len: 1306 microversion: 2.1 time: 0.244542 Aug 03 04:40:43.278240 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1127/2222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:43 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:43.304905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:43.305610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:43.308668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:43.317115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.317904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.333909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.335788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.356577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.371280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.378814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.381069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba7feaca-1278-4c68-a09f-acf0acc8cab8 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.485371 Aug 03 04:40:43.382560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1096/2223] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:42 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:43.395020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-930451897", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3ea0f30e-20c0-47a6-b799-5f717f05283e"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:43.504081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:40:43.808424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.818717 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c438f55a-1046-49cd-9227-294380172e0a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.518576 Aug 03 04:40:43.819800 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1128/2224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:43 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:43.825068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:43.825864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:43.835165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.835165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.836127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:43.836682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:43.971179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.985742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.988190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:43.990092 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1bc3f3a-6658-49d5-9e3b-3ddd0cdc4e50 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1316 microversion: 2.21 time: 0.169127 Aug 03 04:40:43.991783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1129/2225] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:43 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:43.997336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:43.998886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:44.007329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.008058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.009824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.010490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.138571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:40:44.138571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:40:44.138571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:40:44.138571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:40:44.138571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:40:44.171438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.177740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.177740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.177740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.192497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:44.198154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:44.212985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 2 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:40:44.215310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:44.341393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:44.353150 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-92fcfc15-d99e-4f15-9415-d2dd1befe283 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1382 microversion: 2.1 time: 0.359703 Aug 03 04:40:44.353956 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1130/2226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:43 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1382 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:44.377815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:44.385077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] [instance: 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:44.386912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.387536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.388612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.389286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.408947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120831) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 03 04:40:44.411095 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] HTTP exception thrown: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Request method failure captured: Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 HTTP/1.1 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fviUX_i_8akS5qag2jlKr1erz01np2s3Uo1xffRUN1CR81h6AmikmLfBt6nhKwS98baorPu9KHVXqT4otHTbYHLiyHWUTmwKOX-z-ipKJkpVVBFOOHBkOIqssW_xiWxtxKSbGl0j9ER9-vjZakssMX3qNHODQz-C10fJlREv0mvlG0 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:44.412227 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c8e013af773c43fd9064cc23f0ee9ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c8e013af773c43fd9064cc23f0ee9ab0 Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1987217935 Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c081e7792c674e9fabc7bcff0f21c1a7 Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesOneServerTestJSON-1987217935-project Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. Aug 03 04:40:44.413419 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3'} Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:44.414061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. Aug 03 04:40:44.415029 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:44.415944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] Returning 404 to user: Instance 0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:44.415944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb5eae97-9c09-4016-8f48-f2015a1cca4b tempest-ImagesOneServerTestJSON-1987217935 tempest-ImagesOneServerTestJSON-1987217935-project] 10.222.0.72 "GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3" status: 404 len: 111 microversion: 2.1 time: 0.047681 Aug 03 04:40:44.417870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1131/2227] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:44 2022] GET /compute/v2.1/servers/0b3c8b1f-b192-44f8-ba41-2b3aa2a46be3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:40:44.453337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:44.481476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:44.491320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:44.643776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:44.644485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:44.658554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.659234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.660290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.660823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.772003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:44.785711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:44.838581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=1b167aeb-d150-4bf0-a017-d08d47eb30ec,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:40:44.920939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-862b2b4e-5ea7-492a-a534-55d1a07d7093 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1533 microversion: 2.1 time: 0.501767 Aug 03 04:40:44.921659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1132/2228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:44 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1533 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:44.938008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:44.938842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:44.949677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.949677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:44.949677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:44.949677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:45.048189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:45.055184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:45.252084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:45.267891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:45.273375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:45.274935 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05080d07-4f66-4233-8a2d-d76e48014a61 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.348206 Aug 03 04:40:45.276197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1133/2229] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:44 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:45.286316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-plugged", "status": "completed", "tag": "10a26f5b-9fa0-437a-a4c4-238615286fc1"}, {"server_uuid": "705d83b8-26c6-4b03-bc01-d58b2b74a5d4", "name": "network-vif-plugged", "status": "completed", "tag": "2ad6144a-0114-4c97-9d9c-11c2ae22a8fc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:45.311052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:45.314067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:45.335421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:45.340658 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] Creating event network-vif-plugged:10a26f5b-9fa0-437a-a4c4-238615286fc1 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:45.341174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] Creating event network-vif-plugged:2ad6144a-0114-4c97-9d9c-11c2ae22a8fc for instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 on n-h2-826756-5 Aug 03 04:40:45.346838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:45.360715 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6bead2b7-3605-480d-a49b-b7a451df0977 req-08223399-ebf6-4715-8ce0-87a1977d56c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083124 Aug 03 04:40:45.361334 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1134/2230] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:45.371005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:45.375016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:45.390939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:45.393360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:45.394440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:45.394888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:45.439001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:45.576042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fb18bcf-6724-47e3-894f-f42813a70c69 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.190666 Aug 03 04:40:45.577870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1097/2231] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:40:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 2194 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:40:45.587348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:45.588210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:45.597303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:45.597758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:45.599275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:45.599771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.461777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f959ef35-8954-4b3f-a608-34800aabd1d1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1533 microversion: 2.1 time: 0.879381 Aug 03 04:40:46.462965 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1098/2232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:45 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1533 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:46.484852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:46.485775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:46.492158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.493101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.494087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.494714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.520982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:46.598934 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c77b303a-0770-4820-8b04-87362fde596b tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 1.171457 Aug 03 04:40:46.598934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1135/2233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:45 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:46.598934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:46.598934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:46.599583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Searching by: {'deleted': False, 'project_id': '18f6f7ad49364611aa364991953d58fa'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:40:46.614751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.615647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.618205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.618730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.657673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:40:46.708639 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a68f2f1-a48f-4bcc-b3b2-38019a442266 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.172516 Aug 03 04:40:46.710076 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1136/2234] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:40:46 2022] GET /compute/v2.1/servers => generated 1002 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:46.714734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:46.716575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:46.725556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.726049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.727523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.728141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.743512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:46.754030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:46.755962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:46.757371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d210618-8b02-4adc-ad71-10a101aa7096 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1358 microversion: 2.21 time: 0.283580 Aug 03 04:40:46.758085 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1099/2235] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:46 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:46.765886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:46.768961 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:40:46.768961 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 04:40:46.770400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.771021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.771966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:46.772574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:46.860042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5122b0ad-1538-4222-8bcd-6bd3c0687c0c tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.100698 Aug 03 04:40:46.860904 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1100/2236] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 04:40:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:46.880291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-677bbf1c-1c20-4455-bca0-8e82d886b3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:46.882200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-677bbf1c-1c20-4455-bca0-8e82d886b3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:47.017423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-677bbf1c-1c20-4455-bca0-8e82d886b3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:47.030559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-677bbf1c-1c20-4455-bca0-8e82d886b3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1218 microversion: 2.1 time: 0.165933 Aug 03 04:40:47.062636 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1101/2237] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:46 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:47.087387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-5", "block_migration": false, "disk_over_commit": false}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:47.091403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:47.126637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:47.129489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:47.130367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:47.130821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:47.221622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lazy-loading 'flavor' on Instance uuid 9e7db61f-e37d-456c-86e2-324f0ff8ae27 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:40:47.242977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:47.249100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Going to try to live migrate instance to n-h2-826756-5 {{(pid=120831) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 04:40:47.253990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:47.255512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:47.269434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-441006c5-2bd3-4a93-ae8a-f76d0eaddc1f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.558450 Aug 03 04:40:47.270044 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1137/2238] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:46 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:47.573145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-84d5f280-bae6-4beb-8114-589dd1d7f48b req-60cc2fdf-0035-4f74-b5ef-0816e87373eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ef8752-6d04-4e20-b64d-938b6196cea2", "tag": "50d0346c-3d96-4bbc-9b1b-5f04797c3cf0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:47.594093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-84d5f280-bae6-4beb-8114-589dd1d7f48b req-60cc2fdf-0035-4f74-b5ef-0816e87373eb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:47.594546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-84d5f280-bae6-4beb-8114-589dd1d7f48b req-60cc2fdf-0035-4f74-b5ef-0816e87373eb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:47.625732 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-84d5f280-bae6-4beb-8114-589dd1d7f48b req-60cc2fdf-0035-4f74-b5ef-0816e87373eb service nova] Creating event network-changed:50d0346c-3d96-4bbc-9b1b-5f04797c3cf0 for instance 92ef8752-6d04-4e20-b64d-938b6196cea2 on n-h1-826756-5 Aug 03 04:40:47.630895 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-84d5f280-bae6-4beb-8114-589dd1d7f48b req-60cc2fdf-0035-4f74-b5ef-0816e87373eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061682 Aug 03 04:40:47.631665 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1138/2239] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:47.641308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:47.642380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:47.651859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:47.652369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:47.653200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:47.653632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:47.971030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:47.982048 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0e66af3-19b1-44c1-8b94-28eb6f977d35 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1315 microversion: 2.1 time: 0.349059 Aug 03 04:40:47.982682 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1139/2240] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:47 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:47.993688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:47.994586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:48.012382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:48.014289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:48.018783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:48.019538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:48.267664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.277236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.279348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.281190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40a830ad-74d7-431a-9fa8-be3a2354a9e6 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1358 microversion: 2.21 time: 0.297175 Aug 03 04:40:48.282340 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1140/2241] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:47 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:48.287501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5db9f7d2-34f3-47f3-941d-aabc01ff921a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:48.288433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5db9f7d2-34f3-47f3-941d-aabc01ff921a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:48.380216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5db9f7d2-34f3-47f3-941d-aabc01ff921a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.390089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5db9f7d2-34f3-47f3-941d-aabc01ff921a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1218 microversion: 2.1 time: 0.105689 Aug 03 04:40:48.392394 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1141/2242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:48 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:48.397496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:48.398415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:48.405403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:48.406121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:48.407058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:48.407686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:48.916497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.929681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.929681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:48.930817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-881061fa-bee5-40ea-a1db-f13df1830572 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1874 microversion: 2.42 time: 0.537313 Aug 03 04:40:48.944427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1142/2243] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:48 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1874 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:49.005438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:49.010302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:49.023519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:49.024918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:49.027439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:49.032957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:49.705964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:49.719769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d948700a-3f9a-48e1-9d2f-7d72be9c69b4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1504 microversion: 2.1 time: 0.720236 Aug 03 04:40:49.736337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1143/2244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:48 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1504 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:50.071771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e38ad472-69d1-4f4c-aa44-a4c9c5ca4c97 tempest-ListImageFiltersNegativeTestJSON-1720947882 tempest-ListImageFiltersNegativeTestJSON-1720947882-project] Calling method '.version_select at 0x7fdd54600940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:50.099947 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-e38ad472-69d1-4f4c-aa44-a4c9c5ca4c97 tempest-ListImageFiltersNegativeTestJSON-1720947882 tempest-ListImageFiltersNegativeTestJSON-1720947882-project] HTTP exception thrown: Image not found. Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e38ad472-69d1-4f4c-aa44-a4c9c5ca4c97 tempest-ListImageFiltersNegativeTestJSON-1720947882 tempest-ListImageFiltersNegativeTestJSON-1720947882-project] Request method failure captured: Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/images/3e402ba3-4d0d-4b47-ae00-8668e061abc8 HTTP/1.1 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxR886bQR-LzUj1iFifkQZj2RLnJvrWIyEXrOKUL6HaoTGruqHnpN3QiyhnnbTM-p9w-_ixxXi1dtAhBzg7cKb0jnJGBYCCgj_NpKfPtvPyYBjvhe8wnpOF3698xveo3CsB5oazIw0JezpaLQMX5lZrFYzU9DrKZ-IYbeV6PHCkDac Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1ffb561ffd9a4fad9fc19a8f19452692 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1720947882 Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:40:50.102415 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ffb561ffd9a4fad9fc19a8f19452692"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ffb561ffd9a4fad9fc19a8f19452692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ffb561ffd9a4fad9fc19a8f19452692"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ffb561ffd9a4fad9fc19a8f19452692"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1720947882 Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1ffb561ffd9a4fad9fc19a8f19452692 Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1720947882 Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ListImageFiltersNegativeTestJSON-1720947882-project Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 57bfc40bebcd40489b932bbd2dae4fe1 Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1720947882-project Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '3e402ba3-4d0d-4b47-ae00-8668e061abc8'} Aug 03 04:40:50.105410 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:40:50.106112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3e402ba3-4d0d-4b47-ae00-8668e061abc8 Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:40:50.107019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e402ba3-4d0d-4b47-ae00-8668e061abc8 could not be found. Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:50.109395 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:40:50.110635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e38ad472-69d1-4f4c-aa44-a4c9c5ca4c97 tempest-ListImageFiltersNegativeTestJSON-1720947882 tempest-ListImageFiltersNegativeTestJSON-1720947882-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:50.111936 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e38ad472-69d1-4f4c-aa44-a4c9c5ca4c97 tempest-ListImageFiltersNegativeTestJSON-1720947882 tempest-ListImageFiltersNegativeTestJSON-1720947882-project] 10.222.0.72 "GET /compute/v2.1/images/3e402ba3-4d0d-4b47-ae00-8668e061abc8" status: 404 len: 62 microversion: 2.1 time: 0.368172 Aug 03 04:40:50.111936 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1144/2245] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:40:49 2022] GET /compute/v2.1/images/3e402ba3-4d0d-4b47-ae00-8668e061abc8 => generated 62 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:40:50.116810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:50.117385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:50.125103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.125359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.130649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.131246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.272880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:50.280984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:50.282493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:50.283600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4acde88d-754c-4370-babb-2153ff6ad5aa tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1358 microversion: 2.21 time: 0.177351 Aug 03 04:40:50.284152 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1145/2246] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:50 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:50.288601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:50.289208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:50.295060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.295575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.296293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.296806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.367062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:50.375920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3651a28d-599f-45eb-b5e9-43839c99f653 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1270 microversion: 2.1 time: 0.090642 Aug 03 04:40:50.376923 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1146/2247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:50 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:50.386766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1925919019"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:50.387425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:50.395161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.409740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.409740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:50.409740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:50.531884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.network.security_group_api [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Adding security group 7225c398-3096-47eb-b40a-974b48f86566 to port 2ad6144a-0114-4c97-9d9c-11c2ae22a8fc Aug 03 04:40:51.203627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5999bddb-29f6-4494-94c1-c813c11f90dc tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.825328 Aug 03 04:40:51.209938 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1147/2248] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:40:50 2022] POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:51.504777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34774f51-0762-4b5a-b916-da876d28c082 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Action: 'create', calling method: .version_select at 0x7fdd55054d30>, body: {"pool": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:53.224954 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf930b3e-7637-4275-9928-dad09e40eb57 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27/action" status: 202 len: 0 microversion: 2.1 time: 6.158489 Aug 03 04:40:53.226411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1102/2249] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:40:47 2022] POST /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27/action => generated 0 bytes in 6162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:53.244803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:53.246940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:53.273953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:53.274466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:53.275265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:53.275698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:53.819558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:53.846452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:53.852183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:53.854142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7a97811-8e42-4ed7-8fb4-d69e0f89226e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2834 microversion: 2.42 time: 0.626382 Aug 03 04:40:53.856511 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1103/2250] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:53 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2834 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:53.865396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd540a6af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:54.812222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use.", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:40:54.813847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.813847 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566 HTTP/1.1 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:40:54.815942 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: exception: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.817146 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '7225c398-3096-47eb-b40a-974b48f86566'} Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:54.821379 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.822806 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:40:54.842426 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 400 to user: Security Group 7225c398-3096-47eb-b40a-974b48f86566 in use. Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-d0d082fb-dfdd-43cc-8fbd-6af740e4bacd'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edfdd2cf-c742-4c29-8563-fbcd9676246d tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566" status: 400 len: 185 microversion: 2.1 time: 0.959458 Aug 03 04:40:54.844737 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1104/2251] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:40:53 2022] DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566 => generated 185 bytes in 961 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:40:54.845260 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34774f51-0762-4b5a-b916-da876d28c082 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.612282 Aug 03 04:40:54.845260 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1148/2252] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:40:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:54.845645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d0d8bd9d-c0ff-4cad-a774-56f7aed173a2 req-1f585a43-78e4-4754-a68c-fa5c2de7f412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705d83b8-26c6-4b03-bc01-d58b2b74a5d4", "tag": "2ad6144a-0114-4c97-9d9c-11c2ae22a8fc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:54.845733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:54.845733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:54.845733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:54.845987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:54.851562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d0d8bd9d-c0ff-4cad-a774-56f7aed173a2 req-1f585a43-78e4-4754-a68c-fa5c2de7f412 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:54.851951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:54.852656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:54.854304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d0d8bd9d-c0ff-4cad-a774-56f7aed173a2 req-1f585a43-78e4-4754-a68c-fa5c2de7f412 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:54.893071 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d0d8bd9d-c0ff-4cad-a774-56f7aed173a2 req-1f585a43-78e4-4754-a68c-fa5c2de7f412 service nova] Creating event network-changed:2ad6144a-0114-4c97-9d9c-11c2ae22a8fc for instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 on n-h2-826756-5 Aug 03 04:40:54.912348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d0d8bd9d-c0ff-4cad-a774-56f7aed173a2 req-1f585a43-78e4-4754-a68c-fa5c2de7f412 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090177 Aug 03 04:40:54.916885 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1105/2253] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:54.942356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:54.945304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:54.963950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:54.970501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:54.970501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:54.971689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:55.561072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:55.590181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:55.596399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:55.598572 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d724b03a-f622-418e-996c-05dff83bfd3c tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1358 microversion: 2.21 time: 0.772885 Aug 03 04:40:55.599859 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1149/2254] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:54 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1358 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:55.604694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:55.632607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a37df24-dfe4-4e0c-843f-dbbb99cee3b0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.702350 Aug 03 04:40:55.633597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1106/2255] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:54 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:55.634251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:55.634934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:55.642485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:55.642986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:55.650890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:55.651634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:55.652548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:55.653007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:55.658900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:55.662731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:55.662731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:55.662731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:55.957377 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97c2083e-7649-4a21-9609-d0182fadab25 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.322420 Aug 03 04:40:55.960878 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1107/2256] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:40:55 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f/os-interface => generated 1832 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:56.137216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a954c54b-bd0b-46f2-b2b9-b75da4f14646 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd540a1f70>, body: {"keypair": {"name": "tempest-keypair-1428900870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkk3YVYwY+vKILpStBEb0zrPv9udlfp4M425ldk2B/J0Qz6yT4+voaj1rDJLH6IStG4WDj51Q3ohRd1BSml3gv14nyTc16QSYK36wNACOOJhpoa2brp4/iHkTtqPAgQ1g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:56.166278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a954c54b-bd0b-46f2-b2b9-b75da4f14646 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:56.177036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a954c54b-bd0b-46f2-b2b9-b75da4f14646 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:56.252002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:56.266102 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fd9ab88-2597-4a0e-ac43-af71bee68fa8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.664280 Aug 03 04:40:56.267602 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1150/2257] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:55 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:56.288523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:56.292133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:56.300314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:56.300960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:56.301805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:56.302247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:56.485392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a954c54b-bd0b-46f2-b2b9-b75da4f14646 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.522280 Aug 03 04:40:56.486318 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1108/2258] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:40:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:56.498912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97454e77-c29e-417e-ace8-88dcde87ba0f tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Action: 'create', calling method: .version_select at 0x7fdd540a1ca0>, body: {"pool": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:56.643924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:56.736250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af5aab13-c19f-40a4-85fc-0eb31da4c1ee tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action" status: 202 len: 0 microversion: 2.1 time: 0.452353 Aug 03 04:40:56.739125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1151/2259] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:40:56 2022] POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:56.746849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2fb28ac8-b955-4eb7-86d7-fd9b6bfbebce req-99dbe758-71c3-4576-a8a1-89ffdde0abbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ef8752-6d04-4e20-b64d-938b6196cea2", "name": "network-vif-plugged", "status": "completed", "tag": "50d0346c-3d96-4bbc-9b1b-5f04797c3cf0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:56.757923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2fb28ac8-b955-4eb7-86d7-fd9b6bfbebce req-99dbe758-71c3-4576-a8a1-89ffdde0abbc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:56.758825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2fb28ac8-b955-4eb7-86d7-fd9b6bfbebce req-99dbe758-71c3-4576-a8a1-89ffdde0abbc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:56.775744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2fb28ac8-b955-4eb7-86d7-fd9b6bfbebce req-99dbe758-71c3-4576-a8a1-89ffdde0abbc service nova] Creating event network-vif-plugged:50d0346c-3d96-4bbc-9b1b-5f04797c3cf0 for instance 92ef8752-6d04-4e20-b64d-938b6196cea2 on n-h1-826756-5 Aug 03 04:40:56.965488 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2fb28ac8-b955-4eb7-86d7-fd9b6bfbebce req-99dbe758-71c3-4576-a8a1-89ffdde0abbc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042868 Aug 03 04:40:56.965488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1152/2260] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:56.965488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39a221ba-1409-492b-ab16-ff4e83462c75 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd545a1160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:56.966550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:56.967235 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39a221ba-1409-492b-ab16-ff4e83462c75 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs/tempest-keypair-1428900870" status: 200 len: 498 microversion: 2.1 time: 0.018535 Aug 03 04:40:56.967235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1153/2261] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:40:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1428900870 => generated 498 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:56.967235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:56.967235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:56.967235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:56.967598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:56.967598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:56.967598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:57.049609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:57.054872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:57.056464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:57.057627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6652b35f-3271-4bd9-b499-1f3839ecb197 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1358 microversion: 2.21 time: 0.248192 Aug 03 04:40:57.058451 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1154/2262] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:56 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:57.071493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:57.072123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:57.079712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:57.080176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:57.081055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:57.081530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:57.436643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:57.453451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b155be18-872e-4a2d-9f68-174c8c49b1c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.385882 Aug 03 04:40:57.454050 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1155/2263] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:57 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:57.462874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:57.465055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:57.480066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:57.480962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:57.481919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:57.485017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:57.536754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:58.242030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:58.251346 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1fcd95f2-eb89-4754-8216-df7d64afc755 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1575 microversion: 2.1 time: 0.795439 Aug 03 04:40:58.269254 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1156/2264] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:57 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1575 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:58.275051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a50f44d5-ecaa-4449-b542-6de345dac1ba tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd59cd88b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:58.385180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:40:58.442327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a50f44d5-ecaa-4449-b542-6de345dac1ba tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428900870" status: 202 len: 0 microversion: 2.1 time: 0.171491 Aug 03 04:40:58.447635 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1157/2265] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428900870 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:40:58.450334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:58.451480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:58.461283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:58.462457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:58.463474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:58.464130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:58.842533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:58.855856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ea18328c-6977-4680-9de1-f6e93aa3fc93 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.408044 Aug 03 04:40:58.856601 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1158/2266] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:58 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:58.870325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2cab29e8-5f56-40d7-b523-71c8a44814d9 req-7817ecb9-dcc8-4847-9f3f-74cdbb547ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d12a3338-6a24-47b2-9a5d-69ae80dd4adf", "tag": "4e49d82b-e4d5-481d-b50e-ef80408cec07"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:58.895536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2cab29e8-5f56-40d7-b523-71c8a44814d9 req-7817ecb9-dcc8-4847-9f3f-74cdbb547ac5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:58.899346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2cab29e8-5f56-40d7-b523-71c8a44814d9 req-7817ecb9-dcc8-4847-9f3f-74cdbb547ac5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:58.949017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2cab29e8-5f56-40d7-b523-71c8a44814d9 req-7817ecb9-dcc8-4847-9f3f-74cdbb547ac5 service nova] Creating event network-changed:4e49d82b-e4d5-481d-b50e-ef80408cec07 for instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf on n-h2-826756-5 Aug 03 04:40:58.972692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2cab29e8-5f56-40d7-b523-71c8a44814d9 req-7817ecb9-dcc8-4847-9f3f-74cdbb547ac5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100321 Aug 03 04:40:58.972692 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1159/2267] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:58.972920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:58.973595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:58.991161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:58.991620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:58.992656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:58.992885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:59.359205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:59.359205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:59.361322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:59.362550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37b2bf09-32f7-411c-84aa-d39905d66393 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1551 microversion: 2.21 time: 0.394502 Aug 03 04:40:59.363122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1160/2268] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:40:58 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1551 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:40:59.374192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21aa2198-0fa7-4a89-812f-93f1200190fc tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd5484c700>, body: {"keypair": {"name": "tempest-keypair-1352759659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4qqeMQ81K/+zQC3yaJX5LtVvJgqh5DjU0Fg/pCMHXbcA+BpiEWB6qYtT6+tIMoP8aKzJ0mbBMk5K0j2hrMCGJEUtkh8Fp/2GjMpa+gi4G4rbBSHBccYccGqXG4FGbH2w=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:59.397216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-21aa2198-0fa7-4a89-812f-93f1200190fc tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:40:59.423361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-21aa2198-0fa7-4a89-812f-93f1200190fc tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:40:59.605643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21aa2198-0fa7-4a89-812f-93f1200190fc tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.236071 Aug 03 04:40:59.613830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1161/2269] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:40:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:59.613830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:40:59.613830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:40:59.629163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:59.629613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:59.630594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:59.632773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:59.937932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:40:59.948423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-856da117-cec3-4568-80c3-4cc1c065a987 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.340147 Aug 03 04:40:59.949024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1162/2270] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:59 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:40:59.955187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-abd71532-06b9-4f8d-a8a5-fd6346c35c0a req-34b30975-548a-477f-aef2-141f0bcb0c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "tag": "c36f89be-660c-419c-bf69-4a19d016dfc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:40:59.968169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-abd71532-06b9-4f8d-a8a5-fd6346c35c0a req-34b30975-548a-477f-aef2-141f0bcb0c1c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:40:59.968573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-abd71532-06b9-4f8d-a8a5-fd6346c35c0a req-34b30975-548a-477f-aef2-141f0bcb0c1c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:40:59.983410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-abd71532-06b9-4f8d-a8a5-fd6346c35c0a req-34b30975-548a-477f-aef2-141f0bcb0c1c service nova] Creating event network-changed:c36f89be-660c-419c-bf69-4a19d016dfc3 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:40:59.989598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-abd71532-06b9-4f8d-a8a5-fd6346c35c0a req-34b30975-548a-477f-aef2-141f0bcb0c1c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039410 Aug 03 04:40:59.990510 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1163/2271] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:40:59.996356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:00.000789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:00.009114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.010142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.011807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.012252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.275959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:00.285467 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6cc77f0-0417-4375-b024-4f39c4150144 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1575 microversion: 2.1 time: 0.293693 Aug 03 04:41:00.286732 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1164/2272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:40:59 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1575 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:00.292697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:00.293609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:00.301690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.302391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.303373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.303962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.338319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:41:00.584693 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97454e77-c29e-417e-ace8-88dcde87ba0f tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.097091 Aug 03 04:41:00.590028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1109/2273] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:40:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:00.592339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efbec648-d00c-43e9-8b5c-5e315190306f tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd54095160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:00.734767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efbec648-d00c-43e9-8b5c-5e315190306f tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352759659" status: 202 len: 0 microversion: 2.1 time: 0.148053 Aug 03 04:41:00.736888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1110/2274] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:41:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352759659 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:00.759698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:00.761321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:00.769402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.769947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.770814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:00.771922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:00.855383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7c96323-3b55-4112-8b0b-cd79bfd2d81a tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "DELETE /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 204 len: 0 microversion: 2.21 time: 0.566297 Aug 03 04:41:00.856081 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1165/2275] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:41:00 2022] DELETE /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:41:00.863576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42added2-8217-4792-bc00-8c3b64c67d55 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Action: 'create', calling method: .version_select at 0x7fdd5484c940>, body: {"pool": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:01.036544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:01.050029 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d0f6931b-c943-4f4d-a49b-7317c7fb1cc1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.310294 Aug 03 04:41:01.051161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1111/2276] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:00 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:01.073825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9b47004-d057-466f-b699-dc59abcf7437 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd540ce280>, body: {"keypair": {"name": "tempest-keypair-712312455", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:01.105489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=33 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:01.107693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a9b47004-d057-466f-b699-dc59abcf7437 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:01.116124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a9b47004-d057-466f-b699-dc59abcf7437 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:01.129875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:01.415822 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9b47004-d057-466f-b699-dc59abcf7437 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.363061 Aug 03 04:41:01.417597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1112/2277] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:01 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:01.447579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:01.449818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:01.470279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:01.485997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:01.485997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:01.485997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:01.765176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:01.777559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:01.778921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:01.785475 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1adcc26b-7f9e-4225-a684-2d93aebbbad1 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1557 microversion: 2.21 time: 0.360388 Aug 03 04:41:01.788610 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1113/2278] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:41:01 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1557 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:41:01.793618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:01.794819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:01.814893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:01.815283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:01.816078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:01.821196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:01.873778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:02.257475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:02.286831 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3245b2b2-ab3d-441b-997d-fa25c9163147 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.496543 Aug 03 04:41:02.288351 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1114/2279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:01 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:02.320951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cdc52170-d54a-4e62-b20b-48e13e94a497 req-a05ccca7-a1cd-4137-a434-3e301bc1f635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b167aeb-d150-4bf0-a017-d08d47eb30ec", "tag": "8bb922d8-20d8-44b9-8d47-b4d944a859e9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:02.349562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cdc52170-d54a-4e62-b20b-48e13e94a497 req-a05ccca7-a1cd-4137-a434-3e301bc1f635 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:02.350444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cdc52170-d54a-4e62-b20b-48e13e94a497 req-a05ccca7-a1cd-4137-a434-3e301bc1f635 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:02.388816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cdc52170-d54a-4e62-b20b-48e13e94a497 req-a05ccca7-a1cd-4137-a434-3e301bc1f635 service nova] Creating event network-changed:8bb922d8-20d8-44b9-8d47-b4d944a859e9 for instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec on n-h2-826756-5 Aug 03 04:41:02.426683 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cdc52170-d54a-4e62-b20b-48e13e94a497 req-a05ccca7-a1cd-4137-a434-3e301bc1f635 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135609 Aug 03 04:41:02.428981 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1115/2280] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:02.446636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:02.448249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:02.471446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:02.472558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:02.479797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:02.479797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:03.047513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:03.060749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17cf11db-4328-44ac-b868-71d2beb4f572 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1573 microversion: 2.1 time: 0.629067 Aug 03 04:41:03.061348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1116/2281] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:02 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1573 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:03.066033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01cd09d2-e754-4e54-9fed-ea868a473a77 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd54095310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:03.251173 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01cd09d2-e754-4e54-9fed-ea868a473a77 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712312455" status: 202 len: 0 microversion: 2.1 time: 0.188015 Aug 03 04:41:03.256995 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1117/2282] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712312455 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:03.263003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:03.264480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:03.271560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:03.272012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:03.272878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:03.273316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:03.728598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:03.748838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f317dabb-cf19-4658-be45-a7dc809b6143 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.481528 Aug 03 04:41:03.763832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1118/2283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:03 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:03.770949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:03.773573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:03.786324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:03.787541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:03.790084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:03.791768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:04.147563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:04.156465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:04.158079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '68e1dcf753c44395a22a8b2bf24f85a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fe1099a770b485d9c51f08b0cfaf2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:04.159156 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-25339abd-f3ce-444f-86a3-ef1557ce311b tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 200 len: 1515 microversion: 2.21 time: 0.406902 Aug 03 04:41:04.172322 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1119/2284] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:41:03 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 1515 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:41:04.172322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-525461365"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:04.172322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:04.178439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:04.179240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:04.180460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:04.181033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:04.539749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Adding security group 929299b1-53ac-43e9-b2fc-94644bb03906 to port 2ad6144a-0114-4c97-9d9c-11c2ae22a8fc Aug 03 04:41:04.685808 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42added2-8217-4792-bc00-8c3b64c67d55 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.827543 Aug 03 04:41:04.693832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1166/2285] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:41:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:04.698863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5e61924-4560-4ebc-8cd7-e9382f39c6f3 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd5477d4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-510026603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZtDg2mEqrtYWnc93+K9iFlrI+bScq3zNZ6nDMF9YtkqWwqmywfG6g+FQ0BlUi30jAHXfebvegmZ5ZYaVNfjzFK5lx9LsUdevKGUqHCloFSlUtZ41sTRei8MR21AK4eaw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:04.728952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c5e61924-4560-4ebc-8cd7-e9382f39c6f3 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:04.740892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c5e61924-4560-4ebc-8cd7-e9382f39c6f3 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:04.758095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:04.855445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5e61924-4560-4ebc-8cd7-e9382f39c6f3 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.160410 Aug 03 04:41:04.865696 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1167/2286] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:04.871230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:04.872907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:04.880927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:04.881705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:04.882760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:04.883203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:05.594527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:05.610073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f34c957c-fad1-4b2b-8469-591d9ceba15c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.737850 Aug 03 04:41:05.618149 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1168/2287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:04 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:05.713960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] Calling method '.version_select at 0x7fdd54581670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:05.769455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 20758429-e3fd-47fb-a84d-d6b53846bc5a could not be found", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:05.773869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] HTTP exception thrown: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] Request method failure captured: Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-floating-ips/20758429-e3fd-47fb-a84d-d6b53846bc5a HTTP/1.1 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxfAOaBgdi0XntWsjpBcCANdh3W3pWo05pDoLUmuEdJG1xhUI5ceHB9sZy3xcZiXJkwsHFqUqZ-awNeqxBrQtsuWyiNcwWo-4SQf_JXViAVMxkzrDRc2flXzhgYKz-TXhUlQLFLOW2stHKjVhSdgCsIxnArSGpgpqFU8YvgSPcv2uc Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 64da9cc5e26a49a097dcbad53a270f76 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-822290437 Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:05.777131 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/64da9cc5e26a49a097dcbad53a270f76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/64da9cc5e26a49a097dcbad53a270f76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_64da9cc5e26a49a097dcbad53a270f76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/64da9cc5e26a49a097dcbad53a270f76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-822290437 Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 64da9cc5e26a49a097dcbad53a270f76 Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-822290437 Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-822290437-project Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bd95f93b7c141d8994f8140fae00071 Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-822290437-project Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: exception: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a Aug 03 04:41:05.779660 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '20758429-e3fd-47fb-a84d-d6b53846bc5a'} Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:05.780568 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 20758429-e3fd-47fb-a84d-d6b53846bc5a could not be found Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ede5aa6f-925c-4bdc-9c78-8422b15755c9'] Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a. Aug 03 04:41:05.782027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:05.784229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:05.786292 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:05.786292 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a Aug 03 04:41:05.786292 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:05.791454 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00d04637-6676-43f9-8e76-b7f2407ce60e tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action" status: 202 len: 0 microversion: 2.1 time: 1.629276 Aug 03 04:41:05.798264 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1120/2288] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:41:04 2022] POST /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4/action => generated 0 bytes in 1637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:05.803886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-27ca2651-99d5-43a1-88ad-a15d641f7185 req-6959f3e7-dfc2-4840-962a-e1ae1d29df28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ef8752-6d04-4e20-b64d-938b6196cea2", "name": "network-vif-deleted", "tag": "50d0346c-3d96-4bbc-9b1b-5f04797c3cf0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:05.805929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] Returning 404 to user: Floating IP not found for ID 20758429-e3fd-47fb-a84d-d6b53846bc5a {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:05.811046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-807d0992-bda4-4c4e-ab0e-9b9030ef48b6 tempest-FloatingIPDetailsNegativeTestJSON-822290437 tempest-FloatingIPDetailsNegativeTestJSON-822290437-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips/20758429-e3fd-47fb-a84d-d6b53846bc5a" status: 404 len: 111 microversion: 2.1 time: 0.185030 Aug 03 04:41:05.814254 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1169/2289] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:41:05 2022] GET /compute/v2.1/os-floating-ips/20758429-e3fd-47fb-a84d-d6b53846bc5a => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:05.839588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a3b4820-d516-40df-b637-9093281d8a97 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Action: 'create', calling method: .version_select at 0x7fdd545d8c10>, body: {"pool": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:05.851232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-27ca2651-99d5-43a1-88ad-a15d641f7185 req-6959f3e7-dfc2-4840-962a-e1ae1d29df28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:05.854659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-27ca2651-99d5-43a1-88ad-a15d641f7185 req-6959f3e7-dfc2-4840-962a-e1ae1d29df28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:05.868919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-27ca2651-99d5-43a1-88ad-a15d641f7185 req-6959f3e7-dfc2-4840-962a-e1ae1d29df28 service nova] Creating event network-vif-deleted:50d0346c-3d96-4bbc-9b1b-5f04797c3cf0 for instance 92ef8752-6d04-4e20-b64d-938b6196cea2 on n-h1-826756-5 Aug 03 04:41:05.877751 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-27ca2651-99d5-43a1-88ad-a15d641f7185 req-6959f3e7-dfc2-4840-962a-e1ae1d29df28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078100 Aug 03 04:41:05.883438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1121/2290] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:05.886532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:05.887287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:05.897795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:05.898239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:05.899013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:05.899617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:06.271398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:06.286795 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-136c6a9c-0d24-43ec-9ec7-eb92d4f8cbb3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.405469 Aug 03 04:41:06.287459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1122/2291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:05 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:06.303370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aac39b50-f1a2-4f97-af0b-05b502603576 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd540e2c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1870851686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGB6vfxMEO4GFL0N/41ttLrFYPz7JEbiqpMlFauTQHMcCRRnsNg7RvsDn5d+bFYGIGFc0B27TjIhLQIJZLUkGaeJqlXrzSJ1PRJfB4oO8cvviqe2uvCo3Mo2eRJwYhdFQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:06.333580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-aac39b50-f1a2-4f97-af0b-05b502603576 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:06.342444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-aac39b50-f1a2-4f97-af0b-05b502603576 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:06.454100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aac39b50-f1a2-4f97-af0b-05b502603576 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.165270 Aug 03 04:41:06.456394 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1123/2292] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:06.463718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:06.469906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:06.481037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:06.483565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:06.485481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:06.486333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:06.515397 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] HTTP exception thrown: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Request method failure captured: Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 HTTP/1.1 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxDGahPpGdVZ6t3VrFuR9o_a57s2o4NZ812r2kkxrvtqjdq49hxYyzXASeYj2VchLCPOqd4x8FokdICEb2BRBRUpnxGtY_nM25hGny23pBsP-AQheBwSZqHg1D77imfiel2qiTn8ahmz6A5XPcnGcSJ-XPzDdioZn83ph7Iz2ZldlI Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:06.518404 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 68e1dcf753c44395a22a8b2bf24f85a0 Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:06.519718 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '92ef8752-6d04-4e20-b64d-938b6196cea2'} Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:06.529547 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:06.530664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.531777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Returning 404 to user: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:06.531777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e69f6d0-e0b9-4f77-b874-d141c12f6128 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 404 len: 111 microversion: 2.21 time: 0.064996 Aug 03 04:41:06.531777 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1124/2293] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:41:06 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:06.537396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5ead8829-ecc7-4119-8eb8-a94bd1c66767 req-79595251-5a04-4435-be23-15a5f2ba6909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12a3338-6a24-47b2-9a5d-69ae80dd4adf", "name": "network-vif-plugged", "status": "completed", "tag": "4e49d82b-e4d5-481d-b50e-ef80408cec07"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:06.609630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5ead8829-ecc7-4119-8eb8-a94bd1c66767 req-79595251-5a04-4435-be23-15a5f2ba6909 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:06.612202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5ead8829-ecc7-4119-8eb8-a94bd1c66767 req-79595251-5a04-4435-be23-15a5f2ba6909 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:06.637630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5ead8829-ecc7-4119-8eb8-a94bd1c66767 req-79595251-5a04-4435-be23-15a5f2ba6909 service nova] Creating event network-vif-plugged:4e49d82b-e4d5-481d-b50e-ef80408cec07 for instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf on n-h2-826756-5 Aug 03 04:41:06.648920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5ead8829-ecc7-4119-8eb8-a94bd1c66767 req-79595251-5a04-4435-be23-15a5f2ba6909 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121844 Aug 03 04:41:06.651098 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1125/2294] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:06.667153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59d36a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:06.987002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use.", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:06.987737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.987737 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906 HTTP/1.1 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:06.990740 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: exception: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.992339 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '929299b1-53ac-43e9-b2fc-94644bb03906'} Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:06.993462 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.994993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:06.995990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] Aug 03 04:41:06.997658 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:06.999771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 400 to user: Security Group 929299b1-53ac-43e9-b2fc-94644bb03906 in use. Aug 03 04:41:06.999771 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6ce7511c-18a4-4ae9-89bc-48b7c3b918bf'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:07.001183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5166e14-c462-4796-8ff6-9f55a41b9eca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906" status: 400 len: 185 microversion: 2.1 time: 0.348032 Aug 03 04:41:07.005422 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1126/2295] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:06 2022] DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906 => generated 185 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:07.011577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6fac3eda-8af7-458d-a94e-4c3145aed5ca tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Action: 'create', calling method: .version_select at 0x7fdd540e0430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1095784821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxbfWATlmqHFXbfL8KjDJBbtgvHtnRD8sYuUP2WcLiGImJsVDyeO3sYQGTGLp5/mD65azyWM8V7FUsyr048QdUPx1H/vDRrX3eSp7lMBiHFlr7y+3TEblD9BJKBJ9Baxw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:07.030277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6fac3eda-8af7-458d-a94e-4c3145aed5ca tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:07.037344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6fac3eda-8af7-458d-a94e-4c3145aed5ca tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Getting quotas for user cc9a5222e8664e1b9605a0e32d82c8e8 and project 58295021493649c99f81edd066d5701f. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:07.151641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6fac3eda-8af7-458d-a94e-4c3145aed5ca tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.144414 Aug 03 04:41:07.158160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1127/2296] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:07.163861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '.version_select at 0x7fdd59d36af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:07.164858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:07.172746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.173534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.174342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.174790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.298821 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8951f82-9e85-47c8-bf82-198e06fb98dc tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.136851 Aug 03 04:41:07.299517 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1128/2297] 10.222.0.72 () {60 vars in 1337 bytes} [Wed Aug 3 04:41:07 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2/os-instance-actions => generated 611 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:41:07.322564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:07.328958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:07.337187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.338644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.339620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.340966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.609690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:07.614857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-739cbebc-00fe-436a-87f6-d25efcbe6219 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.314249 Aug 03 04:41:07.615446 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1129/2298] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:07 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:07.621630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:07.622402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:07.629484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.629946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.630729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:07.631169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:07.668090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:41:08.026483 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2dcdf48e-fd4d-4cc6-a034-35c41f182f80 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 204 len: 0 microversion: 2.1 time: 0.408700 Aug 03 04:41:08.030561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1130/2299] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:41:07 2022] DELETE /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:41:08.033131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-358417e0-a808-40a4-a1c0-69757fa1bde1 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd540e24c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.047715 n-d-826756-5 devstack@n-api.service[120831]: WARNING oslo_db.sqlalchemy.utils [None req-358417e0-a808-40a4-a1c0-69757fa1bde1 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:41:08.054690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-358417e0-a808-40a4-a1c0-69757fa1bde1 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.026097 Aug 03 04:41:08.055272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1131/2300] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:08.060735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.061651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:08.069352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.070038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.071007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.071449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.089055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] HTTP exception thrown: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Request method failure captured: Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 HTTP/1.1 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxDGahPpGdVZ6t3VrFuR9o_a57s2o4NZ812r2kkxrvtqjdq49hxYyzXASeYj2VchLCPOqd4x8FokdICEb2BRBRUpnxGtY_nM25hGny23pBsP-AQheBwSZqHg1D77imfiel2qiTn8ahmz6A5XPcnGcSJ-XPzDdioZn83ph7Iz2ZldlI Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:08.090956 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 68e1dcf753c44395a22a8b2bf24f85a0 Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.092451 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '92ef8752-6d04-4e20-b64d-938b6196cea2'} Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:08.093219 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.094424 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.096363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Returning 404 to user: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:08.097222 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a6110c9e-4e0b-45a1-be8d-dbfc9cfeaa23 tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "DELETE /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 404 len: 111 microversion: 2.21 time: 0.040874 Aug 03 04:41:08.097789 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1132/2301] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:41:08 2022] DELETE /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:08.105489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.106102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:08.112847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.113295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.114241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.114677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.352918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:08.378689 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d81a1ed3-1300-4f81-9a22-9ae16d09eb53 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.276723 Aug 03 04:41:08.379746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1133/2302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:08.384500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-846822b0-4b0d-4046-9ade-f0cb87e82a87 req-a6a71867-f64c-4bbe-bad2-602dd02dabd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "705d83b8-26c6-4b03-bc01-d58b2b74a5d4", "tag": "2ad6144a-0114-4c97-9d9c-11c2ae22a8fc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:08.395602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-846822b0-4b0d-4046-9ade-f0cb87e82a87 req-a6a71867-f64c-4bbe-bad2-602dd02dabd3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.396078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-846822b0-4b0d-4046-9ade-f0cb87e82a87 req-a6a71867-f64c-4bbe-bad2-602dd02dabd3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.412453 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-846822b0-4b0d-4046-9ade-f0cb87e82a87 req-a6a71867-f64c-4bbe-bad2-602dd02dabd3 service nova] Creating event network-changed:2ad6144a-0114-4c97-9d9c-11c2ae22a8fc for instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 on n-h2-826756-5 Aug 03 04:41:08.418476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-846822b0-4b0d-4046-9ade-f0cb87e82a87 req-a6a71867-f64c-4bbe-bad2-602dd02dabd3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037454 Aug 03 04:41:08.419966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1134/2303] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:08.428776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.429581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:08.436620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.438508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.458246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.458246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.730119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a3b4820-d516-40df-b637-9093281d8a97 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.914522 Aug 03 04:41:08.738694 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1170/2304] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:41:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:08.739463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c85770df-5deb-4fef-a1fd-72fe41d3d836 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd549a64c0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.760411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:08.769544 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-041158b5-f1cd-4e16-b401-e936b98c79d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1647 microversion: 2.1 time: 0.344908 Aug 03 04:41:08.771125 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1135/2305] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1647 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:08.775961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.776833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] [instance: 92ef8752-6d04-4e20-b64d-938b6196cea2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:08.784098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.785271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.786078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.786567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.801739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] HTTP exception thrown: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Request method failure captured: Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 HTTP/1.1 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxDGahPpGdVZ6t3VrFuR9o_a57s2o4NZ812r2kkxrvtqjdq49hxYyzXASeYj2VchLCPOqd4x8FokdICEb2BRBRUpnxGtY_nM25hGny23pBsP-AQheBwSZqHg1D77imfiel2qiTn8ahmz6A5XPcnGcSJ-XPzDdioZn83ph7Iz2ZldlI Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.21 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:08.803555 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5fe1099a770b485d9c51f08b0cfaf2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 5fe1099a770b485d9c51f08b0cfaf2a3 Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-476279999 Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 68e1dcf753c44395a22a8b2bf24f85a0 Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceActionsV221TestJSON-476279999-project Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.805015 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '92ef8752-6d04-4e20-b64d-938b6196cea2'} Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:08.805758 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. Aug 03 04:41:08.806843 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:08.808639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] Returning 404 to user: Instance 92ef8752-6d04-4e20-b64d-938b6196cea2 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:08.809555 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4374d5a8-11b8-44c6-8bc1-dbc514fcd0fd tempest-InstanceActionsV221TestJSON-476279999 tempest-InstanceActionsV221TestJSON-476279999-project] 10.222.0.72 "GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2" status: 404 len: 111 microversion: 2.21 time: 0.037291 Aug 03 04:41:08.814202 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1136/2306] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/servers/92ef8752-6d04-4e20-b64d-938b6196cea2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:08.815612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:08.816419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:08.825513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.825993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.826847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:08.827287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:08.884008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c85770df-5deb-4fef-a1fd-72fe41d3d836 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1095784821" status: 202 len: 0 microversion: 2.1 time: 0.150917 Aug 03 04:41:08.888109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1171/2307] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 04:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1095784821 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:08.892067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fbfab57-742b-4fe2-85f5-7f58fdf80b8b tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd54e79c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.217534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:09.228867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07de97da-8c15-41be-9333-c303b904ce98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.416581 Aug 03 04:41:09.231400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1137/2308] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:09.240799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e956479-cdc2-42ed-8ba6-28f756de0850 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd54089670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.276521 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fbfab57-742b-4fe2-85f5-7f58fdf80b8b tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips/010340a8-9dec-436f-a325-5d7a3a15b6da" status: 200 len: 142 microversion: 2.1 time: 0.390180 Aug 03 04:41:09.277123 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1172/2309] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:41:08 2022] GET /compute/v2.1/os-floating-ips/010340a8-9dec-436f-a325-5d7a3a15b6da => generated 142 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:09.289304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9aef56fe-3ab9-46c7-9d92-9c43e0e7ac0a tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd549a6b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.386615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e956479-cdc2-42ed-8ba6-28f756de0850 tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1870851686" status: 202 len: 0 microversion: 2.1 time: 0.153175 Aug 03 04:41:09.391568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1138/2310] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 04:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1870851686 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:09.400538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e27127f9-e8fa-4653-bf56-66a19ffaafdb tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] Calling method '.version_select at 0x7fdd59c948b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.512258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e27127f9-e8fa-4653-bf56-66a19ffaafdb tempest-KeyPairsV2TestJSON-1464280242 tempest-KeyPairsV2TestJSON-1464280242-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-510026603" status: 202 len: 0 microversion: 2.1 time: 0.118444 Aug 03 04:41:09.515209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1139/2311] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:41:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-510026603 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:41:09.522758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.522849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:09.530989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:09.531538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:09.532449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:09.532981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:09.939098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:09.948412 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-86af563d-cffb-4294-b25d-c229e734a4ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.431649 Aug 03 04:41:09.949156 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1140/2312] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:09 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:09.954581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:09.955501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:09.962519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:09.963314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:09.964335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:09.965105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:10.003180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:10.387780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:10.403761 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4898d813-fd1f-4715-8f28-36674b60d3e8 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1647 microversion: 2.1 time: 0.450041 Aug 03 04:41:10.403761 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1141/2313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:09 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1647 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:10.407849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:10.416510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:10.419660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:10.420107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:10.420944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:10.421379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:10.990563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:10.999719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05a6d9fd-44c5-447c-a6bd-9a5c7c419c20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1318 microversion: 2.1 time: 0.597167 Aug 03 04:41:11.000533 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1142/2314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:10 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:11.006177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-eaca0288-489c-4019-b679-fa71a608d2e7 req-34cd6961-e873-4487-a056-151bf0797403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b167aeb-d150-4bf0-a017-d08d47eb30ec", "name": "network-vif-plugged", "status": "completed", "tag": "8bb922d8-20d8-44b9-8d47-b4d944a859e9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:11.016802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eaca0288-489c-4019-b679-fa71a608d2e7 req-34cd6961-e873-4487-a056-151bf0797403 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:11.017594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eaca0288-489c-4019-b679-fa71a608d2e7 req-34cd6961-e873-4487-a056-151bf0797403 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:11.029837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-eaca0288-489c-4019-b679-fa71a608d2e7 req-34cd6961-e873-4487-a056-151bf0797403 service nova] Creating event network-vif-plugged:8bb922d8-20d8-44b9-8d47-b4d944a859e9 for instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec on n-h2-826756-5 Aug 03 04:41:11.035028 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-eaca0288-489c-4019-b679-fa71a608d2e7 req-34cd6961-e873-4487-a056-151bf0797403 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Aug 03 04:41:11.035740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1143/2315] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:11.041940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:11.042635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:11.049683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:11.050228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:11.051001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:11.051441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:11.211590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:11.220502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44b4f068-62a5-41cf-b76d-49e070a6cf52 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.183111 Aug 03 04:41:11.221320 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1144/2316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:11 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:11.424524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:11.425920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:11.441961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:11.443031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:11.444437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:11.445266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:11.483931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9aef56fe-3ab9-46c7-9d92-9c43e0e7ac0a tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/010340a8-9dec-436f-a325-5d7a3a15b6da" status: 202 len: 0 microversion: 2.1 time: 2.197712 Aug 03 04:41:11.492083 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1173/2317] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:09 2022] DELETE /compute/v2.1/os-floating-ips/010340a8-9dec-436f-a325-5d7a3a15b6da => generated 0 bytes in 2200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:41:11.502726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d4cf9d8-8718-4224-b886-0feac9547b30 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd549a63a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:11.897085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d4cf9d8-8718-4224-b886-0feac9547b30 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.405547 Aug 03 04:41:11.905559 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1174/2318] 10.222.0.72 () {58 vars in 1164 bytes} [Wed Aug 3 04:41:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:41:11.911079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b2fbf89-6cb8-4b61-afbf-332ec6e036e6 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd59cd88b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:12.067964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:12.077819 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a43bd25e-b748-4487-8a71-125f174805ca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1647 microversion: 2.1 time: 0.657363 Aug 03 04:41:12.091806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1145/2319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:11 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1647 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:12.096566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:12.097244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:12.099895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:12.105259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.105910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:12.107564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.108017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:12.364916 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b2fbf89-6cb8-4b61-afbf-332ec6e036e6 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.457500 Aug 03 04:41:12.365854 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1175/2320] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:41:11 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:12.370812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:12.371796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:12.381969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.382533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:12.383576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.384023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:12.433124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:12.453023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92608666-790b-4d63-a8b9-6beeef4ae2a7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1468 microversion: 2.1 time: 0.360152 Aug 03 04:41:12.453941 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1146/2321] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:12 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1468 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:12.458810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4492125-6606-4944-8138-7fc7efc7ec39 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd540a6e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:12.710392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:12.729106 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5435561-49cd-4a2b-9767-87751ea44fb1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.362056 Aug 03 04:41:12.743670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1176/2322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:12 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:12.743670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:12.746522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:12.759567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.760053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:12.760902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:12.761346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:13.275452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:13.288971 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5bdd558-a021-4c9c-a527-0118249e4351 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1318 microversion: 2.1 time: 0.553843 Aug 03 04:41:13.293039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1177/2323] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:12 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:13.630107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a74fbaac-f98f-47bd-9e38-71c19106d430 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd549acf70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl1+2Sk/Qi6oDTtbvnA15hKKmy4B/V4LKzYHvcqakT3KUFOHunIx45DvjDi/t31XoU/OM5sy7Juwhc+gQPlfAjbSz78am/a5l/zqMpynfTEiUsiqVKuz1xieIlJgz/qDg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a74fbaac-f98f-47bd-9e38-71c19106d430 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 257 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:13.634369 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:13.635573 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl1+2Sk/Qi6oDTtbvnA15hKKmy4B/V4LKzYHvcqakT3KUFOHunIx45DvjDi/t31XoU/OM5sy7Juwhc+gQPlfAjbSz78am/a5l/zqMpynfTEiUsiqVKuz1xieIlJgz/qDg=="}} Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl1+2Sk/Qi6oDTtbvnA15hKKmy4B/V4LKzYHvcqakT3KUFOHunIx45DvjDi/t31XoU/OM5sy7Juwhc+gQPlfAjbSz78am/a5l/zqMpynfTEiUsiqVKuz1xieIlJgz/qDg=='}}} Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:13.636166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:13.637120 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:13.638544 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:13.639537 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 03 04:41:13.639537 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:13.641668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a74fbaac-f98f-47bd-9e38-71c19106d430 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:13.642548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a74fbaac-f98f-47bd-9e38-71c19106d430 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.345838 Aug 03 04:41:13.643175 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1178/2324] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:13 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 350 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:13.648219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cb4defd8-a7c8-4a20-a416-b4a8a955f8ce req-1f6f554f-1abe-4ed9-8c4f-55b8b7c936a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "705d83b8-26c6-4b03-bc01-d58b2b74a5d4", "name": "network-vif-deleted", "tag": "2ad6144a-0114-4c97-9d9c-11c2ae22a8fc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:13.660358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cb4defd8-a7c8-4a20-a416-b4a8a955f8ce req-1f6f554f-1abe-4ed9-8c4f-55b8b7c936a9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:13.661251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cb4defd8-a7c8-4a20-a416-b4a8a955f8ce req-1f6f554f-1abe-4ed9-8c4f-55b8b7c936a9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:13.674543 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cb4defd8-a7c8-4a20-a416-b4a8a955f8ce req-1f6f554f-1abe-4ed9-8c4f-55b8b7c936a9 service nova] Creating event network-vif-deleted:2ad6144a-0114-4c97-9d9c-11c2ae22a8fc for instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 on n-h2-826756-5 Aug 03 04:41:13.680071 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cb4defd8-a7c8-4a20-a416-b4a8a955f8ce req-1f6f554f-1abe-4ed9-8c4f-55b8b7c936a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035368 Aug 03 04:41:13.680803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1179/2325] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:13.686679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:13.687487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:13.695407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:13.697510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:13.697510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:13.697874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:13.741039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:13.741627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:13.742078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lazy-loading 'fault' on Instance uuid 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:41:14.060230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:14.076837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e647831-8acd-44e9-94b4-1f3880671545 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1305 microversion: 2.1 time: 0.392839 Aug 03 04:41:14.092306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1180/2326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:13 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1305 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:14.092835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd54e86040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-165423436", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:14.120747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:14.127379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for user 42580504eaef4ea5a707499ed6acc6ed and project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:14.146786 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 2166 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-165423436", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:14.173253 n-d-826756-5 devstack@n-api.service[120832]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-165423436', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:14.175722 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:14.180246 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:14.186057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:14.189141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6321802-fb6f-4680-8fed-12f6fdb94786 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.107319 Aug 03 04:41:14.189963 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1181/2327] 10.222.0.72 () {60 vars in 1160 bytes} [Wed Aug 3 04:41:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:41:14.204433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:14.206459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:14.243340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:14.245777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:14.246633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:14.247191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:14.980606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:14.996466 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-406c4e0f-03fd-4bf5-ae23-b262ae79f6ed tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.803313 Aug 03 04:41:15.012981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1182/2328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:14 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:15.018841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec17d063-cb17-439b-840c-0947f373b0fd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd54e86550>, body: {"keypair": {"name": "tempest-keypair-1733378759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKepTSgMVqSas7X+8l/3eZtyDCe6xkuclubr0WEdPD9MQb1ZXF7HTxJvvaiUJhj7iyol8pw8MdgCVQpqjW9KxFoLyYDk9M9S56KzyMHvpH/136frGmAoEQBtJY0uhOU0iA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:15.045154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-ec17d063-cb17-439b-840c-0947f373b0fd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:15.053221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-ec17d063-cb17-439b-840c-0947f373b0fd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for user 42580504eaef4ea5a707499ed6acc6ed and project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:15.220751 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec17d063-cb17-439b-840c-0947f373b0fd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206326 Aug 03 04:41:15.221756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1183/2329] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:15.237018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:15.237890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:15.246096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.247094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.248395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.249280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.554270 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4492125-6606-4944-8138-7fc7efc7ec39 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/f301fdac-f7da-4b94-b80e-7633468e2fce" status: 202 len: 0 microversion: 2.1 time: 3.098248 Aug 03 04:41:15.566065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1147/2330] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:12 2022] DELETE /compute/v2.1/os-floating-ips/f301fdac-f7da-4b94-b80e-7633468e2fce => generated 0 bytes in 3109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:15.571713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:15.572371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:15.581774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.582813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.583985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.584473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.595896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:15.610611 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a951e625-a029-4ea6-92c7-592df27b2640 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1318 microversion: 2.1 time: 0.377505 Aug 03 04:41:15.617114 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1184/2331] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:15 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:15.628218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd546154c0>, body: {"keypair": {"name": "tempest-keypair-1733378759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJsBZaFbmfiIis6iHWVDhK4/md/hEFI3famJi5zlGZekUJOq5gQ+i+on3JHzdP6yh5coP9AM4vt/KEel2/jPFMm0Ds92vOMpyst9VrVRsEg/xj+orZQydW72xD4jeZ5Dw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:15.646601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:15.649748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.650214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.650697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lazy-loading 'fault' on Instance uuid 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:41:15.653437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for user 42580504eaef4ea5a707499ed6acc6ed and project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:15.702438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:15.710963 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90aaad78-304a-4904-a4f8-8ec60fb25b70 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 200 len: 1473 microversion: 2.1 time: 0.144344 Aug 03 04:41:15.711555 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1148/2332] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:15 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 1473 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:15.717045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b1494ef-3a35-41bb-a246-ef6d70991cf0 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd54095ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:15.773818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] HTTP exception thrown: Key pair 'tempest-keypair-1733378759' already exists. Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 273 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "tempest-keypair-1733378759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJsBZaFbmfiIis6iHWVDhK4/md/hEFI3famJi5zlGZekUJOq5gQ+i+on3JHzdP6yh5coP9AM4vt/KEel2/jPFMm0Ds92vOMpyst9VrVRsEg/xj+orZQydW72xD4jeZ5Dw=="}} Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: exception: Key pair 'tempest-keypair-1733378759' already exists. Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1733378759', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJsBZaFbmfiIis6iHWVDhK4/md/hEFI3famJi5zlGZekUJOq5gQ+i+on3JHzdP6yh5coP9AM4vt/KEel2/jPFMm0Ds92vOMpyst9VrVRsEg/xj+orZQydW72xD4jeZ5Dw=='}}} Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '42580504eaef4ea5a707499ed6acc6ed-tempest-keypair-1733378759' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 03 04:41:15.783547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi session.flush() Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result.read() Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 03 04:41:15.786863 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '42580504eaef4ea5a707499ed6acc6ed-tempest-keypair-1733378759' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 3, 4, 41, 15, 672467), 'updated_at': None, 'name': 'tempest-keypair-1733378759', 'user_id': '42580504eaef4ea5a707499ed6acc6ed', 'fingerprint': '0f:ae:5f:ff:fe:2f:57:60:25:c4:c3:3e:81:04:22:a1', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJsBZaFbmfiIis6iHWVDhK4/md/hEFI3famJi5zlGZekUJOq5gQ+i+on3JHzdP6yh5coP9AM4vt/KEel2/jPFMm0Ds92vOMpyst9VrVRsEg/xj+orZQydW72xD4jeZ5Dw==', 'type': 'ssh'}] Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6730, in import_key_pair Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi keypair.create() Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._create() Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1733378759' already exists. Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 03 04:41:15.796605 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1733378759' already exists. Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1733378759' already exists. Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 409 to user: Key pair 'tempest-keypair-1733378759' already exists. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a67763e-7791-4d9c-af62-06b684945dcd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.172666 Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1185/2333] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:15 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:41:15.802527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7db61f-e37d-456c-86e2-324f0ff8ae27", "name": "network-vif-unplugged", "status": "completed", "tag": "0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e"}, {"name": "network-changed", "server_uuid": "9e7db61f-e37d-456c-86e2-324f0ff8ae27", "tag": "0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:15.810524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:15.810996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:15.821793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] Creating event network-vif-unplugged:0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e for instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 on n-h1-826756-5 Aug 03 04:41:15.822389 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] Creating event network-changed:0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e for instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 on n-h1-826756-5 Aug 03 04:41:15.829043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e3927b16-3685-4392-9def-a3ee112c88b5 req-1668b3b1-fa50-4082-9b88-78cff2f98366 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.041663 Aug 03 04:41:15.829664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1186/2334] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:15.835539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9014e4d6-1901-4d13-9f2b-93d2c6cbdd83 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Calling method '.version_select at 0x7fdd5492c9d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:15.936084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9014e4d6-1901-4d13-9f2b-93d2c6cbdd83 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733378759" status: 202 len: 0 microversion: 2.1 time: 0.104925 Aug 03 04:41:15.936717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1187/2335] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733378759 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:15.950477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c4a3496-d627-459d-9865-5ce456083265 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd553cc160>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAprgKqtNBHOJL0LGjThwC1EPeMiflrbYMkrBR0pzEQ3fxl5W/Si9AmG5xAdMXXZqKd9JLep29B907KAyN4b91JWjzO9kIpkfqLmIuQYRXkZ0lVdMKyvt0I7fLUpoDMkyQ=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c4a3496-d627-459d-9865-5ce456083265 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 247 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAprgKqtNBHOJL0LGjThwC1EPeMiflrbYMkrBR0pzEQ3fxl5W/Si9AmG5xAdMXXZqKd9JLep29B907KAyN4b91JWjzO9kIpkfqLmIuQYRXkZ0lVdMKyvt0I7fLUpoDMkyQ=="}} Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAprgKqtNBHOJL0LGjThwC1EPeMiflrbYMkrBR0pzEQ3fxl5W/Si9AmG5xAdMXXZqKd9JLep29B907KAyN4b91JWjzO9kIpkfqLmIuQYRXkZ0lVdMKyvt0I7fLUpoDMkyQ=='}}} Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '' Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:15.956623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c4a3496-d627-459d-9865-5ce456083265 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c4a3496-d627-459d-9865-5ce456083265 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012268 Aug 03 04:41:15.967367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1188/2336] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:41:15.975732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd5485e040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865757505", "public_key": " "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:15.993114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:15.998923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for user 42580504eaef4ea5a707499ed6acc6ed and project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:16.019683 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 95 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865757505", "public_key": " "}} Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1865757505', 'public_key': ' '}}} Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:16.021525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:16.025732 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d558d4e-d7da-498f-8446-d0faaaad3f1c tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.051604 Aug 03 04:41:16.032671 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1189/2337] 10.222.0.72 () {60 vars in 1158 bytes} [Wed Aug 3 04:41:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:41:16.040664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:16.041674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:16.052689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:16.053613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:16.054547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:16.055067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:16.600665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:16.614413 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dcfdc442-82fe-4eba-9b68-4f815c9a5b49 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.578410 Aug 03 04:41:16.620498 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1190/2338] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:16 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:16.631135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49b6eb73-6945-4441-a84b-72bdd0cd9ca8 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd54600f70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEcqWxNVRYoEgSTuNgmCgs72nQOAph9L8fdZnBWNDTYq6ZLGyrTD8RvDnEWG85BXw04qbCvvKR5xXFwvy0CwaoxOLS9i5is4uOCJ9Xx5sKCL7VBlAlpeWVdghsKgwyLsw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49b6eb73-6945-4441-a84b-72bdd0cd9ca8 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 507 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEcqWxNVRYoEgSTuNgmCgs72nQOAph9L8fdZnBWNDTYq6ZLGyrTD8RvDnEWG85BXw04qbCvvKR5xXFwvy0CwaoxOLS9i5is4uOCJ9Xx5sKCL7VBlAlpeWVdghsKgwyLsw=="}} Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEcqWxNVRYoEgSTuNgmCgs72nQOAph9L8fdZnBWNDTYq6ZLGyrTD8RvDnEWG85BXw04qbCvvKR5xXFwvy0CwaoxOLS9i5is4uOCJ9Xx5sKCL7VBlAlpeWVdghsKgwyLsw=='}}} Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 03 04:41:16.641332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 03 04:41:16.644250 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:16.649027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49b6eb73-6945-4441-a84b-72bdd0cd9ca8 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:16.650174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49b6eb73-6945-4441-a84b-72bdd0cd9ca8 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.028445 Aug 03 04:41:16.651401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1191/2339] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:16 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:16.660237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:16.661307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:16.672733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:16.673644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:16.674685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:16.675339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:17.046764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=11 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:17.052637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:17.060734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:17.069190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-745a19b6-e71b-4c2c-ae6d-47d6db6e8a9d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1467 microversion: 2.1 time: 0.416313 Aug 03 04:41:17.072539 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1192/2340] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:16 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1467 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:17.096114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Action: 'create', calling method: .version_select at 0x7fdd545d8c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-859063935", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:17.126533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:17.139710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Getting quotas for user 42580504eaef4ea5a707499ed6acc6ed and project c092332d8efe4010b827f0e35b9b5eb1. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:17.177306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 117 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-859063935", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: exception: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-859063935', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6727, in import_key_pair Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6800, in _generate_fingerprint Aug 03 04:41:17.182384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.186245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:17.197661 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c08c4c22-e487-4759-be0c-5812433191dd tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.123198 Aug 03 04:41:17.201381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1193/2341] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:41:17 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:41:17.208845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:17.211932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:17.220753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:17.221806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:17.223789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:17.224328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:17.245487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 HTTP/1.1 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '705d83b8-26c6-4b03-bc01-d58b2b74a5d4'} Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:17.247144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:17.251899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ff6ca2e-f07b-4c67-adad-d22a67ef9fe0 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 404 len: 111 microversion: 2.1 time: 0.045843 Aug 03 04:41:17.256693 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1194/2342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:17 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:17.264024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:17.269847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:17.273587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Searching by: {'reservation_id': 'r-30u6z920', 'deleted': False, 'project_id': '18f6f7ad49364611aa364991953d58fa'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:41:17.285791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:17.286251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:17.287064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:17.287515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:17.445470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:41:17.515256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:17.521830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:17.522284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:18.141365 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b1494ef-3a35-41bb-a246-ef6d70991cf0 tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/e1dc177b-355a-416b-b0f9-5c73298a548c" status: 202 len: 0 microversion: 2.1 time: 2.427820 Aug 03 04:41:18.145697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37f2af6a-8eaf-469c-adde-2ae5dd4fc2e7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?reservation_id=r-30u6z920" status: 200 len: 2928 microversion: 2.1 time: 0.885168 Aug 03 04:41:18.147790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1149/2343] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:15 2022] DELETE /compute/v2.1/os-floating-ips/e1dc177b-355a-416b-b0f9-5c73298a548c => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:18.155413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a27e464a-5890-4175-b3b4-8db561ea0894 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Calling method '.version_select at 0x7fdd540a6af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:18.160850 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1195/2344] 10.222.0.72 () {58 vars in 1197 bytes} [Wed Aug 3 04:41:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-30u6z920 => generated 2928 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:18.168448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-75ce84c2-e168-40e1-a715-e49c24f77af6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd54623550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:18.191822 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a27e464a-5890-4175-b3b4-8db561ea0894 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a27e464a-5890-4175-b3b4-8db561ea0894 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Request method failure captured: Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-949817078 HTTP/1.1 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxo3W1vQkCtsl9-107snvCpC73qdQUtdx_Lte64eZVoW03xdgCW7DGGapvwyAWHQCVCwFF0H2uE-lhDvkLFuS4ssZPFGUf4jfnU-OVDOPPq3doroF5Vg8GMOhRtfWCi9UI24mTbDfZFPw4X-9syelLIbq2qZzpWdZYyVgp0VyC1zF0 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/c092332d8efe4010b827f0e35b9b5eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: c092332d8efe4010b827f0e35b9b5eb1 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1137086066 Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1137086066-project Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: exception: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'tempest-keypair-non-existent-949817078'} Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6814, in delete_key_pair Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6835, in get_key_pair Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:18.194891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed Aug 03 04:41:18.199590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:18.213061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a27e464a-5890-4175-b3b4-8db561ea0894 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] Returning 404 to user: Keypair tempest-keypair-non-existent-949817078 not found for user 42580504eaef4ea5a707499ed6acc6ed {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:18.213061 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a27e464a-5890-4175-b3b4-8db561ea0894 tempest-KeyPairsNegativeTestJSON-1137086066 tempest-KeyPairsNegativeTestJSON-1137086066-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-949817078" status: 404 len: 144 microversion: 2.1 time: 0.057051 Aug 03 04:41:18.213061 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1150/2345] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 04:41:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-949817078 => generated 144 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:18.217789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:18.218895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:18.226434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:18.227204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:18.230203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:18.230928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:18.447434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:18.457287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db7b1ca7-bc7f-45de-8a71-b578211761d1 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.248478 Aug 03 04:41:18.457986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1151/2346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:18 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:18.466177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d08e1624-4bf3-4584-958e-ca884a0962dd tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] Calling method '.version_select at 0x7fdd59e524c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:18.691038 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-75ce84c2-e168-40e1-a715-e49c24f77af6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566" status: 202 len: 0 microversion: 2.1 time: 0.528908 Aug 03 04:41:18.711479 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1196/2347] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:18 2022] DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:18.717296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94732a98-f3f5-4ea6-8a75-8f78cc6daace tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:18.790063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.server_groups [None req-94732a98-f3f5-4ea6-8a75-8f78cc6daace tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Querying cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) for 2 instances {{(pid=120832) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 04:41:18.791319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94732a98-f3f5-4ea6-8a75-8f78cc6daace tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:18.793053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94732a98-f3f5-4ea6-8a75-8f78cc6daace tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:18.841733 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94732a98-f3f5-4ea6-8a75-8f78cc6daace tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups/3ea0f30e-20c0-47a6-b799-5f717f05283e" status: 200 len: 266 microversion: 2.1 time: 0.129976 Aug 03 04:41:18.848108 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1197/2348] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:18 2022] GET /compute/v2.1/os-server-groups/3ea0f30e-20c0-47a6-b799-5f717f05283e => generated 266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:18.854852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcf1c7ea-dc1d-4093-bc99-9d95b2397b5f tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd5485e040>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:19.601387 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcf1c7ea-dc1d-4093-bc99-9d95b2397b5f tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906" status: 202 len: 0 microversion: 2.1 time: 0.751540 Aug 03 04:41:19.602384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1198/2349] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:18 2022] DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906 => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:19.608589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:19.610971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:19.625110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:19.626075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:19.627596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:19.634317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:19.860607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d08e1624-4bf3-4584-958e-ca884a0962dd tempest-FloatingIPDetailsTestJSON-738908123 tempest-FloatingIPDetailsTestJSON-738908123-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/7b90d717-e7ff-481b-a949-366a72d354f4" status: 202 len: 0 microversion: 2.1 time: 1.401474 Aug 03 04:41:19.861232 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1152/2350] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:18 2022] DELETE /compute/v2.1/os-floating-ips/7b90d717-e7ff-481b-a949-366a72d354f4 => generated 0 bytes in 1403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:19.871069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:19.872009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:19.882486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:19.883403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:19.884490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:19.885148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:20.105093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd217ac8-6467-45b6-ac18-77a550aa9a78 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1618 microversion: 2.1 time: 0.500805 Aug 03 04:41:20.106210 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1199/2351] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:19 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1618 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:20.115351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7df02465-6ac0-4a5e-b22e-42754c4dab11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'create', calling method: .version_select at 0x7fdd54e86af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-416706008", "description": "tempest-description-1887450894"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:20.194365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:20.206933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb558aa6-d035-42c3-92d6-a59c1fbe24c3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.340404 Aug 03 04:41:20.208061 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1153/2352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:19 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:20.213934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:20.214193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:20.221333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:20.222127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:20.223062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:20.223812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:20.783096 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7df02465-6ac0-4a5e-b22e-42754c4dab11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.674939 Aug 03 04:41:20.784068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1200/2353] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:41:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:20.797348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa11925b-7a05-4f89-8620-6db4ee1f1c52 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Action: 'update', calling method: .version_select at 0x7fdd549a6a60>, body: {"security_group": {"name": "tempest-sg-hth-1141512168", "description": "tempest-description-hth-1654955060"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:20.848718 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f84bb49-3bd8-4ffb-b336-8bb456679cba tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 200 len: 1619 microversion: 2.1 time: 0.638981 Aug 03 04:41:20.849539 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1154/2354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:20 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 1619 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:20.879878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: .version_select at 0x7fdd540899d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2014245162", "policies": ["anti-affinity"]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:20.912244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:20.919802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:21.135427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:21.142385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:21.159688 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76388a69-4271-4a2d-8fc9-42ab768b3307 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.283647 Aug 03 04:41:21.160981 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1155/2355] 10.222.0.72 () {60 vars in 1174 bytes} [Wed Aug 3 04:41:20 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:41:21.209175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa11925b-7a05-4f89-8620-6db4ee1f1c52 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "PUT /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621" status: 200 len: 218 microversion: 2.1 time: 0.415527 Aug 03 04:41:21.209715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1201/2356] 10.222.0.72 () {60 vars in 1290 bytes} [Wed Aug 3 04:41:20 2022] PUT /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621 => generated 218 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:41:21.224258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dd70a36-5e7d-429f-8634-cebff3487007 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd54600a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:21.230630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:21.231368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:21.235376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:21.253726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:21.254192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:21.255031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:21.255690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:21.334242 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6dd70a36-5e7d-429f-8634-cebff3487007 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621" status: 200 len: 218 microversion: 2.1 time: 0.115147 Aug 03 04:41:21.334992 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1156/2357] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:41:21 2022] GET /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621 => generated 218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:21.349945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-968bf581-2e49-4364-9bcb-acabdb9cb869 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59e52c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:21.631173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:21.640789 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45847720-299a-49e8-924e-5394209f713e tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.415173 Aug 03 04:41:21.644523 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1202/2358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:21 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:21.669943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1952389060", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3d669fd0-b33e-4b0c-824e-215543d92634"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:21.758786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:41:22.035340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-968bf581-2e49-4364-9bcb-acabdb9cb869 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621" status: 202 len: 0 microversion: 2.1 time: 0.689462 Aug 03 04:41:22.037320 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1157/2359] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:21 2022] DELETE /compute/v2.1/os-security-groups/9d99ad52-ac15-4bca-8964-503f3dc03621 => generated 0 bytes in 693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:41:22.047662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.050407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:22.068006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.073683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.078154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.081186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.135206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 HTTP/1.1 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '705d83b8-26c6-4b03-bc01-d58b2b74a5d4'} Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:22.138545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.142164 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.151566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.153064 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90d53c6a-1c6e-4c74-affa-7abf239d24a1 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 404 len: 111 microversion: 2.1 time: 0.111798 Aug 03 04:41:22.159753 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1158/2360] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:41:22 2022] DELETE /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:22.165816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.170495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: 705d83b8-26c6-4b03-bc01-d58b2b74a5d4] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:22.181331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:41:22.181925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:41:22.182991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:41:22.183402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:41:22.184572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:41:22.191314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.192058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.193177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.193837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.220329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 HTTP/1.1 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '705d83b8-26c6-4b03-bc01-d58b2b74a5d4'} Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.222435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Instance 705d83b8-26c6-4b03-bc01-d58b2b74a5d4 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85b37f05-bc04-4e50-abc7-2db28ad937a6 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4" status: 404 len: 111 microversion: 2.1 time: 0.064808 Aug 03 04:41:22.232767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1159/2361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:22 2022] GET /compute/v2.1/servers/705d83b8-26c6-4b03-bc01-d58b2b74a5d4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:22.245106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.245570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.246695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.247448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.293877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:22.306397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:22.335162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 2 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:41:22.337780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:41:22.432037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c86d797a-915f-4046-89a9-25a395e26538 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-595383253", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:22.435692 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c86d797a-915f-4046-89a9-25a395e26538 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] HTTP exception thrown: min_count must be <= max_count Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c86d797a-915f-4046-89a9-25a395e26538 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Request method failure captured: Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 183 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxyZH9GwuuYXTO4U4Lg0kw_n_g6xpQ5WxdxzOjhI8uKeoZuUgN473uLyi-4HMLQusKkviJs03lLBCKEfe7m5h3ZbIvunlL9CHjjyk5yUDrDrwRIQOL4YPwhovTzTpfuvfTai9pQ-4qUkyvTOwlCgO8ToQOqkGUCmfoe3XO7y8ku2tA Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5239281d0ed14dcd9abffadec1251fcd Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-595383253", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: exception: min_count must be <= max_count Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-595383253', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 03 04:41:22.437224 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.446295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c86d797a-915f-4046-89a9-25a395e26538 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Returning 400 to user: min_count must be <= max_count {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.446295 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c86d797a-915f-4046-89a9-25a395e26538 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.210612 Aug 03 04:41:22.446295 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1160/2362] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:22 2022] POST /compute/v2.1/servers => generated 74 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:41:22.449190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59e52c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.505006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:22.505772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 929299b1-53ac-43e9-b2fc-94644bb03906 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:22.506344 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.506344 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906 HTTP/1.1 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '929299b1-53ac-43e9-b2fc-94644bb03906'} Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:22.508525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 929299b1-53ac-43e9-b2fc-94644bb03906 does not exist Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-f89b80b2-3008-4bb4-a136-09ec4e60d8c7'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c517910f-51bf-4a1d-bce4-0206bcc8efb7 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906" status: 404 len: 194 microversion: 2.1 time: 0.069615 Aug 03 04:41:22.513041 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1161/2363] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:22 2022] DELETE /compute/v2.1/os-security-groups/929299b1-53ac-43e9-b2fc-94644bb03906 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:22.580356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.582339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.582806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.583628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.584100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.601298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120832) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 03 04:41:22.613044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c32cd0fb-2068-4497-8c27-8db8885c9547 tempest-AZV2TestJSON-2057265650 tempest-AZV2TestJSON-2057265650-project] 10.222.0.72 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.100857 Aug 03 04:41:22.613952 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1162/2364] 10.222.0.72 () {58 vars in 1164 bytes} [Wed Aug 3 04:41:22 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:41:22.618853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ace026f-d3aa-4133-a6a5-b29c9d2d503d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-550444969", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "max_count": 0}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ace026f-d3aa-4133-a6a5-b29c9d2d503d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Request method failure captured: Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 167 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxyZH9GwuuYXTO4U4Lg0kw_n_g6xpQ5WxdxzOjhI8uKeoZuUgN473uLyi-4HMLQusKkviJs03lLBCKEfe7m5h3ZbIvunlL9CHjjyk5yUDrDrwRIQOL4YPwhovTzTpfuvfTai9pQ-4qUkyvTOwlCgO8ToQOqkGUCmfoe3XO7y8ku2tA Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5239281d0ed14dcd9abffadec1251fcd Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-550444969", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "max_count": 0}} Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-550444969', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'max_count': 0}}} Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 0 Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:22.632181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ace026f-d3aa-4133-a6a5-b29c9d2d503d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.639340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ace026f-d3aa-4133-a6a5-b29c9d2d503d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018814 Aug 03 04:41:22.640720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:22.655125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:22.677950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1163/2365] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:22.703634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd546001f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.759605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:22.760369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 7225c398-3096-47eb-b40a-974b48f86566 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:22.761218 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.761218 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566 HTTP/1.1 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '7225c398-3096-47eb-b40a-974b48f86566'} Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:22.763587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 7225c398-3096-47eb-b40a-974b48f86566 does not exist Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-5216b4b4-b438-4e12-a061-296c2c8313cd'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5ec49ee-d5ff-4cd4-8b65-c74157106bc4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566" status: 404 len: 194 microversion: 2.1 time: 0.086503 Aug 03 04:41:22.773283 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1164/2366] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:22 2022] DELETE /compute/v2.1/os-security-groups/7225c398-3096-47eb-b40a-974b48f86566 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:22.778187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:22.778929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:22.786539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.787190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.788046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:22.788718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:22.871788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:22.880656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:22.900224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=8f060dda-f7ee-4523-84c8-8efa336e4512,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:41:23.079886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:23.094540 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26b655e1-251e-490a-8e48-de65ff9acfc6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.327175 Aug 03 04:41:23.095699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1165/2367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:22 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:23.102334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59d62a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.149470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:23.150491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 88707a39-aaf4-4114-9f9d-178b491bfc19 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:23.151886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.151886 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19 HTTP/1.1 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '88707a39-aaf4-4114-9f9d-178b491bfc19'} Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:23.155716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 88707a39-aaf4-4114-9f9d-178b491bfc19 does not exist Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-6d335d55-334f-4934-aac0-d6bf3e2fa9b9'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c959754-2a79-4b7c-a217-636803593256 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19" status: 404 len: 194 microversion: 2.1 time: 0.061117 Aug 03 04:41:23.160570 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1166/2368] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:23 2022] DELETE /compute/v2.1/os-security-groups/88707a39-aaf4-4114-9f9d-178b491bfc19 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:23.169294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:23.176165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee8bfd42-c14b-4264-9d0d-1f02a4d2fa07 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1688880982", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "max_count": 2.5}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:23.186826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee8bfd42-c14b-4264-9d0d-1f02a4d2fa07 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Request method failure captured: Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 170 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxyZH9GwuuYXTO4U4Lg0kw_n_g6xpQ5WxdxzOjhI8uKeoZuUgN473uLyi-4HMLQusKkviJs03lLBCKEfe7m5h3ZbIvunlL9CHjjyk5yUDrDrwRIQOL4YPwhovTzTpfuvfTai9pQ-4qUkyvTOwlCgO8ToQOqkGUCmfoe3XO7y8ku2tA Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5239281d0ed14dcd9abffadec1251fcd Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1688880982", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "max_count": 2.5}} Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1688880982', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'max_count': 2.5}}} Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 2.5 Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:23.189100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee8bfd42-c14b-4264-9d0d-1f02a4d2fa07 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.195053 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee8bfd42-c14b-4264-9d0d-1f02a4d2fa07 tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029996 Aug 03 04:41:23.208238 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1167/2369] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:23.225100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd546001f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.311499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:23.312181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group caafd85d-c491-4aa9-af09-9cbd12583b6f not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:23.312794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.312794 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f HTTP/1.1 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'caafd85d-c491-4aa9-af09-9cbd12583b6f'} Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:23.319823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group caafd85d-c491-4aa9-af09-9cbd12583b6f does not exist Aug 03 04:41:23.324030 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-93a7dbe7-767c-4901-ab1d-f175da041642'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.332834 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-214d97d5-f575-4042-b234-8af73153fdca tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f" status: 404 len: 194 microversion: 2.1 time: 0.126376 Aug 03 04:41:23.332834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1168/2370] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:23 2022] DELETE /compute/v2.1/os-security-groups/caafd85d-c491-4aa9-af09-9cbd12583b6f => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:23.338941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71893d9c-9987-4533-b887-66baf360ca7d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034498894", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 0}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71893d9c-9987-4533-b887-66baf360ca7d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Request method failure captured: Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 168 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fxyZH9GwuuYXTO4U4Lg0kw_n_g6xpQ5WxdxzOjhI8uKeoZuUgN473uLyi-4HMLQusKkviJs03lLBCKEfe7m5h3ZbIvunlL9CHjjyk5yUDrDrwRIQOL4YPwhovTzTpfuvfTai9pQ-4qUkyvTOwlCgO8ToQOqkGUCmfoe3XO7y8ku2tA Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5239281d0ed14dcd9abffadec1251fcd Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1034498894", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 0}} Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1034498894', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'min_count': 0}}} Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 0 Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:23.344948 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 03 04:41:23.350789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.352582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71893d9c-9987-4533-b887-66baf360ca7d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.354058 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71893d9c-9987-4533-b887-66baf360ca7d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022534 Aug 03 04:41:23.355156 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1169/2371] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:23.362265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd540a6a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.387498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:23.388605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group 6cc82a41-e096-42bf-a76f-1752a021a277 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:23.389286 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.389286 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277 HTTP/1.1 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '6cc82a41-e096-42bf-a76f-1752a021a277'} Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:23.391627 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] Aug 03 04:41:23.395066 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.403697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group 6cc82a41-e096-42bf-a76f-1752a021a277 does not exist Aug 03 04:41:23.403697 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-c6ed978a-1045-4f1f-8dda-145bb254d6b6'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.404799 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40c10355-4aa0-48ad-afc4-e00d7c52676c tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277" status: 404 len: 194 microversion: 2.1 time: 0.047225 Aug 03 04:41:23.410008 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1170/2372] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:23 2022] DELETE /compute/v2.1/os-security-groups/6cc82a41-e096-42bf-a76f-1752a021a277 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:23.414184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59d62940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.432015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:23.443608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'server_group_members'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:23.448582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:41:23.449201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Neutron security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 not found {{(pid=120831) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:41:23.450054 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.450054 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 HTTP/1.1 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: exception: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1'} Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:41:23.453220 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] Aug 03 04:41:23.456726 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.460639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Security group a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 does not exist Aug 03 04:41:23.460639 n-d-826756-5 devstack@n-api.service[120831]: Neutron server returns request_ids: ['req-be903da1-4bdb-4b19-b5a0-4da0027e90ce'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.462774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d6dcbf8-ef21-4aa2-a0ca-241f2cfc1dcd tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1" status: 404 len: 194 microversion: 2.1 time: 0.051494 Aug 03 04:41:23.467824 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1171/2373] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:23 2022] DELETE /compute/v2.1/os-security-groups/a64dd34b-9b30-48f2-a9d9-a6a4ee2433d1 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:23.476588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.483636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:23.501035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:23.502537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:23.505629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:23.508098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:23.569928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37f64b7c-6bbf-4034-b53b-846faafdebc3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.908230 Aug 03 04:41:23.572712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:41:23.573581 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1203/2374] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1913 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:41:23.584586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.611371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:23.612211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Searching by: {'deleted': False, 'project_id': '18f6f7ad49364611aa364991953d58fa'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:41:23.643601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:23.643601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:23.643601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:23.643601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:23.675963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:41:23.725746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80ab3333-950e-433f-b49d-1ae34a1f6848 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.146812 Aug 03 04:41:23.727281 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1204/2375] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:41:23 2022] GET /compute/v2.1/servers => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:23.736446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc9022a0-1a9a-42d8-8de1-7c487180361d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-201136787", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 2.5}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc9022a0-1a9a-42d8-8de1-7c487180361d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Request method failure captured: Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 169 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fxyZH9GwuuYXTO4U4Lg0kw_n_g6xpQ5WxdxzOjhI8uKeoZuUgN473uLyi-4HMLQusKkviJs03lLBCKEfe7m5h3ZbIvunlL9CHjjyk5yUDrDrwRIQOL4YPwhovTzTpfuvfTai9pQ-4qUkyvTOwlCgO8ToQOqkGUCmfoe3XO7y8ku2tA Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b2fe41bd3b68462f877f29b2330d8218"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b2fe41bd3b68462f877f29b2330d8218 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1067736408 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5239281d0ed14dcd9abffadec1251fcd Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1067736408-project Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-201136787", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 2.5}} Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-201136787', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'min_count': 2.5}}} Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 2.5 Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:41:23.743682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 03 04:41:23.748230 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:23.749239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc9022a0-1a9a-42d8-8de1-7c487180361d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:23.750658 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc9022a0-1a9a-42d8-8de1-7c487180361d tempest-MultipleCreateNegativeTestJSON-1067736408 tempest-MultipleCreateNegativeTestJSON-1067736408-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021602 Aug 03 04:41:23.756056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1205/2376] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:41:23.763532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-843b18d2-6f26-4edd-91cb-04e155b5067f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:23.764551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-843b18d2-6f26-4edd-91cb-04e155b5067f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:24.006751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-843b18d2-6f26-4edd-91cb-04e155b5067f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:24.017406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-843b18d2-6f26-4edd-91cb-04e155b5067f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1219 microversion: 2.1 time: 0.260051 Aug 03 04:41:24.018557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1206/2377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:23 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1219 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:24.088549 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ad9c44e-9a65-4975-aba6-5127cb5e4c16 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 204 len: 0 microversion: 2.1 time: 0.619026 Aug 03 04:41:24.090443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1172/2378] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:41:23 2022] DELETE /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:41:24.102284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:24.103060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:24.122316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:24.122963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:24.123392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:24.123983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:24.126874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:24.128121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:24.135900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:24.136382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:24.138339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:24.138792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:25.013211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:25.019298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:25.021818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ffc40bb-cf8d-48d1-a2e7-3d0e343e4b11 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1645 microversion: 2.1 time: 0.925468 Aug 03 04:41:25.022413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1207/2379] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:24 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1645 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:25.028315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fce19627-6d2a-4c9d-9107-a17e588949cd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.911438 Aug 03 04:41:25.044677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1173/2380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:24 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:25.049496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1744c5fc-e2fb-4def-b403-6b5e7c37972c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:25.050122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1744c5fc-e2fb-4def-b403-6b5e7c37972c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:25.322276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1744c5fc-e2fb-4def-b403-6b5e7c37972c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:25.329944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1744c5fc-e2fb-4def-b403-6b5e7c37972c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1219 microversion: 2.1 time: 0.289613 Aug 03 04:41:25.333384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1208/2381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:25 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1219 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:26.046461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:26.047080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:26.068758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:26.072915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:26.072915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:26.073105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:26.073516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:26.073591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:26.089018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:26.089528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:26.091233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:26.092170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:26.549938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:26.566955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:26.567363 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4062a22-4bac-4c77-b4b3-9583a7f79a8d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1392 microversion: 2.1 time: 0.500723 Aug 03 04:41:26.567363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1209/2382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:26 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1392 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:26.570533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b57e7839-4604-4690-a497-e1a4b18081ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:26.572199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b57e7839-4604-4690-a497-e1a4b18081ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:26.576373 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc694592-4602-4fe9-919c-07cb679e63d4 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1645 microversion: 2.1 time: 0.534765 Aug 03 04:41:26.591616 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1174/2383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:26 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1645 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:26.657983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b57e7839-4604-4690-a497-e1a4b18081ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:26.669932 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b57e7839-4604-4690-a497-e1a4b18081ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1219 microversion: 2.1 time: 0.107074 Aug 03 04:41:26.671508 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1210/2384] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:26 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:26.906856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4d2ada69-54a7-4bcb-b1b6-67ad63d4b3a7 req-df7b74a4-1253-450f-b882-49272b4903b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6461964-1030-4ecb-9a84-51505a6bfa23", "name": "network-vif-deleted", "tag": "b2dd659f-bcd2-4d9c-8e12-e047606a00b9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:26.919403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4d2ada69-54a7-4bcb-b1b6-67ad63d4b3a7 req-df7b74a4-1253-450f-b882-49272b4903b8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:26.920090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4d2ada69-54a7-4bcb-b1b6-67ad63d4b3a7 req-df7b74a4-1253-450f-b882-49272b4903b8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:26.933236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4d2ada69-54a7-4bcb-b1b6-67ad63d4b3a7 req-df7b74a4-1253-450f-b882-49272b4903b8 service nova] Creating event network-vif-deleted:b2dd659f-bcd2-4d9c-8e12-e047606a00b9 for instance d6461964-1030-4ecb-9a84-51505a6bfa23 on n-h1-826756-5 Aug 03 04:41:26.939706 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4d2ada69-54a7-4bcb-b1b6-67ad63d4b3a7 req-df7b74a4-1253-450f-b882-49272b4903b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Aug 03 04:41:26.945507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1175/2385] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:41:27.588943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:27.590447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:27.602010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:27.606580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:27.616879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:27.617598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:27.649548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:27.871702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:27.908570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-883d9ab4-9174-4754-b953-c2062641b6fa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1382 microversion: 2.1 time: 0.301338 Aug 03 04:41:27.908570 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1176/2386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:27 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1382 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:27.908570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:27.908570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:27.910394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:27.911125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:27.912093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:27.912899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:27.983033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:27.983702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:27.984235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lazy-loading 'fault' on Instance uuid d6461964-1030-4ecb-9a84-51505a6bfa23 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:41:28.179033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-177930278", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "7355cd35-092d-4804-b996-5025b03fa6a9"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55543d8f640640039b72d044a49ba779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf2b285affb34cb8b6c589a68e658714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63af6979-1bff-4e3a-8977-329d15254adf tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 200 len: 1306 microversion: 2.1 time: 0.194042 Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1177/2387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:27 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 1306 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.180997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.182834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] validate_networks() for [('7355cd35-092d-4804-b996-5025b03fa6a9', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:41:28.197291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:28.205850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82f062ba-7ebc-4bec-981b-5315c446b4fa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1215 microversion: 2.1 time: 0.122187 Aug 03 04:41:28.207054 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1178/2388] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:28 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:28.228764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90c04ea6-8d53-4869-9734-5662aade65d6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '.version_select at 0x7fdd546150d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:28.235642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c04ea6-8d53-4869-9734-5662aade65d6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.236459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c04ea6-8d53-4869-9734-5662aade65d6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.252742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90c04ea6-8d53-4869-9734-5662aade65d6 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.044373 Aug 03 04:41:28.263354 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1179/2389] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:41:28 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:28.268303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:28.268928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:28.275399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.280008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.280008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.280008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.826158 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9d01cb8-36c0-493b-b4ef-78c8cbd0ddd1 tempest-LiveMigrationTest-1670953419 tempest-LiveMigrationTest-1670953419-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1533 microversion: 2.1 time: 0.561392 Aug 03 04:41:28.831607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1180/2390] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:28 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1533 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:28.873770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:28.878559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:28.888147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.888976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.889986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:28.891212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:28.926352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:41:29.594946 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-25b9fc18-469e-42e0-a968-494829c0b3e3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 204 len: 0 microversion: 2.1 time: 0.725641 Aug 03 04:41:29.596336 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1181/2391] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:41:28 2022] DELETE /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:41:29.604870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:29.606721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] [instance: d6461964-1030-4ecb-9a84-51505a6bfa23] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:29.622660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.622660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.622660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.624896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.643952 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] HTTP exception thrown: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Request method failure captured: Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 HTTP/1.1 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fv3mrwGKKWT-JRzqgZ8zLKajHmlUJCm1eq9M5pJB8uFk8-mCEiqJ36Rw5ZBnE-6DJ6Cjy5K07EqvclTThqijlhxNoMCmvOt88sPdViMI0hRf-14idWC-bl6Gf9WKbHrLr6YuXR3sAHJYYTwbevuihwk6AWL71gIjhvxie95XZIXmyU Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf2b285affb34cb8b6c589a68e658714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf2b285affb34cb8b6c589a68e658714 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-986967010 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 55543d8f640640039b72d044a49ba779 Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-SecurityGroupsTestJSON-986967010-project Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd6461964-1030-4ecb-9a84-51505a6bfa23'} Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:29.646727 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Returning 404 to user: Instance d6461964-1030-4ecb-9a84-51505a6bfa23 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d72375a-eb4f-4194-bd85-fe6ff0af1d44 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23" status: 404 len: 111 microversion: 2.1 time: 0.050637 Aug 03 04:41:29.654201 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1182/2392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:29 2022] GET /compute/v2.1/servers/d6461964-1030-4ecb-9a84-51505a6bfa23 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:29.659275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:29.660401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:29.668753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.669605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.670781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.671705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.694377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:41:29.694958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:41:29.695413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:41:29.696066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:41:29.696545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:41:29.714029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.715284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.720446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.721139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.766400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:29.783275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for user dcb77614e0f94653a93492f3f31b9dae and project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:29.797033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:29.809001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:41:29.813142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:41:29.844413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:29.852005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9cb67080-1a5c-4ec9-b1d3-cee6f45b4891 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1271 microversion: 2.1 time: 0.201330 Aug 03 04:41:29.865949 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1183/2393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:29 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:29.865949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:29.866253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:29.872811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.873322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:29.874175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:29.874674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:30.018995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:30.031089 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e252792c-2def-49dc-8530-733be180ce51 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1388 microversion: 2.1 time: 0.169367 Aug 03 04:41:30.032442 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1184/2394] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:29 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:30.038665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e21c6e90-2119-48f5-8c60-ddaaaaf2670a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd59cd5700>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:30.038849 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e53e485a-2db0-408e-a67e-e0a80adad840 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538992 Aug 03 04:41:30.039829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1211/2395] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:41:30.063262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8947e180-be99-4ef7-87d4-022c13c18dbb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:30.064713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8947e180-be99-4ef7-87d4-022c13c18dbb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:30.287971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8947e180-be99-4ef7-87d4-022c13c18dbb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:30.302715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=65 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:30.327391 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8947e180-be99-4ef7-87d4-022c13c18dbb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1217 microversion: 2.1 time: 0.273247 Aug 03 04:41:30.328378 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1212/2396] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:30 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:30.790303 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e21c6e90-2119-48f5-8c60-ddaaaaf2670a tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/bdd3a856-9750-4344-89ca-59a283a28042" status: 202 len: 0 microversion: 2.1 time: 0.755920 Aug 03 04:41:30.791276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1185/2397] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:30 2022] DELETE /compute/v2.1/os-security-groups/bdd3a856-9750-4344-89ca-59a283a28042 => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:30.801842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8d627da-aed8-4f19-9b83-8dbdf10402e9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] Calling method '.version_select at 0x7fdd549acd30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:30.877982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:30.880416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:30.889238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:30.889932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:30.890918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:30.891563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:31.040602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:31.096020 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a91a081e-ce3c-4ee8-80f7-2db1a6e2f5fb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1289 microversion: 2.1 time: 0.219965 Aug 03 04:41:31.097367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1186/2398] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:30 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1289 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:31.117869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:31.120604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:31.151048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:31.154648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:31.156907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:31.160105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:31.164714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:32.380143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:32.405337 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3db8c36-eca1-4dad-9c87-992c05bcd6c5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1388 microversion: 2.1 time: 1.305879 Aug 03 04:41:32.405948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1187/2399] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:31 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1388 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:32.426816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:32.427528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:32.449468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:32.450150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:32.450978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:32.451429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:32.579587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:32.604112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:32.606855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba35b324-c28a-42b5-98bb-fcee5d284ecc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1221 microversion: 2.1 time: 0.196811 Aug 03 04:41:32.624176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1188/2400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:32 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:32.637407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:32.643395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:32.644432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8d627da-aed8-4f19-9b83-8dbdf10402e9 tempest-SecurityGroupsTestJSON-986967010 tempest-SecurityGroupsTestJSON-986967010-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/7fa09c0d-143d-4990-a091-349b3bf4e423" status: 202 len: 0 microversion: 2.1 time: 1.848174 Aug 03 04:41:32.649293 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1213/2401] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:41:30 2022] DELETE /compute/v2.1/os-security-groups/7fa09c0d-143d-4990-a091-349b3bf4e423 => generated 0 bytes in 1854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:41:32.664558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:32.665019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:32.673328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:32.674120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.023524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:33.038060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc2e5c8b-dc7f-4880-8527-247a7fec0859 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.411368 Aug 03 04:41:33.039924 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1189/2402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:32 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:33.303629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e3e5abd-69c3-45a5-b006-201d04abd91c tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] Calling method '.version_select at 0x7fdd54e16d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:33.367535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e3e5abd-69c3-45a5-b006-201d04abd91c tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] 10.222.0.72 "GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464" status: 200 len: 784 microversion: 2.1 time: 0.247867 Aug 03 04:41:33.369238 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1214/2403] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:41:33 2022] GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464 => generated 784 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:33.391356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f945e768-0899-4709-a9de-600c2539f51b tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] Calling method '.version_select at 0x7fdd59d6c310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:33.430923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:33.431569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:33.442140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:33.442974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.450729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:33.451451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.546547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f945e768-0899-4709-a9de-600c2539f51b tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] 10.222.0.72 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.160239 Aug 03 04:41:33.557230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1190/2404] 10.222.0.72 () {58 vars in 1122 bytes} [Wed Aug 3 04:41:33 2022] GET /compute/v2.1/images => generated 445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:33.566079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-00d5c170-cfc1-4f03-b0af-635196d88646 req-86213b84-e2c4-4bdd-aa75-01db50cc46e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7db61f-e37d-456c-86e2-324f0ff8ae27", "name": "network-vif-deleted", "tag": "0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:33.580017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-00d5c170-cfc1-4f03-b0af-635196d88646 req-86213b84-e2c4-4bdd-aa75-01db50cc46e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:33.580866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-00d5c170-cfc1-4f03-b0af-635196d88646 req-86213b84-e2c4-4bdd-aa75-01db50cc46e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.595671 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-00d5c170-cfc1-4f03-b0af-635196d88646 req-86213b84-e2c4-4bdd-aa75-01db50cc46e6 service nova] Creating event network-vif-deleted:0bde5faf-7ad4-46ce-82cf-7c0b32f5b09e for instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 on n-h2-826756-5 Aug 03 04:41:33.602520 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-00d5c170-cfc1-4f03-b0af-635196d88646 req-86213b84-e2c4-4bdd-aa75-01db50cc46e6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043088 Aug 03 04:41:33.604799 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1191/2405] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:33.621589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:33.638264 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf399b42-dbe5-449b-a740-87254de2d537 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1346 microversion: 2.1 time: 0.211673 Aug 03 04:41:33.640417 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1215/2406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:33 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:33.641348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b13d351-0e90-4966-be7d-beb9d2646e5d tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] Calling method '.version_select at 0x7fdd59d62d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:33.650254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:33.650868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:33.684162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:33.685250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.687899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:33.689363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:33.740976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b13d351-0e90-4966-be7d-beb9d2646e5d tempest-ListImagesTestJSON-879860041 tempest-ListImagesTestJSON-879860041-project] 10.222.0.72 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.133621 Aug 03 04:41:33.742149 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1192/2407] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 04:41:33 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:33.830314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:33.857744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5abce6d-4fed-4641-916b-4575edc31805 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1269 microversion: 2.1 time: 0.215828 Aug 03 04:41:33.858822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1216/2408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:33 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1269 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:34.064157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:34.064959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:34.085318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:34.093244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.096167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:34.098185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.105929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:34.664767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:34.665382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:34.679515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.681760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:34.685243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.686121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:34.885498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:34.896367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-158da25f-8dc2-4087-82d3-de01c1b5a843 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1184 microversion: 2.1 time: 0.235353 Aug 03 04:41:34.896965 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1217/2409] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:34 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1184 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:34.901519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:34.909681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:34.911348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:34.919750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5acf495f-a0be-47a6-a697-1fbc3d3beac1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.861127 Aug 03 04:41:34.920757 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1193/2410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:34 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:34.928528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.928989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:34.929823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:34.932603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:35.049203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:35.065063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff44623a-8094-4a62-b6c4-1c7f68c5eb28 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1275 microversion: 2.1 time: 0.166966 Aug 03 04:41:35.067096 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1218/2411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:34 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:35.363227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7cf09430-b096-45f7-9cf2-0ff47e39bf08 req-db2a71ef-160f-4a9a-9782-aa0c992798db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f060dda-f7ee-4523-84c8-8efa336e4512", "tag": "fa61412c-bfdb-486c-99f5-b31d8c5aa763"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:35.378150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7cf09430-b096-45f7-9cf2-0ff47e39bf08 req-db2a71ef-160f-4a9a-9782-aa0c992798db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:35.378742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7cf09430-b096-45f7-9cf2-0ff47e39bf08 req-db2a71ef-160f-4a9a-9782-aa0c992798db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:35.391077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7cf09430-b096-45f7-9cf2-0ff47e39bf08 req-db2a71ef-160f-4a9a-9782-aa0c992798db service nova] Creating event network-changed:fa61412c-bfdb-486c-99f5-b31d8c5aa763 for instance 8f060dda-f7ee-4523-84c8-8efa336e4512 on n-h1-826756-5 Aug 03 04:41:35.396047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7cf09430-b096-45f7-9cf2-0ff47e39bf08 req-db2a71ef-160f-4a9a-9782-aa0c992798db service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049223 Aug 03 04:41:35.397056 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1194/2412] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:35.917681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:35.920724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:35.928207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:35.930461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:35.930461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:35.930461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:35.942825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:35.944139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:35.958024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:35.960804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:35.964854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:35.964854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:36.516525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:36.529601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-704ec8d9-4bcf-4c48-b84e-783f7db88007 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1184 microversion: 2.1 time: 0.614259 Aug 03 04:41:36.530157 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1219/2413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:35 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1184 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:36.547126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:36.547581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:36.556417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:36.557329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:36.558576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:36.559882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:36.649916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:36.666069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efb5e030-d466-4061-ad22-c64f8d1e1e80 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.726387 Aug 03 04:41:36.666720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1195/2414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:35 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:36.814478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:36.822666 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cd34049-7546-4f31-9f99-56a46a79f572 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1275 microversion: 2.1 time: 0.289216 Aug 03 04:41:36.829543 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1220/2415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:36 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:37.558845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:37.559647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:37.592387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-127fb1db-6d68-4afa-924a-10442e1ce708 req-43fc052f-1b7a-4fb7-a5c0-a90da5122867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d78b208-4450-45bf-bc8f-284106dcf83d", "tag": "08187d7b-97eb-4f09-ade2-fe72e3f3e298"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:37.618209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:37.619390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:37.623102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:37.624027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:37.642646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-127fb1db-6d68-4afa-924a-10442e1ce708 req-43fc052f-1b7a-4fb7-a5c0-a90da5122867 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:37.644613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-127fb1db-6d68-4afa-924a-10442e1ce708 req-43fc052f-1b7a-4fb7-a5c0-a90da5122867 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:37.704115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-127fb1db-6d68-4afa-924a-10442e1ce708 req-43fc052f-1b7a-4fb7-a5c0-a90da5122867 service nova] Creating event network-changed:08187d7b-97eb-4f09-ade2-fe72e3f3e298 for instance 6d78b208-4450-45bf-bc8f-284106dcf83d on n-h2-826756-5 Aug 03 04:41:37.748502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-127fb1db-6d68-4afa-924a-10442e1ce708 req-43fc052f-1b7a-4fb7-a5c0-a90da5122867 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149358 Aug 03 04:41:37.757810 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1221/2416] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:37.767244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:37.768788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:37.776769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:37.777502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:37.778504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:37.779102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:38.110114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:38.118130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:38.131372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d30cbacc-18ce-4af3-b2aa-5590e8cc3fdf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1184 microversion: 2.1 time: 0.580283 Aug 03 04:41:38.135559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1196/2417] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:37 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1184 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:38.152312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:38.153116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:38.177475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:38.178673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:38.182343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:38.184572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:38.672543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:38.681974 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23c42daa-caa6-4706-acb8-e504769fcd98 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.919034 Aug 03 04:41:38.685249 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1222/2418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:37 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:38.828488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:38.838640 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-facd0da4-c882-4242-aead-2e0c95d6ea4c tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.698206 Aug 03 04:41:38.842781 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1197/2419] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:38 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:39.160152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:39.161932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:39.188863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.192584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.200991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.201502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.263453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:39.379389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:39.395671 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-74784351-5cb3-4eb9-ad81-44b7859dfbaf tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1184 microversion: 2.1 time: 0.244784 Aug 03 04:41:39.396570 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1223/2420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:39 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1184 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:39.507099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Calling method '.version_select at 0x7fdd54089160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:39.522943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.523870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.524907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.525721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.553700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49e83453-3d7e-4917-b1ab-afd59f31635d tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] 10.222.0.72 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.253708 Aug 03 04:41:39.571031 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1198/2421] 10.222.0.72 () {58 vars in 1122 bytes} [Wed Aug 3 04:41:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:39.647633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-66653542", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:39.705866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:39.708014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:39.730284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:39.746415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.749716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.759030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:39.760431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:39.797868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:41:40.076911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:40.093205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c079ea7b-884c-44cc-a5de-c51f1d39f399 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.387074 Aug 03 04:41:40.093342 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1199/2422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:39 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:40.103277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:40.105971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:40.122277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:40.124598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:40.126587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:40.127978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:40.317342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Getting quotas for project 712015b190f24248951d4a680688e495. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:40.339760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Getting quotas for user 8d5bfbfd645c47a18bb696a42bdd8698 and project 712015b190f24248951d4a680688e495. Resources: dict_keys(['metadata_items']) {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:40.389409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:40.394561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 03 04:41:40.402952 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b725e675-4cc0-4f89-b153-1995dd51f2d6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.308258 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Request method failure captured: Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 1750 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fyDjwG9GnkRVYZgODsK3prxv2sJB3yo2NI3V5qu9ggs3ezaP2Jk4S8dKXGCf1W9VZbK7gAI3WOkg6_UJQFPKaBS4V82FDT-Xgs0BkG8eEQVslB8aomOgTwSxXmQR4XWyRla5dFbKuYLuzUx2Sh7SZ_d4h-3AJ_Zy_9g7MLCxFA09LA Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 712015b190f24248951d4a680688e495 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1053719748 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/712015b190f24248951d4a680688e495"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/712015b190f24248951d4a680688e495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_712015b190f24248951d4a680688e495"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/712015b190f24248951d4a680688e495"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1053719748 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 712015b190f24248951d4a680688e495 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1053719748 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 8d5bfbfd645c47a18bb696a42bdd8698 Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-66653542", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:41:40.407564 n-d-826756-5 devstack@n-api.service[120832]: exception: Maximum number of metadata items exceeds 128 Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-66653542', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:40.409975 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 03 04:41:40.412474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:40.415398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:40.416545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ff3a38f-5fa8-4db4-867d-468e4d4040e1 tempest-AbsoluteLimitsNegativeTestJSON-1053719748 tempest-AbsoluteLimitsNegativeTestJSON-1053719748-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.780049 Aug 03 04:41:40.418447 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1224/2424] 10.222.0.72 () {60 vars in 1148 bytes} [Wed Aug 3 04:41:39 2022] POST /compute/v2.1/servers => generated 87 bytes in 783 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:41:40.425458 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1200/2424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:40 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:40.429391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f75ccc82-b24e-4c94-b1a3-43b034e0a27d req-08ceae5a-3ebe-41f1-b65f-d18a7f32f3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42553f0f-11ef-47c7-83e0-a18390d947c9", "tag": "ebff0715-8ab9-4359-a02d-421e37dd67ed"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:40.442606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:40.445343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:40.456210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f75ccc82-b24e-4c94-b1a3-43b034e0a27d req-08ceae5a-3ebe-41f1-b65f-d18a7f32f3d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:40.458423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f75ccc82-b24e-4c94-b1a3-43b034e0a27d req-08ceae5a-3ebe-41f1-b65f-d18a7f32f3d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:40.467530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:40.470191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:40.472092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:40.473817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:40.479340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f75ccc82-b24e-4c94-b1a3-43b034e0a27d req-08ceae5a-3ebe-41f1-b65f-d18a7f32f3d2 service nova] Creating event network-changed:ebff0715-8ab9-4359-a02d-421e37dd67ed for instance 42553f0f-11ef-47c7-83e0-a18390d947c9 on n-h1-826756-5 Aug 03 04:41:40.489687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f75ccc82-b24e-4c94-b1a3-43b034e0a27d req-08ceae5a-3ebe-41f1-b65f-d18a7f32f3d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067061 Aug 03 04:41:40.490300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1201/2425] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:40.676137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:40.687489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7bb32c4c-3420-4da2-8558-c0658895ffb5 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1184 microversion: 2.1 time: 0.258325 Aug 03 04:41:40.688293 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1225/2426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:40 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1184 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:41.119771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:41.121607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:41.139380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.139927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.142081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.142662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.426467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:41.426908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:41.473018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.476593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.477866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.478695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.530549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:41.543065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ea27727-477b-4f45-9a29-f90054e24db4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.431468 Aug 03 04:41:41.544346 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1202/2427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:41 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:41.712914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:41.714967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:41.721520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.722312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.723331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.730926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.795564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:41.796478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:41.797212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lazy-loading 'fault' on Instance uuid 9e7db61f-e37d-456c-86e2-324f0ff8ae27 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:41:41.918260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:41.929617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b90994e1-4aca-45b0-8448-1d64de65a4dc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.507597 Aug 03 04:41:41.930094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1226/2428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:41 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:41.941501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:41.955777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9785b0ba-3b39-4bea-a40d-bd7cc29d51d6 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 200 len: 1189 microversion: 2.1 time: 0.245010 Aug 03 04:41:41.969475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1203/2429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:41 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 1189 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:42.569581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:42.573871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:42.584698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:42.585205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:42.586034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:42.586737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:42.953327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:42.954242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:42.969524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:42.970950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:42.972766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:42.974186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:43.855169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:43.875487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c937d6e-e4db-43ea-b112-17662d1f05cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 1.309769 Aug 03 04:41:43.887585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1227/2430] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:42 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:43.900250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:43.901943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9e7db61f-e37d-456c-86e2-324f0ff8ae27] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:43.922981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:43.923804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:43.924953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:43.926521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:43.967794 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] HTTP exception thrown: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Request method failure captured: Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 HTTP/1.1 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frLdTzjkTzuCRrb-VtiwSpuw1fbfIsdPpMAqcXPtlBLVs2bfpVk7qMGD6ZWVKSpdU_Brx3x1xslz3IhzKrb1acyTug9Okf7121E9KopjGLlYaD0THuLPUHxLOkgdPcNYlE-ztRatKsUwAYnXsuuAzJgAoaLidITMAULgFkPYYGSBrY Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveMigrationTest-108703051 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveMigrationTest-108703051-project Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ef84ed9611c449ec8ee31cf936faeb75 Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveMigrationTest-108703051-project Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9e7db61f-e37d-456c-86e2-324f0ff8ae27'} Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:41:43.970616 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Returning 404 to user: Instance 9e7db61f-e37d-456c-86e2-324f0ff8ae27 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:41:43.985892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c10a6ad-a3e5-4424-b024-04c5f057ce9a tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27" status: 404 len: 111 microversion: 2.1 time: 0.095031 Aug 03 04:41:43.991024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1228/2431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:43 2022] GET /compute/v2.1/servers/9e7db61f-e37d-456c-86e2-324f0ff8ae27 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:41:44.126915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:44.160911 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d5ce7a4-821e-4509-9c41-f943c581ebb1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 1.192774 Aug 03 04:41:44.162093 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1204/2432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:42 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:44.906911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:44.908119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:44.924785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:44.925856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:44.926970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:44.929476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:45.174429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:45.175452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:45.207130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:45.210740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:45.213320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:45.214670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:45.330838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:45.346840 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cba24528-a8cf-4d77-a800-d902dcdcbb36 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.442121 Aug 03 04:41:45.352443 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1229/2433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:44 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:45.631309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:45.644061 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d536dec-55bf-4e45-9185-770698fd05cb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.474176 Aug 03 04:41:45.656797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1205/2434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:45 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:46.367864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:46.368757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:46.379764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:46.384595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:46.386347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:46.387329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:46.661468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:46.671354 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3c1bed66-8d1e-4fb9-a08b-e422b10a2ec4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.308323 Aug 03 04:41:46.673772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:46.674959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:46.681011 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1230/2435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:46 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:46.720218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:46.720218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:46.720218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:46.728280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:47.001620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:47.019499 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85fd7788-bc9f-4c60-aec5-9ad890817ce6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.349651 Aug 03 04:41:47.022083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1206/2436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:46 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:47.046146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-312396563", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:47.182856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] validate_networks() for [('0cdc991e-0c09-4e1e-8d9d-7bc2ced8c554', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:41:47.697107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:47.697729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:47.724116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:47.724911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:47.728782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:47.730584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:48.273750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:48.290004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b467fd4d-eb1b-4ef2-a0b9-b66d667b6f15 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.598257 Aug 03 04:41:48.290623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1207/2437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:47 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:48.303643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:48.304552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:48.333715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:48.334565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:48.335577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:48.336202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:48.477847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:41:48.478391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:41:48.479599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:41:48.481258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:41:48.482133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:41:48.502742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:48.506205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:48.507312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:48.508137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:48.554041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Getting quotas for project b4cd12a3a4c342b2950043b47b7e39b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:41:48.567193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Getting quotas for user 73d83656153f465a9c1bee17b9195287 and project b4cd12a3a4c342b2950043b47b7e39b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:41:48.592042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:41:48.594417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:41:48.897795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96bf1104-6337-48cc-ab00-106e0c194679 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.118375 Aug 03 04:41:48.901493 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1231/2438] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:41:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:41:48.914124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0e9e3fb7-400a-4974-bd51-68ec1a7c254e req-704c78d7-2a6f-4830-88b6-65fb82df7f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d78b208-4450-45bf-bc8f-284106dcf83d", "name": "network-vif-plugged", "status": "completed", "tag": "08187d7b-97eb-4f09-ade2-fe72e3f3e298"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:48.918631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:48.934743 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-151c7adc-cc5d-4fb4-a516-4994793b3ba1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.639276 Aug 03 04:41:48.941344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1208/2439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:48 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:48.956401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b69f09bc-fe7f-43fc-8062-73528aa1da55 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:48.968519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0e9e3fb7-400a-4974-bd51-68ec1a7c254e req-704c78d7-2a6f-4830-88b6-65fb82df7f44 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:48.970343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b69f09bc-fe7f-43fc-8062-73528aa1da55 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:48.976720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0e9e3fb7-400a-4974-bd51-68ec1a7c254e req-704c78d7-2a6f-4830-88b6-65fb82df7f44 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:49.019079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0e9e3fb7-400a-4974-bd51-68ec1a7c254e req-704c78d7-2a6f-4830-88b6-65fb82df7f44 service nova] Creating event network-vif-plugged:08187d7b-97eb-4f09-ade2-fe72e3f3e298 for instance 6d78b208-4450-45bf-bc8f-284106dcf83d on n-h2-826756-5 Aug 03 04:41:49.038803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0e9e3fb7-400a-4974-bd51-68ec1a7c254e req-704c78d7-2a6f-4830-88b6-65fb82df7f44 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132113 Aug 03 04:41:49.042602 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1232/2440] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:49.140828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b69f09bc-fe7f-43fc-8062-73528aa1da55 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:49.166387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b69f09bc-fe7f-43fc-8062-73528aa1da55 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1213 microversion: 2.1 time: 0.223594 Aug 03 04:41:49.174815 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1209/2441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:48 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:49.311712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:49.312682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:49.321072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:49.324988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:49.326298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:49.331019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:49.748743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:49.758523 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ce07a1f-45a2-4b65-a728-6afe6f35acbc tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.451028 Aug 03 04:41:49.761220 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1233/2442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:49 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:49.967898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:49.968725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:49.972061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:49.988075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:49.990754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:49.993243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:49.993752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:50.195304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ac4af2e-f142-4f1a-8a45-c8946e7582de tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:50.196229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ac4af2e-f142-4f1a-8a45-c8946e7582de tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:50.272576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ac4af2e-f142-4f1a-8a45-c8946e7582de tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:50.272724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:50.281247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ac4af2e-f142-4f1a-8a45-c8946e7582de tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1213 microversion: 2.1 time: 0.090345 Aug 03 04:41:50.281931 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cd8c76b8-49d8-41c1-bab9-7bc82b284ff1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.321977 Aug 03 04:41:50.282837 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1234/2443] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:50 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:50.304904 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1210/2444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:49 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:50.808417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:51.045074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:51.058918 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67d182a0-1829-499d-a6b9-862718e423e9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1319 microversion: 2.1 time: 0.280941 Aug 03 04:41:51.059748 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1235/2445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:50 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:51.304067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1bf2cb09-078e-4d2f-9ec8-2c4c354b1a99 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:51.305022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1bf2cb09-078e-4d2f-9ec8-2c4c354b1a99 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:51.467323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1bf2cb09-078e-4d2f-9ec8-2c4c354b1a99 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:51.478099 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1bf2cb09-078e-4d2f-9ec8-2c4c354b1a99 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1213 microversion: 2.1 time: 0.177307 Aug 03 04:41:51.480678 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1236/2446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:51 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1213 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:51.490028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:51.493096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:51.510273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:51.510733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:51.515838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:51.516388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:51.742901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f060dda-f7ee-4523-84c8-8efa336e4512", "name": "network-vif-plugged", "status": "completed", "tag": "fa61412c-bfdb-486c-99f5-b31d8c5aa763"}, {"server_uuid": "42553f0f-11ef-47c7-83e0-a18390d947c9", "name": "network-vif-plugged", "status": "completed", "tag": "ebff0715-8ab9-4359-a02d-421e37dd67ed"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:51.762442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:51.767474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:51.802341 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] Creating event network-vif-plugged:fa61412c-bfdb-486c-99f5-b31d8c5aa763 for instance 8f060dda-f7ee-4523-84c8-8efa336e4512 on n-h1-826756-5 Aug 03 04:41:51.803123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] Creating event network-vif-plugged:ebff0715-8ab9-4359-a02d-421e37dd67ed for instance 42553f0f-11ef-47c7-83e0-a18390d947c9 on n-h1-826756-5 Aug 03 04:41:51.816631 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-372b31e1-8cd7-4ee8-8d5f-6bbae48fb0e6 req-fad4d43d-2875-4bc4-83a2-c89143393b27 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.530101 Aug 03 04:41:51.818404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1211/2447] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:52.082474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:52.083205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:52.105379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.105890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.110382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.111041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.165820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:52.180843 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-928df709-656c-45e0-81ac-1cfb1f205d04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.698767 Aug 03 04:41:52.183763 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1237/2448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:51 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:52.391391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:52.392262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:52.403317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.410588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.411591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.412443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.473207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:41:52.918558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:52.930006 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b07dea4f-03f3-4fd1-a559-ebb48b6ad347 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1469 microversion: 2.1 time: 0.852279 Aug 03 04:41:52.948137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1212/2449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:52 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1469 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:52.955030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:52.956487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:52.962927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8dfbc41-6f0c-4ee9-826b-f1b7dd0a2a59 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 204 len: 0 microversion: 2.1 time: 0.575055 Aug 03 04:41:52.963660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1238/2450] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:41:52 2022] DELETE /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:41:52.974052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.974567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.975249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:52.975488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.975845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.975977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:52.999021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:52.999021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:52.999021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:53.001792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:53.284614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:53.295136 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01d07a51-89da-494b-a7eb-a5ab32d7c8f0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1209 microversion: 2.1 time: 0.343363 Aug 03 04:41:53.295984 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1213/2451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:52 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1209 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:53.308978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:53.309881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:53.325560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:53.326028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:53.327271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:53.327378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:53.734885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:53.747030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24ce9f51-ddde-4f43-a1bb-f32cd00a41eb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1319 microversion: 2.1 time: 0.777629 Aug 03 04:41:53.747869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1239/2452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:52 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1319 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:53.763959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:53.767919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:53.774456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:53.775393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:53.776538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:53.777210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:53.852783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:53.866723 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85c9d6d8-9dec-48be-90ef-6060d058e6fe tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1666 microversion: 2.1 time: 0.566876 Aug 03 04:41:53.870566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1214/2453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:53 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1666 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:54.127532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:54.147311 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a957766-5522-4789-a578-afa2c4c5ce5e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1317 microversion: 2.1 time: 0.395159 Aug 03 04:41:54.151442 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1240/2454] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:53 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:54.320388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:54.321010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:54.335120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.335738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.336855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.337301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.411707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:54.423577 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-778fe627-830d-4ed5-ba9e-cca422f0b3b4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1265 microversion: 2.1 time: 0.107153 Aug 03 04:41:54.424656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1215/2455] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:54 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:54.771986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:54.774876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:54.787568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.788035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.788901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.789346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.890579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:54.891486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:54.901577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.906761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.907392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:54.907742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:54.929867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:55.112925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:55.126916 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e134250-599c-4ffd-9611-46fc1b9ae9ec tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1319 microversion: 2.1 time: 0.359715 Aug 03 04:41:55.132445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1241/2456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:54 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:55.175269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:55.175949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:55.189744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:55.190133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:55.190935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:55.191379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.163133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:56.178788 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af6da432-85a8-42a1-b690-367e234cb4d3 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1666 microversion: 2.1 time: 1.292366 Aug 03 04:41:56.196196 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1216/2457] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:54 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1666 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:56.202096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:56.204152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:56.223676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.228118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.230089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.243234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.553123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:56.563619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dce82d91-21fc-49d8-918f-8c66f6a96cb7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1507 microversion: 2.1 time: 1.392276 Aug 03 04:41:56.576452 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1242/2458] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:55 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1507 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:41:56.589163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:56.589849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:56.596479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:56.598908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.599580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.603153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.603153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.638443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:56.848661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:56.867559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b34538a2-7eff-4885-9375-01a1a2ed3215 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1271 microversion: 2.1 time: 0.669772 Aug 03 04:41:56.868952 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1217/2459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:56 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1271 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:56.890141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:56.891262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:56.911913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.912820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:56.918455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:56.919485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.002946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:57.033286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83970216-a7bf-4e3e-81da-41f2f40e5ad4 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1467 microversion: 2.1 time: 0.449704 Aug 03 04:41:57.071147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1243/2460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:56 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1467 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:57.080368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:57.092221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:57.093561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Searching by: {'reservation_id': 'r-pj94mys8', 'deleted': False, 'project_id': '18f6f7ad49364611aa364991953d58fa'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:41:57.110388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.114389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.117547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.118283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.341126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:41:57.375288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:57.389480 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2208ab7-7643-4b31-b116-c5ea40f5f48e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1507 microversion: 2.1 time: 0.518257 Aug 03 04:41:57.390290 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1218/2461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:56 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1507 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:57.404823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:57.405694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:57.424623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.425600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.427746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.428633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.506906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:57.520145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.521002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.716826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:57.728766 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11b504b8-4512-4f3e-b191-c2710193eafa tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1598 microversion: 2.1 time: 0.332805 Aug 03 04:41:57.730225 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1219/2462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:57 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1598 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:57.749026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:57.758053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:57.767219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.767935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.769172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:57.770032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:57.907693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:41:57.908165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:41:57.912989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:41:57.913187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:41:57.913540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:41:58.427266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:58.450554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.452979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:58.456994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.457706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:58.517557 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22a52e4a-552c-47e7-91ff-6cdcbacad105 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "POST /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9/action" status: 202 len: 1109 microversion: 2.1 time: 0.785430 Aug 03 04:41:58.538006 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1220/2463] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:41:57 2022] POST /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9/action => generated 1109 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 04:41:58.545928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:58.548999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:58.570544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.571079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:58.576456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.577073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:58.741749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-660a1d21-64e2-495f-ab0c-68a0117d555c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?reservation_id=r-pj94mys8" status: 200 len: 2929 microversion: 2.1 time: 1.668137 Aug 03 04:41:58.742353 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1244/2464] 10.222.0.72 () {58 vars in 1197 bytes} [Wed Aug 3 04:41:57 2022] GET /compute/v2.1/servers/detail?reservation_id=r-pj94mys8 => generated 2929 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:58.768336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:58.769480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:58.794158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.794616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:58.795414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:58.802856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.146664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:41:59.271593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:59.286149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3010235-179e-45c0-a3b8-d441a3488889 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.746204 Aug 03 04:41:59.286643 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1221/2465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:58 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:59.296356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:59.296904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:59.318470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.320223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.324383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.324853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.394465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:59.408333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7dafc997-dad5-4a31-9bff-541d8cd36f57 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.648998 Aug 03 04:41:59.423916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1245/2466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:58 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:59.431856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad87f2f6-701b-4bf3-8576-599e7d920451 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:59.437043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:41:59.455924 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4774987e-9f1e-447e-ae1f-c91659eee01c tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 200 len: 1598 microversion: 2.1 time: 0.168211 Aug 03 04:41:59.457060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1222/2467] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:59 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 1598 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:59.472147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8b837dcb-7d5b-4318-b527-6cb51220e281 req-12c74f72-f3ba-41f8-90f9-a205c57b8940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bb2fcb-cf43-444a-87f4-bbca57d65276", "name": "network-vif-deleted", "tag": "13ded0d9-8cf5-40bf-b63e-d3fef52df641"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:41:59.476046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.server_groups [None req-ad87f2f6-701b-4bf3-8576-599e7d920451 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Querying cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) for 2 instances {{(pid=120832) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 04:41:59.482776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad87f2f6-701b-4bf3-8576-599e7d920451 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.485060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad87f2f6-701b-4bf3-8576-599e7d920451 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.488955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8b837dcb-7d5b-4318-b527-6cb51220e281 req-12c74f72-f3ba-41f8-90f9-a205c57b8940 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.489412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8b837dcb-7d5b-4318-b527-6cb51220e281 req-12c74f72-f3ba-41f8-90f9-a205c57b8940 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.514961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8b837dcb-7d5b-4318-b527-6cb51220e281 req-12c74f72-f3ba-41f8-90f9-a205c57b8940 service nova] Creating event network-vif-deleted:13ded0d9-8cf5-40bf-b63e-d3fef52df641 for instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 on n-h1-826756-5 Aug 03 04:41:59.531407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8b837dcb-7d5b-4318-b527-6cb51220e281 req-12c74f72-f3ba-41f8-90f9-a205c57b8940 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072893 Aug 03 04:41:59.532376 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1223/2468] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:59.544035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad87f2f6-701b-4bf3-8576-599e7d920451 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups/3d669fd0-b33e-4b0c-824e-215543d92634" status: 200 len: 271 microversion: 2.1 time: 0.118428 Aug 03 04:41:59.545654 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1246/2469] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:41:59 2022] GET /compute/v2.1/os-server-groups/3d669fd0-b33e-4b0c-824e-215543d92634 => generated 271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:41:59.556244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:59.556949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:59.572992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.572992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.572992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.575849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.908598 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c2ab987-40d2-4066-a3d5-2973b334bad2 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1620 microversion: 2.1 time: 0.357011 Aug 03 04:41:59.925077 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1224/2470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:59 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1620 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:41:59.940333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:41:59.941317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:41:59.961665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.962468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:41:59.966177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:41:59.967912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:00.298405 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eeeda80b-ad21-46cb-9cfc-d0d68a55c0b1 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1618 microversion: 2.1 time: 0.372507 Aug 03 04:42:00.300811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1247/2471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:41:59 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1618 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:00.333920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:00.341135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:00.349842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:00.350081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:00.351055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:00.358190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:00.437564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:00.437564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:00.449225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:00.449933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:00.451029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:00.454915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:01.391346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:01.397800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:01.460627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c82fe7d0-d88e-4e26-b5cd-1a20d9ea4b65 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 1.023279 Aug 03 04:42:01.475188 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1248/2472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:00 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:01.475389 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4c56676-8e94-47c2-8c93-b78733c17801 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 1.147931 Aug 03 04:42:01.476914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1225/2473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:00 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:01.496063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-533179200", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d2ebaa9e-c7c2-4d30-857a-3c9ad0086337"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:01.497127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:01.499240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 82bb2fcb-cf43-444a-87f4-bbca57d65276] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:01.515882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:01.516414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:01.517209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:01.517659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:01.549516 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] HTTP exception thrown: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Request method failure captured: Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 HTTP/1.1 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frLdTzjkTzuCRrb-VtiwSpuw1fbfIsdPpMAqcXPtlBLVs2bfpVk7qMGD6ZWVKSpdU_Brx3x1xslz3IhzKrb1acyTug9Okf7121E9KopjGLlYaD0THuLPUHxLOkgdPcNYlE-ztRatKsUwAYnXsuuAzJgAoaLidITMAULgFkPYYGSBrY Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveMigrationTest-108703051 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ef84ed9611c449ec8ee31cf936faeb75 Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '82bb2fcb-cf43-444a-87f4-bbca57d65276'} Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:01.553641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. Aug 03 04:42:01.558920 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:01.577400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Returning 404 to user: Instance 82bb2fcb-cf43-444a-87f4-bbca57d65276 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:01.578311 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f439400-8201-4eca-b146-3a24d81ae1f8 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276" status: 404 len: 111 microversion: 2.1 time: 0.115432 Aug 03 04:42:01.591836 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1249/2474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:01 2022] GET /compute/v2.1/servers/82bb2fcb-cf43-444a-87f4-bbca57d65276 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:01.617112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:01.624939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9eaa637a-671b-476a-a9af-f3cab7f4a211 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '.version_select at 0x7fdd551ba670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:01.751604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9eaa637a-671b-476a-a9af-f3cab7f4a211 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209196570" status: 202 len: 0 microversion: 2.1 time: 0.155535 Aug 03 04:42:01.752866 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1250/2475] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:42:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209196570 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:42:01.867133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3fc5a53d-1074-49e1-831d-cf66dd58116b req-9299067d-f3e3-42f2-adf9-684cd6172a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a433988c-4c56-4c4e-b09f-05331e3d36e6", "tag": "71e5fc97-32b9-4f06-9170-8f6f10069669"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:01.884087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3fc5a53d-1074-49e1-831d-cf66dd58116b req-9299067d-f3e3-42f2-adf9-684cd6172a3a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:01.899281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3fc5a53d-1074-49e1-831d-cf66dd58116b req-9299067d-f3e3-42f2-adf9-684cd6172a3a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:01.922424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3fc5a53d-1074-49e1-831d-cf66dd58116b req-9299067d-f3e3-42f2-adf9-684cd6172a3a service nova] Creating event network-changed:71e5fc97-32b9-4f06-9170-8f6f10069669 for instance a433988c-4c56-4c4e-b09f-05331e3d36e6 on n-h1-826756-5 Aug 03 04:42:01.934323 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3fc5a53d-1074-49e1-831d-cf66dd58116b req-9299067d-f3e3-42f2-adf9-684cd6172a3a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074027 Aug 03 04:42:01.935719 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1251/2476] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:02.392479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:02.393572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:02.394260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:02.394869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:02.395476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:02.416435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.416435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:02.417044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.419233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:02.450986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:02.457985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:02.483641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:02.485115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:02.503188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.504702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:02.507958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.507958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:02.509330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:02.516510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:02.831785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc9f9063-e603-4b9b-81b1-aeb520904df6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350836 Aug 03 04:42:02.833538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1226/2477] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:02.841677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:02.843700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:02.858710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.859458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:02.860509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:02.861423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:03.323854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:03.342457 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-026ea8c3-a657-4272-b447-3cc0849eb4f7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.862801 Aug 03 04:42:03.344577 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1252/2478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:02 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:03.350261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46a6c3a1-e8fe-432f-aa6f-2d7ebe6f5d4c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:03.352748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46a6c3a1-e8fe-432f-aa6f-2d7ebe6f5d4c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:03.485819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46a6c3a1-e8fe-432f-aa6f-2d7ebe6f5d4c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:03.491913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:03.507115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46a6c3a1-e8fe-432f-aa6f-2d7ebe6f5d4c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1216 microversion: 2.1 time: 0.161086 Aug 03 04:42:03.508181 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1253/2479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:03 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:03.678821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:03.694694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f3495ab9-a275-4aa0-88d3-b9750f533d88 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.859319 Aug 03 04:42:03.700656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1227/2480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:02 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:04.139668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:04.139668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:04.146149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.147753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.149028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.149583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.196650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:42:04.374996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:04.375628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:04.389931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.397424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.397424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.397424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.615656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:04.633026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa424b43-e3e3-4829-a9bd-db4d35892f4d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.262189 Aug 03 04:42:04.633809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1228/2481] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:04 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:04.642431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:04.643105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:04.651800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.652261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.654311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.654311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.746865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:04.751726 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eabac77a-f92c-4a54-8d2a-4d66388c5a45 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 204 len: 0 microversion: 2.1 time: 0.620399 Aug 03 04:42:04.754170 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1254/2482] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:04 2022] DELETE /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:42:04.762644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:04.765559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93defb27-2c52-4a75-9ee7-96f79c9a6633 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1220 microversion: 2.1 time: 0.128123 Aug 03 04:42:04.766568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:04.784522 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1229/2483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:04 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:04.787026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:04.788169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.793499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.794372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:04.795454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.797184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.805398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:04.816432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.818397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:04.819424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:04.821067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:05.212331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:05.249619 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8061bfe2-3d56-4ce7-8ae1-cb21a75d518d tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1486 microversion: 2.1 time: 0.463682 Aug 03 04:42:05.252037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1230/2484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:04 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1486 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:05.291705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:05.302598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15d44c5e-d348-4a69-8fad-891d0041e049 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.545932 Aug 03 04:42:05.303359 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1255/2485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:04 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:05.653765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-903943629", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d011daa0-c911-42a0-9301-0733331c6958"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:05.660463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:05.661120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:05.685783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:05.686482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:05.687331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:05.688130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:05.765237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] validate_networks() for [('d011daa0-c911-42a0-9301-0733331c6958', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:06.146480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:06.154904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-728bf7f5-55f0-458f-8747-9e456b8184ae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.499713 Aug 03 04:42:06.155769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1256/2486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:05 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:06.160489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:06.161498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:06.168061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:06.168757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:06.169704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:06.170303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:06.287875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:06.300397 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5833918f-fd4b-4c16-b1a3-e906cc0a329b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1268 microversion: 2.1 time: 0.142041 Aug 03 04:42:06.315419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1257/2487] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:06 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:06.373458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-827956598", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "f14cb937-df0a-4a13-b784-d2d0ffef6af8"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:06.446957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] validate_networks() for [('f14cb937-df0a-4a13-b784-d2d0ffef6af8', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:06.804165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:06.804940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:06.805234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:06.805681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:06.807080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:06.829389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:06.829858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:06.830674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:06.831121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:06.934699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Getting quotas for project 5d290ac2b0734dd09c10c2000d98a406. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:06.949015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Getting quotas for user ca6deb3c13e347dbb7d31026d4cbb831 and project 5d290ac2b0734dd09c10c2000d98a406. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:07.006908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:07.021689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:07.231479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:07.234547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-784de441-596f-42dc-8d02-cb43854b4a13 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697403 Aug 03 04:42:07.235268 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1231/2488] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:07.434951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-704a9b99-a583-4881-98f5-395697c6d7c0 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Action: 'create', calling method: .version_select at 0x7fdd546095e0>, body: {"keypair": {"name": "tempest-keypair-2058430100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt+Ih0Imuvp/IbLz9o1ERtLMrAUSICgjJ6jNxLC/vwot8vJiN1J7lXgJCLbm7HuAI+RVE1fCPlfrKvBHMTl0EITFqoUS2hfoMLt2i9yrA7Q67DoTOI5SqTLlgtIG1x3+A=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:07.435468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:07.436257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:07.437527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:07.438403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:07.439100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:07.463871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.464388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.465217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.465667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.471679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-704a9b99-a583-4881-98f5-395697c6d7c0 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for project 85e273b566c84276a6cc6930b18aa8c3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:07.482465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-704a9b99-a583-4881-98f5-395697c6d7c0 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for user d409642f486d4d52a57a9d644c28f6cf and project 85e273b566c84276a6cc6930b18aa8c3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:07.502565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Getting quotas for project f5ef89ddefa54a189962ffdc6b0f89fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:07.514254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Getting quotas for user 8974a34e01b64ddf8e4152f889adebdb and project f5ef89ddefa54a189962ffdc6b0f89fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:07.539922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:07.545559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:07.656349 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-704a9b99-a583-4881-98f5-395697c6d7c0 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.407334 Aug 03 04:42:07.662769 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1232/2489] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:42:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:07.695996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:07.699961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:07.726375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.733114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.736094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.738522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.798182 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e08439b-f23b-41df-81c2-3009a0d55611 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492971 Aug 03 04:42:07.798849 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1258/2490] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:07.805990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.810139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:07.810781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.811264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lazy-loading 'fault' on Instance uuid 3e177ca7-4008-4345-9e66-b36e8b1e9c0c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:07.815678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:07.816608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:07.830276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.831586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.832674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.835987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.905795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:07.922440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bad9ca72-cd63-448a-97c5-c6f4f9db2bad tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1301 microversion: 2.1 time: 0.256092 Aug 03 04:42:07.924598 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1233/2491] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:07 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1301 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:07.938414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-22bb43ac-98ce-4a4d-bba3-8801883d68b2 req-f6f84dd8-349f-4e0a-a003-bdfc38a35d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e177ca7-4008-4345-9e66-b36e8b1e9c0c", "name": "network-vif-deleted", "tag": "3a048de8-d942-45ac-ba50-253e71cc418f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:07.961945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-22bb43ac-98ce-4a4d-bba3-8801883d68b2 req-f6f84dd8-349f-4e0a-a003-bdfc38a35d28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:07.963647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-22bb43ac-98ce-4a4d-bba3-8801883d68b2 req-f6f84dd8-349f-4e0a-a003-bdfc38a35d28 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:07.998006 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-22bb43ac-98ce-4a4d-bba3-8801883d68b2 req-f6f84dd8-349f-4e0a-a003-bdfc38a35d28 service nova] Creating event network-vif-deleted:3a048de8-d942-45ac-ba50-253e71cc418f for instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c on n-h2-826756-5 Aug 03 04:42:08.011225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-22bb43ac-98ce-4a4d-bba3-8801883d68b2 req-f6f84dd8-349f-4e0a-a003-bdfc38a35d28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085114 Aug 03 04:42:08.012195 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1234/2492] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:08.018592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:08.024204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:08.046300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.046989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:08.048980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.050174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:08.160050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:08.169604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3cbd805-488a-4ced-a09e-0246a02068f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.369338 Aug 03 04:42:08.175468 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1259/2493] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:07 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:08.184903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33abf725-0dc3-4e5f-825f-37b086198488 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:08.186052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33abf725-0dc3-4e5f-825f-37b086198488 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:08.288010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33abf725-0dc3-4e5f-825f-37b086198488 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:08.301085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33abf725-0dc3-4e5f-825f-37b086198488 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1224 microversion: 2.1 time: 0.123931 Aug 03 04:42:08.302010 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1260/2494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:08 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:08.307173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:08.312630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:08.319025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.319929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:08.321032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.321628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:08.414428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:08.418167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:08.423985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5051f4f-5e30-460a-9b6d-de84d3ec6923 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1274 microversion: 2.1 time: 0.120548 Aug 03 04:42:08.432325 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1261/2495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:08 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:08.432509 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b0759b3-09e0-48de-937b-e6a0a90e5589 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.411164 Aug 03 04:42:08.432509 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1235/2496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:08 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:08.432657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c26e9931-62a7-452b-b0f6-d88cafbf274b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:08.432657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c26e9931-62a7-452b-b0f6-d88cafbf274b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:08.506346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c26e9931-62a7-452b-b0f6-d88cafbf274b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:08.515475 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c26e9931-62a7-452b-b0f6-d88cafbf274b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1227 microversion: 2.1 time: 0.089287 Aug 03 04:42:08.517052 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1262/2497] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:08 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1227 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:08.951441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:08.952713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:08.962688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.963492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:08.964788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:08.965393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.028830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.029634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.030380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lazy-loading 'fault' on Instance uuid 3e177ca7-4008-4345-9e66-b36e8b1e9c0c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:09.159283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:09.173212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe5483fe-dfdf-4220-8f60-58e2cab259f0 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 200 len: 1301 microversion: 2.1 time: 0.229619 Aug 03 04:42:09.201588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:09.202215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:09.211386 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1236/2498] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:08 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 1301 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:09.216005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.216906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.218457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.219064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.327489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84b21614-a0f7-4c7a-8e1a-7ad5b9af45c0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:09.328405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84b21614-a0f7-4c7a-8e1a-7ad5b9af45c0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:09.498105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:09.508948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7973df7f-982e-4514-ac10-0ec367982226 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.311693 Aug 03 04:42:09.516195 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1263/2499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:09 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:09.522584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:09.529837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:09.547418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.554564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.556140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.557418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.592524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84b21614-a0f7-4c7a-8e1a-7ad5b9af45c0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:09.597419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:09.601054 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84b21614-a0f7-4c7a-8e1a-7ad5b9af45c0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1224 microversion: 2.1 time: 0.281322 Aug 03 04:42:09.602108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1237/2500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:09 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1224 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:09.622373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:09.623615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:09.631074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.631840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:09.633062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:09.633655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.375235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:10.389444 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b59459b-ed26-43e3-9c15-73716f6725db tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.869240 Aug 03 04:42:10.390179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1264/2501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:09 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:10.395602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:10.420722 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-139f8afb-c5b1-4c84-b560-6f8532f8d80b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.815976 Aug 03 04:42:10.424262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:10.427489 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1238/2502] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:09 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:10.435427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:10.438423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:10.460470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 3e177ca7-4008-4345-9e66-b36e8b1e9c0c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:10.469414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.469870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.470662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.471097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.474940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.479481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.482682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.483310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.515078 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] HTTP exception thrown: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Request method failure captured: Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c HTTP/1.1 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6frLdTzjkTzuCRrb-VtiwSpuw1fbfIsdPpMAqcXPtlBLVs2bfpVk7qMGD6ZWVKSpdU_Brx3x1xslz3IhzKrb1acyTug9Okf7121E9KopjGLlYaD0THuLPUHxLOkgdPcNYlE-ztRatKsUwAYnXsuuAzJgAoaLidITMAULgFkPYYGSBrY Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-LiveMigrationTest-108703051 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ef84ed9611c449ec8ee31cf936faeb75 Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3e177ca7-4008-4345-9e66-b36e8b1e9c0c'} Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:10.519657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. Aug 03 04:42:10.529723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:10.530930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Returning 404 to user: Instance 3e177ca7-4008-4345-9e66-b36e8b1e9c0c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:10.531952 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d19f67f8-dd3b-4be4-acd3-2409260410f4 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c" status: 404 len: 111 microversion: 2.1 time: 0.102765 Aug 03 04:42:10.532724 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1239/2503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:10 2022] GET /compute/v2.1/servers/3e177ca7-4008-4345-9e66-b36e8b1e9c0c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:10.623009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:10.636513 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4de3599-24bc-48a1-8fbd-88c531349774 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1231 microversion: 2.1 time: 0.241570 Aug 03 04:42:10.638856 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1265/2504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:10 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1231 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:10.645935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:10.651009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:10.661383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.662056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.662950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.663444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.664871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b4277a54-3928-4560-bfe5-2f9e4f1d5b00 req-7427ee2e-77e1-4560-b78f-9b300f813569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249", "tag": "e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:10.676711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b4277a54-3928-4560-bfe5-2f9e4f1d5b00 req-7427ee2e-77e1-4560-b78f-9b300f813569 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.677157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b4277a54-3928-4560-bfe5-2f9e4f1d5b00 req-7427ee2e-77e1-4560-b78f-9b300f813569 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.723084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b4277a54-3928-4560-bfe5-2f9e4f1d5b00 req-7427ee2e-77e1-4560-b78f-9b300f813569 service nova] Creating event network-changed:e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1 for instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 on n-h2-826756-5 Aug 03 04:42:10.730297 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b4277a54-3928-4560-bfe5-2f9e4f1d5b00 req-7427ee2e-77e1-4560-b78f-9b300f813569 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196200 Aug 03 04:42:10.731183 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1240/2505] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:10.740028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:10.746475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:10.755350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.758349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.761455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.764701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.821218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:42:10.870373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:10.881401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb21213f-c35a-49aa-89f1-6fa9c07a1222 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.241279 Aug 03 04:42:10.897568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1266/2506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:10 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:10.905416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:10.906123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:10.913115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.914719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.916339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:10.917736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:10.982453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:10.990099 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ca763bb-4e06-4fb2-8b55-6404cb65afe1 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1276 microversion: 2.1 time: 0.091209 Aug 03 04:42:10.990676 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1267/2507] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:10 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:11.301277 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-520e6393-b438-4ff4-bb24-baf06dd3f863 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 204 len: 0 microversion: 2.1 time: 0.565108 Aug 03 04:42:11.301879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1241/2508] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:10 2022] DELETE /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:42:11.310278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:11.311253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:11.320012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.320012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.320898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.321613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.413838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:11.414713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:11.422065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.422898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.423941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.424617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.613628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:11.667079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18985bd5-9274-4fae-82a7-72dbaecbcdb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1500 microversion: 2.1 time: 0.360321 Aug 03 04:42:11.677104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:11.687579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0c2666b-e877-449d-bdda-77851d06a109 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.279086 Aug 03 04:42:11.687782 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1268/2509] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:11 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:11.689680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1242/2510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:11 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:11.704750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:11.707580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:11.717987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:11.718933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:11.722072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.722823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.723986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.727272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.736204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.740762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.740762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.740762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.863625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:11.882752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-479e9574-2045-4b2b-9763-c0cdbf78d74c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1279 microversion: 2.1 time: 0.191733 Aug 03 04:42:11.899572 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1243/2511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:11 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:11.904729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:11.905596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:11.919504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.920246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:11.921818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:11.922431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.015522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:12.027377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-404a383c-127f-4d16-a0ec-031de0ba62fb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.314623 Aug 03 04:42:12.033934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1269/2512] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:11 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:12.044179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:12.047269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:12.059014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.062822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.069751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.072212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.235926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:12.245377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f484c36-3e6c-4902-9d29-542831b00237 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1284 microversion: 2.1 time: 0.210073 Aug 03 04:42:12.245990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1270/2513] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:12 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:12.286454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-759b3e23-b9c6-462f-a8ed-6ec3b7e32373 req-9eb1523c-af78-4276-939b-7d3e2225cb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a433988c-4c56-4c4e-b09f-05331e3d36e6", "name": "network-vif-plugged", "status": "completed", "tag": "71e5fc97-32b9-4f06-9170-8f6f10069669"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:12.305576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:12.305576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bece3b76-1dc4-4449-b89c-a38aa290ce0d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.402732 Aug 03 04:42:12.306109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-759b3e23-b9c6-462f-a8ed-6ec3b7e32373 req-9eb1523c-af78-4276-939b-7d3e2225cb3b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.306478 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1244/2514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:11 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:12.306636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-759b3e23-b9c6-462f-a8ed-6ec3b7e32373 req-9eb1523c-af78-4276-939b-7d3e2225cb3b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.330915 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-759b3e23-b9c6-462f-a8ed-6ec3b7e32373 req-9eb1523c-af78-4276-939b-7d3e2225cb3b service nova] Creating event network-vif-plugged:71e5fc97-32b9-4f06-9170-8f6f10069669 for instance a433988c-4c56-4c4e-b09f-05331e3d36e6 on n-h1-826756-5 Aug 03 04:42:12.340985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-759b3e23-b9c6-462f-a8ed-6ec3b7e32373 req-9eb1523c-af78-4276-939b-7d3e2225cb3b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071351 Aug 03 04:42:12.341918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1271/2515] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:12.692863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:12.694176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:12.702501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.703228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.704335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.704971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.714082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:12.715145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:12.722848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.723411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:12.724223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:12.724604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.043730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.055483 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ba97aa0-e400-4291-bbcd-07473ebab366 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1500 microversion: 2.1 time: 0.366908 Aug 03 04:42:13.056179 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1245/2516] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:12 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1500 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:13.066786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:13.068953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:13.085670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.086308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.088061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.088892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.121136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.130766 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc091d59-c180-4880-9f3e-3adf7f8dcc46 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.422275 Aug 03 04:42:13.143683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1272/2517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:12 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:13.152664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:13.153293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:13.161838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.162582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.168179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.169961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.434172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.443468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec1fbf6c-07d5-4d46-9144-2eafc0ee986c tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1287 microversion: 2.1 time: 0.384132 Aug 03 04:42:13.444288 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1246/2518] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:13 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1287 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:13.464953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:13.469031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:13.480571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.482987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.490275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.491100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.573654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.588131 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6303415-b112-42be-8a44-158a8e680f62 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.437150 Aug 03 04:42:13.592818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1273/2519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:13 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:13.602070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:13.602943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:13.615097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.616049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.617115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:13.617890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:13.668926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.677643 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50bb7d38-b1df-4ca2-a62b-9e2311425895 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1282 microversion: 2.1 time: 0.232171 Aug 03 04:42:13.678421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1247/2520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:13 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:13.845484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:13.859467 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88fab792-4873-4213-9bae-6cb42fcef4a6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1313 microversion: 2.1 time: 0.268498 Aug 03 04:42:13.860505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1274/2521] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:13 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:14.079821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.081263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.091630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.092629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.093796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.095942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.158402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.159483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.181875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.182424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.183314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.183841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.401838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:14.422014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d0f24876-9e5f-4a6f-8066-7b2b5a521bb9 tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1500 microversion: 2.1 time: 0.346542 Aug 03 04:42:14.422935 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1248/2522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1500 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:14.427561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d502d478-445c-477f-86bb-8c3dfb29c0c3 req-889f7e85-939c-4228-80a2-25d71ee8f851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fde05c5-b996-409c-9e44-e6f2dc34f4c2", "name": "network-vif-deleted", "tag": "79987c6a-a281-4dd5-afd1-d767893a20dd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:14.438707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d502d478-445c-477f-86bb-8c3dfb29c0c3 req-889f7e85-939c-4228-80a2-25d71ee8f851 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.439571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d502d478-445c-477f-86bb-8c3dfb29c0c3 req-889f7e85-939c-4228-80a2-25d71ee8f851 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.452855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d502d478-445c-477f-86bb-8c3dfb29c0c3 req-889f7e85-939c-4228-80a2-25d71ee8f851 service nova] Creating event network-vif-deleted:79987c6a-a281-4dd5-afd1-d767893a20dd for instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 on n-h2-826756-5 Aug 03 04:42:14.463084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d502d478-445c-477f-86bb-8c3dfb29c0c3 req-889f7e85-939c-4228-80a2-25d71ee8f851 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038309 Aug 03 04:42:14.466150 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1249/2523] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:14.473172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.474227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.482271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.483879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.485508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.486195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.535512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:14.546975 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41b43efd-3d3a-42a8-afbd-0b4117277952 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.395049 Aug 03 04:42:14.548522 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1275/2524] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:14.584801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:14.598297 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a71bc68-6d82-4c67-b692-c076541acf40 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1297 microversion: 2.1 time: 0.130245 Aug 03 04:42:14.619871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.619871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.626249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1250/2525] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:14.628187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.628675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.629675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.630274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.702540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.703145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.710292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.710833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.715700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.720680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.831003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:14.864573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dee5bff4-a78c-4dd4-bc04-127fe7847eae tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.249507 Aug 03 04:42:14.866131 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1276/2526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:14.884770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:14.885652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:14.888826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:14.892471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.892923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.898470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:14.898470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:14.898794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:14.900982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:14.905439 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-140230bd-046e-4607-9d1f-ff48de09253d tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.207102 Aug 03 04:42:14.906382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1251/2527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:15.102019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:15.118216 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f9a48df-84e2-4948-9a6a-b2f0c1e8efdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1499 microversion: 2.1 time: 0.240647 Aug 03 04:42:15.135066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1277/2528] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:14 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:15.142630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:15.145045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:15.164358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.164358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.164358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.164358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.218526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lazy-loading 'flavor' on Instance uuid a433988c-4c56-4c4e-b09f-05331e3d36e6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:15.449726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:15.450721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:15.463882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.465357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.482096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.484126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.550650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.551456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.552136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lazy-loading 'fault' on Instance uuid 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:15.608043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef84ed9611c449ec8ee31cf936faeb75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22d07c060aa4335b68d9362ad62d31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:15.617682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6c33d3c-6126-403c-9c34-19e7bfc64fdd tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 200 len: 1300 microversion: 2.1 time: 0.174215 Aug 03 04:42:15.634857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1278/2529] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:15 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:15.638312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:15.639393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:15.647110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.647986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.649162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.650399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.805174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9461490-f1c2-4572-8279-3daefc777f68 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "POST /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6/action" status: 200 len: 32 microversion: 2.1 time: 0.665924 Aug 03 04:42:15.806057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1252/2530] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:42:15 2022] POST /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6/action => generated 32 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:42:15.816695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:15.817771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:15.833043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.834340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:15.835579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:15.836475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.035886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:16.053945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66bc7160-5182-4261-a772-cb09df5448bc tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1285 microversion: 2.1 time: 0.242946 Aug 03 04:42:16.054795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1253/2531] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:15 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:16.060880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:16.063749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:16.072890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.073342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.074126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.074561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.135531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:16.143824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cb19a1b-8fce-48e7-b321-80375cd85e37 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.509511 Aug 03 04:42:16.156531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1279/2532] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:15 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:16.164221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:16.165598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:16.177573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.177573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.177573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.177573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.482396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:16.495245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c455f147-ad42-44e1-9419-b63608a3acd2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.439183 Aug 03 04:42:16.495957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1254/2533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:16 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:16.522943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:16.525029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:16.541722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.542182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.545738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.546376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.787132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:16.815137 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9b7b7a9-a4e2-48e2-8391-6b02547f5bd6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.660823 Aug 03 04:42:16.832998 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1280/2534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:16 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:16.842052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:16.842828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] [instance: 9fde05c5-b996-409c-9e44-e6f2dc34f4c2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:16.860496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.861124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.861981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:16.862430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:16.867331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:16.885165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:16.897973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] HTTP exception thrown: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Request method failure captured: Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 HTTP/1.1 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6frLdTzjkTzuCRrb-VtiwSpuw1fbfIsdPpMAqcXPtlBLVs2bfpVk7qMGD6ZWVKSpdU_Brx3x1xslz3IhzKrb1acyTug9Okf7121E9KopjGLlYaD0THuLPUHxLOkgdPcNYlE-ztRatKsUwAYnXsuuAzJgAoaLidITMAULgFkPYYGSBrY Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a22d07c060aa4335b68d9362ad62d31c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-LiveMigrationTest-108703051 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a22d07c060aa4335b68d9362ad62d31c Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-LiveMigrationTest-108703051 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ef84ed9611c449ec8ee31cf936faeb75 Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-LiveMigrationTest-108703051-project Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9fde05c5-b996-409c-9e44-e6f2dc34f4c2'} Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:16.900041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. Aug 03 04:42:16.904480 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:16.907655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] Returning 404 to user: Instance 9fde05c5-b996-409c-9e44-e6f2dc34f4c2 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:16.908870 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d838e27-8493-4ca1-8df5-bedbc7ed58ca tempest-LiveMigrationTest-108703051 tempest-LiveMigrationTest-108703051-project] 10.222.0.72 "GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2" status: 404 len: 111 microversion: 2.1 time: 0.075482 Aug 03 04:42:16.910104 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1281/2535] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:16 2022] GET /compute/v2.1/servers/9fde05c5-b996-409c-9e44-e6f2dc34f4c2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:17.035988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cceee7d1-2a36-46cf-9e73-23f8354d95e5 req-e0800798-b930-42c0-85ac-48c344954fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026960ce-ebcc-46d4-847d-bd5647e37f52", "tag": "4b7b9f1e-71d4-49be-8247-8f4b18c1c96f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:17.060815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:17.063642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cceee7d1-2a36-46cf-9e73-23f8354d95e5 req-e0800798-b930-42c0-85ac-48c344954fcd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.064597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cceee7d1-2a36-46cf-9e73-23f8354d95e5 req-e0800798-b930-42c0-85ac-48c344954fcd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.069414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b9abf4f-5acf-4c21-b4d9-4643575a901e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.560551 Aug 03 04:42:17.072008 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1255/2536] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:16 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:17.083862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:17.084912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cceee7d1-2a36-46cf-9e73-23f8354d95e5 req-e0800798-b930-42c0-85ac-48c344954fcd service nova] Creating event network-changed:4b7b9f1e-71d4-49be-8247-8f4b18c1c96f for instance 026960ce-ebcc-46d4-847d-bd5647e37f52 on n-h2-826756-5 Aug 03 04:42:17.087758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:17.108609 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cceee7d1-2a36-46cf-9e73-23f8354d95e5 req-e0800798-b930-42c0-85ac-48c344954fcd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195660 Aug 03 04:42:17.110229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.111546 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1282/2537] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:17.112088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.112937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.113389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.169006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:17.169729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:17.181102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.187263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.187263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.187263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.604918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:17.612916 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef58a118-bff5-4f74-a0fc-03534f53ef24 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.539464 Aug 03 04:42:17.613715 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1256/2538] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:17 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:17.622470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:17.626030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:17.635913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.636487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.637418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.638089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.651298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:17.662134 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f03e5f49-85e7-49ca-989f-5d13caec2718 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.498750 Aug 03 04:42:17.674396 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1283/2539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:17 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:17.841278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:17.841806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:17.855716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.856715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:17.857782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:17.858441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.263886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:18.288763 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b738b9a8-9619-4758-b210-9a1baf601159 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.657908 Aug 03 04:42:18.288763 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1257/2540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:17 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:18.288763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1a47377e-69d5-4ae8-a9b6-159c50de0e4b req-a931c73a-fd4a-44b2-890c-01d9375c58b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d1656f-004d-45f3-b6b2-7537c21afcb5", "tag": "6d99c746-f7bd-4da5-bc87-ea936edee69a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:18.289743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a47377e-69d5-4ae8-a9b6-159c50de0e4b req-a931c73a-fd4a-44b2-890c-01d9375c58b0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.290201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a47377e-69d5-4ae8-a9b6-159c50de0e4b req-a931c73a-fd4a-44b2-890c-01d9375c58b0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.302093 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1a47377e-69d5-4ae8-a9b6-159c50de0e4b req-a931c73a-fd4a-44b2-890c-01d9375c58b0 service nova] Creating event network-changed:6d99c746-f7bd-4da5-bc87-ea936edee69a for instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 on n-h2-826756-5 Aug 03 04:42:18.307593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1a47377e-69d5-4ae8-a9b6-159c50de0e4b req-a931c73a-fd4a-44b2-890c-01d9375c58b0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031047 Aug 03 04:42:18.308833 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1258/2541] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:18.314081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:18.314982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:18.322593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.323624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.324635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.325242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.513403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=11 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:18.531749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:18.542636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b93f6c70-9824-43d8-9ec1-a485fd94a581 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.705412 Aug 03 04:42:18.544942 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1284/2542] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:17 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:18.595979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:18.606468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dca1fa74-f023-46b9-8a5d-3ff1644ffb7f tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.296132 Aug 03 04:42:18.620014 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1259/2543] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:18 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:18.637795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:18.638541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:18.645601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.646388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.647384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.647896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.702192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:18.703390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:18.714475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.715180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.716304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:18.717005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:18.833509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:18.848507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc9b629d-7847-4b27-a22b-96a907b77d3b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.215001 Aug 03 04:42:18.849425 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1285/2544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:18 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:18.902697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:18.911416 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe8ee670-5525-4963-895c-b29aec4c68aa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.220379 Aug 03 04:42:18.912555 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1260/2545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:18 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:19.297205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:19.298015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:19.307901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.309280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.313199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.313656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.504803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:19.519460 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de4fc3b5-fa03-4925-b838-c00ad5f24192 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.225869 Aug 03 04:42:19.521597 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1286/2546] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:19 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:19.566297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:19.567048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:19.575461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.576307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.577285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.577856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.602199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:19.631712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:19.631712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:19.632894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:19.638899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.639790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.641408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.642099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.815161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:19.825207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4980328-7885-4c9a-b043-88c1f29ccc53 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.264225 Aug 03 04:42:19.826004 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1261/2547] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:19 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:19.833300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0020dc05-6b61-4832-8f3b-e83a003b4c80 req-c7ed8133-41ec-4279-9026-77ea0def758d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249", "name": "network-vif-plugged", "status": "completed", "tag": "e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:19.868579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:19.872749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0020dc05-6b61-4832-8f3b-e83a003b4c80 req-c7ed8133-41ec-4279-9026-77ea0def758d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.873383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0020dc05-6b61-4832-8f3b-e83a003b4c80 req-c7ed8133-41ec-4279-9026-77ea0def758d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.888706 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0020dc05-6b61-4832-8f3b-e83a003b4c80 req-c7ed8133-41ec-4279-9026-77ea0def758d service nova] Creating event network-vif-plugged:e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1 for instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 on n-h2-826756-5 Aug 03 04:42:19.896610 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0020dc05-6b61-4832-8f3b-e83a003b4c80 req-c7ed8133-41ec-4279-9026-77ea0def758d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067757 Aug 03 04:42:19.898380 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1262/2548] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:19.906942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:19.907464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:19.908042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:19.918264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.920054 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fbc99b7b-9944-4078-b453-3b3b0ff0ed8b tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.294471 Aug 03 04:42:19.920834 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1287/2549] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:19 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:19.921180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.922478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.922574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.934551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:19.935488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:19.942706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.943212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:19.944073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:19.944674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.282284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:20.291736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54e0b55d-8f35-4862-9dd7-022ffaaa34b3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.361545 Aug 03 04:42:20.293307 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1288/2550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:19 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:20.326202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:20.338458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f6a9921-6e9f-45f2-b727-4913f36a0772 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.436221 Aug 03 04:42:20.339261 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1263/2551] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:19 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:20.550637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:20.551399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:20.559118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.559901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.561050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.561675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.773542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:20.782248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7b97c18d-0401-4b40-80c8-94f81f0793af tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.240250 Aug 03 04:42:20.782832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1289/2552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:20 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:20.847394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:20.848603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:20.856898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.857455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.858477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.858990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.941796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:20.942422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:20.949997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.950457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:20.951242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:20.951689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.092178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:21.102354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-465587db-f25f-4abc-8c08-95d1e3ee8df4 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.258798 Aug 03 04:42:21.104035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1264/2553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:20 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:21.175914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:21.185646 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e00daf65-474c-41bf-acf9-ef12020e56f5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.247728 Aug 03 04:42:21.197989 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1290/2554] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:20 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:21.318455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:21.321475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:21.328451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.329038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.329847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.330286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.368855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:21.368855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:21.373098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.373742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.374763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.375385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.585816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:21.598480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:21.600065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-def2abcd-8bcb-4bde-af36-da804efac0a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.288795 Aug 03 04:42:21.600742 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1265/2555] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:21 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:21.628830 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5bfd45f-94fd-46c4-bf7b-9f1fddda3c1f tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.269356 Aug 03 04:42:21.629565 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1291/2556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:21 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:21.803191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:21.803852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:21.810681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.811136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.811903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:21.812379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:21.949768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:21.958181 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d568725-0265-4178-be1f-2c44ff781eb6 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.158718 Aug 03 04:42:21.978657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1266/2557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:21 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:22.126383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:22.127021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:22.137610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.139076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.142488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.143020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.219425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:22.220298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:22.234868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.235328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.236122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.241649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.295363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:22.303547 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89b5b959-8fdd-4dc8-8c72-b0185557b262 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.181637 Aug 03 04:42:22.307617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1292/2558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:22 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:22.411718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:22.415788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:22.420618 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2f4eb65-3c97-48af-af0e-9cd47358b1d3 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.205770 Aug 03 04:42:22.421447 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1267/2559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:22 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:22.627232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:22.627862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:22.636104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.636598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.637574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.638012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.656964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:22.656964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:22.670516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.671259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.672330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.672780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.881871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:22.890911 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72a017a9-d416-4261-b538-30108fa32509 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.242480 Aug 03 04:42:22.891521 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1268/2560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:22 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:22.908473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:22.917103 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97578dad-7934-489e-86bc-3668a246ffaa tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.293987 Aug 03 04:42:22.918236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1293/2561] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:22 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:22.979997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:22.980809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:22.988029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.989020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:22.989806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:22.990247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.231013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:23.246217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2596affe-b44e-4b49-85e5-412cb12b3c62 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.269400 Aug 03 04:42:23.254782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1269/2562] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:22 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:23.328216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:23.328874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:23.341090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.341556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.342356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.343961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.443345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:23.446562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:23.459624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.463378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.463835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.464605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.621831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:23.643395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3b48f59-578e-4c3e-82bf-4c43c167e454 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.320115 Aug 03 04:42:23.655000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1294/2563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:23 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:23.704784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:23.714563 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34a51fad-5af7-4582-90f5-5383ace82e59 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.275318 Aug 03 04:42:23.719229 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1270/2564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:23 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:23.913261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:23.913893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:23.920747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.921336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.922447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.922899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.938985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:23.939786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:23.949122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.949704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:23.951543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:23.952256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.176449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:24.182591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:24.196213 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28d96aca-cb86-4aae-b41c-570631c4ed48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.287597 Aug 03 04:42:24.200518 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb48c716-1745-422a-9699-3b75d097f67f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1316 microversion: 2.1 time: 0.265099 Aug 03 04:42:24.204078 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1271/2565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:23 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:24.213781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1295/2566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:23 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:24.270194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:24.271049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:24.278401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.278863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.279759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.280715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.435961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:24.448758 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f54a3be1-95fc-4bc2-a21a-91fabdf262df tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.182638 Aug 03 04:42:24.449972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1272/2567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:24 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:24.668086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:24.668845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:24.676238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.677068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.677792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.678229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.742281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:24.743546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:24.751154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.751872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.752705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:24.753155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:24.874758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:24.890262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6c7068e-8059-40bb-8d53-7831665c38df tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.226752 Aug 03 04:42:24.892682 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1296/2568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:24 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:24.962436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:24.974246 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0541dfb6-ae22-40c5-bbd9-5ca020a00995 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.237818 Aug 03 04:42:24.975443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1273/2569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:24 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:25.222691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:25.223344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:25.236359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:25.237769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:25.262380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.263843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.264645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.265000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.267574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.267909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.269255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.269717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.543137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:25.547127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:25.554431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16bfc1f4-c6b8-45bc-b1e9-d3e6a354fb92 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1466 microversion: 2.1 time: 0.324570 Aug 03 04:42:25.555782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1274/2570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:25 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1466 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:25.556199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7bd8db3b-bb08-45c3-a798-0ca59abbf2b8 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.338390 Aug 03 04:42:25.568500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:25.568500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:25.569134 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1297/2571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:25 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:25.571315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.571844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.572663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.573131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.581525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:25.582451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:25.589846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.590434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.591339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.592560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.859130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:25.867007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3257514-6bc4-4634-9700-d9503c143a7b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.310151 Aug 03 04:42:25.868011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1275/2572] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:25 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:25.911405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:25.913580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:25.925880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.926485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:25.927389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:25.927932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:26.285084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6eda8e9-345e-497a-840f-e1919ae575e7 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1617 microversion: 2.1 time: 0.708724 Aug 03 04:42:26.285730 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1298/2573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:25 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1617 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:26.314562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:26.314861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:26.322269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:26.322974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:26.323932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:26.324568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:26.329637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:26.548525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:26.562982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cbfe1b98-9a19-4ed7-a0c5-2abb2b6fcef2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1514 microversion: 2.1 time: 0.655264 Aug 03 04:42:26.564366 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1276/2574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:25 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1514 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:26.570298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-913d85ce-9d7d-4e5f-9977-2116bfc24daa req-bbd51216-3f1c-4e33-8c69-8958b0b962d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026960ce-ebcc-46d4-847d-bd5647e37f52", "name": "network-vif-plugged", "status": "completed", "tag": "4b7b9f1e-71d4-49be-8247-8f4b18c1c96f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:26.581953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-913d85ce-9d7d-4e5f-9977-2116bfc24daa req-bbd51216-3f1c-4e33-8c69-8958b0b962d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:26.582427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-913d85ce-9d7d-4e5f-9977-2116bfc24daa req-bbd51216-3f1c-4e33-8c69-8958b0b962d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:26.596220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-913d85ce-9d7d-4e5f-9977-2116bfc24daa req-bbd51216-3f1c-4e33-8c69-8958b0b962d6 service nova] Creating event network-vif-plugged:4b7b9f1e-71d4-49be-8247-8f4b18c1c96f for instance 026960ce-ebcc-46d4-847d-bd5647e37f52 on n-h2-826756-5 Aug 03 04:42:26.601697 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-913d85ce-9d7d-4e5f-9977-2116bfc24daa req-bbd51216-3f1c-4e33-8c69-8958b0b962d6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Aug 03 04:42:26.602736 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1277/2575] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:26.610014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-281259189", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d2ebaa9e-c7c2-4d30-857a-3c9ad0086337"]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:26.642908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:26.653209 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4f8392a-e87b-474a-816c-5240c24c60d9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.350946 Aug 03 04:42:26.673382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:26.677320 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1299/2576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:26 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:26.689270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:26.689884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:26.698631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:26.699364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:26.700333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:26.700922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.073163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:27.084027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d3477306-e1c0-47b9-9714-87e4ac2a39b6 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.399902 Aug 03 04:42:27.098376 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1300/2577] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:26 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:27.098376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:27.098376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:27.098376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.098376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.098843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.099244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.256325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:27.256771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:27.257251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:27.261694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:27.262513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:27.273330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.274032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.275057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.275656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.296068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:27.302384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:27.316671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:27.321361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:27.363189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:27.372772 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f150216a-da76-432f-93e7-b3d27810446c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.287050 Aug 03 04:42:27.373371 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1301/2578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:27 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:27.476223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9517bae-27bd-4e28-ac8e-e158354182e8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872063 Aug 03 04:42:27.477705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1278/2579] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:27.490058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a03204fc-fef2-438c-8792-0b9dfc054f01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:27.491074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a03204fc-fef2-438c-8792-0b9dfc054f01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:27.591666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:27.592668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:27.593964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a03204fc-fef2-438c-8792-0b9dfc054f01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:27.602929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a03204fc-fef2-438c-8792-0b9dfc054f01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1216 microversion: 2.1 time: 0.115830 Aug 03 04:42:27.606780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.610645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.611863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.612834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.617159 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1302/2580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:27 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1216 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:27.679431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:27.680927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:27.687855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.688799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.691159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:27.691633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:27.967299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:27.977811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:27.993137 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac8876bb-a10f-4a1c-9b08-b7a5687711a0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.319859 Aug 03 04:42:28.006871 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d0fd405-a573-4435-809d-6f0547c3989d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.408715 Aug 03 04:42:28.008514 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1303/2581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:27 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:28.009210 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1279/2582] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:27 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:28.107748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:28.108390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:28.114946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:28.115586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:28.116533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:28.117153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:28.373912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:28.384164 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26b48db9-3777-4190-a7d9-8849b724af48 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.280908 Aug 03 04:42:28.408357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:28.409168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:28.412846 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1304/2583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:28 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:28.417966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:28.418662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:28.419670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:28.420256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:28.628769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57266183-ba2a-4850-8151-f1028950bc20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:28.656443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57266183-ba2a-4850-8151-f1028950bc20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:28.669586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:28.683398 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c35cc91b-e31f-45c7-a740-e555ead96d6a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.280535 Aug 03 04:42:28.699856 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1280/2584] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:28 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:28.722963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57266183-ba2a-4850-8151-f1028950bc20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:28.732101 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57266183-ba2a-4850-8151-f1028950bc20 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1216 microversion: 2.1 time: 0.107316 Aug 03 04:42:28.733335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1305/2585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:28 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:29.013719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:29.014345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:29.021423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.021886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.022661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.023107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.031730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:29.032384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:29.043371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.044328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.045464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.045945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.296304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:29.305784 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4cc3e356-c4cc-4c2c-8688-099182e41bf4 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1324 microversion: 2.1 time: 0.295882 Aug 03 04:42:29.307957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1281/2586] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:29 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:29.326498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:29.339942 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48ef1c97-b58b-4544-b1d8-5e42e21e626e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.308055 Aug 03 04:42:29.340685 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1306/2587] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:29 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:29.408174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:29.408837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:29.418423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.419170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.420015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.420494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.448623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e30426af-1564-48cf-a1e3-763bc7b95d2b req-270cf646-f3de-478c-a3a4-9eb1fcf41741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1656f-004d-45f3-b6b2-7537c21afcb5", "name": "network-vif-plugged", "status": "completed", "tag": "6d99c746-f7bd-4da5-bc87-ea936edee69a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:29.459984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e30426af-1564-48cf-a1e3-763bc7b95d2b req-270cf646-f3de-478c-a3a4-9eb1fcf41741 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.470816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e30426af-1564-48cf-a1e3-763bc7b95d2b req-270cf646-f3de-478c-a3a4-9eb1fcf41741 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.479635 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e30426af-1564-48cf-a1e3-763bc7b95d2b req-270cf646-f3de-478c-a3a4-9eb1fcf41741 service nova] Creating event network-vif-plugged:6d99c746-f7bd-4da5-bc87-ea936edee69a for instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 on n-h2-826756-5 Aug 03 04:42:29.485319 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e30426af-1564-48cf-a1e3-763bc7b95d2b req-270cf646-f3de-478c-a3a4-9eb1fcf41741 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040772 Aug 03 04:42:29.486285 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1307/2588] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:42:29.677245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:29.687117 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61ef374f-a5b8-48f7-875e-c1f0fcead307 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.283784 Aug 03 04:42:29.687851 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1282/2589] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:29 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:29.711545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:29.712425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:29.719094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.719757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.721034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.721998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.755303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:29.756710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:29.767122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.767943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.769648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:29.772766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:29.874451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:29.883961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53bf0687-e0e6-439d-8e5a-88e8ce916630 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1220 microversion: 2.1 time: 0.132285 Aug 03 04:42:29.897291 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1283/2590] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:29 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:29.927151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:29.936568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f0c6ab3-7868-4d79-98d6-87b11a4dd58b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.230448 Aug 03 04:42:29.937569 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1308/2591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:29 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:30.331200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.331996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.340432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.341736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.341736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.342252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.363406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.364089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.376165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.376839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.377375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.377821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.568544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:30.578272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72abfae1-055d-4473-8e9d-bad0b095d952 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1521 microversion: 2.1 time: 0.251018 Aug 03 04:42:30.578869 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1284/2592] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:30.596448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:30.602839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.603390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.606047 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-967a5d59-34f9-44bc-915a-0932c1a3b368 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.247192 Aug 03 04:42:30.606637 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1309/2593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:30.610023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.610474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.611242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.611675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.640951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:30.643573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] HTTP exception thrown: Action 999 not found Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Request method failure captured: Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52/os-instance-actions/999 HTTP/1.1 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fydhJR6eIGLW8qhE2Yn-GSckYFEug2Of1gTnIPdC0q4FwdTSX3MHQq-dE1jl1VJK-q2-jDQvlC-Wi2YTNs2hQay8G8moXg_YYD8aCLUU1TZNdnoCm1jpffV6Rk7_xDWdoi_Fq6Cu2-NVYTZnMYYkDh7YVs8jjPGzxSUCEuC_msVeaY Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ca6deb3c13e347dbb7d31026d4cbb831 Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: exception: Action 999 not found Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '026960ce-ebcc-46d4-847d-bd5647e37f52', 'id': '999'} Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 03 04:42:30.649967 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.654406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Returning 404 to user: Action 999 not found {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:30.654406 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc099f2c-81d2-42f9-8481-edd8503712ce tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.053866 Aug 03 04:42:30.654406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1285/2594] 10.222.0.72 () {58 vars in 1308 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52/os-instance-actions/999 => generated 66 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:42:30.661860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '.version_select at 0x7fdd54e79af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.662454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 9b987d7c-f37e-44c4-bf9c-c2c736c02256] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.668718 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] HTTP exception thrown: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Request method failure captured: Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/9b987d7c-f37e-44c4-bf9c-c2c736c02256/os-instance-actions HTTP/1.1 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fydhJR6eIGLW8qhE2Yn-GSckYFEug2Of1gTnIPdC0q4FwdTSX3MHQq-dE1jl1VJK-q2-jDQvlC-Wi2YTNs2hQay8G8moXg_YYD8aCLUU1TZNdnoCm1jpffV6Rk7_xDWdoi_Fq6Cu2-NVYTZnMYYkDh7YVs8jjPGzxSUCEuC_msVeaY Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ca6deb3c13e347dbb7d31026d4cbb831 Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': '9b987d7c-f37e-44c4-bf9c-c2c736c02256'} Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:30.675360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Returning 404 to user: Instance 9b987d7c-f37e-44c4-bf9c-c2c736c02256 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eab45d48-b931-459c-a62c-152f1709488e tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/9b987d7c-f37e-44c4-bf9c-c2c736c02256/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.014248 Aug 03 04:42:30.681567 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1310/2595] 10.222.0.72 () {58 vars in 1296 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/9b987d7c-f37e-44c4-bf9c-c2c736c02256/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:30.694619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.695137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.703630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.708761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.708761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.708761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.712410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.713301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.724233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.725840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.726927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.727639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.756658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:42:30.896782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:30.905250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-deb86091-4600-4cb7-97b4-e4a5b3a13a87 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.200327 Aug 03 04:42:30.905880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1311/2596] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:30.919829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:30.920805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:30.930334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.931401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:30.932215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:30.932694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.002512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:31.011636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1fdfdd8b-04c0-4f06-93c9-b6567a66a9c0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1212 microversion: 2.1 time: 0.104534 Aug 03 04:42:31.012223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1312/2597] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:30 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1212 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:31.017328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:31.018140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:31.025079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.033027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.033027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.033027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.178956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:31.188172 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-374be35c-7ec6-49c6-bc4d-e1632b0c8735 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.174697 Aug 03 04:42:31.191661 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1313/2598] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:31 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:31.193621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-041882f9-222e-4aba-9dc1-f3b984c897c9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "DELETE /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 204 len: 0 microversion: 2.1 time: 0.503725 Aug 03 04:42:31.197433 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1286/2599] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:30 2022] DELETE /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:42:31.213415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:31.213415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:31.216491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.217149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.217926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.218651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.432846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:31.432846 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-254f834d-86e2-4911-90e1-59ca88d028b9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1527 microversion: 2.1 time: 0.172908 Aug 03 04:42:31.432846 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1314/2600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:31 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1527 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:31.502095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f57dd7b1-857a-4658-b108-8c0e372710c8 req-08d83f95-ef51-484e-ae67-505a5ceab5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42553f0f-11ef-47c7-83e0-a18390d947c9", "name": "network-vif-unplugged", "status": "completed", "tag": "ebff0715-8ab9-4359-a02d-421e37dd67ed"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:31.514069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f57dd7b1-857a-4658-b108-8c0e372710c8 req-08d83f95-ef51-484e-ae67-505a5ceab5bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.514520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f57dd7b1-857a-4658-b108-8c0e372710c8 req-08d83f95-ef51-484e-ae67-505a5ceab5bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.528974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f57dd7b1-857a-4658-b108-8c0e372710c8 req-08d83f95-ef51-484e-ae67-505a5ceab5bb service nova] Creating event network-vif-unplugged:ebff0715-8ab9-4359-a02d-421e37dd67ed for instance 42553f0f-11ef-47c7-83e0-a18390d947c9 on n-h1-826756-5 Aug 03 04:42:31.535757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f57dd7b1-857a-4658-b108-8c0e372710c8 req-08d83f95-ef51-484e-ae67-505a5ceab5bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037520 Aug 03 04:42:31.536459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1287/2601] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:31.627547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:31.628428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:31.635204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.635857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.636996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.637609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.807861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:31.817027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34bff2a7-345f-4a00-ad34-63450576f556 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.193661 Aug 03 04:42:31.817694 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1315/2602] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:31 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:31.926838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:31.927536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:31.935252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.935700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:31.936494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:31.936931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.041204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:32.041826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:32.048033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.048736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.049694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.050273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.108540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:32.116005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7da2d169-8be3-41b1-b8ca-2bc2af93d85d tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.193404 Aug 03 04:42:32.116881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1288/2603] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:31 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:32.128514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:32.134489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9f1e6ce-bf78-460c-8c97-c349fdbd0412 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1268 microversion: 2.1 time: 0.098052 Aug 03 04:42:32.135065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1316/2604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:32 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:32.211615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:32.212362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:32.218778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.219363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.220209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.220815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.367406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:32.385357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1868e851-afa2-45cf-b4e1-a64f8c488146 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.178195 Aug 03 04:42:32.393075 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1289/2605] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:32 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:32.455882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:32.456531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:32.463719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.464177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.465029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.465485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.640058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:32.656165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-897d03d9-6d63-470c-be1b-317fb6685ef5 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1527 microversion: 2.1 time: 0.204267 Aug 03 04:42:32.673702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1317/2606] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:32 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1527 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:32.840026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:32.840793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:32.848004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.848543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:32.849394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:32.849765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.003039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:33.024230 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70a8b5a3-4ecf-40b0-a45f-05c34efbfa0f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.177296 Aug 03 04:42:33.024230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1290/2607] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:32 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:33.138544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:33.139157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:33.146514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.146998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.147859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.148868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.155544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:33.156189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:33.164989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.168200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.168200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.168200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.246990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:33.263217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ec4fd25-6403-42cb-b844-23e48851d751 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1268 microversion: 2.1 time: 0.111547 Aug 03 04:42:33.279028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1291/2608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:33 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1268 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:33.322851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:33.331304 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64dfd494-79e7-454c-a25f-09278bf38d28 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1327 microversion: 2.1 time: 0.196463 Aug 03 04:42:33.331929 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1318/2609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:33 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1327 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:33.421163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:33.423578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:33.437226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.437975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.439062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.442716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.585537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:33.594792 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64fe668e-acc2-46ae-a7ce-35dbe907ba3b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.180784 Aug 03 04:42:33.608657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1292/2610] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:33 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:33.678633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:33.679249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:33.686453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.686913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.687698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.688150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.713098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:33.767280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3e7eedc0-3916-46fa-9631-91ac21bae39a req-e1daab48-c868-43a9-bc72-f50c3f06681e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42553f0f-11ef-47c7-83e0-a18390d947c9", "name": "network-vif-plugged", "status": "completed", "tag": "ebff0715-8ab9-4359-a02d-421e37dd67ed"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:33.782330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3e7eedc0-3916-46fa-9631-91ac21bae39a req-e1daab48-c868-43a9-bc72-f50c3f06681e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:33.783038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3e7eedc0-3916-46fa-9631-91ac21bae39a req-e1daab48-c868-43a9-bc72-f50c3f06681e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:33.798129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3e7eedc0-3916-46fa-9631-91ac21bae39a req-e1daab48-c868-43a9-bc72-f50c3f06681e service nova] Creating event network-vif-plugged:ebff0715-8ab9-4359-a02d-421e37dd67ed for instance 42553f0f-11ef-47c7-83e0-a18390d947c9 on n-h1-826756-5 Aug 03 04:42:33.804213 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3e7eedc0-3916-46fa-9631-91ac21bae39a req-e1daab48-c868-43a9-bc72-f50c3f06681e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040599 Aug 03 04:42:33.806387 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1293/2611] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:42:33.871802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:33.881652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6f9f366-129a-4ab4-927e-554ea8cde031 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1527 microversion: 2.1 time: 0.206804 Aug 03 04:42:33.896299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1319/2612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:33 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1527 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:34.038741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:34.040000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:34.049770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.050308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.051462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.051999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.256359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:34.264893 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fcd013c-f595-42da-89ec-125f8c73657f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.234822 Aug 03 04:42:34.265601 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1294/2613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:34 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:34.286624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:34.287241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:34.295440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.299424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.299424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.299424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.355433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:34.356059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:34.363477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.364124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.364944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.365389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.381533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:34.391624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff7afb33-09e5-49b2-b018-7f3e40bdea4e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1268 microversion: 2.1 time: 0.108421 Aug 03 04:42:34.406695 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1320/2614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:34 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1268 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:34.621082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:34.622003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:34.652029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.653024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.654151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.655046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.676589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:34.687267 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c386904-161d-4c19-b7af-0587dd6d0bbb tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1528 microversion: 2.1 time: 0.336869 Aug 03 04:42:34.691526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1295/2615] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:34 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:34.715636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:34.716669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:34.723990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.724751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:34.726725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:34.727503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.042740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:35.060714 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98a3760b-703b-491d-9479-8078ba212756 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.446983 Aug 03 04:42:35.066312 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1321/2616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:34 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:35.067250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:35.081635 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5190e92a-6bcd-480a-95f1-1ccb98978d66 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1528 microversion: 2.1 time: 0.370789 Aug 03 04:42:35.084298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:35.084790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1296/2617] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:34 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1528 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:35.099627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:35.121000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.121803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.123044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.123978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.263645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:35.274956 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c62ff51d-604a-432e-83aa-87fc5e8b4fd9 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1485 microversion: 2.1 time: 0.212244 Aug 03 04:42:35.278646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1322/2618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:35 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1485 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:35.297721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a985d656-140c-4ef9-97aa-b4db09aa0124 req-12d1e649-b74f-47d8-90e8-18f82a410443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026960ce-ebcc-46d4-847d-bd5647e37f52", "name": "network-vif-deleted", "tag": "4b7b9f1e-71d4-49be-8247-8f4b18c1c96f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:35.317176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a985d656-140c-4ef9-97aa-b4db09aa0124 req-12d1e649-b74f-47d8-90e8-18f82a410443 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.317631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a985d656-140c-4ef9-97aa-b4db09aa0124 req-12d1e649-b74f-47d8-90e8-18f82a410443 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.331863 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a985d656-140c-4ef9-97aa-b4db09aa0124 req-12d1e649-b74f-47d8-90e8-18f82a410443 service nova] Creating event network-vif-deleted:4b7b9f1e-71d4-49be-8247-8f4b18c1c96f for instance 026960ce-ebcc-46d4-847d-bd5647e37f52 on n-h2-826756-5 Aug 03 04:42:35.338531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a985d656-140c-4ef9-97aa-b4db09aa0124 req-12d1e649-b74f-47d8-90e8-18f82a410443 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057199 Aug 03 04:42:35.339476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1323/2619] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:35.345790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:35.346515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:35.369198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:35.370394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.371087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.372078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.373219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.487137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:35.487876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:35.496703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.498454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.499479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.500150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.536073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] HTTP exception thrown: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Request method failure captured: Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 HTTP/1.1 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fydCv3ii-4_-kqLjsEpczLgZNVZfsenhYi0JZprWr7AEDlFvNbbqSuCuHDfNJvxc0obfQavUMYHY1ALWv6-lUUinANiDI5nMWFw_yr8uVJgLpoD6JerZ9O2TQL0G9omHYsh4i959MFaGpCjVC7sBLMFlkTuZc4BqVDWfRZHpO_eEDk Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 378f3d336dee49169fb431eba89ea0cb Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 378f3d336dee49169fb431eba89ea0cb Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestMultiTenantJSON-73282508-project Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 096202ce5bdb4557bc0ac78363815fe7 Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508-project Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '26d1656f-004d-45f3-b6b2-7537c21afcb5'} Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:35.549357 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Returning 404 to user: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60957d52-bcac-49b6-a97c-c4cfd97ec317 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] 10.222.0.72 "DELETE /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 404 len: 111 microversion: 2.1 time: 0.447067 Aug 03 04:42:35.558971 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1297/2620] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:35 2022] DELETE /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 111 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:35.567219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:35.567851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:35.580004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.583553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.583553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.583553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.705986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:35.715680 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1b77ceb3-e417-454c-aa0b-49227c1d3b77 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1274 microversion: 2.1 time: 0.160206 Aug 03 04:42:35.717322 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1298/2621] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:35 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:35.728956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:35.729509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:35.740025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.740239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:35.749658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.750609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:35.751053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:35.753922 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf7894ab-ae83-4e8e-bffc-3bc86f0a83ad tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1520 microversion: 2.1 time: 0.410280 Aug 03 04:42:35.754772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1324/2622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:35 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:35.946973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29ca0190-2705-499d-9c3a-e4b637a4336e tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] Calling method '.version_select at 0x7fdd551db550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:36.115511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:36.125215 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84e9c35b-8b85-4781-95de-ea7b15516fa7 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1528 microversion: 2.1 time: 0.406821 Aug 03 04:42:36.136202 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1299/2623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:35 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1528 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:36.143406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:36.144448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:36.151502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.152252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.153571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.153709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.574129 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29ca0190-2705-499d-9c3a-e4b637a4336e tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] 10.222.0.72 "GET /compute/v2.1/os-networks" status: 200 len: 8799 microversion: 2.1 time: 0.762131 Aug 03 04:42:36.575574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1325/2624] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:42:35 2022] GET /compute/v2.1/os-networks => generated 8799 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:36.581091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Action: 'update', calling method: >, body: {"server": {"name": "26d1656f-004d-45f3-b6b2-7537c21afcb5_new"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:36.584003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:36.594552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.595011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.596113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.596905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.613429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] HTTP exception thrown: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Request method failure captured: Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 HTTP/1.1 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 64 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fydCv3ii-4_-kqLjsEpczLgZNVZfsenhYi0JZprWr7AEDlFvNbbqSuCuHDfNJvxc0obfQavUMYHY1ALWv6-lUUinANiDI5nMWFw_yr8uVJgLpoD6JerZ9O2TQL0G9omHYsh4i959MFaGpCjVC7sBLMFlkTuZc4BqVDWfRZHpO_eEDk Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 378f3d336dee49169fb431eba89ea0cb Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/378f3d336dee49169fb431eba89ea0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 378f3d336dee49169fb431eba89ea0cb Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestMultiTenantJSON-73282508-project Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 096202ce5bdb4557bc0ac78363815fe7 Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-73282508-project Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "26d1656f-004d-45f3-b6b2-7537c21afcb5_new"}} Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '26d1656f-004d-45f3-b6b2-7537c21afcb5', 'body': {'server': {'name': '26d1656f-004d-45f3-b6b2-7537c21afcb5_new'}}} Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:42:36.617602 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] Returning 404 to user: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a37c852-ce4b-4a32-a3c9-269b1f115331 tempest-ServersNegativeTestMultiTenantJSON-73282508 tempest-ServersNegativeTestMultiTenantJSON-73282508-project] 10.222.0.72 "PUT /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 404 len: 111 microversion: 2.1 time: 0.039965 Aug 03 04:42:36.622199 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1326/2625] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:42:36 2022] PUT /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:36.627513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:36.628359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:36.635101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.635634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.636527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.637037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.663736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:36.676990 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-461a723a-4674-4af0-9dc6-1e5df12cfe0a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.537367 Aug 03 04:42:36.677681 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1300/2626] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:36 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:36.682922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d9ce00b4-d6a9-413c-94ca-8cda4f4e1133 tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] Calling method '.version_select at 0x7fdd554714c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:36.694992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.699900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.700694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lazy-loading 'fault' on Instance uuid 026960ce-ebcc-46d4-847d-bd5647e37f52 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:36.847586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6deb3c13e347dbb7d31026d4cbb831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d290ac2b0734dd09c10c2000d98a406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:36.858924 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3dd45695-cb0f-43c5-9574-801106082348 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 200 len: 1314 microversion: 2.1 time: 0.236714 Aug 03 04:42:36.859371 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1327/2627] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:36 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:36.865080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:36.866476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:36.879309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.882094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.885798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:36.885798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:36.946256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:42:37.039650 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d9ce00b4-d6a9-413c-94ca-8cda4f4e1133 tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] 10.222.0.72 "GET /compute/v2.1/os-networks/1174c063-27cd-4b37-9449-022c0c71d48b" status: 200 len: 652 microversion: 2.1 time: 0.343277 Aug 03 04:42:37.039650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1301/2628] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:42:36 2022] GET /compute/v2.1/os-networks/1174c063-27cd-4b37-9449-022c0c71d48b => generated 652 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:37.039650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.039650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:37.047571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.048043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.049213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.049962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.243821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:37.260229 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84fc03a3-c0f8-456c-995f-97797173ac42 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.231456 Aug 03 04:42:37.264744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1302/2629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:37.268868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.269880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:37.282247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:37.284727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.286159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.288338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.289044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.290722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:37.351394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:37.535105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5210efaa-9d4f-49fe-bf6f-54cb7a18ed64 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "DELETE /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 204 len: 0 microversion: 2.1 time: 0.673248 Aug 03 04:42:37.536579 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1328/2630] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:36 2022] DELETE /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:42:37.543347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c564c469-ef77-4866-8fc3-509514ac46c7 tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] Calling method '.version_select at 0x7fdd548140d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.608950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:37.612408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:37.617392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1cf1dba5-c126-456d-81a0-6be68e5156b1 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1505 microversion: 2.1 time: 0.353763 Aug 03 04:42:37.618158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1303/2631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:37.623099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.623651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:37.631320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.631951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.633551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.634036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.838080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c564c469-ef77-4866-8fc3-509514ac46c7 tempest-NetworksTest-144182129 tempest-NetworksTest-144182129-project-admin] 10.222.0.72 "GET /compute/v2.1/os-networks" status: 200 len: 8799 microversion: 2.1 time: 0.299685 Aug 03 04:42:37.838701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1329/2632] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/os-networks => generated 8799 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:37.843974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.845031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:37.853554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.854016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.855372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.855777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.887703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:37.897292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-86dfd6ec-b07b-4e0a-b936-6b673941ea9b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1534 microversion: 2.1 time: 0.277863 Aug 03 04:42:37.907674 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1304/2633] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1534 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:37.907674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:37.907674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:37.914812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.914812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:37.915731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:37.916179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.082921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:38.091246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee360863-c3df-40cd-bd57-b099804979e0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 200 len: 1505 microversion: 2.1 time: 0.251383 Aug 03 04:42:38.091826 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1330/2634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:38.097115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:38.097736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] [instance: 026960ce-ebcc-46d4-847d-bd5647e37f52] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:38.104816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.105281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.106056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.106733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.122394 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] HTTP exception thrown: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Request method failure captured: Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 HTTP/1.1 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fydhJR6eIGLW8qhE2Yn-GSckYFEug2Of1gTnIPdC0q4FwdTSX3MHQq-dE1jl1VJK-q2-jDQvlC-Wi2YTNs2hQay8G8moXg_YYD8aCLUU1TZNdnoCm1jpffV6Rk7_xDWdoi_Fq6Cu2-NVYTZnMYYkDh7YVs8jjPGzxSUCEuC_msVeaY Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/5d290ac2b0734dd09c10c2000d98a406"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 5d290ac2b0734dd09c10c2000d98a406 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-884578443 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ca6deb3c13e347dbb7d31026d4cbb831 Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-884578443-project Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '026960ce-ebcc-46d4-847d-bd5647e37f52'} Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:38.124950 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] Returning 404 to user: Instance 026960ce-ebcc-46d4-847d-bd5647e37f52 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4ead685-552a-4142-a47d-c4dfcf8ed6d0 tempest-InstanceActionsNegativeTestJSON-884578443 tempest-InstanceActionsNegativeTestJSON-884578443-project] 10.222.0.72 "GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52" status: 404 len: 111 microversion: 2.1 time: 0.033653 Aug 03 04:42:38.129550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1331/2635] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:38 2022] GET /compute/v2.1/servers/026960ce-ebcc-46d4-847d-bd5647e37f52 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:42:38.131731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:38.132226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:38.139271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.140127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.140536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.140980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.167832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:42:38.215943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:38.223729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00056fc5-6d93-49b5-b9ef-0af4b8e9cbb2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.323898 Aug 03 04:42:38.224438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1305/2636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:37 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:38.284517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:38.285704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:38.292758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.293217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.294259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.294849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.576709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:38.586251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2409c4dc-fa0d-4988-aaa6-b37d9ed25d13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.306221 Aug 03 04:42:38.587074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1306/2637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:38 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:38.724391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-33ba63fa-3286-4992-ba8f-b39f699393bf req-5aa6389c-4236-4896-92dc-9db2d4cc41d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8d040b-046f-4144-88c6-dafa272e0b05", "tag": "5993c63c-287a-4e17-885d-8c443e17bd32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:38.731272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:38.737524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-33ba63fa-3286-4992-ba8f-b39f699393bf req-5aa6389c-4236-4896-92dc-9db2d4cc41d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.738084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-33ba63fa-3286-4992-ba8f-b39f699393bf req-5aa6389c-4236-4896-92dc-9db2d4cc41d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.756980 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba915d33-2e1a-4e99-9f11-278093641988 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 204 len: 0 microversion: 2.1 time: 0.628573 Aug 03 04:42:38.758124 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1332/2638] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:42:38 2022] DELETE /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:42:38.759257 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-33ba63fa-3286-4992-ba8f-b39f699393bf req-5aa6389c-4236-4896-92dc-9db2d4cc41d5 service nova] Creating event network-changed:5993c63c-287a-4e17-885d-8c443e17bd32 for instance 7f8d040b-046f-4144-88c6-dafa272e0b05 on n-h2-826756-5 Aug 03 04:42:38.769408 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-33ba63fa-3286-4992-ba8f-b39f699393bf req-5aa6389c-4236-4896-92dc-9db2d4cc41d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044745 Aug 03 04:42:38.769408 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1307/2639] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:42:38.893843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2047116772", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "7355cd35-092d-4804-b996-5025b03fa6a9"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:38.924036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:38.924784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:38.931711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.932140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.933085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:38.933736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:38.962465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] validate_networks() for [('7355cd35-092d-4804-b996-5025b03fa6a9', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:39.301956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:39.309518 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-916f695b-8496-44af-a16a-e7ea76b78c11 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1534 microversion: 2.1 time: 0.390740 Aug 03 04:42:39.310113 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1308/2640] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:38 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1534 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:39.328173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:39.328840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:39.352554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:39.353316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:39.355029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:39.355828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.072299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:40.080380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e404660f-1873-41f5-8fe8-bf98d6ba27eb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.769164 Aug 03 04:42:40.092589 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1309/2641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:39 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:40.092589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:40.092589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:40.095204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.096878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.097779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.098295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.502598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:40.503205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:40.503615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:40.504093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:40.504689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:40.515100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.515720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.516572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.517034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.535739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:40.547165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:40.550653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for user dcb77614e0f94653a93492f3f31b9dae and project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:40.556741 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6742ab4f-1cce-41b5-8996-40b03b9881d5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.474357 Aug 03 04:42:40.557550 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1310/2642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:40 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:40.564716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-83d3545a-e35c-4890-822c-264db781d996 req-1ca33eac-a2c9-4919-8d22-1d5b1360aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d1656f-004d-45f3-b6b2-7537c21afcb5", "name": "network-vif-deleted", "tag": "6d99c746-f7bd-4da5-bc87-ea936edee69a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:40.579538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-83d3545a-e35c-4890-822c-264db781d996 req-1ca33eac-a2c9-4919-8d22-1d5b1360aed3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.580944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-83d3545a-e35c-4890-822c-264db781d996 req-1ca33eac-a2c9-4919-8d22-1d5b1360aed3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.582686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:40.586405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:40.609129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-83d3545a-e35c-4890-822c-264db781d996 req-1ca33eac-a2c9-4919-8d22-1d5b1360aed3 service nova] Creating event network-vif-deleted:6d99c746-f7bd-4da5-bc87-ea936edee69a for instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 on n-h2-826756-5 Aug 03 04:42:40.613831 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-83d3545a-e35c-4890-822c-264db781d996 req-1ca33eac-a2c9-4919-8d22-1d5b1360aed3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054648 Aug 03 04:42:40.617155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1311/2643] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:40.624719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:40.625706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:40.634771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.635254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.636101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:40.636614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:40.754636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:40.769092 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ef24705-56a7-403a-b8b6-3da11d0d01c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1492 microversion: 2.1 time: 0.150660 Aug 03 04:42:40.769707 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1312/2644] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:40 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1492 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:40.880885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-048ece98-d7ea-4403-8d66-397ad03fcbcb tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991082 Aug 03 04:42:40.881942 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1333/2645] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:40.897628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-796689d9-eef3-4080-91c0-4429c1481ee7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:40.898591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-796689d9-eef3-4080-91c0-4429c1481ee7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:41.081525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-796689d9-eef3-4080-91c0-4429c1481ee7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:41.090400 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-796689d9-eef3-4080-91c0-4429c1481ee7 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1218 microversion: 2.1 time: 0.200905 Aug 03 04:42:41.105346 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1313/2646] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:40 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:41.111979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:41.112868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:41.138902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.149982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.150961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.151421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.525943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:41.533705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1dca591-459a-4f82-87a9-40fb3c591903 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.429187 Aug 03 04:42:41.534888 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1334/2647] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:41 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:41.580881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:41.593112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:41.602776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.603485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.604537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.605197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.709847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3f3f5452-8400-4166-af17-c08ace29fcaf req-9237a668-64f1-4064-9851-a8ccaee4f965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42553f0f-11ef-47c7-83e0-a18390d947c9", "name": "network-vif-deleted", "tag": "ebff0715-8ab9-4359-a02d-421e37dd67ed"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:41.750650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3f3f5452-8400-4166-af17-c08ace29fcaf req-9237a668-64f1-4064-9851-a8ccaee4f965 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.751242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3f3f5452-8400-4166-af17-c08ace29fcaf req-9237a668-64f1-4064-9851-a8ccaee4f965 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.765468 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3f3f5452-8400-4166-af17-c08ace29fcaf req-9237a668-64f1-4064-9851-a8ccaee4f965 service nova] Creating event network-vif-deleted:ebff0715-8ab9-4359-a02d-421e37dd67ed for instance 42553f0f-11ef-47c7-83e0-a18390d947c9 on n-h1-826756-5 Aug 03 04:42:41.773955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3f3f5452-8400-4166-af17-c08ace29fcaf req-9237a668-64f1-4064-9851-a8ccaee4f965 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066613 Aug 03 04:42:41.775418 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1335/2648] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:41.797549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:41.799219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:41.811514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.812182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.813364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.814388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.854427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:41.863091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e68dd75-1528-4a57-8d23-448369ab4e60 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.288487 Aug 03 04:42:41.863863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1314/2649] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:41 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:41.895144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:41.895608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:41.896068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lazy-loading 'fault' on Instance uuid 26d1656f-004d-45f3-b6b2-7537c21afcb5 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:41.941685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:41.952860 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-06640ca8-daed-408c-a179-928f62d0ad6b tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1317 microversion: 2.1 time: 0.163317 Aug 03 04:42:41.954008 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1336/2650] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:41 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:42.113992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f37fcdb-0bb2-4387-826f-e28f4fd6bdce tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:42.115003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f37fcdb-0bb2-4387-826f-e28f4fd6bdce tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:42.216843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f37fcdb-0bb2-4387-826f-e28f4fd6bdce tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:42.225142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f37fcdb-0bb2-4387-826f-e28f4fd6bdce tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1218 microversion: 2.1 time: 0.115444 Aug 03 04:42:42.229997 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1315/2651] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:42 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:42.561128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:42.561858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:42.571071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.571649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:42.572550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.573268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:42.610083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:42.776455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:42.808674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ddcb3008-32e0-48c6-81e5-90b298ccaf7e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.252179 Aug 03 04:42:42.810314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1337/2652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:42 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:42.889138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:42.889940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:42.897534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.898230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:42.899075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.899577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:42.977322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:42.978235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:42.984617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.985165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:42.986075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:42.986757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:43.021347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:43.021946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:43.022749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lazy-loading 'fault' on Instance uuid 26d1656f-004d-45f3-b6b2-7537c21afcb5 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:42:43.060787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:43.069242 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de2da00b-3554-48f9-b716-74f60cd4218f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.183806 Aug 03 04:42:43.083395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1316/2653] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:42 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:43.096854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8974a34e01b64ddf8e4152f889adebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ef89ddefa54a189962ffdc6b0f89fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:43.105708 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e9694a3-5bb6-4730-841c-2609523968c9 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 200 len: 1317 microversion: 2.1 time: 0.134331 Aug 03 04:42:43.106899 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1338/2654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:42 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:43.260039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:43.372981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:43.372981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc67bf07-f64f-42ff-bd94-213116deca8d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1222 microversion: 2.1 time: 0.124733 Aug 03 04:42:43.372981 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1317/2655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:43 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:43.833706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:43.835024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:43.843401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:43.844009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:43.844874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:43.845757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.074725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:44.083243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-793cb4ce-4b25-4161-a2ca-527c4c53624f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.253696 Aug 03 04:42:44.083840 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1339/2656] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:43 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:44.092137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:44.092815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:44.104976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.107312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.109625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.111133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.128824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:44.129463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] [instance: 26d1656f-004d-45f3-b6b2-7537c21afcb5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:44.141272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.141739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.150094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.150094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.198067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] HTTP exception thrown: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Request method failure captured: Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 HTTP/1.1 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fyLuRtGYVUr8i87r2hE2jymnhHAYvrgPngQSkjaEax95R73vu4CwilOucr31b4410fwR0ulPgRUGSwwYuhbHszHRtwNBSlCv22-cp6HoOQn1ksw-PEA14gWeSIcvuCoOtZqZc4RAWg3Z5efFDEYEEkGanBvbqfpccVnAxQn8L6B98I Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: f5ef89ddefa54a189962ffdc6b0f89fa Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1776630458 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5ef89ddefa54a189962ffdc6b0f89fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f5ef89ddefa54a189962ffdc6b0f89fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f5ef89ddefa54a189962ffdc6b0f89fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f5ef89ddefa54a189962ffdc6b0f89fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1776630458 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: f5ef89ddefa54a189962ffdc6b0f89fa Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1776630458 Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1776630458-project Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 8974a34e01b64ddf8e4152f889adebdb Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1776630458-project Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '26d1656f-004d-45f3-b6b2-7537c21afcb5'} Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:44.199998 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. Aug 03 04:42:44.206038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:42:44.214539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] Returning 404 to user: Instance 26d1656f-004d-45f3-b6b2-7537c21afcb5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:42:44.215821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df09d583-9d62-4b4c-a8f4-868013429902 tempest-ServersNegativeTestMultiTenantJSON-1776630458 tempest-ServersNegativeTestMultiTenantJSON-1776630458-project] 10.222.0.72 "GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5" status: 404 len: 111 microversion: 2.1 time: 0.092507 Aug 03 04:42:44.218240 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1340/2657] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:44 2022] GET /compute/v2.1/servers/26d1656f-004d-45f3-b6b2-7537c21afcb5 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:42:44.363385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:44.372686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1605839e-3fd1-4b9a-b83d-491f889b82e0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.285209 Aug 03 04:42:44.388363 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1318/2658] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:44 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:44.389306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:44.389891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:44.391998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-69837763", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:44.396197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.396788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.398151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.398815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.507217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:44.514822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:44.524193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee848311-c313-4557-86d7-250444c9f1af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1270 microversion: 2.1 time: 0.138996 Aug 03 04:42:44.525572 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1319/2659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:44 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:44.720229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:44.720723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:44.721204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:44.721620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:44.722291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:44.740937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.740937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.740937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:44.740937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:44.756006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Getting quotas for project 9507d823753f45cf8af897380864f3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:44.763160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Getting quotas for user f5daf9e187444dc3b5b729d97fd3ea8f and project 9507d823753f45cf8af897380864f3e2. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:44.780159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:44.782607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:44.926357 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e263049e-ce64-499b-aa4d-bf2b478bceb9 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682030 Aug 03 04:42:44.927481 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1341/2660] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:44.940472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd882082-b91b-4e24-8370-ccf1c6f45f8d tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:44.941103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd882082-b91b-4e24-8370-ccf1c6f45f8d tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:45.003890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd882082-b91b-4e24-8370-ccf1c6f45f8d tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:45.011651 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd882082-b91b-4e24-8370-ccf1c6f45f8d tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1221 microversion: 2.1 time: 0.075392 Aug 03 04:42:45.014779 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1320/2661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:44 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:45.108772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:45.113076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:45.155832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.157151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.158182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.159863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.377142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:45.385782 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe96305f-cc70-45c0-9e02-7e06012748b3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1505 microversion: 2.1 time: 0.283887 Aug 03 04:42:45.386373 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1342/2662] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:45 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:45.395789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:45.396562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:45.405381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.405830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.406640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.407078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.548293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:45.549003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:45.556173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:45.559078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.560831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.561709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:45.565653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:45.565815 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69a229f5-3eaa-4e4a-a453-33057baff367 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.173749 Aug 03 04:42:45.581311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1321/2663] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:45 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:45.647111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:45.655142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5ef3602-e9cb-45cf-bf63-4452ebf997af tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1270 microversion: 2.1 time: 0.111721 Aug 03 04:42:45.655729 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1343/2664] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:45 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:46.035650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-490e0c79-5bd9-4cd6-ace9-8d85d8c531ef tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:46.036755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-490e0c79-5bd9-4cd6-ace9-8d85d8c531ef tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:46.110130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-490e0c79-5bd9-4cd6-ace9-8d85d8c531ef tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:46.121387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-490e0c79-5bd9-4cd6-ace9-8d85d8c531ef tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1221 microversion: 2.1 time: 0.089773 Aug 03 04:42:46.121387 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1322/2665] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:46 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:46.410566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:46.415770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:46.431812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:46.433523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:46.435319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:46.437343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:46.592502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:46.593267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:46.605039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:46.607142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:46.611499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:46.611972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:47.192590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:47.203026 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13ce044e-2b60-4015-b1d5-e52cb5ca4b7d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1485 microversion: 2.1 time: 0.797711 Aug 03 04:42:47.209298 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1344/2666] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:46 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1485 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:47.218417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:47.230669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:47.231693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:47.242761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:47.246188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:47.249114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:47.250326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:47.261491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-342b49de-fe09-4ef5-bc03-7a70014fc3f6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.673456 Aug 03 04:42:47.262578 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1323/2667] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:46 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:47.285035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-117e6a01-499d-49f6-ba1d-c07a020919b0 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:47.285662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-117e6a01-499d-49f6-ba1d-c07a020919b0 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:47.358466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:47.366876 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-123c142f-9de1-4556-9244-400d546fe122 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1276 microversion: 2.1 time: 0.156067 Aug 03 04:42:47.370795 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1345/2668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:47 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:47.408504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-117e6a01-499d-49f6-ba1d-c07a020919b0 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:47.424323 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-117e6a01-499d-49f6-ba1d-c07a020919b0 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1221 microversion: 2.1 time: 0.140951 Aug 03 04:42:47.424323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1324/2669] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:47 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1221 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:47.433151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1232522396", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:47.496725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] validate_networks() for [('0cdc991e-0c09-4e1e-8d9d-7bc2ced8c554', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:48.151475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:48.151475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:48.151475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:48.151475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:48.151475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:48.159379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.160419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.161255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.161779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.184057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Getting quotas for project b4cd12a3a4c342b2950043b47b7e39b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:48.191681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Getting quotas for user 73d83656153f465a9c1bee17b9195287 and project b4cd12a3a4c342b2950043b47b7e39b6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:48.213924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:48.216476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:48.255351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:48.284590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:48.285030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:48.304730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.305447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.306402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.308439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.395145 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56361479-388a-4ac2-a879-a5db5280a44a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.971287 Aug 03 04:42:48.396156 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1346/2670] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:42:48.401390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:48.402666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:48.411795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.412375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.413830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.414432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.814995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:48.823973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe066a4f-48b5-4869-b811-5904db29d38e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.544013 Aug 03 04:42:48.825850 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1325/2671] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:48 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:48.839346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf7625d8-4542-4607-9153-57aa8558dd22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:48.855825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf7625d8-4542-4607-9153-57aa8558dd22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:48.862590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:48.875158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-11c25bbe-7a23-404b-89a0-b8ec2e75bfc9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.477321 Aug 03 04:42:48.876558 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1347/2672] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:48 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:48.885908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:48.888935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:48.906258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.906979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:48.909931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:48.910577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.026572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf7625d8-4542-4607-9153-57aa8558dd22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:49.041381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf7625d8-4542-4607-9153-57aa8558dd22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1214 microversion: 2.1 time: 0.214159 Aug 03 04:42:49.043864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1326/2673] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:48 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:49.057795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e4b6b878-279b-4c41-bd67-60067a4d1448 req-fd7bf8a0-a8a0-4f36-a07d-94e98a355d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d040b-046f-4144-88c6-dafa272e0b05", "name": "network-vif-plugged", "status": "completed", "tag": "5993c63c-287a-4e17-885d-8c443e17bd32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:49.072902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e4b6b878-279b-4c41-bd67-60067a4d1448 req-fd7bf8a0-a8a0-4f36-a07d-94e98a355d38 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.073545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e4b6b878-279b-4c41-bd67-60067a4d1448 req-fd7bf8a0-a8a0-4f36-a07d-94e98a355d38 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.074685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:49.086851 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e4b6b878-279b-4c41-bd67-60067a4d1448 req-fd7bf8a0-a8a0-4f36-a07d-94e98a355d38 service nova] Creating event network-vif-plugged:5993c63c-287a-4e17-885d-8c443e17bd32 for instance 7f8d040b-046f-4144-88c6-dafa272e0b05 on n-h2-826756-5 Aug 03 04:42:49.088755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ed8e4e4-03f9-4da9-b8a7-5bf685b05547 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1273 microversion: 2.1 time: 0.208906 Aug 03 04:42:49.093380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e4b6b878-279b-4c41-bd67-60067a4d1448 req-fd7bf8a0-a8a0-4f36-a07d-94e98a355d38 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049848 Aug 03 04:42:49.094288 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1327/2674] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:49.107095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1348/2675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:48 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:49.829864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-be503b29-0dea-4500-b857-13cfe557b431 req-de059c79-5b1e-4b50-84ed-c7ba022247af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83216e78-e5e9-40e1-9d32-be089211ff58", "tag": "45fbfd9c-a3df-40f1-b115-0461347b1e66"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:49.841996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be503b29-0dea-4500-b857-13cfe557b431 req-de059c79-5b1e-4b50-84ed-c7ba022247af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.842592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be503b29-0dea-4500-b857-13cfe557b431 req-de059c79-5b1e-4b50-84ed-c7ba022247af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.847389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:49.853726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:49.857220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-be503b29-0dea-4500-b857-13cfe557b431 req-de059c79-5b1e-4b50-84ed-c7ba022247af service nova] Creating event network-changed:45fbfd9c-a3df-40f1-b115-0461347b1e66 for instance 83216e78-e5e9-40e1-9d32-be089211ff58 on n-h1-826756-5 Aug 03 04:42:49.863583 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-be503b29-0dea-4500-b857-13cfe557b431 req-de059c79-5b1e-4b50-84ed-c7ba022247af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037261 Aug 03 04:42:49.865379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.866761 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1328/2676] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:49.867097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.869312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.869782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.900703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:49.902459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:49.917419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.923265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.926477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:49.928303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:49.941266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:50.402135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:50.409860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f17d8c7c-61ae-4757-aaa6-af664c96fce8 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.514977 Aug 03 04:42:50.410362 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1329/2677] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:49 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:50.419958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:50.429689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:50.430307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:50.431895 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da94e329-eed5-4706-b5b7-d04efa87409a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1316 microversion: 2.1 time: 0.588806 Aug 03 04:42:50.432864 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1349/2678] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:49 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:50.437134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:50.437597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:50.438370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:50.438501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:50.439085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:50.439201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:50.446131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:50.447034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:50.448121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:50.448695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:50.583257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:50.593201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1baa64d-4d2b-4e64-9ad0-aab576568911 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1218 microversion: 2.1 time: 0.167926 Aug 03 04:42:50.594139 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1330/2679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:50 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:50.648022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:50.658796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f2f14291-7c2d-407a-a9af-ea0e7b81f5cf tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1291 microversion: 2.1 time: 0.224603 Aug 03 04:42:50.668632 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1350/2680] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:50 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1291 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:50.706631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1191300814", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5f20cbf2-4fdb-4920-81d6-38054dfe8e24"}], "security_groups": [{"name": "tempest-securitygroup--1643403474"}], "key_name": "tempest-keypair-2058430100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fe955cd8-05e3-4338-952e-64c80ee87f74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:50.971462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] validate_networks() for [('5f20cbf2-4fdb-4920-81d6-38054dfe8e24', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:51.433505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:51.435614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:51.451778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:51.452239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:51.453066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:51.453701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:52.233207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:52.235675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02756648-4fe6-4a57-b0e0-75432dbe28ac tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.808761 Aug 03 04:42:52.236263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1351/2681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:51 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:52.241814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:52.242955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:52.257001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:52.257789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:52.259302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:52.260091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:52.826435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:52.834018 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dae88165-d5ee-4b26-b6ce-ae072178cc63 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1466 microversion: 2.1 time: 0.596564 Aug 03 04:42:52.834647 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1352/2682] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:52 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1466 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:52.855286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:52.855920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:52.864065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:52.864549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:52.866470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:52.867305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:52.983486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:52.995251 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b92ec87c-1807-481e-b94f-c69f31a68513 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1274 microversion: 2.1 time: 0.149530 Aug 03 04:42:52.996448 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1353/2683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:52 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:53.003280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:53.004170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:53.011138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.012043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.013140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.013707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.079153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for project 85e273b566c84276a6cc6930b18aa8c3. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:53.085021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for user d409642f486d4d52a57a9d644c28f6cf and project 85e273b566c84276a6cc6930b18aa8c3. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:53.092640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:53.105308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28abae21-d24e-4afb-bde4-57c0f3e83938 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1279 microversion: 2.1 time: 0.107504 Aug 03 04:42:53.107288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1354/2684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:52 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:53.118226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:53.119771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:53.125356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:53.125784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:53.128404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:53.129849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:53.132154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:53.133405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.135963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.137252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.138653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.155941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.156908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.159472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.160179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.206178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for project 85e273b566c84276a6cc6930b18aa8c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:53.219183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Getting quotas for user d409642f486d4d52a57a9d644c28f6cf and project 85e273b566c84276a6cc6930b18aa8c3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:53.298780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:53.301947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe955cd8-05e3-4338-952e-64c80ee87f74',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:53.436490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:53.443589 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab6489f0-83ae-43c1-acab-75c1d1e70fcd tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1617 microversion: 2.1 time: 0.334167 Aug 03 04:42:53.458731 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1355/2685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:53 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1617 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:53.472111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:53.477982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:53.486103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.486809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.487774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:53.488520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:53.820478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:53.830410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b5a9af7-5a3a-436d-aea7-5c837b06b561 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.369503 Aug 03 04:42:53.833363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1356/2686] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:53 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:53.839813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-758753458", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d2ebaa9e-c7c2-4d30-857a-3c9ad0086337"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:53.919862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:42:54.063122 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0aa54848-b08a-4901-97f5-f542ac6b08fc tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.358425 Aug 03 04:42:54.065024 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1331/2687] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:50 2022] POST /compute/v2.1/servers => generated 407 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:54.078598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:54.080151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:54.093343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.094431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.096911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.097665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.260646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:54.275350 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cba547d1-7faf-4c8f-b167-c3a6d77271ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1272 microversion: 2.1 time: 0.206973 Aug 03 04:42:54.275967 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1332/2688] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:54 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:54.288815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0631fc6b-f6e0-48be-be1b-c0966d5f9a91 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:54.289772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0631fc6b-f6e0-48be-be1b-c0966d5f9a91 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:54.342147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:42:54.342818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:42:54.344164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:42:54.345002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:42:54.345620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:42:54.362927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.363948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.367397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.369350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.404973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:42:54.411607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Getting quotas for user 2f846965ad9542238d5e7bce2a1e980d and project 18f6f7ad49364611aa364991953d58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:42:54.426662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:42:54.429093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:42:54.472795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0631fc6b-f6e0-48be-be1b-c0966d5f9a91 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:54.483164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0631fc6b-f6e0-48be-be1b-c0966d5f9a91 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1122 microversion: 2.1 time: 0.204855 Aug 03 04:42:54.484806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1333/2689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:54 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1122 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:54.491604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:54.494076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:54.500873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:42:54.503504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.504242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.505035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.505587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.734419 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1266be42-dc8b-4c85-bdd2-77bd5e4e9033 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899704 Aug 03 04:42:54.741585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1357/2690] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:42:54.749223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ef3fc1b-2b0f-418a-baaf-619f4ac1d0c9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:54.749859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ef3fc1b-2b0f-418a-baaf-619f4ac1d0c9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:54.888507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ef3fc1b-2b0f-418a-baaf-619f4ac1d0c9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:54.890987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:54.906155 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de87d6a4-4b61-4941-9664-da0f276d49cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.418135 Aug 03 04:42:54.906155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1334/2691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:54 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:54.909385 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ef3fc1b-2b0f-418a-baaf-619f4ac1d0c9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1216 microversion: 2.1 time: 0.164267 Aug 03 04:42:54.911463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:54.912189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:54.916615 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1358/2692] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:54 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:54.920682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.921145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:54.921982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:54.922425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:55.139759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:55.148332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b30e0ec7-8423-4234-a7af-63b5159d7c9d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.242028 Aug 03 04:42:55.149296 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1335/2693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:54 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:55.313834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:55.314649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:55.334058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:55.335270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:55.338212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:55.345784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:55.505987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efd88604-7609-4b13-9fcc-e6d76030dde3 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:55.506681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efd88604-7609-4b13-9fcc-e6d76030dde3 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:55.564883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:55.578798 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04b59fea-2cf5-4fc9-8fb9-6f379a1901ab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.277467 Aug 03 04:42:55.579418 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1359/2694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:55 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:55.627012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-efd88604-7609-4b13-9fcc-e6d76030dde3 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:55.661018 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efd88604-7609-4b13-9fcc-e6d76030dde3 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1122 microversion: 2.1 time: 0.158923 Aug 03 04:42:55.665216 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1336/2695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:55 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1122 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:42:55.929915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:55.931249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:55.937834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:55.943383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a408f7a9-6688-4f70-a872-e820c18858cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:55.944311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a408f7a9-6688-4f70-a872-e820c18858cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:55.949581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:55.953632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:55.954171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:56.154251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a408f7a9-6688-4f70-a872-e820c18858cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:56.166136 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a408f7a9-6688-4f70-a872-e820c18858cf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1216 microversion: 2.1 time: 0.226536 Aug 03 04:42:56.181019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1337/2696] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:55 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:56.188967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a2472f32-ee91-44b9-824e-8b55caffeb84 req-0401a6ec-ec4a-4f6f-a3e6-53b88155f810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d96d6b-82ea-48e4-8903-ce27089048f1", "tag": "91ef02c6-e04e-48f7-8c98-b4c4f727b8b0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:56.200029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2472f32-ee91-44b9-824e-8b55caffeb84 req-0401a6ec-ec4a-4f6f-a3e6-53b88155f810 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:56.200746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2472f32-ee91-44b9-824e-8b55caffeb84 req-0401a6ec-ec4a-4f6f-a3e6-53b88155f810 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:56.213419 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a2472f32-ee91-44b9-824e-8b55caffeb84 req-0401a6ec-ec4a-4f6f-a3e6-53b88155f810 service nova] Creating event network-changed:91ef02c6-e04e-48f7-8c98-b4c4f727b8b0 for instance d3d96d6b-82ea-48e4-8903-ce27089048f1 on n-h2-826756-5 Aug 03 04:42:56.219276 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a2472f32-ee91-44b9-824e-8b55caffeb84 req-0401a6ec-ec4a-4f6f-a3e6-53b88155f810 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Aug 03 04:42:56.220093 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1338/2697] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:56.225771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:56.226929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:56.233689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:56.234383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:56.235370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:56.235959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:56.865179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:56.873899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01dc1f03-effa-4109-ae52-3ca86b721fbd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.948312 Aug 03 04:42:56.888943 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1360/2698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:55 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:56.895527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:56.896733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:56.905093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:56.908332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:56.908332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:56.908332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.135562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:57.176126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c2fe6ab-d00b-4af7-a2f6-3c7a06b3103b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.950260 Aug 03 04:42:57.180973 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1339/2699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:56 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:57.207137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:57.208472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:57.249704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.252359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.253746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.258353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.340232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:57.361788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8966338-8b79-452f-abcb-10d79ba75285 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.470127 Aug 03 04:42:57.379563 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1361/2700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:56 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:57.391465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:57.392487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:57.399365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.400973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.402218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.402854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.462851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:57.499636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d88bd405-76c0-42ca-925c-64b5cec18805 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1220 microversion: 2.1 time: 0.316393 Aug 03 04:42:57.503675 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1340/2701] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:57 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1220 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:57.534712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:57.545188 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65dd59f8-9a0a-4f67-ba86-3a8c7ad5467c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1212 microversion: 2.1 time: 0.163883 Aug 03 04:42:57.546378 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1362/2702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:57 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1212 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:57.895184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:57.897361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:57.932723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.932723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:57.932723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:57.932723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.115377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:58.123932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b63d0608-7b80-4b95-b97a-69c9a385c495 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.232496 Aug 03 04:42:58.124574 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1341/2703] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:57 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:58.210506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:58.219267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:58.232364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.233575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.247136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.249382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.352665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c174d3e8-590d-43ff-b177-91c5bb9833fa req-cbe5620b-ec76-4064-a601-84c5ef1f9e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83216e78-e5e9-40e1-9d32-be089211ff58", "name": "network-vif-plugged", "status": "completed", "tag": "45fbfd9c-a3df-40f1-b115-0461347b1e66"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:58.373178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c174d3e8-590d-43ff-b177-91c5bb9833fa req-cbe5620b-ec76-4064-a601-84c5ef1f9e5b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.373640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c174d3e8-590d-43ff-b177-91c5bb9833fa req-cbe5620b-ec76-4064-a601-84c5ef1f9e5b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.398201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c174d3e8-590d-43ff-b177-91c5bb9833fa req-cbe5620b-ec76-4064-a601-84c5ef1f9e5b service nova] Creating event network-vif-plugged:45fbfd9c-a3df-40f1-b115-0461347b1e66 for instance 83216e78-e5e9-40e1-9d32-be089211ff58 on n-h1-826756-5 Aug 03 04:42:58.407382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c174d3e8-590d-43ff-b177-91c5bb9833fa req-cbe5620b-ec76-4064-a601-84c5ef1f9e5b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062274 Aug 03 04:42:58.408707 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1342/2704] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:58.417979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:58.423584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:58.432760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.433650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.435535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.441607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.720762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:58.736910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-856e14e8-f389-4cf6-9e9f-aa2577731f09 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.538934 Aug 03 04:42:58.753541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1363/2705] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:58 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:58.761879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:58.761879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:58.783229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.784088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.785222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.785822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.921422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:58.932940 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c142a566-f7e8-4836-ba82-a0c90b568c85 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1228 microversion: 2.1 time: 0.177878 Aug 03 04:42:58.933604 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1364/2706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:58 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1228 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:58.938564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:58.945470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:58.970933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.971456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:58.972350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:58.972963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.158347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:59.171083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c49766f2-22dd-4e76-bc33-42e222e81bab tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.756631 Aug 03 04:42:59.172865 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1343/2707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:58 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:59.188959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8db8073c-efa6-40d4-953e-b5cc65b1f90d req-28786f84-6789-43de-81cd-09434f58a5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98690b1-467a-46cd-b033-84b1fe83adb1", "tag": "04174684-1810-4c29-b3b8-1f18d271b98f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:42:59.200646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:59.210875 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5dfb0423-e3a9-4653-908f-7d97a1f7369f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1268 microversion: 2.1 time: 0.275649 Aug 03 04:42:59.218515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1365/2708] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:58 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1268 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:59.231832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8db8073c-efa6-40d4-953e-b5cc65b1f90d req-28786f84-6789-43de-81cd-09434f58a5de service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.231832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8db8073c-efa6-40d4-953e-b5cc65b1f90d req-28786f84-6789-43de-81cd-09434f58a5de service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.237712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:59.249253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:59.257501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.257956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.258816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.259259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.267332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8db8073c-efa6-40d4-953e-b5cc65b1f90d req-28786f84-6789-43de-81cd-09434f58a5de service nova] Creating event network-changed:04174684-1810-4c29-b3b8-1f18d271b98f for instance a98690b1-467a-46cd-b033-84b1fe83adb1 on n-h2-826756-5 Aug 03 04:42:59.279393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8db8073c-efa6-40d4-953e-b5cc65b1f90d req-28786f84-6789-43de-81cd-09434f58a5de service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102307 Aug 03 04:42:59.282741 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1344/2709] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:42:59.732302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:42:59.740334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c788bf5-9bcf-4663-a3a2-163721f6c51f tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.506670 Aug 03 04:42:59.741019 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1366/2710] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:59 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:42:59.762036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:59.762674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:59.782075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.782562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.783387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.783833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.959334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:42:59.959929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:42:59.976109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.976575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:42:59.977576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:42:59.977799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.102427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:00.114570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2622cdac-c066-4625-9296-fef6c6266d66 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1238 microversion: 2.1 time: 0.159293 Aug 03 04:43:00.125886 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1367/2711] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:59 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1238 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:00.198054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:00.198903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:00.209037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.212855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.213897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.216038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.508132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:00.523931 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad23a8a4-fa01-4e7e-9d19-f3f7892ebbdc tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1318 microversion: 2.1 time: 0.766195 Aug 03 04:43:00.524772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1345/2712] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:42:59 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:00.530990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:00.531605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:00.549556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.550012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.550797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.551233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.698890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:00.713314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3326d2a3-cd11-4653-9289-98ab2e844ee6 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1274 microversion: 2.1 time: 0.183692 Aug 03 04:43:00.720722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1346/2713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:00 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:00.763822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:00.764641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:00.781897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.782448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:00.783335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:00.783877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.390668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:01.403709 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17e56f7b-4b06-4287-88cc-a053e893cb86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 1.210379 Aug 03 04:43:01.421080 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1368/2714] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:00 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:01.429078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:01.430061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:01.438229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.438929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.439924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.440554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.641039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:01.664776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-729bec75-0fff-4f0a-b3bd-3813b92caa60 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1238 microversion: 2.1 time: 0.241417 Aug 03 04:43:01.670699 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1369/2715] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:01 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1238 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:01.676463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:01.679534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:01.692975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.695192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.697005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.699228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.938480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:01.948440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0726e4e4-c8f1-45d0-87ac-127835f56a29 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 1.190652 Aug 03 04:43:01.949214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1347/2716] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:00 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:01.954780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:01.955609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:01.964094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.964582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:01.965909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:01.966036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:02.216771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:02.225380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64aa5e26-1405-4c66-a37c-3cb32baa9c7d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1274 microversion: 2.1 time: 0.273574 Aug 03 04:43:02.226313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1348/2717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:01 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1274 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:02.379902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:02.416902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-200c0575-dda8-4d21-9c68-f12412a9a4e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1509 microversion: 2.1 time: 0.718353 Aug 03 04:43:02.417586 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1370/2718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:01 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:02.438426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:02.439917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:02.441889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:02.442698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:02.461023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:02.461023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:02.461389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:02.461493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:02.461586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:02.461684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:02.461777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:02.461777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.187076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:03.195676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:03.196488 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4ca4357-cd16-4876-882b-566eeec885e7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.765688 Aug 03 04:43:03.200592 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1349/2719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:02 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:03.205626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:03.213132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:03.227977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.228531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.229517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.230120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.243026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:03.262965 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6c6c1c8-d84e-4ee3-aa4c-3788fb8302de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1509 microversion: 2.1 time: 0.823182 Aug 03 04:43:03.262965 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1371/2720] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:02 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1509 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:03.279463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:03.281803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:03.297583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.298230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.307423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.310440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.880563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:03.889381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3255a502-39ba-4507-b6dd-c6a0c5293e78 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1306 microversion: 2.1 time: 0.687365 Aug 03 04:43:03.889993 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1350/2721] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:03 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1306 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:03.904232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:03.904819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:03.922128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.922860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.923818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:03.925224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:03.977096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:04.004937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:04.021199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4edba7e5-fd76-41f2-a089-f698fd842e85 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.754474 Aug 03 04:43:04.022110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1372/2722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:03 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:04.031756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:04.043554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:04.069744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.070742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:04.071841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.072463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:04.192514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:04.333398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-320cf144-15e8-4618-9951-dd44db71c0e6 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "PUT /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1081 microversion: 2.1 time: 0.309607 Aug 03 04:43:04.336739 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1373/2723] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:43:04 2022] PUT /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1081 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:04.393442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:04.560766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:04.571013 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ae7717e-ed45-4cfd-bcff-798502cbf1a9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.679226 Aug 03 04:43:04.571013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1351/2724] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:03 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:04.587747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:04.588487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:04.595721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.596181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:04.596997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.597441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:04.611639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d7a6815-ef78-4505-9590-6c18e14a7cde tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: .version_select at 0x7fdd47eb5820>, body: {"keypair": {"name": "tempest-keypair-824954441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP5fFEv45U0YXPQ4A+6DwZ1vhaDFYbnQL77c5oxmZhI9tl6e+eH4d02qX2hCGm9PtfzlqMN3BXt3Ifdf3H0tfRdJNnfwBv+bprbMGyp1uG8rDx2fFGCImoh65F/7sWSTA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:04.649945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1d7a6815-ef78-4505-9590-6c18e14a7cde tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:04.686337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1d7a6815-ef78-4505-9590-6c18e14a7cde tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:04.822353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d7a6815-ef78-4505-9590-6c18e14a7cde tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.483726 Aug 03 04:43:04.828700 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1374/2725] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:43:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:04.843485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:04.845461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:04.886315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.932531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:04.937048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:04.937658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:05.519746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:05.527956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3cc4acc5-0d48-4d5f-b39c-3ac948918c41 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.945117 Aug 03 04:43:05.528594 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1352/2726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:04 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:05.545852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:05.555458 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-871cb878-55b2-4222-8b07-36839ef26733 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1507 microversion: 2.1 time: 0.730911 Aug 03 04:43:05.560520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1375/2727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:04 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:05.575105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:05.575105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:05.581078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:05.589823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:05.590621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:05.591318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:05.592389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:05.593070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:05.595389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:05.596199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:05.597342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:05.600292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.043727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:06.078191 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e0fbf10-a0bf-4515-8166-43bb1be093e2 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.489643 Aug 03 04:43:06.082935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1376/2728] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:05 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:06.105574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:06.111684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:06.121485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:06.131661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.132687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.133493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.134177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ae9affb-4d2c-43d5-80ae-fc87f2d298ce tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1306 microversion: 2.1 time: 0.604525 Aug 03 04:43:06.134773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1353/2729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:05 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1306 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:06.135619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.139832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:06.149467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:06.156998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.165576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.166640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.167376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.168056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=28 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:06.605523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:06.619494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d38f2ee-858c-4a1f-b245-e5fc49607e8e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.483326 Aug 03 04:43:06.621666 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1354/2730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:06 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:06.622919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:06.651213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:06.651764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1a3f2c1-f1f9-4b8b-95b0-2b32e9d2019e tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1507 microversion: 2.1 time: 0.548599 Aug 03 04:43:06.651858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:06.651937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1377/2731] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:06 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1507 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:06.652023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.652023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.652023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.652023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.663164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:06.666018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:06.672472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.672833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.673609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:06.674221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:06.778643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:43:06.779596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:43:06.780372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:43:06.781721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:43:06.782468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:43:06.948980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:06.981611 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-072edcf1-4b64-41af-bbd6-1a235dda6563 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.358472 Aug 03 04:43:06.982531 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1355/2732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:06 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:07.008756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceed001-1497-4a04-829e-95b663847c7b", "tag": "622756e3-d616-46b7-a167-2c6b4b32f856"}, {"name": "network-changed", "server_uuid": "5f86ddfe-e4d8-417d-b2ae-6b991fad9394", "tag": "badd34b0-cfa4-4f70-8280-7eba96dcc31c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:07.023394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.023844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.040200 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] Creating event network-changed:622756e3-d616-46b7-a167-2c6b4b32f856 for instance 9ceed001-1497-4a04-829e-95b663847c7b on n-h1-826756-5 Aug 03 04:43:07.041571 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] Creating event network-changed:badd34b0-cfa4-4f70-8280-7eba96dcc31c for instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 on n-h1-826756-5 Aug 03 04:43:07.050154 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8ccf3abd-25d7-4d51-9b13-5f5857ac1d97 req-bfb94c5e-baaf-4ff7-97f7-de27b86156e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065550 Aug 03 04:43:07.051928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1356/2733] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:07.102233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:07.118798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.120697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.121969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.122590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.129094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:07.132898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:07.157318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.160607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.178563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.178563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.178769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b82f2aa7-1be9-4ecd-b253-b5f090655801 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "POST /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58/action" status: 202 len: 1113 microversion: 2.1 time: 0.506495 Aug 03 04:43:07.178769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1378/2734] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:43:06 2022] POST /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58/action => generated 1113 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 03 04:43:07.193977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:07.194613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:07.211090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.211537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.212395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.213339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.767190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:07.790013 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e84be2f6-d6e6-4205-a566-a663878d2476 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.685855 Aug 03 04:43:07.790013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1357/2735] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:07 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:07.796900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:07.807030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc39b636-56e3-4d3d-98a8-77df55c3f58c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1306 microversion: 2.1 time: 0.639383 Aug 03 04:43:07.807505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1379/2736] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:07 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1306 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:07.818324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:07.819013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:07.821887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:07.822732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:07.829444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.829903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.830844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.831441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.831660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.832308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:07.833265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:07.833871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.268819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:08.283971 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78695803-0af7-4686-8281-521b43513286 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.468855 Aug 03 04:43:08.285756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1380/2737] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:07 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:08.304219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:08.305170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:08.308513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:08.310965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:08.312739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.313405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.314191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.314832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.322640 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88897005-5369-4ea2-957b-58fdeecd11e2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.527349 Aug 03 04:43:08.323380 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1358/2738] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:07 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:08.456875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:08.465337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-943f6262-ca49-45d0-b949-4b42ca4021c9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.178203 Aug 03 04:43:08.465838 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1381/2739] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:08 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:08.606969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e82de814-e4c5-4973-ad34-1b2a6fc09ab6 req-e78eb7b8-b727-4bbf-84a5-14b11c2f48f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d96d6b-82ea-48e4-8903-ce27089048f1", "name": "network-vif-plugged", "status": "completed", "tag": "91ef02c6-e04e-48f7-8c98-b4c4f727b8b0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:08.617667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e82de814-e4c5-4973-ad34-1b2a6fc09ab6 req-e78eb7b8-b727-4bbf-84a5-14b11c2f48f9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.618347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e82de814-e4c5-4973-ad34-1b2a6fc09ab6 req-e78eb7b8-b727-4bbf-84a5-14b11c2f48f9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.631351 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e82de814-e4c5-4973-ad34-1b2a6fc09ab6 req-e78eb7b8-b727-4bbf-84a5-14b11c2f48f9 service nova] Creating event network-vif-plugged:91ef02c6-e04e-48f7-8c98-b4c4f727b8b0 for instance d3d96d6b-82ea-48e4-8903-ce27089048f1 on n-h2-826756-5 Aug 03 04:43:08.636435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e82de814-e4c5-4973-ad34-1b2a6fc09ab6 req-e78eb7b8-b727-4bbf-84a5-14b11c2f48f9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033402 Aug 03 04:43:08.637064 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1359/2740] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:08.809335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:08.810701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:08.817375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.817960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.819593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.820781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.828207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:08.829469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:08.840298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.840760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:08.841729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:08.842168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.048585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:09.056822 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c52a461a-1561-4726-aea1-b2a13b43083a tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.252581 Aug 03 04:43:09.057407 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1382/2741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:08 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:09.060759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:09.069520 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae9a9d5b-c9fd-407e-bcf6-10f2a42bcff7 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.245705 Aug 03 04:43:09.070227 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1360/2742] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:08 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:09.308104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:09.308706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:09.315052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.315767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.316775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.317223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.393945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:09.394604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:09.413002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.413787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.414764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.415373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.537272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:09.546343 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3792a795-87cc-4054-ade2-b3f0e933d915 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.242523 Aug 03 04:43:09.547340 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1383/2743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:09 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:09.552093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:09.552972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:09.559582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.560220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.561324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:09.562005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:09.656517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:09.667757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d84aee9a-af22-4bd6-a843-a4f5580d57d0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.287571 Aug 03 04:43:09.669028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1361/2744] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:09 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:09.737131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:09.749921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce90b9d4-6912-4dcd-b8a9-0b7000a2516a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.200025 Aug 03 04:43:09.751533 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1384/2745] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:09 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:10.030365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1355121212", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f881aa8-baa3-4832-9e42-a4ace23e4798"}], "security_groups": [{"name": "tempest-securitygroup--1527135312"}], "key_name": "tempest-keypair-824954441", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:10.078946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:10.079645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:10.092500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:10.093176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:10.098862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:10.098862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:10.334408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] validate_networks() for [('1f881aa8-baa3-4832-9e42-a4ace23e4798', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:43:10.510633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:10.533873 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03e2b5cb-6f01-4b54-a504-c5b4350d36c5 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1321 microversion: 2.1 time: 0.451850 Aug 03 04:43:10.544328 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1385/2746] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:10 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:10.552637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:10.553640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:10.582519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:10.583053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:10.584547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:10.585066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24074b45-78c2-4c23-b00e-f6c28db65ef5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.781906 Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1386/2747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:10 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:11.433445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:11.849919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:11.867186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0aedccf8-3ac1-4c73-8f1b-e63da9731bf1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.541218 Aug 03 04:43:11.868441 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1387/2748] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:11 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:11.874173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:11.876461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:11.884309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:11.885028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:11.885977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:11.886569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.163686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:43:12.164695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:43:12.165204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:43:12.165616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:43:12.166029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:43:12.182545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.183133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.184447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.185087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.206679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:12.212864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:12.227558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:43:12.231877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:43:12.330046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:12.337943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-831a21e3-662c-464d-9723-1607eb43bf6f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.468301 Aug 03 04:43:12.338536 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1388/2749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:11 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:12.343045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:12.343658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:12.350194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.350645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.351413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.352030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.361737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:12.368713 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eca3fa9a-8262-4dd7-be39-fe390d2a53a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.342899 Aug 03 04:43:12.375555 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1362/2750] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:43:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:43:12.380881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:12.382228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:12.390133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.390783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.391802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.392443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.780489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:12.789410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab42d9dc-312d-4a29-aed7-7805a597b019 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.449751 Aug 03 04:43:12.800191 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1389/2751] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:12 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:12.800191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:12.800191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:12.803574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.804372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.813608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:12.814196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:12.873385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:12.905841 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5671062f-f1b0-4f1e-9a64-2e7ac037d1bd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1471 microversion: 2.1 time: 0.524547 Aug 03 04:43:12.910103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1363/2752] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:12 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1471 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:12.924660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e7822c3-a14f-4f41-96ef-e441178cd2d2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:12.935826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e7822c3-a14f-4f41-96ef-e441178cd2d2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.053680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0e7822c3-a14f-4f41-96ef-e441178cd2d2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:13.061826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e7822c3-a14f-4f41-96ef-e441178cd2d2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1238 microversion: 2.1 time: 0.150367 Aug 03 04:43:13.062984 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1364/2753] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:12 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1238 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:13.068546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.069625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.077419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.080222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.080222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.080222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.167875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:13.178024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d8ab5e5-1f70-4ca0-8cce-9eb0c03f8080 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.385838 Aug 03 04:43:13.192977 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1390/2754] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:12 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:13.198666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.199418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.212723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.213809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.214908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.215411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.259366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Request method failure captured: Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1/diagnostics HTTP/1.1 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzCwkdXd2Nt0lvyJnyT6fMDtA6a655ZwHe392pT_awyqNnF3l6OAymUC3qwwWRYyO41DXaundSJWjuUDxIJVc9j_lDSZ1ET-jlvJkTPSw5Ye6Xf52EPRKGcna6n8zy4hUTGEX-eaUtHJOjMINZwdiztfssxUGjhWmqb5GgXwc8V-6w Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9507d823753f45cf8af897380864f3e2 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9507d823753f45cf8af897380864f3e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9507d823753f45cf8af897380864f3e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9507d823753f45cf8af897380864f3e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9507d823753f45cf8af897380864f3e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9507d823753f45cf8af897380864f3e2 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiagnosticsNegativeTest-471339828-project Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: f5daf9e187444dc3b5b729d97fd3ea8f Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-471339828-project Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': 'd3d96d6b-82ea-48e4-8903-ce27089048f1'} Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise self.value Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:13.265721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d33cdff-f6dd-4c0d-8913-82fbc5c9a783 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.072814 Aug 03 04:43:13.270623 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1391/2755] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:43:13 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1/diagnostics => generated 117 bytes in 74 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:13.280999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.281714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.290386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.291119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.292095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.292890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.331526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:13.512625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:13.521675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-094af560-56cd-4a55-9f3a-cf8b23efc0c5 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.457051 Aug 03 04:43:13.533670 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1365/2756] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:13 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:13.539467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.540227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.547309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.547848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.548729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.549177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.798334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84e47f88-5877-46a7-8b83-41a1a3d03709 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 204 len: 0 microversion: 2.1 time: 0.523625 Aug 03 04:43:13.800186 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1392/2757] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:13 2022] DELETE /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:43:13.808504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.810296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.814137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:13.816390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.817048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.818058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.818952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.822354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff71c770-c17b-42e6-8047-43a9e35167b9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.287180 Aug 03 04:43:13.837004 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1366/2758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:13 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:13.846166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:13.847092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:13.854462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.856164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:13.856570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:13.857169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.413289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:14.415743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:14.421659 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd7e22eb-633d-4754-a1df-c11f2d31b27b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1477 microversion: 2.1 time: 0.617358 Aug 03 04:43:14.422249 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1393/2759] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:13 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1477 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:14.423653 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edf71b26-e838-4e1f-aaa5-59b6f90cdb6b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.585301 Aug 03 04:43:14.424238 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1367/2760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:13 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:14.438550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1422fe72-bee2-4af8-9c92-9997859732e9 req-0c79a042-c940-421c-b5be-e568e28cccde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f86ddfe-e4d8-417d-b2ae-6b991fad9394", "name": "network-vif-plugged", "status": "completed", "tag": "badd34b0-cfa4-4f70-8280-7eba96dcc31c"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:14.438683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:14.438683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:14.441669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1422fe72-bee2-4af8-9c92-9997859732e9 req-0c79a042-c940-421c-b5be-e568e28cccde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.441808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.442119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.442237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1422fe72-bee2-4af8-9c92-9997859732e9 req-0c79a042-c940-421c-b5be-e568e28cccde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.443517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.444047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.454321 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1422fe72-bee2-4af8-9c92-9997859732e9 req-0c79a042-c940-421c-b5be-e568e28cccde service nova] Creating event network-vif-plugged:badd34b0-cfa4-4f70-8280-7eba96dcc31c for instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 on n-h1-826756-5 Aug 03 04:43:14.459594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1422fe72-bee2-4af8-9c92-9997859732e9 req-0c79a042-c940-421c-b5be-e568e28cccde service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036096 Aug 03 04:43:14.460197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1394/2761] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:14.465416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:14.473588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:14.473588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.473588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.474410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.474507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.519063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:14.527747 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3bce760a-1c6f-4ba3-8843-11053d467575 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1242 microversion: 2.1 time: 0.102449 Aug 03 04:43:14.528387 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1368/2762] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:14 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:14.548357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:14.548357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:14.550951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.551502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.552637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.553196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.719589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=30 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:14.861002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:14.871127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aefc3e5b-aaeb-40cb-9641-5e85939e17c1 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.409424 Aug 03 04:43:14.871772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1395/2763] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:14 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:14.887986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:14.890353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:14.891177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:14.905642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.907988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.907988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:14.907988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:14.917785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-879ae36c-7cf3-4f18-918b-69ed7f48df13 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.377468 Aug 03 04:43:14.919323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1369/2764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:14 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:15.062488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:15.071109 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1015634a-df7c-49b1-a309-4bf04e2a0201 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.184830 Aug 03 04:43:15.071860 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1396/2765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:14 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:15.445121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:15.446086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:15.448941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:15.450251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:15.453707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.454402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.455404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.457630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.465719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.466231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.468301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.469479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.669644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:15.678435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-010aa0c9-afdf-4c43-9f90-79441c565653 tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1477 microversion: 2.1 time: 0.237828 Aug 03 04:43:15.679152 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1370/2766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:15 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:15.681331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:15.689331 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1bb93984-18ff-4700-a683-4dc3f6e049c8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.247577 Aug 03 04:43:15.703896 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1397/2767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:15 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:15.710297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:15.718116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:15.719559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.720017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.720819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.721651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.728706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:15.789054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:15.796547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ba8a071-d41e-41c8-920b-1be5dbff67cf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1242 microversion: 2.1 time: 0.116094 Aug 03 04:43:15.797223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1371/2768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:15 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:15.893077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:15.893761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:15.906474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.906936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.909963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.909963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.941710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:15.943269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:15.970247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.971130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:15.972143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:15.972781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.171242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:16.181078 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04e625ad-69cc-4e7f-ba24-8af339adb81b tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.292274 Aug 03 04:43:16.182377 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1398/2769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:15 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:16.189059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:16.190493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:16.198004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.198801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.199947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.200702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.219569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:16.229584 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c15dd31-af74-43df-9dc9-f365f65b24f7 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1316 microversion: 2.1 time: 0.293007 Aug 03 04:43:16.231108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1372/2770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:15 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:16.369306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:16.377801 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a64d292-05b2-4769-ae3b-99acacaa5ad9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.194157 Aug 03 04:43:16.378520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1399/2771] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:16 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:16.480704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d8df85b2-86c0-4455-9846-495f77efc625 req-69a4969c-68a0-46bc-92f1-4b2617994d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98690b1-467a-46cd-b033-84b1fe83adb1", "name": "network-vif-plugged", "status": "completed", "tag": "04174684-1810-4c29-b3b8-1f18d271b98f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:16.487605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:16.491714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8df85b2-86c0-4455-9846-495f77efc625 req-69a4969c-68a0-46bc-92f1-4b2617994d01 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.492161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8df85b2-86c0-4455-9846-495f77efc625 req-69a4969c-68a0-46bc-92f1-4b2617994d01 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.507886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d8df85b2-86c0-4455-9846-495f77efc625 req-69a4969c-68a0-46bc-92f1-4b2617994d01 service nova] Creating event network-vif-plugged:04174684-1810-4c29-b3b8-1f18d271b98f for instance a98690b1-467a-46cd-b033-84b1fe83adb1 on n-h2-826756-5 Aug 03 04:43:16.512892 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d8df85b2-86c0-4455-9846-495f77efc625 req-69a4969c-68a0-46bc-92f1-4b2617994d01 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036033 Aug 03 04:43:16.513697 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1373/2772] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:16.704055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:16.705182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:16.713650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:16.715685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:16.734191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.735991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.736614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.738041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.738603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.739615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:16.741082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.744682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:16.999345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:17.007887 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-568f1470-8677-415e-bbf9-fa0e507a17d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.299968 Aug 03 04:43:17.008890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1374/2773] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:16 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:17.020220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:17.020455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:17.025170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:17.029202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9aba1a49-e079-4b46-9c87-c7b7a9bf710b tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1477 microversion: 2.1 time: 0.333041 Aug 03 04:43:17.030911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.031481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.032634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.033295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.043714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1400/2774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:16 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:17.110672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:17.126634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e503bd09-04bc-4355-bd9e-bb26547c511d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1290 microversion: 2.1 time: 0.116537 Aug 03 04:43:17.134262 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1375/2775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:17 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:17.216843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:17.217490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:17.228477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.228948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.242881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.242881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.251148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:17.251702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:17.290301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.292072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.296132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.296864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.655858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:17.669762 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1760ca2-6130-4890-9c03-aa291b526b98 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.469593 Aug 03 04:43:17.670883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1401/2776] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:17 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:17.688635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7a08561d-f53f-4553-8d90-10d0cdcf02f1 req-584c9996-37bf-4e80-b8a1-41a0325e55e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d96d6b-82ea-48e4-8903-ce27089048f1", "name": "network-vif-deleted", "tag": "91ef02c6-e04e-48f7-8c98-b4c4f727b8b0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:17.714874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a08561d-f53f-4553-8d90-10d0cdcf02f1 req-584c9996-37bf-4e80-b8a1-41a0325e55e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.720569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a08561d-f53f-4553-8d90-10d0cdcf02f1 req-584c9996-37bf-4e80-b8a1-41a0325e55e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.728239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:17.736504 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04c408df-f44a-493b-9273-69852118917a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1465 microversion: 2.1 time: 0.489383 Aug 03 04:43:17.740136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1376/2777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:17 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1465 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:17.743632 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7a08561d-f53f-4553-8d90-10d0cdcf02f1 req-584c9996-37bf-4e80-b8a1-41a0325e55e0 service nova] Creating event network-vif-deleted:91ef02c6-e04e-48f7-8c98-b4c4f727b8b0 for instance d3d96d6b-82ea-48e4-8903-ce27089048f1 on n-h2-826756-5 Aug 03 04:43:17.751221 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7a08561d-f53f-4553-8d90-10d0cdcf02f1 req-584c9996-37bf-4e80-b8a1-41a0325e55e0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078028 Aug 03 04:43:17.753678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:17.754374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:17.758664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1402/2778] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:17.767700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:17.769408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:17.769628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.770089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.771073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.771872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.778674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.779143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:17.779958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:17.780435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.002275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.010832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dbfc5afc-5a61-4087-b85d-1a976dd46ee2 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.265863 Aug 03 04:43:18.019044 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1377/2779] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:17 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:18.019735 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5b81500-dc53-4998-8cb2-ff7caf325fc6 tempest-ServersOnMultiNodesTest-31615089 tempest-ServersOnMultiNodesTest-31615089-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1616 microversion: 2.1 time: 0.256728 Aug 03 04:43:18.019735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1403/2780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:17 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1616 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:18.030993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.031984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.040784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.041401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.042553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.043082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.153148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e8b0cf7-42c2-432c-bd84-e54359c08970 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: .version_select at 0x7fdd548f9b80>, body: {"keypair": {"name": "tempest-keypair-2008770153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3y2uPDc+mZMG/+6vZamaH4awLhsQqiV+ICz0y82umAmvhkpUT9LA/OxGj8mDxq+JCSrm/N+3JcJDzqhLTa6Pkxe4qLG4XNbNxwzyM87bBTq/gTMFLgzia4arqEoirKGA=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:18.174505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5e8b0cf7-42c2-432c-bd84-e54359c08970 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for project 93a21344add4431685ff685ac8aa43a4. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:18.181461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5e8b0cf7-42c2-432c-bd84-e54359c08970 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for user 19c105bc7f2d4207bb168dfe3c19052f and project 93a21344add4431685ff685ac8aa43a4. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:18.192895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.202471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a081ee0-ac32-45ec-b2ed-7aefdc609a1e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.176518 Aug 03 04:43:18.212356 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1404/2781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:18 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:18.212356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.212356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.217426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.218249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.219314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.219892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.250928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:18.254096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:18.307968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e8b0cf7-42c2-432c-bd84-e54359c08970 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.295484 Aug 03 04:43:18.314859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1378/2782] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:43:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 297 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:43:18.314859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.314859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.322139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.322721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.323778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.324230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.371066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.371509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.372601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lazy-loading 'fault' on Instance uuid d3d96d6b-82ea-48e4-8903-ce27089048f1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:18.437419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.449041 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-432b1761-8c4e-42d5-98c9-9e62916a4c7e tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1311 microversion: 2.1 time: 0.139073 Aug 03 04:43:18.449894 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1379/2783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:18 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:18.455148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.455980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.471035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.471748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.472871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.473507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.549315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.561019 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-df6a9940-76ef-46be-be6b-09c7b7a88245 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1298 microversion: 2.1 time: 0.109671 Aug 03 04:43:18.561724 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1380/2784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:18 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:18.666251 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82f3272d-ba30-44c3-8f1c-2427cf6f1800 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 204 len: 0 microversion: 2.1 time: 0.461445 Aug 03 04:43:18.668133 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1405/2785] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:18 2022] DELETE /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:18.674945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.675680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.683038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.683487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.684261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.684719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.692846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:18.693989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:18.703899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.704632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.706026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:18.707377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:18.922629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.927684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:18.931274 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab62948e-f399-4c9d-b42d-a0133c648bc8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1471 microversion: 2.1 time: 0.260031 Aug 03 04:43:18.932200 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1381/2786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:18 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:18.935302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db35988e-e8d0-48d1-ad5e-5558202d30db tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.247673 Aug 03 04:43:18.935873 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1406/2787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:18 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:19.039982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.041033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.047802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.048440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.049404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.050009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.223339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:19.229392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.230633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.231976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ad3f95b-fe58-4ebb-81e4-2ffe55a9548f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.197669 Aug 03 04:43:19.232604 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1382/2788] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:19.264096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.272806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.275688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.287066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.473779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.474408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.487207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.487649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.488462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.488897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.498108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:19.507318 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7d6d1e8-f66f-4558-97de-effd16311952 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1314 microversion: 2.1 time: 0.285981 Aug 03 04:43:19.510564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1407/2789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:19.531719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.532170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.532643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lazy-loading 'fault' on Instance uuid d3d96d6b-82ea-48e4-8903-ce27089048f1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:19.583310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5daf9e187444dc3b5b729d97fd3ea8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9507d823753f45cf8af897380864f3e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:19.587809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.588855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.594909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70f41763-3585-46ec-a85a-8ff3076970de tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 200 len: 1311 microversion: 2.1 time: 0.124930 Aug 03 04:43:19.601158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1383/2790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:19.601306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.601306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.601306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.601958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.731708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:19.743858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d3e5c79-ca54-4fff-a782-9d4ad69d58e9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1296 microversion: 2.1 time: 0.159507 Aug 03 04:43:19.755983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1408/2791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1296 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:19.953997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.960816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.961022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:19.961022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:19.962650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.963108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.963890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.964734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.968864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.975967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:19.977102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:19.980478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.344665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:20.360024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:20.387258 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5aa01525-0f6b-437a-9ee8-3c9f71a7a7f8 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.434451 Aug 03 04:43:20.389315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33b1445c-e05b-4ef8-8219-f3e6aae8d19f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1471 microversion: 2.1 time: 0.438751 Aug 03 04:43:20.392299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1409/2792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:20.393066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1384/2793] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:19 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:20.402731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:20.403896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:20.408256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9d7877fa-eb55-4fae-8b7b-c4fb3e1992a8 req-b12df84a-19dd-4c3f-8230-d5aca0d61cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceed001-1497-4a04-829e-95b663847c7b", "name": "network-vif-plugged", "status": "completed", "tag": "622756e3-d616-46b7-a167-2c6b4b32f856"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:20.415587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:20.416299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.417129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:20.417671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.432207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9d7877fa-eb55-4fae-8b7b-c4fb3e1992a8 req-b12df84a-19dd-4c3f-8230-d5aca0d61cb9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:20.434599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9d7877fa-eb55-4fae-8b7b-c4fb3e1992a8 req-b12df84a-19dd-4c3f-8230-d5aca0d61cb9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.450298 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9d7877fa-eb55-4fae-8b7b-c4fb3e1992a8 req-b12df84a-19dd-4c3f-8230-d5aca0d61cb9 service nova] Creating event network-vif-plugged:622756e3-d616-46b7-a167-2c6b4b32f856 for instance 9ceed001-1497-4a04-829e-95b663847c7b on n-h1-826756-5 Aug 03 04:43:20.471472 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9d7877fa-eb55-4fae-8b7b-c4fb3e1992a8 req-b12df84a-19dd-4c3f-8230-d5aca0d61cb9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077060 Aug 03 04:43:20.472445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1410/2794] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:20.534870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:20.535873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:20.545087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:20.548054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.549198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:20.549741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:20.942136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:20.954106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92e39d9c-470a-4230-b38a-485cf0946e90 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.557736 Aug 03 04:43:20.969039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1385/2795] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:20 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:20.993987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:20.994662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] [instance: d3d96d6b-82ea-48e4-8903-ce27089048f1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:21.007700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.008421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.009392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.010988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.031183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] HTTP exception thrown: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Request method failure captured: Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 HTTP/1.1 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fzCwkdXd2Nt0lvyJnyT6fMDtA6a655ZwHe392pT_awyqNnF3l6OAymUC3qwwWRYyO41DXaundSJWjuUDxIJVc9j_lDSZ1ET-jlvJkTPSw5Ye6Xf52EPRKGcna6n8zy4hUTGEX-eaUtHJOjMINZwdiztfssxUGjhWmqb5GgXwc8V-6w Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9507d823753f45cf8af897380864f3e2 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9507d823753f45cf8af897380864f3e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9507d823753f45cf8af897380864f3e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9507d823753f45cf8af897380864f3e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9507d823753f45cf8af897380864f3e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9507d823753f45cf8af897380864f3e2 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-471339828 Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerDiagnosticsNegativeTest-471339828-project Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f5daf9e187444dc3b5b729d97fd3ea8f Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-471339828-project Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd3d96d6b-82ea-48e4-8903-ce27089048f1'} Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:21.033555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. Aug 03 04:43:21.039352 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:21.041702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] Returning 404 to user: Instance d3d96d6b-82ea-48e4-8903-ce27089048f1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:21.043572 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dc59384-645b-4a6a-8e0c-33cf9f6ce8cd tempest-ServerDiagnosticsNegativeTest-471339828 tempest-ServerDiagnosticsNegativeTest-471339828-project] 10.222.0.72 "GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1" status: 404 len: 111 microversion: 2.1 time: 0.054067 Aug 03 04:43:21.051307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1386/2796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:20 2022] GET /compute/v2.1/servers/d3d96d6b-82ea-48e4-8903-ce27089048f1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:21.051307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:21.051307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:21.052648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:21.061867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34a21707-0220-4150-b91f-e333b7a5f8aa tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1501 microversion: 2.1 time: 0.531111 Aug 03 04:43:21.063299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.064006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.065028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.065663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.082811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1411/2797] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:20 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1501 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:21.090386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:21.095203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:21.111154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.111756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.115955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.116451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.144741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lazy-loading 'flavor' on Instance uuid a98690b1-467a-46cd-b033-84b1fe83adb1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:21.357077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:21.366431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6852dd1-b3b9-443e-af4a-932fab5170bd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.320673 Aug 03 04:43:21.367783 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1387/2798] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:21 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:21.375610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-eb3333d9-ea7d-477a-b48d-57e98066e1e6 req-df2bd5db-d71c-4373-b26d-74b678e73a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:21.391366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb3333d9-ea7d-477a-b48d-57e98066e1e6 req-df2bd5db-d71c-4373-b26d-74b678e73a88 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.392068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb3333d9-ea7d-477a-b48d-57e98066e1e6 req-df2bd5db-d71c-4373-b26d-74b678e73a88 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.404800 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-eb3333d9-ea7d-477a-b48d-57e98066e1e6 req-df2bd5db-d71c-4373-b26d-74b678e73a88 service nova] Creating event network-changed:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:43:21.409938 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-eb3333d9-ea7d-477a-b48d-57e98066e1e6 req-df2bd5db-d71c-4373-b26d-74b678e73a88 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040720 Aug 03 04:43:21.410634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1388/2799] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:21.457378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:21.462560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:21.480527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.481135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.481937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.497259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.694159 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f730b23f-4316-440e-9a8b-fcb8e07d1ca7 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "POST /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1/action" status: 200 len: 32 microversion: 2.1 time: 0.606088 Aug 03 04:43:21.696793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1412/2800] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:43:21 2022] POST /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1/action => generated 32 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:43:21.735745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:21.744565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:21.773059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.773059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:21.781816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:21.782664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.067902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:22.078011 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7d3f417-3cb0-4ee2-a696-b20f49c0677d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1429 microversion: 2.1 time: 0.377888 Aug 03 04:43:22.081745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1413/2801] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:21 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1429 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:22.089949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a6354e09-18e1-4b7c-93ce-8c182edd77f4 req-f53adb84-bbc2-456d-a24e-25af3efbf815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f86ddfe-e4d8-417d-b2ae-6b991fad9394", "name": "network-vif-deleted", "tag": "badd34b0-cfa4-4f70-8280-7eba96dcc31c"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:22.118976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6354e09-18e1-4b7c-93ce-8c182edd77f4 req-f53adb84-bbc2-456d-a24e-25af3efbf815 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:22.119449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6354e09-18e1-4b7c-93ce-8c182edd77f4 req-f53adb84-bbc2-456d-a24e-25af3efbf815 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.149949 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a6354e09-18e1-4b7c-93ce-8c182edd77f4 req-f53adb84-bbc2-456d-a24e-25af3efbf815 service nova] Creating event network-vif-deleted:badd34b0-cfa4-4f70-8280-7eba96dcc31c for instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 on n-h1-826756-5 Aug 03 04:43:22.163221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:22.164029 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a6354e09-18e1-4b7c-93ce-8c182edd77f4 req-f53adb84-bbc2-456d-a24e-25af3efbf815 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080718 Aug 03 04:43:22.164689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1414/2802] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:22.174712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:22.175443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:22.194028 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e3b5ba3-242d-40a2-a209-66ae07b33eb5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1294 microversion: 2.1 time: 0.753122 Aug 03 04:43:22.198821 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1389/2803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:21 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1294 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:22.213710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:22.214182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.216315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:22.216315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.216495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:22.217609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:22.232565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:22.240548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:22.241027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.241847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:22.245923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:22.262009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:23.022166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:23.038034 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fbcbacd-8623-44c4-a35f-026cc34cb1a0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.837875 Aug 03 04:43:23.038900 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1390/2804] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:22 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:23.051614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:23.052797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:23.059290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.060797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.060797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.072641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.073262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:23.084149 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e3fe1d5-15ef-4aac-abda-e129c77825a5 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.917424 Aug 03 04:43:23.084855 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1415/2805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:22 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:23.105368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:23.106460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:23.113076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.113531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.114744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.115529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.155389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.155953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.156550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lazy-loading 'fault' on Instance uuid 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:23.224519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:23.237297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e1b71dc-e173-462c-b15f-00fc043068ad tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 200 len: 1306 microversion: 2.1 time: 0.137310 Aug 03 04:43:23.245052 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1416/2806] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:23 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 1306 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:23.257036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:23.257687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:23.266562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.267267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.268568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.269208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.400662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:23.415947 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2530e2a-3fde-43bd-8cb2-826ada922c65 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.368525 Aug 03 04:43:23.419480 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1391/2807] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:23 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:23.493211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:23.501555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c63e992d-26a1-4a12-a161-e34f9d96211e tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1486 microversion: 2.1 time: 0.253774 Aug 03 04:43:23.502526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1417/2808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:23 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1486 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:23.523401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:23.523907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:23.531253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.531711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.532560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:23.533228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:23.688127 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70b98b36-cd19-4518-ad2b-658735bdd773 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169729 Aug 03 04:43:23.688832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1392/2809] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:43:23 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:23.892164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1472911015", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "737954b7-73c1-40c1-8374-956026effeb0"}], "security_groups": [{"name": "tempest-securitygroup--1559302983"}], "key_name": "tempest-keypair-2008770153", "user_data": "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:24.006679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] validate_networks() for [('737954b7-73c1-40c1-8374-956026effeb0', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:43:24.059428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.060419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:24.066864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.067434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.068355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.070373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.278927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:24.290071 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95588748-7676-4228-b8e1-e68f320b8071 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1518 microversion: 2.1 time: 0.234495 Aug 03 04:43:24.304383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1393/2810] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:24 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:24.304383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.304383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:24.304383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.304847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.305797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.306477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.495890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:24.508863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f3222a0-8bf0-45d1-a5a8-cfe8a6384f7c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.216412 Aug 03 04:43:24.533888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1394/2811] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:24 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:24.541240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.541861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 5f86ddfe-e4d8-417d-b2ae-6b991fad9394] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:24.551457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.552617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.553442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.554059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.569717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 HTTP/1.1 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5f86ddfe-e4d8-417d-b2ae-6b991fad9394'} Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:24.571429 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 5f86ddfe-e4d8-417d-b2ae-6b991fad9394 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cdc722e8-e77b-4271-be1c-25d768474adb tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394" status: 404 len: 111 microversion: 2.1 time: 0.035853 Aug 03 04:43:24.575645 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1395/2812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:24 2022] GET /compute/v2.1/servers/5f86ddfe-e4d8-417d-b2ae-6b991fad9394 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:24.579968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.580629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:24.587208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.588925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.588925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.588925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.649731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:43:24.650222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:43:24.650660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:43:24.651074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:43:24.651496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:43:24.662445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.663063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.664194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.664747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.687340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for project 93a21344add4431685ff685ac8aa43a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:24.693972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for user 19c105bc7f2d4207bb168dfe3c19052f and project 93a21344add4431685ff685ac8aa43a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:24.709975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:24.715301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:43:24.717918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:43:24.773925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:24.782189 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3a23dd4-b3b0-4134-b634-070d6a7afd89 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.207318 Aug 03 04:43:24.782802 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1396/2813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:24 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:24.787996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.788595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:24.794735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.795204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.795989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:24.796465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:24.823270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:24.856753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dab26622-925e-43ac-aa50-0e5cdf734da0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.969368 Aug 03 04:43:24.858042 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1418/2814] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:43:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:43:24.873427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:24.874432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.002819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.012802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.014420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.015910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82fcc289-c209-4086-b395-c429c5382e9f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1282 microversion: 2.20 time: 0.150204 Aug 03 04:43:25.017286 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1419/2815] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:24 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:43:25.234666 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19825df8-b66d-41af-a480-b6cd57bcbc67 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 204 len: 0 microversion: 2.1 time: 0.448689 Aug 03 04:43:25.236245 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1397/2816] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:24 2022] DELETE /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:25.246788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:25.246788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.255378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.256204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.257258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.257718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.282578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:25.283442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.295114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.295895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.296919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.297760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.514851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.538766 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d011e8e3-8abf-4d9b-8bc1-139de641d960 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1472 microversion: 2.1 time: 0.297269 Aug 03 04:43:25.538984 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1420/2817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:25 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:25.543024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.552919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d56ba04-4c0a-4bd6-8f62-dcb6ad433e3f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1486 microversion: 2.1 time: 0.274790 Aug 03 04:43:25.553556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1398/2818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:25 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:25.560509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:25.561143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.572943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f9d38f92-7ef1-49a9-a241-8e0d56aed55f req-76439b1f-d762-41c5-9646-73e7870af47d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceed001-1497-4a04-829e-95b663847c7b", "tag": "622756e3-d616-46b7-a167-2c6b4b32f856"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:25.579485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.579950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.580953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.582248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f9d38f92-7ef1-49a9-a241-8e0d56aed55f req-76439b1f-d762-41c5-9646-73e7870af47d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f9d38f92-7ef1-49a9-a241-8e0d56aed55f req-76439b1f-d762-41c5-9646-73e7870af47d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f9d38f92-7ef1-49a9-a241-8e0d56aed55f req-76439b1f-d762-41c5-9646-73e7870af47d service nova] Creating event network-changed:622756e3-d616-46b7-a167-2c6b4b32f856 for instance 9ceed001-1497-4a04-829e-95b663847c7b on n-h1-826756-5 Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f9d38f92-7ef1-49a9-a241-8e0d56aed55f req-76439b1f-d762-41c5-9646-73e7870af47d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067800 Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1421/2819] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.665234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.677484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:25.896486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.907643 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bcda15a1-5098-43a0-9f51-78f8ac48fc4b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1524 microversion: 2.1 time: 0.351351 Aug 03 04:43:25.908633 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1399/2820] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:25 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1524 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:25.917066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:25.918137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:25.928411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.929399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.930705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:25.932526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:25.932526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:25.939762 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ccaddace-4f5e-4e0d-b6a6-e9e82842d490 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.304965 Aug 03 04:43:25.940584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1422/2821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:25 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:26.057842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:26.058468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:26.142571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:26.153660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:26.156637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:26.158328 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6da839a8-4a9b-4ed1-8994-e62edbe5c015 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1282 microversion: 2.20 time: 0.122894 Aug 03 04:43:26.161651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1423/2822] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:26 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:26.222345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:26.234630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f37a25bd-1fb9-4238-bd12-5553e8af8b99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.323482 Aug 03 04:43:26.235332 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1400/2823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:25 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:26.560743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:26.561666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:26.569592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.570247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:26.571069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.571514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:26.747413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:26.754950 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-66913418-a859-47f1-a23e-fd1eb9e617e1 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1472 microversion: 2.1 time: 0.198608 Aug 03 04:43:26.755515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1424/2824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:26 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:26.930455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:26.931031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:26.938073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.938304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:26.939083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.939597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:26.962930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:26.963883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:26.970641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.971098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:26.971881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:26.974385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.127618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.138362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82c7b3ef-900a-4d39-b948-72559ae4934a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1524 microversion: 2.1 time: 0.211457 Aug 03 04:43:27.139338 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1401/2825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:26 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:27.168569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.181067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-169267d8-fb22-4fdc-8764-972c234feaa2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.219270 Aug 03 04:43:27.181709 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1425/2826] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:26 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:27.184412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:27.185035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:27.191758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.192358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.194031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.194478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.257834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:27.258679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:27.265227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.265695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.266563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.267158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.268539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.288542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.295850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.297896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44db4dde-8430-4551-bcec-a85f5ca68e3c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1286 microversion: 2.20 time: 0.119718 Aug 03 04:43:27.300142 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1402/2827] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:27 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:27.416320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:27.427595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36da227d-88cd-4411-9da5-48c2ba3f5c6e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.171343 Aug 03 04:43:27.427595 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1426/2828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:27 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:27.778951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:27.779945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:27.787999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.788822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:27.789796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:27.790476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.073322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.083220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-20634100-307e-444e-ba60-cd13015f7652 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1472 microversion: 2.1 time: 0.308512 Aug 03 04:43:28.083870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1403/2829] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:27 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:28.161613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:28.163020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:28.170747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.171579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.172543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.173268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.202561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:28.203985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:28.205853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:28.214234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.215050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.216027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.216821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.496974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.509044 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68c8b44a-83d6-4f3e-a2bd-5e77a25b417f tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1524 microversion: 2.1 time: 0.351994 Aug 03 04:43:28.510310 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1427/2830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:28 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1524 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:28.520803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:28.520803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:28.524761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.526150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.527282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.528282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.528880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.534530 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c79b8059-dc14-4825-a1ea-7eb25e0b1b39 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.335749 Aug 03 04:43:28.535126 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1404/2831] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:28 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:28.552162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:28.553016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:28.560080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.565566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.567385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.568035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.777745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.792173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.794306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.795700 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-849be5d8-af39-4728-9769-d94e1ed56fe7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1342 microversion: 2.20 time: 0.283968 Aug 03 04:43:28.796793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1428/2832] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:28 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1342 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:28.814510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-de52e3dc-033d-4f0d-9003-b2467fb962a9 req-c45e7b97-c51a-45de-8c60-bea2417955cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8d040b-046f-4144-88c6-dafa272e0b05", "name": "network-vif-deleted", "tag": "5993c63c-287a-4e17-885d-8c443e17bd32"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:28.826172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-de52e3dc-033d-4f0d-9003-b2467fb962a9 req-c45e7b97-c51a-45de-8c60-bea2417955cd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:28.826889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-de52e3dc-033d-4f0d-9003-b2467fb962a9 req-c45e7b97-c51a-45de-8c60-bea2417955cd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:28.850540 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-de52e3dc-033d-4f0d-9003-b2467fb962a9 req-c45e7b97-c51a-45de-8c60-bea2417955cd service nova] Creating event network-vif-deleted:5993c63c-287a-4e17-885d-8c443e17bd32 for instance 7f8d040b-046f-4144-88c6-dafa272e0b05 on n-h2-826756-5 Aug 03 04:43:28.863308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-de52e3dc-033d-4f0d-9003-b2467fb962a9 req-c45e7b97-c51a-45de-8c60-bea2417955cd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065006 Aug 03 04:43:28.864847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1429/2833] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:28.946246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:28.954825 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6fda6eda-9e79-489f-b627-316df20b6360 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.417257 Aug 03 04:43:28.955640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1405/2834] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:28 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:29.107379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:29.108112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:29.119972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.120490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.128438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.128438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.202676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:29.210969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d334ec53-cdba-45a6-a7fc-12347103a060 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1301 microversion: 2.1 time: 0.107634 Aug 03 04:43:29.212516 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1430/2835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:29 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:29.535056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:29.536162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:29.543092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.543545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.544350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.544789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.548951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:29.563083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:29.564051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:29.571182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.571864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.572671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.573224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.888753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:29.896801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:29.900502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f71b5861-c411-4676-92a3-57f4133a22ed tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1524 microversion: 2.1 time: 0.369111 Aug 03 04:43:29.906148 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1406/2836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:29 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1524 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:29.907090 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7af6084-81d5-454c-bf9d-25d4e6d8da2a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.347739 Aug 03 04:43:29.908120 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1431/2837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:29 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:29.929354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:29.929354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:29.935455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.935919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.937409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.938002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.976817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:29.977436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:29.985843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.986300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:29.987265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:29.987522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.032936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:30.048599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:30.053907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:30.058228 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1337d393-4833-4d67-b9fc-cdfb3ea0aecd tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1340 microversion: 2.20 time: 0.150182 Aug 03 04:43:30.059038 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1407/2838] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:29 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1340 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:30.233866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:30.235240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:30.249287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:30.250894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.251839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.252804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.253327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.257189 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-015d07eb-a5e9-4949-a1ce-7ebf9040cc3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.284232 Aug 03 04:43:30.257790 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1432/2839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:29 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:30.274472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b48be145-b1e8-4076-9fb8-1bd4ebd308bb req-8fc27696-25d9-45b0-a4e3-8ea86282974f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83216e78-e5e9-40e1-9d32-be089211ff58", "name": "network-vif-plugged", "status": "completed", "tag": "45fbfd9c-a3df-40f1-b115-0461347b1e66"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:30.287955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b48be145-b1e8-4076-9fb8-1bd4ebd308bb req-8fc27696-25d9-45b0-a4e3-8ea86282974f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.288444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b48be145-b1e8-4076-9fb8-1bd4ebd308bb req-8fc27696-25d9-45b0-a4e3-8ea86282974f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.304898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.305517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.305741 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b48be145-b1e8-4076-9fb8-1bd4ebd308bb req-8fc27696-25d9-45b0-a4e3-8ea86282974f service nova] Creating event network-vif-plugged:45fbfd9c-a3df-40f1-b115-0461347b1e66 for instance 83216e78-e5e9-40e1-9d32-be089211ff58 on n-h1-826756-5 Aug 03 04:43:30.306118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lazy-loading 'fault' on Instance uuid 7f8d040b-046f-4144-88c6-dafa272e0b05 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:30.313265 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b48be145-b1e8-4076-9fb8-1bd4ebd308bb req-8fc27696-25d9-45b0-a4e3-8ea86282974f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054287 Aug 03 04:43:30.316427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1433/2840] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:30.354839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:30.366675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6170924-8612-459e-8feb-e6e4f3786651 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 200 len: 1306 microversion: 2.1 time: 0.138306 Aug 03 04:43:30.367798 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1408/2841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:30 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:30.933033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:30.933760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:30.944234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:30.944895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:30.954636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.958240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.959957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.960876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.961615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.963415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:30.964572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:30.967033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.232473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.236839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.251971 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d803d4b0-b734-40ab-989c-bf2dcb2923d1 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.312911 Aug 03 04:43:31.252599 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1409/2842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:30 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:31.260022 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93023ef1-fa57-41f8-ac17-17a3de133d7b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1524 microversion: 2.1 time: 0.331696 Aug 03 04:43:31.266136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1434/2843] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:30 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:31.269675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:31.270917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:31.280149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:31.281019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:31.288998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.297458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.297458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.297458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.297909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.298548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.302332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.303245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.734469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.736381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.751821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.757562 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1db71b59-51c6-4c76-b9ac-08b6fa468bf1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.482365 Aug 03 04:43:31.767693 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1435/2844] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:31 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:31.768412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:31.773819 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2590698d-555f-4418-b2b7-d130e1f01c0f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.516353 Aug 03 04:43:31.774745 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1410/2845] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:31 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:31.780032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:31.781253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 7f8d040b-046f-4144-88c6-dafa272e0b05] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:31.797673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.798491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.799513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.800372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.818238 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 HTTP/1.1 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '7f8d040b-046f-4144-88c6-dafa272e0b05'} Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:31.820506 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. Aug 03 04:43:31.825853 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:31.828207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 7f8d040b-046f-4144-88c6-dafa272e0b05 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:31.829353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a2b9359-0e77-4be5-96b6-951224b95e89 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05" status: 404 len: 111 microversion: 2.1 time: 0.060681 Aug 03 04:43:31.830467 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1436/2846] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:31 2022] GET /compute/v2.1/servers/7f8d040b-046f-4144-88c6-dafa272e0b05 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:31.842560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:31.843631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:31.859013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.859887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.861125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:31.864694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:31.914910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:32.045799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:32.046430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:32.053911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.054572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.055437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.055882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.361152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:32.375470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:32.377643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:32.379822 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2242b928-d1ce-4a68-9708-b2bdd1333802 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2953 microversion: 2.42 time: 0.603848 Aug 03 04:43:32.381297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1411/2847] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:31 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2953 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:32.386807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:32.387806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:32.413669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:32.427758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.428038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.432063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.432567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.577986 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6f2d246f-6de0-4d11-b07e-d316dfdb627c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 204 len: 0 microversion: 2.1 time: 0.742956 Aug 03 04:43:32.579168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1437/2848] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:31 2022] DELETE /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:32.585164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:32.586210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:32.603405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.603547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.604590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.606017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.662169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:32.672050 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca1deae4-f09b-4e89-91c3-b60c7a27502f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.289220 Aug 03 04:43:32.684296 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1412/2849] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:32 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:32.696370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:32.699510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:32.715996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.719648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.720804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:32.721609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:32.998261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f81129bb-b62c-4927-a211-d1431215aafb tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.323848 Aug 03 04:43:32.999501 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1413/2850] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:43:32 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f/os-interface => generated 1832 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:33.006003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.006969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.014639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.015354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.016778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.017601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.043251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.075601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b595053-3d61-41ab-b582-9386b62ee412 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1509 microversion: 2.1 time: 0.494745 Aug 03 04:43:33.076796 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1438/2851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:32 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1509 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:33.090871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.091518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.105194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.106007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.107122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.107757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.333407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.343126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17b2262c-f815-4cff-9368-cd0b9d4aff2d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1472 microversion: 2.1 time: 0.342112 Aug 03 04:43:33.344035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1414/2852] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:32 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1472 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:33.349167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.350186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.363859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.364562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.365420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.365930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.386442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.394005 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c9d99b7b-452b-4e77-a5ba-7b9211d3962d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.316385 Aug 03 04:43:33.394585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1439/2853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:33 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:33.399775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-95f41493-6f77-4d71-9c6c-7941cfab4058 req-f6bd2f38-2670-49ad-a399-74a2d51fc781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:33.424035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-95f41493-6f77-4d71-9c6c-7941cfab4058 req-f6bd2f38-2670-49ad-a399-74a2d51fc781 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.424796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-95f41493-6f77-4d71-9c6c-7941cfab4058 req-f6bd2f38-2670-49ad-a399-74a2d51fc781 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.439811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:33.442985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-95f41493-6f77-4d71-9c6c-7941cfab4058 req-f6bd2f38-2670-49ad-a399-74a2d51fc781 service nova] Creating event network-changed:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:43:33.448787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-95f41493-6f77-4d71-9c6c-7941cfab4058 req-f6bd2f38-2670-49ad-a399-74a2d51fc781 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052252 Aug 03 04:43:33.450290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1440/2854] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:33.459366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-85153af5-6c4c-43b7-bcca-3fb1daddcf95 req-8cbcc5f9-eb96-46ef-bdee-80bcd915e241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-plugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:33.471821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-85153af5-6c4c-43b7-bcca-3fb1daddcf95 req-8cbcc5f9-eb96-46ef-bdee-80bcd915e241 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.472461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-85153af5-6c4c-43b7-bcca-3fb1daddcf95 req-8cbcc5f9-eb96-46ef-bdee-80bcd915e241 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.484787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-85153af5-6c4c-43b7-bcca-3fb1daddcf95 req-8cbcc5f9-eb96-46ef-bdee-80bcd915e241 service nova] Creating event network-vif-plugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:43:33.490112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-85153af5-6c4c-43b7-bcca-3fb1daddcf95 req-8cbcc5f9-eb96-46ef-bdee-80bcd915e241 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037992 Aug 03 04:43:33.491097 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1441/2855] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:33.497863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.499046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.507332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.507958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.508782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.509356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.687622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.704806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.708703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.709892 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7da6b0d1-3710-4e49-a998-afea8f7bb0e8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.364568 Aug 03 04:43:33.717169 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1415/2856] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:33 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:33.738168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.739486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.753883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.754636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.755765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.756058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.774307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:33.786478 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6a0ebd8-7e08-4a84-b793-362f41ea869b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 200 len: 1509 microversion: 2.1 time: 0.292999 Aug 03 04:43:33.789659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1442/2857] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:33 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:33.809736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:33.810534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:33.820056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.820945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.822114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:33.823373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:33.859826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:34.054039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:34.063496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f40a5af3-2107-424f-8980-f93d3a9f2818 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.337153 Aug 03 04:43:34.064096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1416/2858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:33 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:34.368715 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c4016a90-ade5-4b1a-aaa3-a24fa1348a80 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 204 len: 0 microversion: 2.1 time: 0.562365 Aug 03 04:43:34.369266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:34.369834 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1443/2859] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:33 2022] DELETE /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:43:34.374466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:34.411699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.413756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.414659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.417348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.422007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:34.423298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:34.443512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.444612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.445740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.446444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.662648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:34.673149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f493188a-7c14-493d-aa4c-0fad7014d29a tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1472 microversion: 2.1 time: 0.309849 Aug 03 04:43:34.673745 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1417/2860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:34 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:34.674995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:34.687985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-361420343", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "7355cd35-092d-4804-b996-5025b03fa6a9"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:34.705856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:34.715034 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-393f7006-aa93-4209-b522-f1c349ec8614 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.299325 Aug 03 04:43:34.728611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1444/2861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:34 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:34.745387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:34.746070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:34.760830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.760830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.760830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:34.760830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:34.765589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] validate_networks() for [('7355cd35-092d-4804-b996-5025b03fa6a9', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:43:35.022664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:35.042958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:35.047366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:35.048582 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78b80ab1-b735-4cda-a949-3a15b1aed66d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.307693 Aug 03 04:43:35.052663 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1445/2862] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:34 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:35.088381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:35.089745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:35.097082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.097978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.099074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.099899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.695214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:43:35.696615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:43:35.697333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:43:35.698058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:43:35.698692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:43:35.702879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:35.713609 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49199104-eed7-4ff6-ad00-7f0485ef20ac tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.628860 Aug 03 04:43:35.716541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1446/2863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:35 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:35.716738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.717355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.719858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.720768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.722110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:35.726754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:35.745028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.745514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.746343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:35.746764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:35.761954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:35.771338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Getting quotas for user dcb77614e0f94653a93492f3f31b9dae and project 7b7f72003a6048289e841b3264c659bb. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:35.786611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:43:35.794373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:43:35.986353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5fa597b-db47-4bde-8008-01133923037b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304944 Aug 03 04:43:35.991208 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1418/2864] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:43:36.001752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:36.005138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:36.040140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.043793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:36.045951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.046433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:36.152340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:36.244605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:36.257464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-92946ca0-de86-4b1d-816e-77d435a35577 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1472 microversion: 2.1 time: 0.539529 Aug 03 04:43:36.258937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1447/2865] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:35 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:36.282541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b58b5fe0-051f-4867-887c-89801b07a675 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:36.296084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b58b5fe0-051f-4867-887c-89801b07a675 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:36.584848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b58b5fe0-051f-4867-887c-89801b07a675 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:36.601947 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b58b5fe0-051f-4867-887c-89801b07a675 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1217 microversion: 2.1 time: 0.331172 Aug 03 04:43:36.610379 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1448/2866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:36 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:36.624772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:36.625527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:36.639381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:36.650389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.650763 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73094f4d-c164-4858-a4f8-9c9694956cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1364 microversion: 2.1 time: 0.657966 Aug 03 04:43:36.651282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:36.652635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.653501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:36.661976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1419/2867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:35 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:36.736852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:36.737700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:36.746886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.747343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:36.751789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:36.752478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.236683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.250612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.252065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.253165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7c1d963-94dd-430f-8371-b1db48e25ff7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.635282 Aug 03 04:43:37.256989 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1449/2868] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:36 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:37.275531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7cd0f139-36ab-420d-b0ec-2abb647702ac req-86f7f140-ec09-48c0-ba21-71e9aa344e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249", "name": "network-vif-deleted", "tag": "e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:37.306630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7cd0f139-36ab-420d-b0ec-2abb647702ac req-86f7f140-ec09-48c0-ba21-71e9aa344e3b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.307848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7cd0f139-36ab-420d-b0ec-2abb647702ac req-86f7f140-ec09-48c0-ba21-71e9aa344e3b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.349676 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7cd0f139-36ab-420d-b0ec-2abb647702ac req-86f7f140-ec09-48c0-ba21-71e9aa344e3b service nova] Creating event network-vif-deleted:e23d70cb-ac5d-4b8d-9ddd-bf7801ced0b1 for instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 on n-h2-826756-5 Aug 03 04:43:37.356535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7cd0f139-36ab-420d-b0ec-2abb647702ac req-86f7f140-ec09-48c0-ba21-71e9aa344e3b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097847 Aug 03 04:43:37.358754 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1450/2869] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:37.365315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.370560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:37.372845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:37.377499 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2a2fd8d-fa22-4f4f-8c94-8d8667a3805c tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.646642 Aug 03 04:43:37.381254 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1420/2870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:36 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:37.383564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.384082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.385088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.385593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.627412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:37.628437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:37.636217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.636995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.637989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.638623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.901177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.912810 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d1c6d91-d389-45e9-90f1-7f054dd0d8f9 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 200 len: 1430 microversion: 2.1 time: 0.552158 Aug 03 04:43:37.927127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1451/2871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:37 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 1430 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:37.935576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:37.939339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:37.944262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.944813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.945622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:37.946385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:37.951134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:37.965138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-764ee99e-b94a-490b-8288-5ce85fca4627 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1221 microversion: 2.1 time: 0.341525 Aug 03 04:43:37.966883 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1421/2872] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:37 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1221 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:38.282902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:38.287555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:38.293100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.296899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.297841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.298383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.491891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:38.501660 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1073031c-5d4b-4c29-a536-b80fcf4a4fb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1550 microversion: 2.1 time: 0.571379 Aug 03 04:43:38.517151 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1452/2873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:37 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1550 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:38.517151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:38.517151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:38.529592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.530053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.530847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.531292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.563370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:38.579311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:38.584768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:38.588593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5c6079c-836a-4f12-a71a-1539ea0c0bf7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.310487 Aug 03 04:43:38.592359 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1422/2874] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:38 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:43:38.606329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:38.608522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:38.622314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.623324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.624724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.625387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.644929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:38.755984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4bb17fd-00a0-4c76-a1b4-06987e2078e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161339 Aug 03 04:43:38.757279 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1423/2875] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:43:38 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:38.857595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:38.868530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7f956bb-1ad9-4d61-835e-a924a6e8882e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.359488 Aug 03 04:43:38.882658 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1453/2876] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:38 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:38.940002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:38.940624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:38.959581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.960535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.967535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:38.968067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:38.990978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:38.991930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:38.998696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.000684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.001702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.002309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.028486 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 HTTP/1.1 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249'} Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:39.030323 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:39.035274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:39.036249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce9426a8-8cd7-4637-8c5c-4ec912722ed3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249" status: 404 len: 111 microversion: 2.1 time: 0.099679 Aug 03 04:43:39.040484 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1424/2877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:38 2022] GET /compute/v2.1/servers/3fd3c47a-e9b3-4e83-a64f-eb7ea1dba249 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:39.051577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:39.054455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:39.060076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.060841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.061747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.062296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.121260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:39.133616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:39.142709 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2541ad77-5173-41fe-ad50-76041c330277 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1269 microversion: 2.1 time: 0.157667 Aug 03 04:43:39.143670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1454/2878] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:38 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:39.405278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c364e1ed-c808-4906-b215-e84d466a412a req-48bb2b74-f6a6-4d8e-9ef5-f54a1901bd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83216e78-e5e9-40e1-9d32-be089211ff58", "name": "network-vif-deleted", "tag": "45fbfd9c-a3df-40f1-b115-0461347b1e66"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:39.424325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c364e1ed-c808-4906-b215-e84d466a412a req-48bb2b74-f6a6-4d8e-9ef5-f54a1901bd4e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.425098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c364e1ed-c808-4906-b215-e84d466a412a req-48bb2b74-f6a6-4d8e-9ef5-f54a1901bd4e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.442108 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c364e1ed-c808-4906-b215-e84d466a412a req-48bb2b74-f6a6-4d8e-9ef5-f54a1901bd4e service nova] Creating event network-vif-deleted:45fbfd9c-a3df-40f1-b115-0461347b1e66 for instance 83216e78-e5e9-40e1-9d32-be089211ff58 on n-h1-826756-5 Aug 03 04:43:39.456232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c364e1ed-c808-4906-b215-e84d466a412a req-48bb2b74-f6a6-4d8e-9ef5-f54a1901bd4e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056233 Aug 03 04:43:39.459446 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1455/2879] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:43:39.592044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-86b9f469-fec9-46f5-bff3-3d11161fe4fd tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 204 len: 0 microversion: 2.1 time: 0.544538 Aug 03 04:43:39.592929 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1425/2880] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:39 2022] DELETE /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:39.603863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:39.605933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:39.619409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.622820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.625184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.626083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.628421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:39.633464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:39.655005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.660808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.661979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:39.664349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:39.710112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:40.014261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:40.151683 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52867da3-5c5f-4397-8d6b-ecdab19d83be tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 204 len: 0 microversion: 2.1 time: 0.554132 Aug 03 04:43:40.152931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1456/2881] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:39 2022] DELETE /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:40.159764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:40.163691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:40.173973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.175692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.177714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.178297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.190407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:40.229056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.238695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.240222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.241636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4df520dc-6014-4960-a2f8-cec2d1fbd69d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.625190 Aug 03 04:43:40.242388 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1426/2882] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:39 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:40.247085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:40.247893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:40.255275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.255973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.256944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.257523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.649281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.662129 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f213dc1e-3b19-4bf1-bfe6-f50305e60201 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.507725 Aug 03 04:43:40.693204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.693811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1457/2883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:40 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:40.699804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:40.700951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:40.707932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d9e3261-9089-4de8-a154-bd544669a03e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1473 microversion: 2.1 time: 0.464252 Aug 03 04:43:40.713239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1427/2884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:40 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:40.725083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.725744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.726621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:40.729964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:40.938853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:40.949175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-75b22558-2d70-4b7a-9fb7-619417cdbd67 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1275 microversion: 2.1 time: 0.253989 Aug 03 04:43:40.950676 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1458/2885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:40 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:41.267160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:41.267793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:41.280170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.282742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.284048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.287422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.503498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-233c4568-929f-4e64-8b80-e4cad1c1884a req-b3a47487-68bd-49a4-97f4-6ccf68011ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:41.540907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-233c4568-929f-4e64-8b80-e4cad1c1884a req-b3a47487-68bd-49a4-97f4-6ccf68011ef2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.541374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-233c4568-929f-4e64-8b80-e4cad1c1884a req-b3a47487-68bd-49a4-97f4-6ccf68011ef2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.584126 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-233c4568-929f-4e64-8b80-e4cad1c1884a req-b3a47487-68bd-49a4-97f4-6ccf68011ef2 service nova] Creating event network-changed:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:43:41.601130 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-233c4568-929f-4e64-8b80-e4cad1c1884a req-b3a47487-68bd-49a4-97f4-6ccf68011ef2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102177 Aug 03 04:43:41.602125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1459/2886] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:41.717033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:41.718428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:41.735304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.740679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.748961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.749688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.849171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:41.862372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:41.864790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:41.870133 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1213bce-e31e-414b-8b20-d1ba7f2edb1b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.607008 Aug 03 04:43:41.886249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1428/2887] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:41 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:41.897543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:41.900865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:41.923623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.924385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:41.926135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:41.926745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:42.432631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:42.442514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce4246d5-9d6a-4b9d-8291-7132f20588b9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.731431 Aug 03 04:43:42.447485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1460/2888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:41 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:42.461627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:42.462625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:42.479942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:42.505743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:42.505743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:42.505743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:42.507258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:42.509294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a311ae0e-1ac0-4e6f-9735-d982aff23e7e tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1473 microversion: 2.1 time: 0.621559 Aug 03 04:43:42.512064 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1429/2889] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:41 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:42.915999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:42.916910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:42.929215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:42.929976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:42.930920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:42.931519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.371181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.380830 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a91b35a4-17bc-4963-b014-a43ce4e52e04 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.931758 Aug 03 04:43:43.381606 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1461/2890] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:42 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:43.454847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.471009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:43.472034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:43.482486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:43.484375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.486914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.489366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.489920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:43.491522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.494973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ae93c56-7e76-415f-9170-61b6f3e5bb17 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.582792 Aug 03 04:43:43.497520 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1430/2891] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:42 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:43.537913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:43.538531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:43.551568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:43.552686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.553637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:43.555688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.764153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.779719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ac296d00-3eca-4702-bc59-659f14c18531 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 200 len: 1431 microversion: 2.1 time: 0.248792 Aug 03 04:43:43.780673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1431/2892] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:43 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 1431 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:43.790537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-94ff868e-c499-4f98-b96d-3d3980267c37 req-cdee6831-c176-4dad-8756-56ffdd018df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f060dda-f7ee-4523-84c8-8efa336e4512", "name": "network-vif-deleted", "tag": "fa61412c-bfdb-486c-99f5-b31d8c5aa763"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:43.817415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-94ff868e-c499-4f98-b96d-3d3980267c37 req-cdee6831-c176-4dad-8756-56ffdd018df2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:43.817415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-94ff868e-c499-4f98-b96d-3d3980267c37 req-cdee6831-c176-4dad-8756-56ffdd018df2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:43.827705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-94ff868e-c499-4f98-b96d-3d3980267c37 req-cdee6831-c176-4dad-8756-56ffdd018df2 service nova] Creating event network-vif-deleted:fa61412c-bfdb-486c-99f5-b31d8c5aa763 for instance 8f060dda-f7ee-4523-84c8-8efa336e4512 on n-h1-826756-5 Aug 03 04:43:43.838272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-94ff868e-c499-4f98-b96d-3d3980267c37 req-cdee6831-c176-4dad-8756-56ffdd018df2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055322 Aug 03 04:43:43.839951 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1432/2893] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:43.927872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:43.949230 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e540e89d-bb82-48d7-b0a4-aaed5e43acc0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.482570 Aug 03 04:43:43.950251 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1462/2894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:43 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:44.243565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0519218d-c41b-4a7b-aa3e-f4aed10c34a8 req-28ccc0b5-0795-4484-8d80-219722c22099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d78b208-4450-45bf-bc8f-284106dcf83d", "name": "network-vif-deleted", "tag": "08187d7b-97eb-4f09-ade2-fe72e3f3e298"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:44.257503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0519218d-c41b-4a7b-aa3e-f4aed10c34a8 req-28ccc0b5-0795-4484-8d80-219722c22099 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.258159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0519218d-c41b-4a7b-aa3e-f4aed10c34a8 req-28ccc0b5-0795-4484-8d80-219722c22099 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.288325 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0519218d-c41b-4a7b-aa3e-f4aed10c34a8 req-28ccc0b5-0795-4484-8d80-219722c22099 service nova] Creating event network-vif-deleted:08187d7b-97eb-4f09-ade2-fe72e3f3e298 for instance 6d78b208-4450-45bf-bc8f-284106dcf83d on n-h2-826756-5 Aug 03 04:43:44.317606 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0519218d-c41b-4a7b-aa3e-f4aed10c34a8 req-28ccc0b5-0795-4484-8d80-219722c22099 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078872 Aug 03 04:43:44.319397 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1433/2895] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:44.405158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:44.405921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:44.421818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.422623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.423877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.424384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.534316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:44.536140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:44.558609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.562996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.564863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.568515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.812822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:44.825805 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03756680-e849-4a17-afd2-d528a989c639 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.425982 Aug 03 04:43:44.838877 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1463/2896] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:44 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:44.849035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:44.849929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 8f060dda-f7ee-4523-84c8-8efa336e4512] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:44.859078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.859739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.860964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.861575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.884100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 HTTP/1.1 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8f060dda-f7ee-4523-84c8-8efa336e4512'} Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:44.889305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 8f060dda-f7ee-4523-84c8-8efa336e4512 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5920c4f8-ec36-4279-b7bd-536c8d5ee520 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512" status: 404 len: 111 microversion: 2.1 time: 0.047099 Aug 03 04:43:44.896774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1464/2897] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:44 2022] GET /compute/v2.1/servers/8f060dda-f7ee-4523-84c8-8efa336e4512 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:44.902944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:44.903800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:44.912516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.914256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.914256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.916192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.967632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:44.968243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:44.968963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lazy-loading 'fault' on Instance uuid 6d78b208-4450-45bf-bc8f-284106dcf83d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:45.008799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:45.019574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:45.021128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:45.022296 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-323ebe22-04cc-4240-b8d3-1508309a54b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.496284 Aug 03 04:43:45.023773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1434/2898] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:44 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:43:45.039490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:45.039490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:45.040197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:45.041073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:45.042024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:45.042468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:45.082297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:45.098911 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e7860ae-636e-4bef-b575-ad4b6e11ee7c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 200 len: 1309 microversion: 2.1 time: 0.200557 Aug 03 04:43:45.100436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1465/2899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:44 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:45.107561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0f06901d-5a28-4e2f-8f6c-eaa1186b28df req-5c0473d4-96bc-426f-891c-efb03b9c4a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "name": "network-vif-plugged", "status": "completed", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:45.125276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0f06901d-5a28-4e2f-8f6c-eaa1186b28df req-5c0473d4-96bc-426f-891c-efb03b9c4a52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:45.126391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0f06901d-5a28-4e2f-8f6c-eaa1186b28df req-5c0473d4-96bc-426f-891c-efb03b9c4a52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:45.162972 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0f06901d-5a28-4e2f-8f6c-eaa1186b28df req-5c0473d4-96bc-426f-891c-efb03b9c4a52 service nova] Creating event network-vif-plugged:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:43:45.169892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0f06901d-5a28-4e2f-8f6c-eaa1186b28df req-5c0473d4-96bc-426f-891c-efb03b9c4a52 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067962 Aug 03 04:43:45.171356 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1466/2900] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:45.350019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:45.364859 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85de4167-581a-4427-866c-ecfc0873be30 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.339746 Aug 03 04:43:45.365629 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1435/2901] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:45 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:45.856869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:45.857498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:45.872354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:45.875529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:45.878754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:45.880093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:45.898470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:45.901580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.084311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:46.087222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f74e8111-f1d0-4e44-a882-d72fa73f5e35 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Action: 'create', calling method: .version_select at 0x7fdd47dbb550>, body: {"keypair": {"name": "tempest-keypair-467888322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSLisFXyRe0/wLzPcuj8JIgNHH87M5CNK/e/U/MY8iKCzJotPXY+0/qlL/iPZ61YYAktw1giJXvlLW8SobiIqhsm/ledZus6RrAc3/bVks0eJR9QWJu2TLJtrUhbC6vEg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:46.092839 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34f83251-3e8a-498e-9b29-586f586e06de tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.245509 Aug 03 04:43:46.096223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1436/2902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:45 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:46.103699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5b1acb31-27c3-40d1-9070-018916ee0740 req-ba52618c-acac-4558-aeec-3909084c8a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29448e94-a5d9-4504-b512-0ee22b086eda", "tag": "5d80b8f5-6fe4-4037-b656-a804217a1c26"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:46.112507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f74e8111-f1d0-4e44-a882-d72fa73f5e35 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:46.113915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5b1acb31-27c3-40d1-9070-018916ee0740 req-ba52618c-acac-4558-aeec-3909084c8a5e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.114362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5b1acb31-27c3-40d1-9070-018916ee0740 req-ba52618c-acac-4558-aeec-3909084c8a5e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.120443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f74e8111-f1d0-4e44-a882-d72fa73f5e35 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for user 9367cfc645e04308aa18bddb0cd685f4 and project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:46.125980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5b1acb31-27c3-40d1-9070-018916ee0740 req-ba52618c-acac-4558-aeec-3909084c8a5e service nova] Creating event network-changed:5d80b8f5-6fe4-4037-b656-a804217a1c26 for instance 29448e94-a5d9-4504-b512-0ee22b086eda on n-h2-826756-5 Aug 03 04:43:46.131237 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5b1acb31-27c3-40d1-9070-018916ee0740 req-ba52618c-acac-4558-aeec-3909084c8a5e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033689 Aug 03 04:43:46.131844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1437/2903] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:46.139673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:46.140537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:46.153850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.153850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.153850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.153850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.292960 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f74e8111-f1d0-4e44-a882-d72fa73f5e35 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.505307 Aug 03 04:43:46.293888 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1467/2904] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:43:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:43:46.299157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:46.303943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 6d78b208-4450-45bf-bc8f-284106dcf83d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:46.309218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.309885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.310853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.311648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.318317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:46.329902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:46.331170 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. Aug 03 04:43:46.333085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:46.334634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b8cb5508-9cb1-4d18-bb92-b4551cf799d7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1408 microversion: 2.20 time: 0.198892 Aug 03 04:43:46.336139 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1438/2905] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:46 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d HTTP/1.1 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6d78b208-4450-45bf-bc8f-284106dcf83d'} Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:46.342500 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 6d78b208-4450-45bf-bc8f-284106dcf83d could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b89d2c1f-ed80-4fda-a566-8a481977ff11 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d" status: 404 len: 111 microversion: 2.1 time: 0.048887 Aug 03 04:43:46.356769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1468/2906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:46 2022] GET /compute/v2.1/servers/6d78b208-4450-45bf-bc8f-284106dcf83d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:46.367515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69d52fa9-815e-49b7-a66e-d17d7ddefa97 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:46.390762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:46.391738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:46.401658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.401658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.401658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.401658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.576713 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69d52fa9-815e-49b7-a66e-d17d7ddefa97 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/3d669fd0-b33e-4b0c-824e-215543d92634" status: 204 len: 0 microversion: 2.1 time: 0.218158 Aug 03 04:43:46.580641 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1439/2907] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:43:46 2022] DELETE /compute/v2.1/os-server-groups/3d669fd0-b33e-4b0c-824e-215543d92634 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:46.586950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:46.587455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:46.591238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:46.598317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.599010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.599950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:46.600564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:46.601603 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-32af3ba7-2c97-48a3-bfd2-314e25af1635 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.215986 Aug 03 04:43:46.603117 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1469/2908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:46 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:46.633503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:46.793756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:47.046197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b73d08c4-cf48-4fab-8ee5-77e8b36f4a01 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 204 len: 0 microversion: 2.1 time: 0.463839 Aug 03 04:43:47.047565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1440/2909] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:46 2022] DELETE /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:47.056105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.056644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.063705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.064209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.065012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.065450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.092220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:47.114884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.115586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.121604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.122126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.122866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.123304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.281417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:47.290185 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-152e6dc2-6b57-43fa-b81f-a61bee4449b0 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.180271 Aug 03 04:43:47.290798 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1441/2910] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:47 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:47.382206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.382869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.391473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.392012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.392930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.393435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.552789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:47.557269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbd98989-4058-4f70-8dc1-d8f1a60ce7a0 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 204 len: 0 microversion: 2.1 time: 0.504949 Aug 03 04:43:47.557996 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1470/2911] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:47 2022] DELETE /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:47.564605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:47.566759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:47.566909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.567599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.568121 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5fd0c62-d8c3-4448-8495-4d05835226c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1600 microversion: 2.20 time: 0.198972 Aug 03 04:43:47.580441 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1442/2912] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:43:47 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1600 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:43:47.580823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.580823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.580823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.581181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.594259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.594945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.603253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.604060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.605105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.605810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.761912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7404b467-45a2-49eb-a484-139b8c110128 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.172187 Aug 03 04:43:47.762540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1443/2913] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:43:47 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:43:47.767170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:47.767786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:47.775199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.775689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.780451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:47.780451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:47.920853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:47.933314 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47d40805-e555-496d-afa4-c3b10a021e54 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1473 microversion: 2.1 time: 0.370731 Aug 03 04:43:47.934309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1471/2914] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:47 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1473 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:48.031773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:48.041275 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47aabf4e-35e9-4a83-8325-f6c30369e4e3 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.277652 Aug 03 04:43:48.041878 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1444/2915] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:47 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:48.312219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:48.313060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:48.323274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:48.323736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:48.324556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:48.325234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:48.573273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:48.586988 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18bcfe26-3b9f-4a70-9d3c-d6c01b426670 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.279261 Aug 03 04:43:48.588741 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1472/2916] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:48 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:48.961031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:48.961772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:48.970377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:48.971031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:48.972007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:48.972770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.006520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e094531a-e3a9-4646-afea-cb3d80e89754 req-0f920fcc-8926-4b9f-9997-11c07261cddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:49.020094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e094531a-e3a9-4646-afea-cb3d80e89754 req-0f920fcc-8926-4b9f-9997-11c07261cddf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:49.020592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e094531a-e3a9-4646-afea-cb3d80e89754 req-0f920fcc-8926-4b9f-9997-11c07261cddf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.033267 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e094531a-e3a9-4646-afea-cb3d80e89754 req-0f920fcc-8926-4b9f-9997-11c07261cddf service nova] Creating event network-changed:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:43:49.039243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e094531a-e3a9-4646-afea-cb3d80e89754 req-0f920fcc-8926-4b9f-9997-11c07261cddf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037528 Aug 03 04:43:49.043485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1473/2917] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:49.064070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:49.064898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:49.072168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:49.072695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.073769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:49.074234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.448947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:49.465917 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9180a92b-c76b-45e3-968d-f2cc44f10356 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.406164 Aug 03 04:43:49.467219 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1474/2918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:49 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:49.490576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:49.501641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45eadf19-7cea-48ed-b157-fb2a7a40a71d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1473 microversion: 2.1 time: 0.545683 Aug 03 04:43:49.505066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1445/2919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:48 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1473 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:49.614478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:49.616764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:49.627755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:49.629281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.630889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:49.631610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:49.955236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:49.978015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1018171057", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "044d96b2-dcaf-474f-ab8d-c2db264ad65a"}], "security_groups": [{"name": "tempest-securitygroup--1803561051"}], "key_name": "tempest-keypair-467888322", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:49.985317 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35946684-5904-494b-a479-e43ea7dab952 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.379224 Aug 03 04:43:49.986160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1475/2920] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:49 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:49.994014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:50.186239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] validate_networks() for [('044d96b2-dcaf-474f-ab8d-c2db264ad65a', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:43:50.437240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1f32f650-2cb9-4c81-9a31-64f79098ee8e req-fba30916-2874-48f6-b99a-ec73a2dc2642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29448e94-a5d9-4504-b512-0ee22b086eda", "name": "network-vif-plugged", "status": "completed", "tag": "5d80b8f5-6fe4-4037-b656-a804217a1c26"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:50.452217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f32f650-2cb9-4c81-9a31-64f79098ee8e req-fba30916-2874-48f6-b99a-ec73a2dc2642 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.454619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f32f650-2cb9-4c81-9a31-64f79098ee8e req-fba30916-2874-48f6-b99a-ec73a2dc2642 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.461556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:50.481513 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1f32f650-2cb9-4c81-9a31-64f79098ee8e req-fba30916-2874-48f6-b99a-ec73a2dc2642 service nova] Creating event network-vif-plugged:5d80b8f5-6fe4-4037-b656-a804217a1c26 for instance 29448e94-a5d9-4504-b512-0ee22b086eda on n-h2-826756-5 Aug 03 04:43:50.487595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1f32f650-2cb9-4c81-9a31-64f79098ee8e req-fba30916-2874-48f6-b99a-ec73a2dc2642 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054950 Aug 03 04:43:50.489087 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1476/2921] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:50.495183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:50.496095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:50.504863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.505325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.506109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.506550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.745599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:50.754370 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67ed99b5-6708-460c-b301-0d1ee812e99b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.263780 Aug 03 04:43:50.755000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1477/2922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:50 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:50.760224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:50.760935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:50.775191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.779396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.779396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.779396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.784596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:43:50.785296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:43:50.785996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:43:50.786646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:43:50.787188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:43:50.803911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.804537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.805509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:50.805951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:50.826283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:43:50.833434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for user 9367cfc645e04308aa18bddb0cd685f4 and project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:43:50.851779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:43:50.854307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:43:50.947507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:50.955213 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9140b89-1d8a-43f0-96d0-5dfc210bf75c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1473 microversion: 2.1 time: 0.198903 Aug 03 04:43:50.955798 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1478/2923] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:50 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1473 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:51.011645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:51.012253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:51.019272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.019881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.020740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.021195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.038934 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49f04889-4249-4f23-b050-44f90275b97f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066845 Aug 03 04:43:51.045563 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1446/2924] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:43:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:43:51.050922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7c2fdf3-e0cb-4547-9d70-233b9c1890cd tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:51.051538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7c2fdf3-e0cb-4547-9d70-233b9c1890cd tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:51.127496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7c2fdf3-e0cb-4547-9d70-233b9c1890cd tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:51.135530 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7c2fdf3-e0cb-4547-9d70-233b9c1890cd tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1241 microversion: 2.1 time: 0.088845 Aug 03 04:43:51.136345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1447/2925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:51 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:51.196095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:51.204106 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc688005-cd4e-415a-be57-6c0b5ba4ba22 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.197317 Aug 03 04:43:51.204780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1479/2926] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:51 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:51.782947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:51.784005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:51.818021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.819599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.824335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.825726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.981066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:51.982464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:51.991059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.991594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.992856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:51.993372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:51.995213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:52.004643 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4af84bc8-64dd-497a-8111-bdd0f40f47bb tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.229858 Aug 03 04:43:52.005243 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1448/2927] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:51 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:52.156973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fa52329-816f-4b3b-8dab-b8aeaf25fd31 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:52.161669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fa52329-816f-4b3b-8dab-b8aeaf25fd31 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:52.162594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:52.170436 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6439b5b-9c8a-4331-bf18-5831020f0621 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1473 microversion: 2.1 time: 0.196083 Aug 03 04:43:52.172157 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1480/2928] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:51 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:52.227636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:52.228547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:52.230001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2fa52329-816f-4b3b-8dab-b8aeaf25fd31 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:52.236754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:52.237777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:52.239032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:52.239689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:52.239920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fa52329-816f-4b3b-8dab-b8aeaf25fd31 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1241 microversion: 2.1 time: 0.086963 Aug 03 04:43:52.241451 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1449/2929] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:52 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:52.393950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:52.402144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8f3fbd1-b609-40df-930f-905b0312b5be tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.179982 Aug 03 04:43:52.402749 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1481/2930] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:52 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:52.913700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b5830dea-bbe1-4e82-8351-fc2e75c81a40 req-ec6c00e2-a801-4259-8a47-3c2c7a564b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b167aeb-d150-4bf0-a017-d08d47eb30ec", "name": "network-vif-deleted", "tag": "8bb922d8-20d8-44b9-8d47-b4d944a859e9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:52.946591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b5830dea-bbe1-4e82-8351-fc2e75c81a40 req-ec6c00e2-a801-4259-8a47-3c2c7a564b19 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:52.947640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b5830dea-bbe1-4e82-8351-fc2e75c81a40 req-ec6c00e2-a801-4259-8a47-3c2c7a564b19 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:52.961776 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b5830dea-bbe1-4e82-8351-fc2e75c81a40 req-ec6c00e2-a801-4259-8a47-3c2c7a564b19 service nova] Creating event network-vif-deleted:8bb922d8-20d8-44b9-8d47-b4d944a859e9 for instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec on n-h2-826756-5 Aug 03 04:43:52.967278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b5830dea-bbe1-4e82-8351-fc2e75c81a40 req-ec6c00e2-a801-4259-8a47-3c2c7a564b19 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058909 Aug 03 04:43:52.967904 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1450/2931] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:53.027482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:53.028193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:53.036995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.037573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.038367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.039065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.207655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:53.209145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:53.240864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.241386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.242437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.243392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.270485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:53.285871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a39550b9-6359-430d-8ba3-5821be7a56f8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.261086 Aug 03 04:43:53.291849 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1482/2932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:53 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:53.320977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:53.325398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:53.338875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.344399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.345729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.346337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.415492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:53.431168 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d363734c-18df-4d09-96a1-03b0786bdb4f tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1303 microversion: 2.1 time: 0.238120 Aug 03 04:43:53.432405 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1451/2933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:53 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:53.437904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:53.438932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:53.450704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.451565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.454688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:53.455422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:53.473536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:53.483327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1cfd5deb-5d85-40d4-85b0-b6c959f31784 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1293 microversion: 2.1 time: 0.193484 Aug 03 04:43:53.483931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1483/2934] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:53 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1293 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:53.631189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:53.641181 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ce2811b-e3fd-4892-81e6-9a658aafadde tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1317 microversion: 2.1 time: 0.207378 Aug 03 04:43:53.641874 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1452/2935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:53 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:54.310964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:54.311573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:54.320250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.320728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.321507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.321955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.454481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:54.455023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:54.463214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.463666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.464483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.464925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.499335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.499789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.500251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lazy-loading 'fault' on Instance uuid 1b167aeb-d150-4bf0-a017-d08d47eb30ec {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:43:54.731399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:54.739760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c676c47-8cf8-43a6-a3ee-89b9e5bf033b tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 200 len: 1308 microversion: 2.1 time: 0.289692 Aug 03 04:43:54.740373 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1453/2936] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:54 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:54.751098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:54.751098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:54.756543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.757028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.758012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.758455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.845600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:54.854994 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f9803f8-4869-4475-a84c-fe18ceb8d44e tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1311 microversion: 2.1 time: 0.113386 Aug 03 04:43:54.855588 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1454/2937] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:54 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:54.861355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:54.866919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:54.869830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.870288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.871284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.871733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:54.880305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:54.890550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e3f8c56-671d-4825-9aa7-45cf42cd35b8 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.583786 Aug 03 04:43:54.892010 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1484/2938] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:54 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:54.986173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f6bdf94b-ee8e-4044-aec1-fe2e3913eaf1 req-841d58eb-ad26-4eb5-8e5d-8938354c3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d12a3338-6a24-47b2-9a5d-69ae80dd4adf", "name": "network-vif-deleted", "tag": "4e49d82b-e4d5-481d-b50e-ef80408cec07"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:54.997435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f6bdf94b-ee8e-4044-aec1-fe2e3913eaf1 req-841d58eb-ad26-4eb5-8e5d-8938354c3ea5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:54.998019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f6bdf94b-ee8e-4044-aec1-fe2e3913eaf1 req-841d58eb-ad26-4eb5-8e5d-8938354c3ea5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.011761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f6bdf94b-ee8e-4044-aec1-fe2e3913eaf1 req-841d58eb-ad26-4eb5-8e5d-8938354c3ea5 service nova] Creating event network-vif-deleted:4e49d82b-e4d5-481d-b50e-ef80408cec07 for instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf on n-h2-826756-5 Aug 03 04:43:55.017776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f6bdf94b-ee8e-4044-aec1-fe2e3913eaf1 req-841d58eb-ad26-4eb5-8e5d-8938354c3ea5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035513 Aug 03 04:43:55.018924 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1485/2939] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:43:55.104232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:55.112026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1e127d8-edfe-484a-9166-15de19cc6dd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1508 microversion: 2.1 time: 0.255295 Aug 03 04:43:55.113531 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1455/2940] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:54 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:55.134431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.135136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.141581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.142035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.142827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.143265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.327720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:55.335739 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2edc1868-40be-4d1a-b88f-3bbe3aad112d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1508 microversion: 2.1 time: 0.205633 Aug 03 04:43:55.336345 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1486/2941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:55.356161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:55.358905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.366382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.366865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.367641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.368114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.615308 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53ce0184-3a73-4cc5-a609-de33ba506344 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "PUT /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1080 microversion: 2.1 time: 0.263088 Aug 03 04:43:55.617982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1456/2942] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:43:55 2022] PUT /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1080 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:55.632891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.633501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.639602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.640053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.640838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.641278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.761813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.762437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: 1b167aeb-d150-4bf0-a017-d08d47eb30ec] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.769551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.770005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.770791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.771232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.780613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:55.789946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1588347b-b753-4d46-aa96-433b309002dd tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1506 microversion: 2.1 time: 0.160900 Aug 03 04:43:55.795107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec HTTP/1.1 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1b167aeb-d150-4bf0-a017-d08d47eb30ec'} Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:55.800633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance 1b167aeb-d150-4bf0-a017-d08d47eb30ec could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:55.806636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e28e4faa-07eb-4508-a493-92bdc658d4bf tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec" status: 404 len: 111 microversion: 2.1 time: 0.044241 Aug 03 04:43:55.807202 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1487/2943] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:55.807291 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1457/2944] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/1b167aeb-d150-4bf0-a017-d08d47eb30ec => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:43:55.809930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.810243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.810668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.810979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d12a3338-6a24-47b2-9a5d-69ae80dd4adf] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.818147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.818596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.818920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.819380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.819738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.820261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.820910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.821550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.842095 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf HTTP/1.1 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd12a3338-6a24-47b2-9a5d-69ae80dd4adf'} Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:43:55.843661 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance d12a3338-6a24-47b2-9a5d-69ae80dd4adf could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:43:55.849552 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08a66e93-1cd4-4993-8448-bb745c336846 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf" status: 404 len: 111 microversion: 2.1 time: 0.038497 Aug 03 04:43:55.850694 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1458/2945] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/d12a3338-6a24-47b2-9a5d-69ae80dd4adf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:43:55.856194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-476314e2-a4cb-4e04-a5bc-fb9e7a64c706 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.970708 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-476314e2-a4cb-4e04-a5bc-fb9e7a64c706 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/3ea0f30e-20c0-47a6-b799-5f717f05283e" status: 204 len: 0 microversion: 2.1 time: 0.119845 Aug 03 04:43:55.976321 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1459/2946] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:43:55 2022] DELETE /compute/v2.1/os-server-groups/3ea0f30e-20c0-47a6-b799-5f717f05283e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:55.979778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:55.980443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:55.994263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.994719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:55.999232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:55.999232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.016506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:56.025740 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab8527a7-3fa8-4575-84b9-a350ce9ec169 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1506 microversion: 2.1 time: 0.219664 Aug 03 04:43:56.038217 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1488/2947] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:56.045112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:56.045747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.055321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.056252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.062673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.062673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.137980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:56.247835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:56.256167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a202b5d-0690-4508-b253-d373966a47f4 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.282411 Aug 03 04:43:56.256894 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1460/2948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:55 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:56.261386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:56.262275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.269080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.270103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.271119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.271744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.298428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:56.323652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:56.328821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:56.336996 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec1dd8c8-e19b-41d4-8c4f-3f4eee78e11d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.295874 Aug 03 04:43:56.341692 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1489/2949] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:56 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:56.346386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:56.349706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.356145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.356626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.357404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.357843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.512360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42f3e4c1-81ae-48cf-aa10-965adf582e95 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "PUT /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1082 microversion: 2.1 time: 0.169521 Aug 03 04:43:56.522366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1490/2950] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:43:56 2022] PUT /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1082 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:56.531179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:56.531802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.538678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.539139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.546826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.546826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.682610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:56.691423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a818992-dd1c-41c3-86b7-5ba89220d6b5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1508 microversion: 2.1 time: 0.164247 Aug 03 04:43:56.692205 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1491/2951] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:56 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:56.713743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:56.714356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.720369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.720825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.722212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.722782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.815529 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2dbb8b89-899d-469d-9992-02397809eee2 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 204 len: 0 microversion: 2.1 time: 0.557273 Aug 03 04:43:56.816197 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1461/2952] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:56 2022] DELETE /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:56.825198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:56.826200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:56.832582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.833269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.834201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:56.834790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:56.974084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:56.983837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81f3edea-3934-48da-a151-09d97fce1600 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1508 microversion: 2.1 time: 0.274393 Aug 03 04:43:56.984736 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1492/2953] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:56 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:57.005499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:57.006009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:57.013020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.013476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.014249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.014689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.035340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:57.042468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:57.074297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:57.083002 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2552ff94-9238-45e0-be1d-8b48fbade494 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1472 microversion: 2.1 time: 0.262276 Aug 03 04:43:57.083589 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1462/2954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:56 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:57.267305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-17054ec3-3e3d-4d49-8449-63fc9200e646 req-3208bd68-bf7c-465a-9b86-116a6caee430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e5184b-8e80-421f-a8c4-cb8e09bda213", "tag": "d3173d89-684c-4855-bf3c-1df7eac9560b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:57.277024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-17054ec3-3e3d-4d49-8449-63fc9200e646 req-3208bd68-bf7c-465a-9b86-116a6caee430 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.277533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-17054ec3-3e3d-4d49-8449-63fc9200e646 req-3208bd68-bf7c-465a-9b86-116a6caee430 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.289445 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-17054ec3-3e3d-4d49-8449-63fc9200e646 req-3208bd68-bf7c-465a-9b86-116a6caee430 service nova] Creating event network-changed:d3173d89-684c-4855-bf3c-1df7eac9560b for instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 on n-h1-826756-5 Aug 03 04:43:57.294404 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-17054ec3-3e3d-4d49-8449-63fc9200e646 req-3208bd68-bf7c-465a-9b86-116a6caee430 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030795 Aug 03 04:43:57.295020 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1463/2955] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:43:57.300856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:57.301566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:57.307845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.308325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.309100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.309542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.333898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:43:57.451756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f00e02e-15cc-48e3-9737-c113f1838538 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 204 len: 0 microversion: 2.1 time: 0.450075 Aug 03 04:43:57.452488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1493/2956] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:56 2022] DELETE /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:57.454127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:57.457899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:57.458626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:57.464896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50a5026d-3bcd-478f-94e7-3dfcd850a417 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.168507 Aug 03 04:43:57.465228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.465793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.465927 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1464/2957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:57 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:57.466825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.467274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.470556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:57.471078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:57.477900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.478376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.479353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.479803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.506422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:43:57.603044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:57.611834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83d7d102-0ce0-4599-b36b-4e9bbef48e44 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.158138 Aug 03 04:43:57.613247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1494/2958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:57 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:57.682003 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.compute.api [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Instance is already in deleting state, ignoring this request Aug 03 04:43:57.682881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ac7eda6-52c7-467d-b563-ea746caacb92 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 204 len: 0 microversion: 2.1 time: 0.216095 Aug 03 04:43:57.683447 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1465/2959] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:43:57 2022] DELETE /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:43:57.692135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:57.692797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:57.698981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.699440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.700294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:57.700771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:57.837788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:57.845622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6bddd23-1278-40d2-ac65-e684972a7314 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1514 microversion: 2.1 time: 0.157864 Aug 03 04:43:57.846200 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1495/2960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:57 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:58.105550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:58.106791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:58.115120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.115532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.116544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.117150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.411460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:58.419663 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c89942b-057a-4975-a0c3-ff8b0548c7ab tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1472 microversion: 2.1 time: 0.318745 Aug 03 04:43:58.432458 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1466/2961] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:58 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:58.486834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:58.488474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:58.496182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.496668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.497454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.497902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.634785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:58.635399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:58.642272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.643067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.643860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.644646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.845185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:58.853606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8229ea68-3d50-4b36-9f04-e4ce4360d090 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.370582 Aug 03 04:43:58.854204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1496/2962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:58 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:58.871374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:58.871997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:58.878472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.879018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:58.879810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:58.880252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:59.015965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:59.023743 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19f3168f-c477-43f3-8ecf-15598c125ce9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.393161 Aug 03 04:43:59.024712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1467/2963] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:58 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:59.205161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:59.216419 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a49c80ee-68c8-4215-a9a7-b2fb767a2f6a tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1514 microversion: 2.1 time: 0.349004 Aug 03 04:43:59.231414 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1497/2964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:58 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1514 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:43:59.443166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:59.443812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:59.447064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-488f672b-d07b-48ca-89ae-ec8b66d031c0 req-b4d4b9ae-9c1e-4794-9cbf-c35e3692f10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ebaa9e-c7c2-4d30-857a-3c9ad0086337", "name": "network-vif-deleted", "tag": "dee67ab2-e809-44c2-858d-caf6c658dc85"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:43:59.450470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:59.450937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:59.451731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:59.452348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:59.456949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-488f672b-d07b-48ca-89ae-ec8b66d031c0 req-b4d4b9ae-9c1e-4794-9cbf-c35e3692f10c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:59.457590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-488f672b-d07b-48ca-89ae-ec8b66d031c0 req-b4d4b9ae-9c1e-4794-9cbf-c35e3692f10c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:59.469600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-488f672b-d07b-48ca-89ae-ec8b66d031c0 req-b4d4b9ae-9c1e-4794-9cbf-c35e3692f10c service nova] Creating event network-vif-deleted:dee67ab2-e809-44c2-858d-caf6c658dc85 for instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 on n-h1-826756-5 Aug 03 04:43:59.475828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-488f672b-d07b-48ca-89ae-ec8b66d031c0 req-b4d4b9ae-9c1e-4794-9cbf-c35e3692f10c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032778 Aug 03 04:43:59.476697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1498/2965] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:43:59.521843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:43:59.529696 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1254cd85-7672-4987-8ae3-30db2d9fdce3 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1430 microversion: 2.1 time: 0.091739 Aug 03 04:43:59.530282 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1468/2966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:59 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1430 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:43:59.877841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:43:59.879230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:43:59.888072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:59.888584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:43:59.889432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:43:59.889814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.047357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:00.048299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:00.050026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:00.056986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.059296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.059296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.059296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.059541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdde592d-f8f4-41b4-97ec-662a2cfc27d6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.185584 Aug 03 04:44:00.063418 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1499/2967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:43:59 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:00.191926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:00.199892 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9277d07d-c7ba-4b07-b0d9-06ae59184fb9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.156983 Aug 03 04:44:00.200506 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1469/2968] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:00 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:00.239444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:00.240546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:00.247109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.247657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.248487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.249106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.276772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cad4ec31-677a-4c60-a6b3-c6113a42d156 req-3423c937-12b6-4cc8-8e0a-7181f973e165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29448e94-a5d9-4504-b512-0ee22b086eda", "name": "network-vif-deleted", "tag": "5d80b8f5-6fe4-4037-b656-a804217a1c26"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:00.287098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cad4ec31-677a-4c60-a6b3-c6113a42d156 req-3423c937-12b6-4cc8-8e0a-7181f973e165 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.287548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cad4ec31-677a-4c60-a6b3-c6113a42d156 req-3423c937-12b6-4cc8-8e0a-7181f973e165 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.299185 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cad4ec31-677a-4c60-a6b3-c6113a42d156 req-3423c937-12b6-4cc8-8e0a-7181f973e165 service nova] Creating event network-vif-deleted:5d80b8f5-6fe4-4037-b656-a804217a1c26 for instance 29448e94-a5d9-4504-b512-0ee22b086eda on n-h2-826756-5 Aug 03 04:44:00.304836 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cad4ec31-677a-4c60-a6b3-c6113a42d156 req-3423c937-12b6-4cc8-8e0a-7181f973e165 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032528 Aug 03 04:44:00.305447 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1470/2969] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:00.323653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:00.331851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2134e2e6-7b8e-419f-955d-07fdb1563fb9 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1472 microversion: 2.1 time: 0.097115 Aug 03 04:44:00.332461 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1500/2970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:00 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1472 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:00.553079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:00.553926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:00.561108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.561568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.562488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:00.562938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:00.632385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:00.640196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5514e6ce-46c9-45ed-a2a7-8b40fa845aa8 tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1302 microversion: 2.1 time: 0.092404 Aug 03 04:44:00.641199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1471/2971] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:00 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:01.080242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:01.081451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:01.089277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.089733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.090654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.091108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.223350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:01.224038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:01.225014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:01.249274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:01.249274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.249274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.249555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6779991a-c707-46e7-a1a5-efea61e0947a tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.156755 Aug 03 04:44:01.249555 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1501/2972] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:01 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:01.249713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.249713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.353076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:01.353695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:01.359950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.360660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.361655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.362219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.372542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:01.380783 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74c187c0-6d23-454c-a135-b4220b07b954 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.161848 Aug 03 04:44:01.381362 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1472/2973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:01 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:01.397270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.397834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.398298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lazy-loading 'fault' on Instance uuid 29448e94-a5d9-4504-b512-0ee22b086eda {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:44:01.445229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb77614e0f94653a93492f3f31b9dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7f72003a6048289e841b3264c659bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:01.452957 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ab23b21-7d20-423d-8997-a2e8e46c4649 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 200 len: 1307 microversion: 2.1 time: 0.103802 Aug 03 04:44:01.453538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1502/2974] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:01 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:01.662455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:01.663170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:01.669354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.669812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.673515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.673515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.703873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:01.704366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:01.705057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lazy-loading 'fault' on Instance uuid d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:44:01.745398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f846965ad9542238d5e7bce2a1e980d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f6f7ad49364611aa364991953d58fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:01.754266 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72af9556-d712-4458-8f20-4e9c7d85672c tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 200 len: 1307 microversion: 2.1 time: 0.095896 Aug 03 04:44:01.754926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1473/2975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:01 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:02.255262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.255805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.263143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.263602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.264398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.264836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.395274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:02.402836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fdcbdea-567b-4fcd-87f5-ac35be1a1b39 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.152465 Aug 03 04:44:02.403344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.403453 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1503/2976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:02.404218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.406900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:02.411955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.412434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.413203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.413701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.476666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.477083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 29448e94-a5d9-4504-b512-0ee22b086eda] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.483981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.484542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.485486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.486017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.505640 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] HTTP exception thrown: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Request method failure captured: Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda HTTP/1.1 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fx37sXvgd5EvBrzneKbtypn2lG2WSh7840tHwlP4vqZSnZP1vhI_zi7AnCDq2Avc_oqZTjlslV8ngdBkJUmPN_d3X0vkXb1e1vK6nOAqw0-mpGKQPh8NgmY5VuF-CmhYWZ3ctOqXISrEH-op06ZauwaymzSUW0T3_3kKMNB58BbhL8 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: dcb77614e0f94653a93492f3f31b9dae Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '29448e94-a5d9-4504-b512-0ee22b086eda'} Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.507712 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Returning 404 to user: Instance 29448e94-a5d9-4504-b512-0ee22b086eda could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7870dcae-7041-49ac-a568-9d608cf68b6b tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda" status: 404 len: 111 microversion: 2.1 time: 0.037111 Aug 03 04:44:02.512455 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1504/2977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/29448e94-a5d9-4504-b512-0ee22b086eda => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:02.518623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.519358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.525594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.526060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.526880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.527356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.544196 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] HTTP exception thrown: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Request method failure captured: Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 HTTP/1.1 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fx37sXvgd5EvBrzneKbtypn2lG2WSh7840tHwlP4vqZSnZP1vhI_zi7AnCDq2Avc_oqZTjlslV8ngdBkJUmPN_d3X0vkXb1e1vK6nOAqw0-mpGKQPh8NgmY5VuF-CmhYWZ3ctOqXISrEH-op06ZauwaymzSUW0T3_3kKMNB58BbhL8 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: dcb77614e0f94653a93492f3f31b9dae Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '83216e78-e5e9-40e1-9d32-be089211ff58'} Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.545822 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Returning 404 to user: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6232c768-475f-4634-b3f1-fa71b2d01846 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 404 len: 111 microversion: 2.1 time: 0.032943 Aug 03 04:44:02.552562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1505/2978] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:02 2022] DELETE /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:02.557101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.557809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 83216e78-e5e9-40e1-9d32-be089211ff58] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.564483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.565257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.566001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.566607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.572096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:02.580390 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-baccbb9f-428a-4d65-914f-545226cb0858 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.181247 Aug 03 04:44:02.595030 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1474/2979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] HTTP exception thrown: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Request method failure captured: Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 HTTP/1.1 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fx37sXvgd5EvBrzneKbtypn2lG2WSh7840tHwlP4vqZSnZP1vhI_zi7AnCDq2Avc_oqZTjlslV8ngdBkJUmPN_d3X0vkXb1e1vK6nOAqw0-mpGKQPh8NgmY5VuF-CmhYWZ3ctOqXISrEH-op06ZauwaymzSUW0T3_3kKMNB58BbhL8 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: dcb77614e0f94653a93492f3f31b9dae Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '83216e78-e5e9-40e1-9d32-be089211ff58'} Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.595261 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Returning 404 to user: Instance 83216e78-e5e9-40e1-9d32-be089211ff58 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3fd13ba6-e6a5-476a-b989-ad68d5f8c5ee tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58" status: 404 len: 111 microversion: 2.1 time: 0.033734 Aug 03 04:44:02.600041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1506/2980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/83216e78-e5e9-40e1-9d32-be089211ff58 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:02.602450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.602963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.610427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.610889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.611839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.613173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.627197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] HTTP exception thrown: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Request method failure captured: Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 HTTP/1.1 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fx37sXvgd5EvBrzneKbtypn2lG2WSh7840tHwlP4vqZSnZP1vhI_zi7AnCDq2Avc_oqZTjlslV8ngdBkJUmPN_d3X0vkXb1e1vK6nOAqw0-mpGKQPh8NgmY5VuF-CmhYWZ3ctOqXISrEH-op06ZauwaymzSUW0T3_3kKMNB58BbhL8 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: dcb77614e0f94653a93492f3f31b9dae Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '42553f0f-11ef-47c7-83e0-a18390d947c9'} Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.629228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Returning 404 to user: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e93033cd-86f6-42ee-a5fd-f4f119b8bcd5 tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "DELETE /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 404 len: 111 microversion: 2.1 time: 0.032964 Aug 03 04:44:02.637177 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1475/2981] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:02 2022] DELETE /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:02.641011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.641644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] [instance: 42553f0f-11ef-47c7-83e0-a18390d947c9] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.648154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.648678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.649472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.649926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.665178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] HTTP exception thrown: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Request method failure captured: Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 HTTP/1.1 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fx37sXvgd5EvBrzneKbtypn2lG2WSh7840tHwlP4vqZSnZP1vhI_zi7AnCDq2Avc_oqZTjlslV8ngdBkJUmPN_d3X0vkXb1e1vK6nOAqw0-mpGKQPh8NgmY5VuF-CmhYWZ3ctOqXISrEH-op06ZauwaymzSUW0T3_3kKMNB58BbhL8 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7b7f72003a6048289e841b3264c659bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7b7f72003a6048289e841b3264c659bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7b7f72003a6048289e841b3264c659bb Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1694039314 Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: dcb77614e0f94653a93492f3f31b9dae Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiskConfigTestJSON-1694039314-project Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '42553f0f-11ef-47c7-83e0-a18390d947c9'} Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.668658 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] Returning 404 to user: Instance 42553f0f-11ef-47c7-83e0-a18390d947c9 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7eef6d3-006f-45f2-993c-bf88ecb2814d tempest-ServerDiskConfigTestJSON-1694039314 tempest-ServerDiskConfigTestJSON-1694039314-project] 10.222.0.72 "GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9" status: 404 len: 111 microversion: 2.1 time: 0.031701 Aug 03 04:44:02.672542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1507/2982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/42553f0f-11ef-47c7-83e0-a18390d947c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:02.694052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-34251c7f-4310-47b5-be3f-8491957b2784 req-bf41df2e-0699-409f-b1f8-de9e4683f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e5184b-8e80-421f-a8c4-cb8e09bda213", "name": "network-vif-plugged", "status": "completed", "tag": "d3173d89-684c-4855-bf3c-1df7eac9560b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:02.706781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-34251c7f-4310-47b5-be3f-8491957b2784 req-bf41df2e-0699-409f-b1f8-de9e4683f8e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.707244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-34251c7f-4310-47b5-be3f-8491957b2784 req-bf41df2e-0699-409f-b1f8-de9e4683f8e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.719412 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-34251c7f-4310-47b5-be3f-8491957b2784 req-bf41df2e-0699-409f-b1f8-de9e4683f8e8 service nova] Creating event network-vif-plugged:d3173d89-684c-4855-bf3c-1df7eac9560b for instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 on n-h1-826756-5 Aug 03 04:44:02.726026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-34251c7f-4310-47b5-be3f-8491957b2784 req-bf41df2e-0699-409f-b1f8-de9e4683f8e8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036542 Aug 03 04:44:02.726638 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1476/2983] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:02.776424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:02.777436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] [instance: d2ebaa9e-c7c2-4d30-857a-3c9ad0086337] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:02.784348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.784816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.785599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:02.786036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:02.802060 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] HTTP exception thrown: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Request method failure captured: Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 HTTP/1.1 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fwq7iVEzZ2xXdJQwoW4nxDUiRqUuvqWKeRNmKN7AwYJgIq7PWtMjTP7NSs_slcHpeVS8civoObGWv_vMgftVKGHhSIHdRgKJZOmngF5syFjUKMJHT3JxR6PctInueRS6OjMCOoZBxqd91893BTB8WpqqGdgc37r5GPycaC7XpJI6gI Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_18f6f7ad49364611aa364991953d58fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/18f6f7ad49364611aa364991953d58fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 18f6f7ad49364611aa364991953d58fa Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1643296616 Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2f846965ad9542238d5e7bce2a1e980d Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersOnMultiNodesTest-1643296616-project Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd2ebaa9e-c7c2-4d30-857a-3c9ad0086337'} Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:02.803678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] Returning 404 to user: Instance d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce591544-3b89-4561-80be-dc117e8fb39d tempest-ServersOnMultiNodesTest-1643296616 tempest-ServersOnMultiNodesTest-1643296616-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337" status: 404 len: 111 microversion: 2.1 time: 0.034088 Aug 03 04:44:02.808675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1508/2984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:02 2022] GET /compute/v2.1/servers/d2ebaa9e-c7c2-4d30-857a-3c9ad0086337 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:03.424185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:03.425720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:03.433510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:03.433966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:03.434798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:03.435240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:03.604155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:03.605796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:03.615904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:03.616885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:03.618485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:03.619403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:03.930467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:03.940118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:03.948121 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3bb04113-bd35-48ca-9d29-4f5bd0f99401 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1367 microversion: 2.1 time: 0.528135 Aug 03 04:44:03.950627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dcebb461-eff2-4f66-9579-ed89afade07b tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.351376 Aug 03 04:44:03.961446 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1477/2985] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:03 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:03.968765 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1509/2986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:03 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:04.978234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:04.979770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:04.989136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:04.999567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:04.999567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:04.999894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:05.000387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:05.000387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:05.000547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:05.008294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:05.008823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:05.012970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:05.016110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:05.018619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:05.287110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:05.294900 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c338e8f-8f83-4d88-b416-10213c589abf tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1558 microversion: 2.1 time: 0.322195 Aug 03 04:44:05.295586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1478/2987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:04 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1558 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:05.326933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:05.327499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:05.337524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:05.338338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:05.338793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:05.339647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:05.340084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:05.351535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6d56e0a-95d7-4e74-ac0a-584671d4cac2 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.363869 Aug 03 04:44:05.354695 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1510/2988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:04 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:05.470754 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77c99fed-3310-4570-81a7-71d5ac00999d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147869 Aug 03 04:44:05.474197 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1479/2989] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:44:05 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:06.382926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:06.383681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:06.390769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:06.391229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:06.392008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:06.392488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:06.722004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:06.730315 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc09be7d-47af-4e3f-a487-2344743c7a22 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.351228 Aug 03 04:44:06.745107 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1511/2990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:06 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:07.073682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b7f958e2-b96b-434c-9744-537d082518bd req-a8c03de4-bdb5-42e3-b2d0-4b86c2be01a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e5184b-8e80-421f-a8c4-cb8e09bda213", "tag": "d3173d89-684c-4855-bf3c-1df7eac9560b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:07.090442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b7f958e2-b96b-434c-9744-537d082518bd req-a8c03de4-bdb5-42e3-b2d0-4b86c2be01a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:07.094655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b7f958e2-b96b-434c-9744-537d082518bd req-a8c03de4-bdb5-42e3-b2d0-4b86c2be01a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:07.109673 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b7f958e2-b96b-434c-9744-537d082518bd req-a8c03de4-bdb5-42e3-b2d0-4b86c2be01a5 service nova] Creating event network-changed:d3173d89-684c-4855-bf3c-1df7eac9560b for instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 on n-h1-826756-5 Aug 03 04:44:07.117376 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b7f958e2-b96b-434c-9744-537d082518bd req-a8c03de4-bdb5-42e3-b2d0-4b86c2be01a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050028 Aug 03 04:44:07.119530 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1480/2991] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:07.755637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:07.755637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:07.764061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:07.764560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:07.765551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:07.765996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:07.803394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:08.413985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:08.426124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-756a8303-b6d7-42e0-bfda-12183d77a300 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1487 microversion: 2.1 time: 0.676771 Aug 03 04:44:08.427553 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1512/2992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:07 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1487 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:08.455378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:08.456010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:08.464462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:08.464915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:08.465693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:08.466126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:08.868331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49487a88-79af-4e55-a216-66185c4f4054 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "POST /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1/action" status: 202 len: 0 microversion: 2.1 time: 0.418473 Aug 03 04:44:08.872077 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1481/2993] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:44:08 2022] POST /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:44:08.877430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:08.878085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:08.885360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:08.885822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:08.886615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:08.887057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:09.020776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:09.028205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2f400a6-f283-4891-b901-2fcc0685c700 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1495 microversion: 2.1 time: 0.154867 Aug 03 04:44:09.028801 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1513/2994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:08 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:10.054570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:10.055281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:10.063236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:10.063702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:10.064711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:10.065240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:10.207981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:10.224663 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca364d92-3756-4a02-ac68-21a0bce8f7fe tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1495 microversion: 2.1 time: 0.176713 Aug 03 04:44:10.225249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1482/2995] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:10 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1495 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:11.248109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:11.249434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:11.268416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:11.274181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:11.274181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:11.274181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:11.454381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:11.463098 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df394716-0a70-40a0-98be-83a23c25d68e tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1495 microversion: 2.1 time: 0.219510 Aug 03 04:44:11.464393 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1514/2996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:11 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1495 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:12.487355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:12.493036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:12.500887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:12.501612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:12.503022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:12.503709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:12.723376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:12.731959 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c81225fe-2895-4eff-8780-55929b937289 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1501 microversion: 2.1 time: 0.248957 Aug 03 04:44:12.732930 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1483/2997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:12 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:12.765408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:12.765926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:12.773398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:12.774133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:12.775092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:12.775686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:12.803399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:44:13.402833 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e01bd04-15e0-450a-adcd-5ebbd1c69fdc tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 204 len: 0 microversion: 2.1 time: 0.637406 Aug 03 04:44:13.402833 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1515/2998] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:12 2022] DELETE /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:44:13.409741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:13.410682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:13.417513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:13.418155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:13.419148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:13.419764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:13.675245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:13.688384 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c25583ee-687b-49d3-81ed-93491bd2e96f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.283361 Aug 03 04:44:13.693435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1484/2999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:13 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:14.717459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:14.718835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:14.731998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:14.732507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:14.733739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:14.735029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:14.931096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:14.957334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94cf7818-1d64-4a64-a859-bdf6abe6c95a tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.246040 Aug 03 04:44:14.979187 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1516/3000] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:14 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:15.183708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-67200c6f-f1e0-41a8-b8be-963b96ed42c5 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Action: 'create', calling method: .version_select at 0x7fdd548688b0>, body: {"pool": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:16.005462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:16.006100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:16.014814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:16.015460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:16.017384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:16.018238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:16.243867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:16.256085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f05ea46d-6f5e-4dda-9629-9a6fdc2b3109 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.252510 Aug 03 04:44:16.256085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1517/3001] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:15 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:17.275490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:17.276720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:17.287646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:17.288107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:17.292651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:17.293302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:17.587686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:17.596279 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8f0714d-b066-4bab-a905-7a9701d531b0 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1507 microversion: 2.1 time: 0.324223 Aug 03 04:44:17.597132 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1518/3002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:17 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:18.209344 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-67200c6f-f1e0-41a8-b8be-963b96ed42c5 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.247284 Aug 03 04:44:18.213960 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1485/3003] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:44:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:18.236477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a492ea27-6d5c-4224-a732-62fac0c48581 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd54623e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:18.562927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a492ea27-6d5c-4224-a732-62fac0c48581 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips/edfc372e-b5c6-488e-bf62-7f483f6a8bd6" status: 200 len: 141 microversion: 2.1 time: 0.332871 Aug 03 04:44:18.568309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1519/3004] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:44:18 2022] GET /compute/v2.1/os-floating-ips/edfc372e-b5c6-488e-bf62-7f483f6a8bd6 => generated 141 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:18.582928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74c046fb-251c-4b16-a47d-b3d4a2e90d68 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd54922ee0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:18.621516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:18.622840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:18.645604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:18.646067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:18.652527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:18.653130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:18.811203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:18.823479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5ec41f1-093d-4857-8cc2-6cb46653e436 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1465 microversion: 2.1 time: 0.208071 Aug 03 04:44:18.824537 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1520/3005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:18 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1465 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:18.943678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-faf85150-a83a-4c07-bc24-cf0ef69c2bdb req-f00af487-ea3e-47c6-b702-538fea3ac347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98690b1-467a-46cd-b033-84b1fe83adb1", "name": "network-vif-deleted", "tag": "04174684-1810-4c29-b3b8-1f18d271b98f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:18.957489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-faf85150-a83a-4c07-bc24-cf0ef69c2bdb req-f00af487-ea3e-47c6-b702-538fea3ac347 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:18.957489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-faf85150-a83a-4c07-bc24-cf0ef69c2bdb req-f00af487-ea3e-47c6-b702-538fea3ac347 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:18.970049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-faf85150-a83a-4c07-bc24-cf0ef69c2bdb req-f00af487-ea3e-47c6-b702-538fea3ac347 service nova] Creating event network-vif-deleted:04174684-1810-4c29-b3b8-1f18d271b98f for instance a98690b1-467a-46cd-b033-84b1fe83adb1 on n-h2-826756-5 Aug 03 04:44:18.976692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-faf85150-a83a-4c07-bc24-cf0ef69c2bdb req-f00af487-ea3e-47c6-b702-538fea3ac347 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039035 Aug 03 04:44:18.982469 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1521/3006] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:19.011797 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74c046fb-251c-4b16-a47d-b3d4a2e90d68 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.438846 Aug 03 04:44:19.013713 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1486/3007] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:44:18 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:19.025870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7262d654-6ed3-4950-8719-4df1f5c4ce42 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd549ac940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:19.851309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:19.851924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:19.861968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:19.862672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:19.863876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:19.864425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:19.933518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:19.933976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:19.934434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lazy-loading 'fault' on Instance uuid a98690b1-467a-46cd-b033-84b1fe83adb1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:44:20.045083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:20.062293 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba44f986-4931-4006-a238-3f7bcc23dc5d tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 200 len: 1304 microversion: 2.1 time: 0.214905 Aug 03 04:44:20.063566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1487/3008] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:19 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:20.559182 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7262d654-6ed3-4950-8719-4df1f5c4ce42 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/edfc372e-b5c6-488e-bf62-7f483f6a8bd6" status: 202 len: 0 microversion: 2.1 time: 1.536397 Aug 03 04:44:20.559831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1522/3009] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:44:19 2022] DELETE /compute/v2.1/os-floating-ips/edfc372e-b5c6-488e-bf62-7f483f6a8bd6 => generated 0 bytes in 1539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:44:20.574150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c3223fc-a580-45a8-a6f4-d33c11196f31 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Action: 'create', calling method: .version_select at 0x7fdd47f84820>, body: {"pool": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:21.014869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-12634740", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8504b64d-60fc-4eab-919d-3f84159d9682"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:21.081680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] validate_networks() for [('8504b64d-60fc-4eab-919d-3f84159d9682', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:44:21.997343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:44:21.997908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:44:21.998257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:44:21.998676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:44:21.999099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:44:22.009041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.009503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.010311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.010758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.030307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Getting quotas for project 4e913cd1107341bcbd7528465a8b8f8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:44:22.036575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Getting quotas for user 79e67381d4944b3099dd89fd461143a8 and project 4e913cd1107341bcbd7528465a8b8f8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:44:22.050646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Going to run 2 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:44:22.053120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: 135d2f8e-5479-49eb-bc61-56a073837cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:44:22.225188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=135d2f8e-5479-49eb-bc61-56a073837cce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:44:22.439639 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6abac10e-6a09-4525-b4c2-ef4698534ee2 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495853 Aug 03 04:44:22.446724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1523/3010] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:44:22.451881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:22.452801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a98690b1-467a-46cd-b033-84b1fe83adb1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:22.460200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.461007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.461963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.462403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.478670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] HTTP exception thrown: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Request method failure captured: Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 HTTP/1.1 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fyKIcyQe3Vuwf5sys5P2QHi2_spKJFPkMP6qBEdj07vwTJv7jlidqs2v6rraejRwZ67YkTjR8y96REkqAZsyMt7kPH37Am4Y2KOhFfLYwLNtIBsFXjbFTnGADDGJdLaL2LfZN-0sshpOF9_mnfmESQwT_-aovY0g7tEhcBT9oDIipc Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b4cd12a3a4c342b2950043b47b7e39b6 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b4cd12a3a4c342b2950043b47b7e39b6 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueTestJSON-1978112153-project Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 73d83656153f465a9c1bee17b9195287 Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueTestJSON-1978112153-project Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a98690b1-467a-46cd-b033-84b1fe83adb1'} Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:22.480301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Returning 404 to user: Instance a98690b1-467a-46cd-b033-84b1fe83adb1 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fee29b39-236a-4725-a940-8971d1793b86 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1" status: 404 len: 111 microversion: 2.1 time: 0.033780 Aug 03 04:44:22.486548 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1524/3011] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:22 2022] GET /compute/v2.1/servers/a98690b1-467a-46cd-b033-84b1fe83adb1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:22.490758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:22.495450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:22.496337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Searching by: {'deleted': False, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:44:22.512792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.513212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.518972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.518972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.537380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d5e637f-39bb-4825-b90d-81a9c54e3b08 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.050223 Aug 03 04:44:22.537968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1525/3012] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:44:22 2022] GET /compute/v2.1/servers => generated 673 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:22.567048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:22.567737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:22.578193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.578729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.579620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:22.580106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:22.618892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:44:22.989283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c3223fc-a580-45a8-a6f4-d33c11196f31 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.419718 Aug 03 04:44:22.990438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1488/3013] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:44:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:22.995339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a564ed0-21a7-4c1d-8bf2-67bc83adb7c6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:22.995956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a564ed0-21a7-4c1d-8bf2-67bc83adb7c6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:23.001353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ba2cba8-e3e4-45ab-8dba-cdebe2f8c453 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 204 len: 0 microversion: 2.1 time: 0.444674 Aug 03 04:44:23.004973 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1526/3014] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:22 2022] DELETE /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:44:23.010877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f2b73c7-089e-4a26-b5f0-a9dae79ab427 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd549ac3a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:23.108913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a564ed0-21a7-4c1d-8bf2-67bc83adb7c6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:23.117677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a564ed0-21a7-4c1d-8bf2-67bc83adb7c6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1218 microversion: 2.1 time: 0.126154 Aug 03 04:44:23.118575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1489/3015] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:22 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:23.137339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:23.138031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:23.147622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:23.148080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:23.149072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:23.149541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:23.421522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:23.435932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6c82c1e-5af0-4f17-878b-6c8352f8a6d4 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1491 microversion: 2.1 time: 0.300000 Aug 03 04:44:23.435932 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1490/3016] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:23 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1491 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:24.083193 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f2b73c7-089e-4a26-b5f0-a9dae79ab427 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd" status: 202 len: 0 microversion: 2.1 time: 1.076840 Aug 03 04:44:24.083778 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1527/3017] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:44:23 2022] DELETE /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:44:24.092475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd47f9c1f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:24.137355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6a50eef-c94e-441f-b721-e0d3cd9634fd could not be found", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:44:24.138143 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] HTTP exception thrown: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.139221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c86a3b7-b9f2-4ccf-8c6b-364694609f72 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:24.139970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c86a3b7-b9f2-4ccf-8c6b-364694609f72 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Request method failure captured: Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd HTTP/1.1 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f0e--cx5AqOcydX_lwLooDeVz2JRU_aDVRFF8etTOd1tco9nXU7F5fAQCmXo_pKguOLlle1hM9Fjk1QrADAtP6Ua_01XkMm9eqg9xB3v7RVE7g2AChD5xztQmIj7Cplt5tzNay6-xTHlIoJxuZbaMQslLfT0rmK9vFE-E6cmhbpe9M Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 847916f26c9f4351a92f0764e3f423a8 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 847916f26c9f4351a92f0764e3f423a8 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsTestJSON-1825785472-project Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8a46cc30e037410aa351a7a21ac3af9a Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsTestJSON-1825785472-project Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: exception: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a6a50eef-c94e-441f-b721-e0d3cd9634fd'} Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6a50eef-c94e-441f-b721-e0d3cd9634fd could not be found Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70858f81-ad43-4ced-935b-194621633b0c'] Aug 03 04:44:24.140181 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd. Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Returning 404 to user: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3b98c03-f9fc-466f-bde3-334d6bbc7d12 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "GET /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd" status: 404 len: 111 microversion: 2.1 time: 0.053326 Aug 03 04:44:24.148831 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1491/3018] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 04:44:24 2022] GET /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:24.158624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:24.160582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Calling method '.version_select at 0x7fdd47fa8b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:24.216895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG neutronclient.v2_0.client [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6a50eef-c94e-441f-b721-e0d3cd9634fd could not be found", "detail": ""}} {{(pid=120831) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:44:24.217597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] HTTP exception thrown: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Request method failure captured: Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd HTTP/1.1 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f0e--cx5AqOcydX_lwLooDeVz2JRU_aDVRFF8etTOd1tco9nXU7F5fAQCmXo_pKguOLlle1hM9Fjk1QrADAtP6Ua_01XkMm9eqg9xB3v7RVE7g2AChD5xztQmIj7Cplt5tzNay6-xTHlIoJxuZbaMQslLfT0rmK9vFE-E6cmhbpe9M Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 847916f26c9f4351a92f0764e3f423a8 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/847916f26c9f4351a92f0764e3f423a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 847916f26c9f4351a92f0764e3f423a8 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1825785472 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-FloatingIPsTestJSON-1825785472-project Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 8a46cc30e037410aa351a7a21ac3af9a Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-FloatingIPsTestJSON-1825785472-project Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: exception: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a6a50eef-c94e-441f-b721-e0d3cd9634fd'} Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6a50eef-c94e-441f-b721-e0d3cd9634fd could not be found Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5723b53-e5d9-4959-9d77-8ae60b4d87f8'] Aug 03 04:44:24.219633 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd. Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] Returning 404 to user: Floating IP not found for ID a6a50eef-c94e-441f-b721-e0d3cd9634fd {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0cd77876-11d5-489a-8474-7c9d00f6d1a0 tempest-FloatingIPsTestJSON-1825785472 tempest-FloatingIPsTestJSON-1825785472-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd" status: 404 len: 111 microversion: 2.1 time: 0.071536 Aug 03 04:44:24.224926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1492/3019] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:44:24 2022] DELETE /compute/v2.1/os-floating-ips/a6a50eef-c94e-441f-b721-e0d3cd9634fd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:24.242236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c86a3b7-b9f2-4ccf-8c6b-364694609f72 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:24.249278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c86a3b7-b9f2-4ccf-8c6b-364694609f72 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1218 microversion: 2.1 time: 0.114015 Aug 03 04:44:24.249931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1528/3020] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:24 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:24.442158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:24.442837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:24.449117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:24.449864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:24.450516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:24.450983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:24.455514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:24.456190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:24.463696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:24.464607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:24.465517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:24.465974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:24.482182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69a1867b-b3c4-46a8-bbae-50a13ed71778 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/ips" status: 200 len: 151 microversion: 2.20 time: 0.044345 Aug 03 04:44:24.482797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1493/3021] 10.222.0.72 () {60 vars in 1289 bytes} [Wed Aug 3 04:44:24 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:44:24.617507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:24.626278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a06a651e-8359-428d-9d08-cfed99a800f9 tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1491 microversion: 2.1 time: 0.174641 Aug 03 04:44:24.627492 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1529/3022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:24 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1491 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:25.272133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9fb80c00-8161-4562-9ee8-1d113b42945f tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:25.272888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9fb80c00-8161-4562-9ee8-1d113b42945f tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:25.347689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9fb80c00-8161-4562-9ee8-1d113b42945f tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:25.357963 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9fb80c00-8161-4562-9ee8-1d113b42945f tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1218 microversion: 2.1 time: 0.090959 Aug 03 04:44:25.361091 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1494/3023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:25 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:25.651566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:25.660687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:25.669259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:25.680216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:25.685180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:25.685870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:25.942363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:25.951422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7aa4d5bc-85bd-4964-85e3-0d0bc773b61f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1491 microversion: 2.1 time: 0.306462 Aug 03 04:44:25.966256 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1530/3024] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:25 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1491 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:26.273127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:26.274639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:26.291782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.293682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.294749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.296931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.326009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d7041103-5e94-46b5-95fc-8289e3e7b26f req-14f21dad-6096-4ae7-ba17-d8b5349a5183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a433988c-4c56-4c4e-b09f-05331e3d36e6", "name": "network-vif-deleted", "tag": "71e5fc97-32b9-4f06-9170-8f6f10069669"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:26.337641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d7041103-5e94-46b5-95fc-8289e3e7b26f req-14f21dad-6096-4ae7-ba17-d8b5349a5183 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.338097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d7041103-5e94-46b5-95fc-8289e3e7b26f req-14f21dad-6096-4ae7-ba17-d8b5349a5183 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.354694 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d7041103-5e94-46b5-95fc-8289e3e7b26f req-14f21dad-6096-4ae7-ba17-d8b5349a5183 service nova] Creating event network-vif-deleted:71e5fc97-32b9-4f06-9170-8f6f10069669 for instance a433988c-4c56-4c4e-b09f-05331e3d36e6 on n-h1-826756-5 Aug 03 04:44:26.366827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d7041103-5e94-46b5-95fc-8289e3e7b26f req-14f21dad-6096-4ae7-ba17-d8b5349a5183 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044748 Aug 03 04:44:26.367605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1531/3025] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:26.396952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:26.400087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:26.414982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.419922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.421011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.421617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.507176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:26.515555 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4b40811-1924-4d53-815d-9c8a77f6d870 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.246677 Aug 03 04:44:26.535679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1495/3026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:26.545163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:26.550247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:26.567065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.567817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.571169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.571807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.588125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:26.592107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:26.601981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3be11074-c72c-49d2-be72-f91fb5b4c7b9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1214 microversion: 2.1 time: 0.217996 Aug 03 04:44:26.603311 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1532/3027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:26 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:26.811006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:26.820615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8b18cea-8705-438b-b388-613d3c457af6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.282439 Aug 03 04:44:26.836304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1496/3028] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:26.843660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:26.845638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:26.853809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.854589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.855776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.856499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.981846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:26.983053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:26.991367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:26.993083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:26.994418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.003249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.061860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.062525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.063230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lazy-loading 'fault' on Instance uuid a433988c-4c56-4c4e-b09f-05331e3d36e6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:44:27.101041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:27.113100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02ab265c-3266-4907-8553-9dae87d52262 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.273780 Aug 03 04:44:27.125245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73d83656153f465a9c1bee17b9195287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4cd12a3a4c342b2950043b47b7e39b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:27.132179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1533/3029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:27.137943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-216173794"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:27.138328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7e74327-cc86-4dc1-8b2e-55d07af56e7f tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 200 len: 1303 microversion: 2.1 time: 0.163720 Aug 03 04:44:27.138986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1497/3030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:26 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:27.157363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:27.166796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.167630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.169295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.169918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.632726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:27.634043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:27.651359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.653016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.654071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:27.654748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:27.791839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:27.807086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-192e7f4d-f603-4d61-b614-5e75837351a9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1278 microversion: 2.1 time: 0.180366 Aug 03 04:44:27.808085 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1498/3031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:27 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:27.950329 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbe46cb5-520d-4aee-8cce-b8c96b7dfab1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.816460 Aug 03 04:44:27.951017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1534/3032] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:44:27 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 03 04:44:28.163784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:28.164517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] [instance: a433988c-4c56-4c4e-b09f-05331e3d36e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:28.171997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:28.172514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:28.173819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:28.174288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:28.189527 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] HTTP exception thrown: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Request method failure captured: Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 HTTP/1.1 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fyKIcyQe3Vuwf5sys5P2QHi2_spKJFPkMP6qBEdj07vwTJv7jlidqs2v6rraejRwZ67YkTjR8y96REkqAZsyMt7kPH37Am4Y2KOhFfLYwLNtIBsFXjbFTnGADDGJdLaL2LfZN-0sshpOF9_mnfmESQwT_-aovY0g7tEhcBT9oDIipc Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b4cd12a3a4c342b2950043b47b7e39b6 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b4cd12a3a4c342b2950043b47b7e39b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b4cd12a3a4c342b2950043b47b7e39b6 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueTestJSON-1978112153 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueTestJSON-1978112153-project Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 73d83656153f465a9c1bee17b9195287 Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueTestJSON-1978112153-project Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a433988c-4c56-4c4e-b09f-05331e3d36e6'} Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:44:28.191626 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] Returning 404 to user: Instance a433988c-4c56-4c4e-b09f-05331e3d36e6 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b8f8db4-9e25-49a8-858e-6cec65e928cf tempest-ServerRescueTestJSON-1978112153 tempest-ServerRescueTestJSON-1978112153-project] 10.222.0.72 "GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6" status: 404 len: 111 microversion: 2.1 time: 0.033451 Aug 03 04:44:28.197925 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1499/3033] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:28 2022] GET /compute/v2.1/servers/a433988c-4c56-4c4e-b09f-05331e3d36e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:44:28.836567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:28.837641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:28.849704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:28.852562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:28.853540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:28.865680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:29.047672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:29.057615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-339b32f4-dfb9-466c-ab87-a29ce19ae948 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1276 microversion: 2.1 time: 0.229546 Aug 03 04:44:29.058534 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1535/3034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:28 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:29.322439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:29.322957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:29.337249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:29.337249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:29.342125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:29.342584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:29.400250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'flavor' on Instance uuid 72531f91-6fd2-475e-bbe2-c4a450af9ee0 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:44:29.712740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:30.079625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:30.081070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:30.089505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:30.089971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:30.090754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:30.091208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:30.194207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fcce5e79-4524-4b07-bed1-b2110cd26c51 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/action" status: 202 len: 0 microversion: 2.20 time: 0.875590 Aug 03 04:44:30.195466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1500/3035] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:44:29 2022] POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/action => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:44:30.210688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:30.216703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:30.230367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:30.237119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:30.237119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:30.237119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:30.680898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:30.691557 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d591f54-47f6-432d-8561-7666351cd4b5 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.615125 Aug 03 04:44:30.711349 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1536/3036] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:30 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:30.796051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:30.813786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:30.816144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:30.819629 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be77739a-d520-48e0-8743-37ad10a34a5b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.618687 Aug 03 04:44:30.820813 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1501/3037] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:30 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:31.151468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-15d199bb-ad00-4ec5-a7bc-27a9871c6bbc req-30b8b29f-ee97-4fd5-93ff-6786285f7c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "135d2f8e-5479-49eb-bc61-56a073837cce", "tag": "d1193e94-8bc2-427f-a31f-8e0403b491f6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:31.162735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-15d199bb-ad00-4ec5-a7bc-27a9871c6bbc req-30b8b29f-ee97-4fd5-93ff-6786285f7c42 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:31.163750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-15d199bb-ad00-4ec5-a7bc-27a9871c6bbc req-30b8b29f-ee97-4fd5-93ff-6786285f7c42 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:31.176601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-15d199bb-ad00-4ec5-a7bc-27a9871c6bbc req-30b8b29f-ee97-4fd5-93ff-6786285f7c42 service nova] Creating event network-changed:d1193e94-8bc2-427f-a31f-8e0403b491f6 for instance 135d2f8e-5479-49eb-bc61-56a073837cce on n-h2-826756-5 Aug 03 04:44:31.182542 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-15d199bb-ad00-4ec5-a7bc-27a9871c6bbc req-30b8b29f-ee97-4fd5-93ff-6786285f7c42 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035074 Aug 03 04:44:31.183930 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1537/3038] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:31.714649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:31.715292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:31.723340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:31.725530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:31.725530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:31.725530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:31.844015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:31.845458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:31.853875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:31.854755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:31.855765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:31.856751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:32.012008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:32.021065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b32f905-875c-40bb-8e4a-e9de14bba377 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.311113 Aug 03 04:44:32.021863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1502/3039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:31 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:32.202718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:32.217523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:32.219851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:32.223729 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8878195d-8c5a-4cac-949b-3de40a141340 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.384004 Aug 03 04:44:32.226068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1538/3040] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:31 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:32.617202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3e511bd5-178c-4d4d-b2e4-d1445df05700 req-9e02900f-454f-4c5d-b8b3-947550de61e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-plugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:32.630626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3e511bd5-178c-4d4d-b2e4-d1445df05700 req-9e02900f-454f-4c5d-b8b3-947550de61e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:32.632332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3e511bd5-178c-4d4d-b2e4-d1445df05700 req-9e02900f-454f-4c5d-b8b3-947550de61e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:32.642499 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3e511bd5-178c-4d4d-b2e4-d1445df05700 req-9e02900f-454f-4c5d-b8b3-947550de61e0 service nova] Creating event network-vif-plugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:44:32.647627 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3e511bd5-178c-4d4d-b2e4-d1445df05700 req-9e02900f-454f-4c5d-b8b3-947550de61e0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045514 Aug 03 04:44:32.648244 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1503/3041] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:33.044938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:33.045578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:33.048649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:33.053132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:33.053617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:33.054402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:33.054913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:33.200803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:33.209212 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46961cb8-8587-4c8d-9124-7c4e3e9a0b3d tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.168258 Aug 03 04:44:33.210329 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1539/3042] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:33 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:33.213740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a48bf0d6-2915-4c47-bcd3-faffd408c473 req-15f16bf7-40cb-487c-aa04-dff9fe83f61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b33e15c6-8e46-4d63-87a6-15ba3961b8e5", "tag": "3b0c9c1e-4a88-4d45-b771-0690c47be22b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:33.224176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a48bf0d6-2915-4c47-bcd3-faffd408c473 req-15f16bf7-40cb-487c-aa04-dff9fe83f61e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:33.224652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a48bf0d6-2915-4c47-bcd3-faffd408c473 req-15f16bf7-40cb-487c-aa04-dff9fe83f61e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:33.235995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a48bf0d6-2915-4c47-bcd3-faffd408c473 req-15f16bf7-40cb-487c-aa04-dff9fe83f61e service nova] Creating event network-changed:3b0c9c1e-4a88-4d45-b771-0690c47be22b for instance b33e15c6-8e46-4d63-87a6-15ba3961b8e5 on n-h2-826756-5 Aug 03 04:44:33.249411 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a48bf0d6-2915-4c47-bcd3-faffd408c473 req-15f16bf7-40cb-487c-aa04-dff9fe83f61e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032543 Aug 03 04:44:33.249411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1504/3043] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:33.251627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:33.252250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:33.258959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:33.259424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:33.260200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:33.260705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:33.423909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:33.432409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:33.433923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:33.435134 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c95bbfe9-87f3-4ebd-a093-0d9777c51e10 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.188220 Aug 03 04:44:33.438384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1540/3044] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:33 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:33.988647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] Calling method '.version_select at 0x7fdd47fa8550>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:34.000258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.001410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.002195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.002711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.022121 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba709730-9ad4-487d-bb9a-5e637820a766 tempest-AbsoluteLimitsTestJSON-2054619092 tempest-AbsoluteLimitsTestJSON-2054619092-project] 10.222.0.72 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.277246 Aug 03 04:44:34.022703 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1505/3045] 10.222.0.72 () {58 vars in 1122 bytes} [Wed Aug 3 04:44:33 2022] GET /compute/v2.1/limits => generated 511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:34.230479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:34.231321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:34.239340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.239797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.240602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.241074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.246322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:34.379374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:34.387303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-796a2b33-67fe-4a32-b478-70dfb07c6f1c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.161065 Aug 03 04:44:34.387873 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1541/3046] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:34 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:34.459521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:34.460541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:34.467823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.468333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.469080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:34.470015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:34.607561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:34.617071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:34.618694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:34.619750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7af9388a-826a-4a90-bf45-2053a3343b36 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.164193 Aug 03 04:44:34.620327 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1506/3047] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:34 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:35.412834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:35.415352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:35.426760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:35.427819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:35.428827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:35.429428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:35.615000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:35.629623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ba7d162-8795-4f56-9b2c-a63734a521c1 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.224273 Aug 03 04:44:35.630434 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1542/3048] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:35 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:35.645480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:35.647179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:35.655431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:35.655921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:35.657355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:35.657991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:35.830195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:35.840658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:35.842422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:35.843883 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5155cbb7-b689-443a-8711-6567e5186447 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.203857 Aug 03 04:44:35.866654 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1507/3049] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:35 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:36.668732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:36.674853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:36.686904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:36.689034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:36.690207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:36.707127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:36.875052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:36.877435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:36.892745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:36.893631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:36.894674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:36.895285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:36.902210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:36.914205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f847bcc3-3ba0-4849-bb88-f39c42749985 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.258258 Aug 03 04:44:36.919560 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1543/3050] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:36 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:36.943977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5cff1009-2cd6-412b-bdba-886a1f307bd5 req-7f42b9e1-e921-4646-afd4-59730a921c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135d2f8e-5479-49eb-bc61-56a073837cce", "name": "network-vif-plugged", "status": "completed", "tag": "d1193e94-8bc2-427f-a31f-8e0403b491f6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:36.971793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5cff1009-2cd6-412b-bdba-886a1f307bd5 req-7f42b9e1-e921-4646-afd4-59730a921c89 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:36.971793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5cff1009-2cd6-412b-bdba-886a1f307bd5 req-7f42b9e1-e921-4646-afd4-59730a921c89 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:37.005527 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5cff1009-2cd6-412b-bdba-886a1f307bd5 req-7f42b9e1-e921-4646-afd4-59730a921c89 service nova] Creating event network-vif-plugged:d1193e94-8bc2-427f-a31f-8e0403b491f6 for instance 135d2f8e-5479-49eb-bc61-56a073837cce on n-h2-826756-5 Aug 03 04:44:37.018320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5cff1009-2cd6-412b-bdba-886a1f307bd5 req-7f42b9e1-e921-4646-afd4-59730a921c89 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094498 Aug 03 04:44:37.019002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1544/3051] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:37.197567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:37.211749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:37.213584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:37.215034 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb8ec03d-55bd-42fe-b41f-484e7525cf32 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.348032 Aug 03 04:44:37.216237 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1508/3052] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:36 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:37.946039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:37.951648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:37.968161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:37.969713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:37.982814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:37.982814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:38.206757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:38.216853 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2b583de-fb1c-4c68-bdb0-e9f2e2ac8860 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.275094 Aug 03 04:44:38.217684 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1545/3053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:37 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:38.249306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:38.251187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:38.261725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:38.269888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:38.269888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:38.269888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:38.446561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:38.460655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:38.463632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:38.464943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2423ada-3e09-4966-882c-e08f211d43cf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.220663 Aug 03 04:44:38.466767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1509/3054] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:38 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:39.120745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dc654661-66b6-4e5b-8ed6-563b3a4fd7ed req-8a0117e9-e5f4-4117-91e8-d2bc91ba145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33e15c6-8e46-4d63-87a6-15ba3961b8e5", "name": "network-vif-plugged", "status": "completed", "tag": "3b0c9c1e-4a88-4d45-b771-0690c47be22b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:39.137513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc654661-66b6-4e5b-8ed6-563b3a4fd7ed req-8a0117e9-e5f4-4117-91e8-d2bc91ba145f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:39.138269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc654661-66b6-4e5b-8ed6-563b3a4fd7ed req-8a0117e9-e5f4-4117-91e8-d2bc91ba145f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:39.152803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dc654661-66b6-4e5b-8ed6-563b3a4fd7ed req-8a0117e9-e5f4-4117-91e8-d2bc91ba145f service nova] Creating event network-vif-plugged:3b0c9c1e-4a88-4d45-b771-0690c47be22b for instance b33e15c6-8e46-4d63-87a6-15ba3961b8e5 on n-h2-826756-5 Aug 03 04:44:39.160082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dc654661-66b6-4e5b-8ed6-563b3a4fd7ed req-8a0117e9-e5f4-4117-91e8-d2bc91ba145f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047556 Aug 03 04:44:39.160938 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1546/3055] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:39.252472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:39.256259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:39.300894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:39.301847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:39.302855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:39.303456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:39.466079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:39.474573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c76166a7-06bf-46c7-843b-0ce63efb39bf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.239747 Aug 03 04:44:39.475190 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1510/3056] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:39 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:39.498091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:39.498859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:39.507030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:39.507491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:39.508879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:39.509335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:39.649072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:39.659052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:39.661378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:39.661976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9359244-57a7-41d0-8730-530a5e22952d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.168725 Aug 03 04:44:39.668631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1547/3057] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:39 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:40.500709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:40.501450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:40.515529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:40.516540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:40.517338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:40.517777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:40.688956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:40.704079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:40.737574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:40.740898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:40.742451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:40.743373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:40.966819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:40.985375 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7457636f-3e7c-460f-8b86-9b9518644c86 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1318 microversion: 2.1 time: 0.491753 Aug 03 04:44:40.987820 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1511/3058] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:40 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:41.054341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:41.072182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:41.074060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:41.083403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f2277b00-a0a4-4dcb-83ad-01d017a67796 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.400285 Aug 03 04:44:41.090464 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1548/3059] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:40 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:42.008950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:42.010279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:42.025737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.029833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:42.031128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.032799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:42.119726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:42.120916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:42.136249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.137017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:42.138005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.140909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:42.796521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:42.808986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-119da23d-e0bb-448e-8f18-acb052757a0c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 200 len: 1505 microversion: 2.1 time: 0.804823 Aug 03 04:44:42.816698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:42.837368 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1512/3060] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:42 2022] GET /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:42.840250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:42.842425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:42.847587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d97808bb-97fc-4d4f-afd8-eb0fe73fb1d1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.732067 Aug 03 04:44:42.849002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:42.849916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: 135d2f8e-5479-49eb-bc61-56a073837cce] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:42.851678 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1549/3061] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:42 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:42.857641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.858320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:42.859270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:42.860083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:43.563090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:43.593945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf42bf2b-845a-4db1-8af0-6719bc90af62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/135d2f8e-5479-49eb-bc61-56a073837cce" status: 200 len: 1505 microversion: 2.1 time: 0.735465 Aug 03 04:44:43.608577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1513/3062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:42 2022] GET /compute/v2.1/servers/135d2f8e-5479-49eb-bc61-56a073837cce => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:44:43.618544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:43.619078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: 135d2f8e-5479-49eb-bc61-56a073837cce] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:43.630566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:43.631175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:43.632024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:43.632648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:43.639604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:43.713783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: 135d2f8e-5479-49eb-bc61-56a073837cce] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:44:43.879552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:43.883909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:43.894419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:43.895891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:43.897177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:43.897878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:43.999387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:44.010408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:44.358293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:44.377622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:44.382301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:44.389272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-237a54d8-fadd-463e-9b48-2d0cd9ca43c9 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.517447 Aug 03 04:44:44.391687 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1514/3063] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:43 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:44.430384 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db490db6-3ae5-444c-a061-ce3e005afdf7 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "DELETE /compute/v2.1/servers/135d2f8e-5479-49eb-bc61-56a073837cce" status: 204 len: 0 microversion: 2.1 time: 0.816563 Aug 03 04:44:44.431688 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1550/3064] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:43 2022] DELETE /compute/v2.1/servers/135d2f8e-5479-49eb-bc61-56a073837cce => generated 0 bytes in 819 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:44:44.449321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:44.450865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:44.467930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:44.471115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:44.472296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:44.473004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:44.530766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: b33e15c6-8e46-4d63-87a6-15ba3961b8e5] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:44:44.949089 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40a1b568-0551-4142-b8a6-08b6ca87766c tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5" status: 204 len: 0 microversion: 2.1 time: 0.507566 Aug 03 04:44:44.952890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1515/3065] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:44:44 2022] DELETE /compute/v2.1/servers/b33e15c6-8e46-4d63-87a6-15ba3961b8e5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:44:45.195921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-325998568", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8504b64d-60fc-4eab-919d-3f84159d9682"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:45.342651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] validate_networks() for [('8504b64d-60fc-4eab-919d-3f84159d9682', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:44:45.414195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:45.414904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:45.425445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:45.427737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:45.445287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:45.446156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:45.446603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:46.378305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:46.390220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:46.395910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:46.403336 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f145aa8b-ba14-4a6b-8f60-3b00c99a36fb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.993547 Aug 03 04:44:46.411730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1516/3066] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:45 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:46.649749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be4b522c-c5fa-4dc9-81ac-6e808d2d5b0e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: .version_select at 0x7fdd47fa9a60>, body: {"keypair": {"name": "tempest-keypair-1371553202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIOAIR1I+8obtc3s9YLdeTOpnvVvq6e2IwZY0ovN4Up+J0OYjPjoC00TLLStdtPTnQtqG0FNTx5kmswksHoKTxWMkjSWRMzbuBjgeA+9N0jgzS0Vvp4XfqOFDWbl+U0Pw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:46.655220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-be4b522c-c5fa-4dc9-81ac-6e808d2d5b0e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for project eb38f33edc704bb39daf9765439257d5. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:44:46.664751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-be4b522c-c5fa-4dc9-81ac-6e808d2d5b0e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for user 2ebe6f390e2741058f63638d0b22eac9 and project eb38f33edc704bb39daf9765439257d5. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:44:46.838001 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be4b522c-c5fa-4dc9-81ac-6e808d2d5b0e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.432681 Aug 03 04:44:46.839118 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1517/3067] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:44:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:46.863120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:44:46.863724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:44:46.864188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:44:46.865187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:44:46.865624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:44:46.888370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:46.888876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:46.901535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:46.902094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:46.934245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Getting quotas for project 4e913cd1107341bcbd7528465a8b8f8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:44:46.943785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Getting quotas for user 79e67381d4944b3099dd89fd461143a8 and project 4e913cd1107341bcbd7528465a8b8f8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:44:46.986558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Going to run 2 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:44:46.989513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:44:47.246765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=fe5e6f52-2aea-4902-9638-70c3d43a017a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:44:47.438122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:47.438880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:47.457377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:47.464505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:47.464505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:47.464505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:47.537765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:47.681977 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c93ca1da-d4c1-4b77-9a11-5233d22d2413 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.494983 Aug 03 04:44:47.692086 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1551/3068] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:44:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 2506 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:44:47.714076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:47.759339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:47.778935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Searching by: {'deleted': False, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:44:47.858778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:47.859734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:47.865588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:47.866873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:47.967569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:44:48.043646 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e3f0018-6a0e-4279-8750-28366c10e052 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.347812 Aug 03 04:44:48.048564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1552/3069] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:44:47 2022] GET /compute/v2.1/servers => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:48.058409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3854ceff-6104-4a7d-8852-e4d1817e6068 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:48.059045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3854ceff-6104-4a7d-8852-e4d1817e6068 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:48.157708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:48.177407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:48.177407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:48.177807 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02ac064d-6312-431d-a5dc-09e875966259 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1745 microversion: 2.20 time: 0.747530 Aug 03 04:44:48.178385 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1518/3070] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:47 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1745 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:48.286457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3854ceff-6104-4a7d-8852-e4d1817e6068 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:48.289508 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3854ceff-6104-4a7d-8852-e4d1817e6068 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1217 microversion: 2.1 time: 0.234886 Aug 03 04:44:48.290115 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1553/3071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:48 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1217 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:48.520886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df0258ee-c7f9-4193-90af-22965b50af91"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:48.523525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:48.560111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:48.569345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:48.572535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:48.573274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:49.216486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:49.217786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:49.238558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:49.244511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:49.245396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:49.246381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:49.538751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:49.548990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:49.559737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:49.561023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b57b65ff-ff07-439d-9f06-8df8e1df8b5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.362884 Aug 03 04:44:49.561605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1554/3072] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:49 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:49.576463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29ff77bb-e40f-445f-a38e-b69d417aa670 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:49.581982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29ff77bb-e40f-445f-a38e-b69d417aa670 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:49.725412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29ff77bb-e40f-445f-a38e-b69d417aa670 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:49.735937 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29ff77bb-e40f-445f-a38e-b69d417aa670 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1217 microversion: 2.1 time: 0.168390 Aug 03 04:44:49.737806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1555/3073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:49 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:50.318702 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f742e04-76d9-4ba9-babb-8f2b7c6a1bea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "POST /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.801306 Aug 03 04:44:50.327387 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1519/3074] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:44:48 2022] POST /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 194 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:50.590192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:50.590722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:50.614376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:50.618364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:50.634065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:50.635026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:50.770932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5bab74e0-647f-4ebd-b461-f5a4254bf4e9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:50.770932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5bab74e0-647f-4ebd-b461-f5a4254bf4e9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:52.044983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5bab74e0-647f-4ebd-b461-f5a4254bf4e9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:52.064720 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5bab74e0-647f-4ebd-b461-f5a4254bf4e9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1217 microversion: 2.1 time: 1.305108 Aug 03 04:44:52.067613 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1520/3075] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:50 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1217 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:52.089521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d92b1311-589e-45a1-a254-d075255f6bf5 req-df3aef3c-119d-41e1-9b7b-71b46a2a9c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b33e15c6-8e46-4d63-87a6-15ba3961b8e5", "name": "network-vif-deleted", "tag": "3b0c9c1e-4a88-4d45-b771-0690c47be22b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:52.125217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d92b1311-589e-45a1-a254-d075255f6bf5 req-df3aef3c-119d-41e1-9b7b-71b46a2a9c45 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:52.126675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d92b1311-589e-45a1-a254-d075255f6bf5 req-df3aef3c-119d-41e1-9b7b-71b46a2a9c45 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:52.156956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d92b1311-589e-45a1-a254-d075255f6bf5 req-df3aef3c-119d-41e1-9b7b-71b46a2a9c45 service nova] Creating event network-vif-deleted:3b0c9c1e-4a88-4d45-b771-0690c47be22b for instance b33e15c6-8e46-4d63-87a6-15ba3961b8e5 on n-h2-826756-5 Aug 03 04:44:52.171039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d92b1311-589e-45a1-a254-d075255f6bf5 req-df3aef3c-119d-41e1-9b7b-71b46a2a9c45 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102063 Aug 03 04:44:52.173788 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1521/3076] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:52.185331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-225c36c5-cefe-428e-9a32-5bfbfcc5116f req-7fecfaf1-9f46-4aa9-8a4b-337b5cd316a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "name": "network-vif-plugged", "status": "completed", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:52.214177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-225c36c5-cefe-428e-9a32-5bfbfcc5116f req-7fecfaf1-9f46-4aa9-8a4b-337b5cd316a6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:52.214986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-225c36c5-cefe-428e-9a32-5bfbfcc5116f req-7fecfaf1-9f46-4aa9-8a4b-337b5cd316a6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:52.247541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-225c36c5-cefe-428e-9a32-5bfbfcc5116f req-7fecfaf1-9f46-4aa9-8a4b-337b5cd316a6 service nova] Creating event network-vif-plugged:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:44:52.262206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-225c36c5-cefe-428e-9a32-5bfbfcc5116f req-7fecfaf1-9f46-4aa9-8a4b-337b5cd316a6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084506 Aug 03 04:44:52.262589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:52.263688 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1522/3077] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:52.296558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:52.299747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:52.302743 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c470c65-04ea-4e92-b92e-9c97ed04972a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 1.716813 Aug 03 04:44:52.306127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1556/3078] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:50 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:53.089075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:53.090421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:53.116501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:53.117327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:53.118380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:53.123133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:53.355105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:53.362971 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bf920a9-9af3-4ca2-9df6-d6ca294b5383 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1213 microversion: 2.1 time: 0.279893 Aug 03 04:44:53.380748 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1523/3079] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:53 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1213 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:53.391280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:53.395387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:53.409968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:53.410992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:53.412130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:53.412884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:53.505309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe2b11f4-9044-4615-80bc-b0d7cb41ee23 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd5484c040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-981215758", "description": "tempest-description-2050732064"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:54.491777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:54.501481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:54.515007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:54.541779 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85faa483-1256-4e1c-b630-77af5ce59dfe tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 1.159348 Aug 03 04:44:54.542699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1524/3080] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:53 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:44:54.565836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a876267e-094d-4883-ae9b-3c9e9c919111 req-c6035a43-7663-45a1-a599-4b8c640bcb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "135d2f8e-5479-49eb-bc61-56a073837cce", "name": "network-vif-deleted", "tag": "d1193e94-8bc2-427f-a31f-8e0403b491f6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:54.577231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a876267e-094d-4883-ae9b-3c9e9c919111 req-c6035a43-7663-45a1-a599-4b8c640bcb2f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:54.578554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a876267e-094d-4883-ae9b-3c9e9c919111 req-c6035a43-7663-45a1-a599-4b8c640bcb2f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:54.593172 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a876267e-094d-4883-ae9b-3c9e9c919111 req-c6035a43-7663-45a1-a599-4b8c640bcb2f service nova] Creating event network-vif-deleted:d1193e94-8bc2-427f-a31f-8e0403b491f6 for instance 135d2f8e-5479-49eb-bc61-56a073837cce on n-h2-826756-5 Aug 03 04:44:54.617901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a876267e-094d-4883-ae9b-3c9e9c919111 req-c6035a43-7663-45a1-a599-4b8c640bcb2f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053991 Aug 03 04:44:54.617901 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1525/3081] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:54.627295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:54.630762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:54.650300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:54.653495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:54.654833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:54.660862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:54.885709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:54.898095 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-20884c79-c392-4b5a-9e57-0868da878c38 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1277 microversion: 2.1 time: 0.283252 Aug 03 04:44:54.916815 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1526/3082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:54 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:55.572612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:55.573238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:55.606813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:55.608008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:55.617926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:55.620286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:56.698754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe2b11f4-9044-4615-80bc-b0d7cb41ee23 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 3.383116 Aug 03 04:44:56.699779 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1557/3083] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:44:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 3385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:44:56.714892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:56.718459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:56.753812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:56.755355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:56.761263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:56.766657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:57.319798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.339749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8a859e9-d2dd-4eb8-b5ff-34f94fe1f0bc tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1275 microversion: 2.1 time: 0.638472 Aug 03 04:44:57.340358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1558/3084] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:56 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1275 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:57.346508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7d0387b-a242-4cff-ba7a-16a42384e6d6 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd54f495e0>, body: {"security_group_rule": {"parent_group_id": "aeb9867e-e9af-4fff-b052-45606445393d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:57.479052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.509133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.521080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.546784 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da11d057-92a5-44d1-96d3-42a2f83f52d2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 1.955484 Aug 03 04:44:57.546784 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1527/3085] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:55 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:44:57.566413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:57.585549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.597305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Searching by: {'deleted': False, 'project_id': '85e273b566c84276a6cc6930b18aa8c3'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:44:57.635337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:57.636857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:57.645309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:57.647888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:57.710553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:44:57.743348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41d62f21-6443-4692-a2af-d8bc25fdbee4 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.204728 Aug 03 04:44:57.744927 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1528/3086] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:44:57 2022] GET /compute/v2.1/servers => generated 344 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:57.759741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:57.785900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:57.787545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Searching by: {'deleted': False, 'project_id': '85e273b566c84276a6cc6930b18aa8c3'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:44:57.877364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:57.877858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:57.882098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:57.945327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:57.994538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:57.995816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:44:58.056981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:58.070887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:58.071589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:58.379931 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21683315-9199-4706-b236-c0049161f091 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.623864 Aug 03 04:44:58.380911 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1529/3087] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:44:57 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:58.385615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:58.386216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:58.399681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:58.400350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:58.403410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:58.403966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:58.568522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:44:58.604412 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef0fca21-9fd3-4776-8a4d-c18a07d215cf tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1275 microversion: 2.1 time: 0.221682 Aug 03 04:44:58.605288 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1530/3088] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:44:58 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:44:58.617055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f8059d4-07e4-46ca-8bf6-1b9c17d5775a tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:58.639928 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f8059d4-07e4-46ca-8bf6-1b9c17d5775a tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027381 Aug 03 04:44:58.641235 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1531/3089] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:44:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:58.655135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-455129627", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e074a4b-f902-4eed-bcc3-75f5a8703622"}], "security_groups": [{"name": "tempest-securitygroup--1300939278"}], "key_name": "tempest-keypair-1371553202", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:44:59.236117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7d0387b-a242-4cff-ba7a-16a42384e6d6 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.894468 Aug 03 04:44:59.237401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1559/3090] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:44:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:44:59.247260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:44:59.248320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:44:59.269345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:44:59.273978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:59.275299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:59.276572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:44:59.278308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:44:59.653802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] validate_networks() for [('7e074a4b-f902-4eed-bcc3-75f5a8703622', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:44:59.730516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:00.094070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:00.126562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:00.134094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:00.135799 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c92e6e46-7276-4fb8-bf04-1aaeeb980362 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.897288 Aug 03 04:45:00.138766 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1560/3091] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:44:59 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:00.151943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:00.153383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:00.162413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:00.163323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:00.164351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:00.164979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:00.225519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:45:00.723841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-70611b89-03f7-49b8-a525-8e61340f3009 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 204 len: 0 microversion: 2.1 time: 0.582241 Aug 03 04:45:00.731495 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1561/3092] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:45:00 2022] DELETE /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:45:00.733160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:00.735215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:00.754579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:00.754579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:00.763121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:00.763597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:01.102110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:45:01.103311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:45:01.103974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:45:01.104708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:45:01.105293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:45:01.126115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:01.126842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:01.131060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:01.133998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:01.166579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for project eb38f33edc704bb39daf9765439257d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:45:01.186319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for user 2ebe6f390e2741058f63638d0b22eac9 and project eb38f33edc704bb39daf9765439257d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:45:01.187171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:01.195641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-666957e3-bcf3-4354-8d2b-1c8f68a3ff18 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.468353 Aug 03 04:45:01.205930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:45:01.208245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:45:01.212168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1562/3093] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:00 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:01.218148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a299a3c-056b-4ca9-8b20-304832dcec9c tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd54879a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1685827", "description": "tempest-description-634865269"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:01.482211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f86e0a94-d585-420f-a312-be0beb438b63 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.831544 Aug 03 04:45:01.483794 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1532/3094] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:44:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:45:01.488549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:01.489435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:01.500791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:01.501464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:01.502419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:01.503023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:02.420535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:02.441316 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc5eeade-28b7-4a19-b798-d9f3a16ca8ce tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.956231 Aug 03 04:45:02.458914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1533/3095] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:01 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:02.471894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:02.473523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:02.481273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:02.481904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:02.482937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:02.483706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:02.764377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a299a3c-056b-4ca9-8b20-304832dcec9c tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.549402 Aug 03 04:45:02.766097 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1563/3096] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:02.773820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:02.778847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:02.797087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:02.801321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:02.802490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:02.803166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:02.976978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:02.991324 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4bf5509-0a48-4370-8e80-668348d6d6c9 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1610 microversion: 2.1 time: 0.530735 Aug 03 04:45:02.992747 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1534/3097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:02 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1610 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:02.997687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-629604491"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:03.000527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:03.008846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:03.009589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:03.010534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:03.011139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:03.268932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:03.286174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:03.288260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:03.290245 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3fabd674-face-40dc-8bbe-ed0dea07ef06 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.521938 Aug 03 04:45:03.311366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1564/3098] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:02 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:03.317043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1253d15-ff67-4a25-ad6f-2f6c2637ed02 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:03.318377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e1253d15-ff67-4a25-ad6f-2f6c2637ed02 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:03.393036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e1253d15-ff67-4a25-ad6f-2f6c2637ed02 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:03.400539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1253d15-ff67-4a25-ad6f-2f6c2637ed02 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1237 microversion: 2.1 time: 0.087690 Aug 03 04:45:03.401137 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1565/3099] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:03 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:03.421594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-45a46167-0cd8-4608-92a1-e96ff8faef4d req-70235849-b039-4255-b95b-8bb6deabd8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a470021b-6220-4d82-9a74-9670f6114c77", "tag": "9539efde-7e66-40c5-a579-8e08988fd5a3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:03.435487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-45a46167-0cd8-4608-92a1-e96ff8faef4d req-70235849-b039-4255-b95b-8bb6deabd8c0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:03.436032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-45a46167-0cd8-4608-92a1-e96ff8faef4d req-70235849-b039-4255-b95b-8bb6deabd8c0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:03.448795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-45a46167-0cd8-4608-92a1-e96ff8faef4d req-70235849-b039-4255-b95b-8bb6deabd8c0 service nova] Creating event network-changed:9539efde-7e66-40c5-a579-8e08988fd5a3 for instance a470021b-6220-4d82-9a74-9670f6114c77 on n-h2-826756-5 Aug 03 04:45:03.456537 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-45a46167-0cd8-4608-92a1-e96ff8faef4d req-70235849-b039-4255-b95b-8bb6deabd8c0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042359 Aug 03 04:45:03.457274 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1566/3100] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:03.465084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a5bf72ac-a44b-49ab-b985-b7d0d9ced74e req-4ba844b7-5d0a-426a-b787-f881a79fdaaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5e6f52-2aea-4902-9638-70c3d43a017a", "tag": "2df457d6-0064-457f-8e3e-dcd9e65197e0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:03.478430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a5bf72ac-a44b-49ab-b985-b7d0d9ced74e req-4ba844b7-5d0a-426a-b787-f881a79fdaaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:03.478978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a5bf72ac-a44b-49ab-b985-b7d0d9ced74e req-4ba844b7-5d0a-426a-b787-f881a79fdaaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:03.496361 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a5bf72ac-a44b-49ab-b985-b7d0d9ced74e req-4ba844b7-5d0a-426a-b787-f881a79fdaaf service nova] Creating event network-changed:2df457d6-0064-457f-8e3e-dcd9e65197e0 for instance fe5e6f52-2aea-4902-9638-70c3d43a017a on n-h1-826756-5 Aug 03 04:45:03.505567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a5bf72ac-a44b-49ab-b985-b7d0d9ced74e req-4ba844b7-5d0a-426a-b787-f881a79fdaaf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044270 Aug 03 04:45:03.506708 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1567/3101] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:03.512616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6358a64-cc92-44f3-af7e-c063e85ce457 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd550350d0>, body: {"security_group_rule": {"parent_group_id": "8711e1ff-f5b8-4dfe-a0c7-8f35f977f892", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:04.189167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f3f3aa75-15cd-4864-92d3-a09d68b048ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 1.194725 Aug 03 04:45:04.189906 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1535/3102] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:45:02 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 03 04:45:04.195265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:04.200615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:04.215475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.215940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.216774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.222998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.228012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:04.512656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:04.525371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5211b2a1-85e1-417f-8106-65776d7c60dd tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.333980 Aug 03 04:45:04.527199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1536/3103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:04 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:04.536371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:04.547857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:04.555784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.557735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.559933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.560694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.683648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6358a64-cc92-44f3-af7e-c063e85ce457 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.175166 Aug 03 04:45:04.686290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1568/3104] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:45:03 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:04.701163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:04.702007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:04.718554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.719004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.719919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.720469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.791948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:04.800838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28a9872c-d7c0-414a-ac8b-65016a1d487f tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1542 microversion: 2.1 time: 0.270734 Aug 03 04:45:04.801650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1537/3105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:04 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1542 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:04.824949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:04.828715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:04.837961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.838814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.839763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:04.840387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:04.963150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:04.977771 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9d2794c-126a-4a09-9bc0-a5c020eaed1b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1233 microversion: 2.1 time: 0.160652 Aug 03 04:45:04.981896 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1538/3106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:04 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1233 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:04.998446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb6fce4c-690d-4b65-a67a-a3b96d48ab01 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd47f84310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1886063436", "description": "tempest-description-706642606"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:05.228929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:05.251472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:05.253844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:05.255884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07d933bc-ca68-4d59-aa15-467bb11dde74 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.568060 Aug 03 04:45:05.275882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1569/3107] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:04 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:05.282767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-189257c5-5b31-4425-a2e2-6061702cddbd req-2c765e47-b45c-4aa2-8de2-a5d8e43b32d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-unplugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:05.305708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-189257c5-5b31-4425-a2e2-6061702cddbd req-2c765e47-b45c-4aa2-8de2-a5d8e43b32d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.306507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-189257c5-5b31-4425-a2e2-6061702cddbd req-2c765e47-b45c-4aa2-8de2-a5d8e43b32d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:05.325443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-189257c5-5b31-4425-a2e2-6061702cddbd req-2c765e47-b45c-4aa2-8de2-a5d8e43b32d6 service nova] Creating event network-vif-unplugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:45:05.331471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-189257c5-5b31-4425-a2e2-6061702cddbd req-2c765e47-b45c-4aa2-8de2-a5d8e43b32d6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053874 Aug 03 04:45:05.332086 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1570/3108] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:05.551313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4d35da97-18c8-4a5f-b7fb-9095dd826710 req-0f94b821-c997-4c6a-b393-e8fe862c381e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceed001-1497-4a04-829e-95b663847c7b", "name": "network-vif-deleted", "tag": "622756e3-d616-46b7-a167-2c6b4b32f856"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:05.584602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d35da97-18c8-4a5f-b7fb-9095dd826710 req-0f94b821-c997-4c6a-b393-e8fe862c381e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.585052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d35da97-18c8-4a5f-b7fb-9095dd826710 req-0f94b821-c997-4c6a-b393-e8fe862c381e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:05.610479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4d35da97-18c8-4a5f-b7fb-9095dd826710 req-0f94b821-c997-4c6a-b393-e8fe862c381e service nova] Creating event network-vif-deleted:622756e3-d616-46b7-a167-2c6b4b32f856 for instance 9ceed001-1497-4a04-829e-95b663847c7b on n-h1-826756-5 Aug 03 04:45:05.621183 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4d35da97-18c8-4a5f-b7fb-9095dd826710 req-0f94b821-c997-4c6a-b393-e8fe862c381e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081691 Aug 03 04:45:05.624336 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1571/3109] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:05.635717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:05.642900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:05.655443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.656176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:05.657525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.660018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:05.933210 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb6fce4c-690d-4b65-a67a-a3b96d48ab01 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.948710 Aug 03 04:45:05.933827 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1539/3110] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:05.956116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:05.958723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:05.967259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.969166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:05.970230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:05.970834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:06.136075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.143183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.164120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea922fe2-fe92-486a-b254-4d0086a7a11c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.201715 Aug 03 04:45:06.165730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1540/3111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:05 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:06.169447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81f30acc-eaa6-4644-a49e-f704110c6f59 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.542735 Aug 03 04:45:06.170792 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1572/3112] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:05 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:06.182172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:06.188470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:06.205049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5348d3a5-eb23-4be7-b9cb-ef24d7e8b877 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd47fb5160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-812417047", "description": "tempest-description-485193457"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:06.205581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:06.207154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:06.208240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:06.210692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:06.269363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:06.349866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.368353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c240659-3e96-4a64-8a37-b889bccb5332 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1289 microversion: 2.1 time: 0.195719 Aug 03 04:45:06.385863 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1573/3113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:06 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1289 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:06.393691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:06.395801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:06.411797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:06.412691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:06.413768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:06.414544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:06.777318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.795875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.795875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:06.795875 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-943fec7a-25f1-4043-8254-9d44b2078be5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.406390 Aug 03 04:45:06.795875 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1574/3114] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:06 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:06.989190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5348d3a5-eb23-4be7-b9cb-ef24d7e8b877 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.822017 Aug 03 04:45:06.989939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1541/3115] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:06 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:07.003319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7282cb3a-c22e-485a-ba0e-94896e432d91 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd553cc310>, body: {"security_group_rule": {"parent_group_id": "c80ac498-6f1e-4fa6-9d42-f5eef71e29bc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0b3770f5-0a1c-4940-9074-7cde7ad5fede"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:07.183963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:07.192161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:07.220700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.221348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:07.222451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.225343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:07.463464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:07.475967 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f62b6b66-0c03-4a32-9fd4-2e0a434f7ba5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.299190 Aug 03 04:45:07.477649 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1542/3116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:07 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:07.490730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:07.499511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:07.512045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.518562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:07.521714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.522464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:07.897673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:07.925793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79ed9cfe-44b8-43ca-819f-c858f47bd63a tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.446492 Aug 03 04:45:07.943682 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1543/3117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:07 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:07.964880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:07.965681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:07.987857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.988661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:07.989767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:07.990314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.240832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:08.245926 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7282cb3a-c22e-485a-ba0e-94896e432d91 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.246805 Aug 03 04:45:08.247079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1575/3118] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:45:06 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:08.254708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:08.254920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe334803-2084-49ee-a2bc-ecd85914a30f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.299446 Aug 03 04:45:08.255032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:08.255123 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1544/3119] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:07 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:08.261412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-936ae589-133f-4b06-b2de-3f68299b0ca3 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd549229d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1290784301", "description": "tempest-description-555046410"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:08.294894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.297129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.298877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.301922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.604840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:08.621927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:08.632709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:08.635287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31bba024-64c3-4415-a2f5-27daadddeaf3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.382546 Aug 03 04:45:08.636589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1576/3120] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:08 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:08.650449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:08.651580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:08.663842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.664695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.668864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.669629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.862728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:08.876731 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6aa80bf8-22bc-4822-a5f3-7a704f9b070c tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.225527 Aug 03 04:45:08.881131 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1577/3121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:08 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:08.950885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:08.952351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:08.964038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.969497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:08.971260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:08.976075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.106398 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-936ae589-133f-4b06-b2de-3f68299b0ca3 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.849665 Aug 03 04:45:09.109040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1545/3122] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:08 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:09.296239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:09.310865 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e52ba48-5454-4ac1-881d-9a9fe84f6885 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.363884 Aug 03 04:45:09.316647 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1578/3123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:08 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:09.332669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d714dcd-821c-4d70-99b9-96f4cf815139 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd54a910d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-932049434", "description": "tempest-description-621010916"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:09.398358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6315e120-6895-49d9-aafe-83c3d90eba01"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:09.401213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:09.420753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:09.421224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.422023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:09.422460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.647378 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] HTTP exception thrown: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Request method failure captured: Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments/df0258ee-c7f9-4193-90af-22965b50af91 HTTP/1.1 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 74 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f0BBgzQcyL5wPxnXvWE-kt1imMJQnJbR4Az08lEDTbTEwHZ3gXfZquIY_U7HoIgild_UpJoj1jIa2hFowoAy_Hxcp5vzm7wVcVWmMtYogYWt_YU09n1lO382r_DYF_7ELjAT_teIPLt8LXtdIA_4kwhPVa8zpJVCoGAiWFCUmkoPfA Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 619aaf8c3d1a47a5a15eac53ed915c67 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 619aaf8c3d1a47a5a15eac53ed915c67 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesAdminNegativeTest-981760968-project-admin Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 448424855c62437a84bbf44ccf109699 Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesAdminNegativeTest-981760968-project-admin Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: {"volumeAttachment": {"volumeId": "6315e120-6895-49d9-aafe-83c3d90eba01"}} Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: exception: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '22e5184b-8e80-421f-a8c4-cb8e09bda213', 'id': 'df0258ee-c7f9-4193-90af-22965b50af91', 'body': {'volumeAttachment': {'volumeId': '6315e120-6895-49d9-aafe-83c3d90eba01'}}} Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. (HTTP 404) (Request-ID: req-158cbcd4-942f-4845-a5f2-8960b2555756) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:45:09.684699 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. Aug 03 04:45:09.689568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:09.696615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Returning 400 to user: Volume 6315e120-6895-49d9-aafe-83c3d90eba01 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:09.698636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9585af63-072e-41b9-a299-20f5e6f79bf1 tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] 10.222.0.72 "PUT /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments/df0258ee-c7f9-4193-90af-22965b50af91" status: 400 len: 107 microversion: 2.1 time: 0.587864 Aug 03 04:45:09.699461 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1546/3124] 10.222.0.72 () {60 vars in 1433 bytes} [Wed Aug 3 04:45:09 2022] PUT /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments/df0258ee-c7f9-4193-90af-22965b50af91 => generated 107 bytes in 590 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:45:09.713052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ebff67ab-f409-413c-9959-fda18f37089b req-8974755a-3d48-4ef9-81d4-9fdad645717a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a470021b-6220-4d82-9a74-9670f6114c77", "name": "network-vif-plugged", "status": "completed", "tag": "9539efde-7e66-40c5-a579-8e08988fd5a3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:09.753124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ebff67ab-f409-413c-9959-fda18f37089b req-8974755a-3d48-4ef9-81d4-9fdad645717a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:09.753858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ebff67ab-f409-413c-9959-fda18f37089b req-8974755a-3d48-4ef9-81d4-9fdad645717a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.772455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ebff67ab-f409-413c-9959-fda18f37089b req-8974755a-3d48-4ef9-81d4-9fdad645717a service nova] Creating event network-vif-plugged:9539efde-7e66-40c5-a579-8e08988fd5a3 for instance a470021b-6220-4d82-9a74-9670f6114c77 on n-h2-826756-5 Aug 03 04:45:09.778800 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ebff67ab-f409-413c-9959-fda18f37089b req-8974755a-3d48-4ef9-81d4-9fdad645717a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074818 Aug 03 04:45:09.780290 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1547/3125] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:09.790619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:09.791610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:09.801762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:09.802519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.803970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:09.805057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:09.991501 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d714dcd-821c-4d70-99b9-96f4cf815139 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.672654 Aug 03 04:45:09.992359 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1579/3126] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:09 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:10.008819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:10.008819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:10.025855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.026611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.027621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.028344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.058496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:10.068813 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-274e02a2-0842-49ad-aa03-fef8500375ce tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.286805 Aug 03 04:45:10.069805 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1548/3127] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:09 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:10.074587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7a6852bc-29c1-441d-a371-cbd9da0c8105 req-35964436-f7af-4b34-b7b7-c03ffc8e67a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779d1f9e-2351-4630-83f4-9a80cfcc5a8d", "tag": "935aefd9-11dd-4cea-a681-d52158672852"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:10.087010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7a6852bc-29c1-441d-a371-cbd9da0c8105 req-35964436-f7af-4b34-b7b7-c03ffc8e67a6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.087470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7a6852bc-29c1-441d-a371-cbd9da0c8105 req-35964436-f7af-4b34-b7b7-c03ffc8e67a6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.135494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7a6852bc-29c1-441d-a371-cbd9da0c8105 req-35964436-f7af-4b34-b7b7-c03ffc8e67a6 service nova] Creating event network-changed:935aefd9-11dd-4cea-a681-d52158672852 for instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d on n-h2-826756-5 Aug 03 04:45:10.146745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7a6852bc-29c1-441d-a371-cbd9da0c8105 req-35964436-f7af-4b34-b7b7-c03ffc8e67a6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074046 Aug 03 04:45:10.148615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1549/3128] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:10.161497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:10.162138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:10.184055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.184552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.185376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.189320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.374940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:10.392673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:10.398818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:10.401907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e149f7c-f044-4a74-9a06-37e73e101b07 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.398736 Aug 03 04:45:10.421882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1580/3129] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:10 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:10.435399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lazy-loading 'services' on Instance uuid 22e5184b-8e80-421f-a8c4-cb8e09bda213 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:45:10.450084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:10.451042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:10.459060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.463065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.466453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.466453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.606130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:10.617198 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c98f7c8d-345c-497f-b4b5-cfdbc13e3ad6 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.193652 Aug 03 04:45:10.624751 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1581/3130] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:10 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:10.645306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7400734b-de95-47e5-89d0-5c807c273544 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd54a91820>, body: {"security_group_rule": {"parent_group_id": "05f89ff1-16d4-4cc3-999d-46817dec8fa8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bd9b38dc-a01b-46f0-8a01-7ddb82dd397d"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:10.884607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05261cbd-a0d2-44f8-8161-92eb0d6bb47d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "DELETE /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments/df0258ee-c7f9-4193-90af-22965b50af91" status: 202 len: 0 microversion: 2.1 time: 0.734177 Aug 03 04:45:10.889538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1550/3131] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:45:10 2022] DELETE /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments/df0258ee-c7f9-4193-90af-22965b50af91 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:10.894028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:10.897598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:10.911229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.912117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:10.913489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:10.914181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.150554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:11.199515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:11.228301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:11.250891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c634d9a8-155d-4c0e-b842-39b656883a62 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1317 microversion: 2.1 time: 0.358716 Aug 03 04:45:11.251998 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1551/3132] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:10 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:11.260458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:11.263059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:11.291847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.295103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.296696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.297304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.351564 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e47b2a97-1e3e-4d36-b0ee-8c42f7f154ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096569 Aug 03 04:45:11.352584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1552/3133] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:11 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:11.361100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:11.362503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:11.369521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.380732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.382661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.383289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.603648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:11.609086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-627e96a2-22e7-4361-af59-9233102f74d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.255279 Aug 03 04:45:11.609935 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1553/3134] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:11 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:11.615018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:11.615852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:11.618141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:11.633162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.635695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.636744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.638621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.872941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7400734b-de95-47e5-89d0-5c807c273544 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.243938 Aug 03 04:45:11.874409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1582/3135] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:45:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:11.887972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:11.890637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:11.918575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.919046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.919869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:11.920451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:11.985576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:12.000332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:12.003412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:12.004938 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43406725-a6bb-4be7-ba12-a77db02ee101 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.393857 Aug 03 04:45:12.007781 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1554/3136] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:11 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:12.031480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5e6f52-2aea-4902-9638-70c3d43a017a", "name": "network-vif-plugged", "status": "completed", "tag": "2df457d6-0064-457f-8e3e-dcd9e65197e0"}, {"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-plugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:12.055363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.055817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.070725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:12.079978 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4abc20f3-6e9a-4597-85b2-3624857d6f95 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.196207 Aug 03 04:45:12.085643 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] Creating event network-vif-plugged:2df457d6-0064-457f-8e3e-dcd9e65197e0 for instance fe5e6f52-2aea-4902-9638-70c3d43a017a on n-h1-826756-5 Aug 03 04:45:12.086173 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] Creating event network-vif-plugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:45:12.094057 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1583/3137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:11 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:12.103109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6d87e61-7099-4185-ac2a-e144860a122c tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd551dbc10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:12.110214 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c26ab4f0-2db8-4585-b436-408fa2cafdb3 req-b48d6115-f2ab-4275-a6be-ebfd71730b24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100369 Aug 03 04:45:12.116774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1555/3138] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:12.278195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:12.279270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:12.303888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.304105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.304919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.305358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.736228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:12.751690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab0300b9-2995-4849-8c7b-3f753a914eda tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 200 len: 1505 microversion: 2.1 time: 0.477798 Aug 03 04:45:12.769329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1556/3139] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:12 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:12.777731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:12.786974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:12.799982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.800737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.801707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.808535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.848126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:12.883338 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6d0207d-94ce-40bb-aa91-13a94d408c7c tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112578 Aug 03 04:45:12.891890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1557/3140] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:12 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:12.949475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:12.950347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:12.965458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.966111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:12.968170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:12.968899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.132509 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6d87e61-7099-4185-ac2a-e144860a122c tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/bd9b38dc-a01b-46f0-8a01-7ddb82dd397d" status: 202 len: 0 microversion: 2.1 time: 1.033683 Aug 03 04:45:13.139056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1584/3141] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:12 2022] DELETE /compute/v2.1/os-security-groups/bd9b38dc-a01b-46f0-8a01-7ddb82dd397d => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:13.148475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:13.150411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:13.184087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.184620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.188438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.191803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.253897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.264009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a1ed92d-96c3-42bc-8bf8-d0a8a9394104 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.369924 Aug 03 04:45:13.266711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1558/3142] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:12 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:13.273822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:13.274582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:13.285103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.286282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.287999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.288706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.398107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:13.563099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.581305 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1de03a47-d637-4fea-9cc2-d4824a4cf755 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 200 len: 1317 microversion: 2.1 time: 0.433863 Aug 03 04:45:13.581305 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1585/3143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:13 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:13.584091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:13.585492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:13.610508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.611037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.611857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.612393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.635463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.650143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.653221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.658298 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b1cc389-1e99-4ccf-9b8f-6acdd0fa7b79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1740 microversion: 2.20 time: 0.387462 Aug 03 04:45:13.659507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1559/3144] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:13 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:13.672542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c32d142-fdd9-4dd7-80cf-bbf02d7cd175 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd47fa9a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:13.802941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd409642f486d4d52a57a9d644c28f6cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e273b566c84276a6cc6930b18aa8c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:13.809853 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c32d142-fdd9-4dd7-80cf-bbf02d7cd175 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/05f89ff1-16d4-4cc3-999d-46817dec8fa8" status: 200 len: 247 microversion: 2.1 time: 0.147731 Aug 03 04:45:13.819784 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1560/3145] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:45:13 2022] GET /compute/v2.1/os-security-groups/05f89ff1-16d4-4cc3-999d-46817dec8fa8 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:13.822620 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e3b26f4-7404-4487-a239-d12958cca3e2 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 200 len: 1253 microversion: 2.1 time: 0.242772 Aug 03 04:45:13.823208 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1586/3146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:13 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 1253 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:13.825492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53d1b603-9a60-499a-b5af-05259c1b1e10 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd47f55d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1867896752", "description": "tempest-description-1839343109"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:13.897342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:13.900697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:13.919965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.921065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.921881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:13.922326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:13.995236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3aeb16f-0b5d-474f-a3d9-c3ec39aaa3a7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103606 Aug 03 04:45:13.999502 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1587/3147] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:13 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:14.292189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:14.293014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:14.308489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:14.311640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:14.311640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:14.311640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:14.421546 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53d1b603-9a60-499a-b5af-05259c1b1e10 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.600235 Aug 03 04:45:14.424684 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1561/3148] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:45:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:14.441331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-710e9662-23ed-417a-8a1f-83f5583d4d75 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd47f01430>, body: {"security_group_rule": {"parent_group_id": "ede6a5f2-f1ba-424c-b741-904fe66fc407", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:15.438796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:15.457757 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d93c379-d81a-498d-9157-4d19da876d43 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 1.171220 Aug 03 04:45:15.468235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1588/3149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:14 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:15.479810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:15.484255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:15.502787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:15.505531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:15.506441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:15.508723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:15.970797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:15.984598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-098c29c5-a807-4a76-b016-5dcd977952d9 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 200 len: 1505 microversion: 2.1 time: 0.512972 Aug 03 04:45:15.985411 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1589/3150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:15 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 1505 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:15.993507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:15.994358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:16.017085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.017806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.020698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.021349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.026521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-710e9662-23ed-417a-8a1f-83f5583d4d75 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.593974 Aug 03 04:45:16.027558 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1562/3151] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:45:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:16.035873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:16.035873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] [instance: 9ceed001-1497-4a04-829e-95b663847c7b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:16.050360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.054703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.056576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.059044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.091035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] HTTP exception thrown: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Request method failure captured: Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b HTTP/1.1 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fydAL2mEUo7MfQ50jzojy9jilaMlg6sNHffRHzNOw1Llq0cZKzdQlyUhyOyx9v3pm6avVeEg_6XiQajlaLVnXX5x5C44u8RrDO3hObnbOoMqFo1ihid-7jgYuei-GxXHJOgm5CiFUBaUrFZJH0gB7dITHWMp6iBSmxrAxfjiICQgmE Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 85e273b566c84276a6cc6930b18aa8c3 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestBootFromVolume-289841561 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/85e273b566c84276a6cc6930b18aa8c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/85e273b566c84276a6cc6930b18aa8c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_85e273b566c84276a6cc6930b18aa8c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/85e273b566c84276a6cc6930b18aa8c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestBootFromVolume-289841561 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 85e273b566c84276a6cc6930b18aa8c3 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestBootFromVolume-289841561 Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestBootFromVolume-289841561-project Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d409642f486d4d52a57a9d644c28f6cf Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestBootFromVolume-289841561-project Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9ceed001-1497-4a04-829e-95b663847c7b'} Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:16.096934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Returning 404 to user: Instance 9ceed001-1497-4a04-829e-95b663847c7b could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3e1961d-72a4-49bd-a9c5-63bb182b00c5 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b" status: 404 len: 111 microversion: 2.1 time: 0.072809 Aug 03 04:45:16.111445 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1563/3152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:16 2022] GET /compute/v2.1/servers/9ceed001-1497-4a04-829e-95b663847c7b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:45:16.118639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:16.127852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:16.145278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.145750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.149826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.150502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.215693 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61e4825a-d590-4c81-87d8-2caf2ceb8b48 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112456 Aug 03 04:45:16.216634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1564/3153] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:16 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:16.223077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:16.224103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:16.232466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.233367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.234204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:16.234668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:16.279116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:16.284194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:45:16.289579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:16.291478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:16.296056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6fe2864-c72a-44be-b4f0-f790d58b0f8a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1722 microversion: 2.20 time: 0.308252 Aug 03 04:45:16.303714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1590/3154] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:15 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1722 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:16.308781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-376e7f37-ee4e-42fb-984f-f72cc40d5603 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Action: 'create', calling method: .version_select at 0x7fdd54de3d30>, body: {"security_group_rule": {"parent_group_id": "ede6a5f2-f1ba-424c-b741-904fe66fc407", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:16.870372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27b745c8-469d-428d-a3a0-af6e00da8735 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 204 len: 0 microversion: 2.1 time: 0.652183 Aug 03 04:45:16.872547 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1565/3155] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:45:16 2022] DELETE /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:45:16.878758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc710f78-69f9-4a0b-9e27-0ccd85f46157 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] Calling method '.version_select at 0x7fdd47f55c10>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:17.246112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc710f78-69f9-4a0b-9e27-0ccd85f46157 tempest-ServersTestBootFromVolume-289841561 tempest-ServersTestBootFromVolume-289841561-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058430100" status: 202 len: 0 microversion: 2.1 time: 0.370855 Aug 03 04:45:17.248997 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1566/3156] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058430100 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:17.261892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:17.262642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:17.278622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.279306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.281877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.283151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.460023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-376e7f37-ee4e-42fb-984f-f72cc40d5603 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.154620 Aug 03 04:45:17.468176 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1591/3157] 10.222.0.72 () {60 vars in 1195 bytes} [Wed Aug 3 04:45:16 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:17.474017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:17.475574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:17.495886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.498574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.502968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.503681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.566736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:45:17.682347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:17.692963 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0927206c-a225-41a0-8499-d9e40ca46d34 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.442593 Aug 03 04:45:17.694179 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1567/3158] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:17 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:17.718553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-93f28ac0-e60f-4b57-902c-e42f673888cf req-47cfa495-54a2-4943-bc24-fb65415c4874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "name": "network-vif-unplugged", "status": "completed", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:17.731092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-93f28ac0-e60f-4b57-902c-e42f673888cf req-47cfa495-54a2-4943-bc24-fb65415c4874 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.731882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-93f28ac0-e60f-4b57-902c-e42f673888cf req-47cfa495-54a2-4943-bc24-fb65415c4874 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.751362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-93f28ac0-e60f-4b57-902c-e42f673888cf req-47cfa495-54a2-4943-bc24-fb65415c4874 service nova] Creating event network-vif-unplugged:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:45:17.766703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-93f28ac0-e60f-4b57-902c-e42f673888cf req-47cfa495-54a2-4943-bc24-fb65415c4874 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053939 Aug 03 04:45:17.766958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1568/3159] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:17.796967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:17.799412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:17.826520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.826981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.827826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.828334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.900905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d0cb901-ee8d-4719-937e-9fbabee20b74 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132747 Aug 03 04:45:17.912176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1569/3160] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:17 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:17.924673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:17.925288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:17.947597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.948426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:17.949620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:17.950436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:18.070742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9e357933-5195-4ed2-8192-3e82ab6796f6 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 204 len: 0 microversion: 2.1 time: 0.600553 Aug 03 04:45:18.072374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1592/3161] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:45:17 2022] DELETE /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:45:18.084555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b5c03c7-ff0e-47b7-91ec-eab3693c01d1 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd47ef8f70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:18.468160 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b5c03c7-ff0e-47b7-91ec-eab3693c01d1 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "GET /compute/v2.1/os-security-groups/ede6a5f2-f1ba-424c-b741-904fe66fc407" status: 200 len: 665 microversion: 2.1 time: 0.394542 Aug 03 04:45:18.469449 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1593/3162] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:45:18 2022] GET /compute/v2.1/os-security-groups/ede6a5f2-f1ba-424c-b741-904fe66fc407 => generated 665 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:18.474298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:18.475245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:18.493515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:18.498660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:18.499867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:18.500352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:18.503171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:18.515834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:18.520448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:18.521687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-157341aa-d063-4cf8-8bc0-77a1b377c21b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1722 microversion: 2.20 time: 0.605532 Aug 03 04:45:18.529897 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1570/3163] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:17 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1722 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:18.535174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e229a834-407a-486f-b34d-df3e56f23238 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd47ed8dc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:18.542298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:18.865287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:18.877150 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95e13b54-624a-4143-9e85-21cf74ee4da0 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 200 len: 1511 microversion: 2.1 time: 0.406221 Aug 03 04:45:18.887358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1594/3164] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:18 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:18.926684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:18.928172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:18.973361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:18.974879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:18.977889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:18.980380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:19.039397 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e229a834-407a-486f-b34d-df3e56f23238 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-group-rules/1956aee4-bab5-4701-8fcf-70d8dc20d518" status: 202 len: 0 microversion: 2.1 time: 0.507924 Aug 03 04:45:19.041024 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1571/3165] 10.222.0.72 () {58 vars in 1287 bytes} [Wed Aug 3 04:45:18 2022] DELETE /compute/v2.1/os-security-group-rules/1956aee4-bab5-4701-8fcf-70d8dc20d518 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:19.050968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:19.053262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:19.071498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:19.071498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:19.071498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:19.071498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:19.116152 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-658f8fa7-6d83-4032-a8c8-29602a319a84 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069079 Aug 03 04:45:19.130889 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1572/3166] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:19 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:19.141256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8e4af02-ce08-4df1-a935-152fb2e094a0 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd54868040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:19.447175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:19.455462 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5190d8c-6cdc-4428-bced-9d77dac456d5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.560741 Aug 03 04:45:19.456228 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1595/3167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:18 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:19.551911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:19.552655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:19.559842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:19.560193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:19.561106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:19.561552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.217224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:20.237058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:20.242286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:20.242286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-328e3f9c-fe24-4b5b-baa4-46a77ea64353 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1725 microversion: 2.20 time: 0.692184 Aug 03 04:45:20.242286 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1596/3168] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:19 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1725 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:20.251233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9e700c41-f3b1-410e-99c0-43d3c93bf5fb req-87b5aa4f-249d-499d-998a-62bdd2998fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779d1f9e-2351-4630-83f4-9a80cfcc5a8d", "name": "network-vif-plugged", "status": "completed", "tag": "935aefd9-11dd-4cea-a681-d52158672852"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:20.276366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9e700c41-f3b1-410e-99c0-43d3c93bf5fb req-87b5aa4f-249d-499d-998a-62bdd2998fd2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.283187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9e700c41-f3b1-410e-99c0-43d3c93bf5fb req-87b5aa4f-249d-499d-998a-62bdd2998fd2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.296333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9e700c41-f3b1-410e-99c0-43d3c93bf5fb req-87b5aa4f-249d-499d-998a-62bdd2998fd2 service nova] Creating event network-vif-plugged:935aefd9-11dd-4cea-a681-d52158672852 for instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d on n-h2-826756-5 Aug 03 04:45:20.318159 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9e700c41-f3b1-410e-99c0-43d3c93bf5fb req-87b5aa4f-249d-499d-998a-62bdd2998fd2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076144 Aug 03 04:45:20.318937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1597/3169] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:20.325535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:20.336661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:20.348951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.349794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.350948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.351571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.514698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8e4af02-ce08-4df1-a935-152fb2e094a0 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/ede6a5f2-f1ba-424c-b741-904fe66fc407" status: 202 len: 0 microversion: 2.1 time: 1.382403 Aug 03 04:45:20.515966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1573/3170] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:19 2022] DELETE /compute/v2.1/os-security-groups/ede6a5f2-f1ba-424c-b741-904fe66fc407 => generated 0 bytes in 1384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:20.521447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:20.523933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:20.542144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.549507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.549507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.549507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.613046 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa8c61dc-dae6-4869-a75d-18bd25cf22db tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095404 Aug 03 04:45:20.624881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1574/3171] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:20 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:20.631100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58126c97-6649-4c8d-b8e2-b9068823c39e"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:20.633473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:20.654671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.655090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.655884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:20.656421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:20.962251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:20.978745 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3c0fb78-0d0b-4c7d-b5ed-3d91a8c02838 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 200 len: 1511 microversion: 2.1 time: 0.654124 Aug 03 04:45:20.978745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1598/3172] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:20 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 1511 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:21.024914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:21.025568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:21.054951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.061656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.066279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.066982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.580233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:21.590292 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae85bc9a-be50-49c8-9bf4-0033eba8acac tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1363 microversion: 2.1 time: 0.596432 Aug 03 04:45:21.591241 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1599/3173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:20 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1363 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:21.597416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd54ecd790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:21.648073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG neutronclient.v2_0.client [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist", "detail": ""}} {{(pid=120832) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 03 04:45:21.648073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.security_group_api [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Neutron security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d not found {{(pid=120832) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 03 04:45:21.648648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] HTTP exception thrown: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.648648 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Request method failure captured: Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-security-groups/bd9b38dc-a01b-46f0-8a01-7ddb82dd397d HTTP/1.1 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f1FJC97_xuimFjjlOhWjbjlQLkR9GGnxijSc4sMpFYSP0ED1VfTshkFukTpAP914977UznMTmf08GwC08r_YLDecLXt3fUaNrEBGhbiavIwJqUXGw21rs_6YK54yht9WWD29Tvr2UB3Q6XOzznT8f-i6biUfBtVee5KOHKK8yffvTU Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d33f340c7ff7470faade53c1028e57e1 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-361523403 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d33f340c7ff7470faade53c1028e57e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d33f340c7ff7470faade53c1028e57e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d33f340c7ff7470faade53c1028e57e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d33f340c7ff7470faade53c1028e57e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-SecurityGroupRulesTestJSON-361523403 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d33f340c7ff7470faade53c1028e57e1 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-361523403 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-SecurityGroupRulesTestJSON-361523403-project Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6357bfb1f57f43f5bf493c46d1679da7 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-SecurityGroupRulesTestJSON-361523403-project Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: exception: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'bd9b38dc-a01b-46f0-8a01-7ddb82dd397d'} Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 03 04:45:21.652006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Returning 404 to user: Security group bd9b38dc-a01b-46f0-8a01-7ddb82dd397d does not exist Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: Neutron server returns request_ids: ['req-fdf34bad-34b0-4884-bd42-0f2a4393414c'] {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34651ae0-9c3f-40c8-b61f-842c9531fa90 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/bd9b38dc-a01b-46f0-8a01-7ddb82dd397d" status: 404 len: 194 microversion: 2.1 time: 0.060307 Aug 03 04:45:21.658016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1600/3174] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:21 2022] DELETE /compute/v2.1/os-security-groups/bd9b38dc-a01b-46f0-8a01-7ddb82dd397d => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:45:21.666498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-98bc8808-5f37-43e8-b81c-c79b61a5562b req-47c517cf-46a8-4d57-bb8c-27c35e282c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a470021b-6220-4d82-9a74-9670f6114c77", "name": "network-vif-deleted", "tag": "9539efde-7e66-40c5-a579-8e08988fd5a3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:21.713973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-98bc8808-5f37-43e8-b81c-c79b61a5562b req-47c517cf-46a8-4d57-bb8c-27c35e282c80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.714440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-98bc8808-5f37-43e8-b81c-c79b61a5562b req-47c517cf-46a8-4d57-bb8c-27c35e282c80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.739760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-98bc8808-5f37-43e8-b81c-c79b61a5562b req-47c517cf-46a8-4d57-bb8c-27c35e282c80 service nova] Creating event network-vif-deleted:9539efde-7e66-40c5-a579-8e08988fd5a3 for instance a470021b-6220-4d82-9a74-9670f6114c77 on n-h2-826756-5 Aug 03 04:45:21.750144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-98bc8808-5f37-43e8-b81c-c79b61a5562b req-47c517cf-46a8-4d57-bb8c-27c35e282c80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094125 Aug 03 04:45:21.760676 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1601/3175] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:21.767884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a6513ef5-e1f7-423b-a7b3-4588c1645c61 req-3f588f16-e7af-495f-90d1-94d2c973b298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5e6f52-2aea-4902-9638-70c3d43a017a", "name": "network-vif-deleted", "tag": "2df457d6-0064-457f-8e3e-dcd9e65197e0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:21.789723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6513ef5-e1f7-423b-a7b3-4588c1645c61 req-3f588f16-e7af-495f-90d1-94d2c973b298 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.790400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6513ef5-e1f7-423b-a7b3-4588c1645c61 req-3f588f16-e7af-495f-90d1-94d2c973b298 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.821020 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a6513ef5-e1f7-423b-a7b3-4588c1645c61 req-3f588f16-e7af-495f-90d1-94d2c973b298 service nova] Creating event network-vif-deleted:2df457d6-0064-457f-8e3e-dcd9e65197e0 for instance fe5e6f52-2aea-4902-9638-70c3d43a017a on n-h1-826756-5 Aug 03 04:45:21.832320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a6513ef5-e1f7-423b-a7b3-4588c1645c61 req-3f588f16-e7af-495f-90d1-94d2c973b298 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070006 Aug 03 04:45:21.832934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1602/3176] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:21.842176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:21.851099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:21.865734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.876930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.877969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:21.878540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:21.937062 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-158463fd-4263-4389-8bf5-a4b42fb8b8c0 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099603 Aug 03 04:45:21.943382 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1603/3177] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:45:21 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:45:21.950116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0139070-ebd2-4cde-8979-073e7f7377de tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd5477d700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:22.367196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04e1bc3c-3d8a-4e5a-b3d5-4b5782c1c628 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.740656 Aug 03 04:45:22.367836 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1575/3178] 10.222.0.72 () {62 vars in 1364 bytes} [Wed Aug 3 04:45:20 2022] POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 188 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:45:22.373460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:22.389859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:22.422894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:22.429187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:22.430646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:22.431446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:22.569230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:22.577220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:22.578064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lazy-loading 'fault' on Instance uuid fe5e6f52-2aea-4902-9638-70c3d43a017a {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:45:22.687840 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0139070-ebd2-4cde-8979-073e7f7377de tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/05f89ff1-16d4-4cc3-999d-46817dec8fa8" status: 202 len: 0 microversion: 2.1 time: 0.740575 Aug 03 04:45:22.687840 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1604/3179] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:21 2022] DELETE /compute/v2.1/os-security-groups/05f89ff1-16d4-4cc3-999d-46817dec8fa8 => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:22.705197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-10644514", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "044d96b2-dcaf-474f-ab8d-c2db264ad65a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:22.875982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79e67381d4944b3099dd89fd461143a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e913cd1107341bcbd7528465a8b8f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:22.890137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:22.890862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] validate_networks() for [('044d96b2-dcaf-474f-ab8d-c2db264ad65a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:45:22.899587 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edc9255a-a4bf-45be-a9e6-1fac5bd28021 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 200 len: 1307 microversion: 2.1 time: 0.530623 Aug 03 04:45:22.915113 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1576/3180] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:22 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:22.927427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:22.928062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:22.947222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:22.950897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:22.950897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:22.950897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:23.740823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:23.758482 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56d5f890-63ba-476a-985a-7c7419816caa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1549 microversion: 2.1 time: 0.831634 Aug 03 04:45:23.760606 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1577/3181] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:22 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1549 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:23.770539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:23.771462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:23.795740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:23.796496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:23.797871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:23.798536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:23.852417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120831) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 04:45:24.274701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18dfcd84-f85b-45ff-a374-5aba71759f4d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/action" status: 202 len: 0 microversion: 2.20 time: 0.512727 Aug 03 04:45:24.286787 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1578/3182] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:45:23 2022] POST /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:45:24.293662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b38fe653-c101-48f9-a5d1-84de22275eec tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd54809670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:24.304292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:45:24.305377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:45:24.306022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:45:24.306611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:45:24.307195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:45:24.320677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.321401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.322567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.323335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.350764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:45:24.356805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Getting quotas for user 9367cfc645e04308aa18bddb0cd685f4 and project 45701dcd506c4c16a3f08445cdbfc30a. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:45:24.371633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:45:24.374915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:45:24.582017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2697b9c1-1363-4cd2-8bfd-53f4453fd546 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894702 Aug 03 04:45:24.583357 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1605/3183] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:45:24.599150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:24.612934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:24.619942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:24.622027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.622998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.623860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.624325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.869554 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7973f213-a890-4f63-b4aa-e91dc81ff263 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.281110 Aug 03 04:45:24.877595 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1606/3184] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:45:24 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:24.877595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:24.877595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: fe5e6f52-2aea-4902-9638-70c3d43a017a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:24.889899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.893058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.893899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.894344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.934655 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] HTTP exception thrown: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Request method failure captured: Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a HTTP/1.1 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f0kukVAZrW_r4ttYFP9ooH41baqpdxCBzNxppfrOhtBxLHDu9kKO44XkLNa10BOuOPOAcl49i6p4q0zp8JG97wH2MoDBgzsSCZg7LQDbtF5VTiWt6FP5WUZmPm5529OXV5ibqjqJ_AjahIvDLtj9fvtCMiS2tZfgHiv71e5OFWcOUk Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 4e913cd1107341bcbd7528465a8b8f8f Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 4e913cd1107341bcbd7528465a8b8f8f Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MultipleCreateTestJSON-1734609890-project Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 79e67381d4944b3099dd89fd461143a8 Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MultipleCreateTestJSON-1734609890-project Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'fe5e6f52-2aea-4902-9638-70c3d43a017a'} Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:24.945625 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Returning 404 to user: Instance fe5e6f52-2aea-4902-9638-70c3d43a017a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54f6829a-787d-4251-bd29-811bf679d071 tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a" status: 404 len: 111 microversion: 2.1 time: 0.075842 Aug 03 04:45:24.951305 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1607/3185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:24 2022] GET /compute/v2.1/servers/fe5e6f52-2aea-4902-9638-70c3d43a017a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:45:24.956239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:24.958910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:24.973905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.974368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:24.975163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:24.975604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:25.400304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b38fe653-c101-48f9-a5d1-84de22275eec tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/0b3770f5-0a1c-4940-9074-7cde7ad5fede" status: 202 len: 0 microversion: 2.1 time: 1.108208 Aug 03 04:45:25.401328 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1579/3186] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:24 2022] DELETE /compute/v2.1/os-security-groups/0b3770f5-0a1c-4940-9074-7cde7ad5fede => generated 0 bytes in 1113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:25.407811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d2dcbd8-03cc-4f51-a76c-6dcd82b366c6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:25.418542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d2dcbd8-03cc-4f51-a76c-6dcd82b366c6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:25.496764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:25.516414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:25.519682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:25.522283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-775295bf-1077-4f34-b39d-bd97ac19df71 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1751 microversion: 2.20 time: 0.571727 Aug 03 04:45:25.523595 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1608/3187] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:24 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1751 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:25.533496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:25.534750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] [instance: a470021b-6220-4d82-9a74-9670f6114c77] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:25.549174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:25.552952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:25.552952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:25.552952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:25.571447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] HTTP exception thrown: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Request method failure captured: Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 HTTP/1.1 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f0kukVAZrW_r4ttYFP9ooH41baqpdxCBzNxppfrOhtBxLHDu9kKO44XkLNa10BOuOPOAcl49i6p4q0zp8JG97wH2MoDBgzsSCZg7LQDbtF5VTiWt6FP5WUZmPm5529OXV5ibqjqJ_AjahIvDLtj9fvtCMiS2tZfgHiv71e5OFWcOUk Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 4e913cd1107341bcbd7528465a8b8f8f Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4e913cd1107341bcbd7528465a8b8f8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 4e913cd1107341bcbd7528465a8b8f8f Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1734609890 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-MultipleCreateTestJSON-1734609890-project Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 79e67381d4944b3099dd89fd461143a8 Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-MultipleCreateTestJSON-1734609890-project Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a470021b-6220-4d82-9a74-9670f6114c77'} Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:25.574932 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] Returning 404 to user: Instance a470021b-6220-4d82-9a74-9670f6114c77 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-304f5354-c551-4e4f-b663-0837122f5d1b tempest-MultipleCreateTestJSON-1734609890 tempest-MultipleCreateTestJSON-1734609890-project] 10.222.0.72 "GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77" status: 404 len: 111 microversion: 2.1 time: 0.057922 Aug 03 04:45:25.588247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1609/3188] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:25 2022] GET /compute/v2.1/servers/a470021b-6220-4d82-9a74-9670f6114c77 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:45:25.595526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7bc67cb-96bf-4c97-b552-b560e5cb9c77 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd5489c9d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:25.742210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d2dcbd8-03cc-4f51-a76c-6dcd82b366c6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:25.755353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d2dcbd8-03cc-4f51-a76c-6dcd82b366c6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1216 microversion: 2.1 time: 0.350068 Aug 03 04:45:25.760084 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1580/3189] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:25 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1216 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:26.549681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:26.554307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:26.564350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:26.565073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:26.567431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:26.574366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:27.146659 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7bc67cb-96bf-4c97-b552-b560e5cb9c77 tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/c80ac498-6f1e-4fa6-9d42-f5eef71e29bc" status: 202 len: 0 microversion: 2.1 time: 1.556291 Aug 03 04:45:27.148085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1610/3190] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:25 2022] DELETE /compute/v2.1/os-security-groups/c80ac498-6f1e-4fa6-9d42-f5eef71e29bc => generated 0 bytes in 1564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:27.153817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:27.154786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:27.186158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:27.186918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:27.188685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:27.190047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:27.468163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:27.483116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:27.484695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:27.491345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5edc099b-beb5-44fd-b6c2-b881711f338e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.945952 Aug 03 04:45:27.491951 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1581/3191] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:26 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:27.508358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c75b27d6-b532-44e8-8221-a8b44322459e tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd47ef7280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:27.627863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:27.635734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dbd6e49c-9505-4354-8c5d-5352264c4bb7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1268 microversion: 2.1 time: 0.486191 Aug 03 04:45:27.636491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1611/3192] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:27 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1268 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:28.515802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:28.516640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:28.533361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:28.536809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:28.537918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:28.549063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:28.977457 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c75b27d6-b532-44e8-8221-a8b44322459e tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/8711e1ff-f5b8-4dfe-a0c7-8f35f977f892" status: 202 len: 0 microversion: 2.1 time: 1.484313 Aug 03 04:45:28.978901 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1582/3193] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:27 2022] DELETE /compute/v2.1/os-security-groups/8711e1ff-f5b8-4dfe-a0c7-8f35f977f892 => generated 0 bytes in 1486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:28.984616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:28.985498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:29.007948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:29.008745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:29.010590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:29.012766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:29.110268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:29.120532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:29.133940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:29.145898 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ed0cb3e-63d5-4090-a401-d1dc7562ef5d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.631347 Aug 03 04:45:29.150534 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1612/3194] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:28 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:45:29.158364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2548718f-b293-4bd9-aa9b-216287d6453d tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] Calling method '.version_select at 0x7fdd5489ca60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:29.243142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:29.282929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7dc12169-11d1-4795-938f-f5c06a79a7ce tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1274 microversion: 2.1 time: 0.294675 Aug 03 04:45:29.283864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1583/3195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:28 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1274 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:29.753208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d67bd3f5-43ec-494d-bc10-a7034c61496b req-e854d723-0b67-4bb0-b702-2c6d60ec17bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779d1f9e-2351-4630-83f4-9a80cfcc5a8d", "tag": "935aefd9-11dd-4cea-a681-d52158672852"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:29.780553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d67bd3f5-43ec-494d-bc10-a7034c61496b req-e854d723-0b67-4bb0-b702-2c6d60ec17bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:29.782577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d67bd3f5-43ec-494d-bc10-a7034c61496b req-e854d723-0b67-4bb0-b702-2c6d60ec17bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:29.822468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d67bd3f5-43ec-494d-bc10-a7034c61496b req-e854d723-0b67-4bb0-b702-2c6d60ec17bb service nova] Creating event network-changed:935aefd9-11dd-4cea-a681-d52158672852 for instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d on n-h2-826756-5 Aug 03 04:45:29.829908 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d67bd3f5-43ec-494d-bc10-a7034c61496b req-e854d723-0b67-4bb0-b702-2c6d60ec17bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088152 Aug 03 04:45:29.833705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1584/3196] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:45:30.071906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2548718f-b293-4bd9-aa9b-216287d6453d tempest-SecurityGroupRulesTestJSON-361523403 tempest-SecurityGroupRulesTestJSON-361523403-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/aeb9867e-e9af-4fff-b052-45606445393d" status: 202 len: 0 microversion: 2.1 time: 0.917292 Aug 03 04:45:30.072519 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1613/3197] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:45:29 2022] DELETE /compute/v2.1/os-security-groups/aeb9867e-e9af-4fff-b052-45606445393d => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:45:30.181026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:30.181988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:30.196601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:30.202209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:30.203634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:30.204428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:30.307962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:30.309025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:30.320872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:30.324540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:30.330197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:30.332147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:30.585248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:30.595593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8856c42-1ac3-462d-a156-7ea1998d38ac tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1274 microversion: 2.1 time: 0.292367 Aug 03 04:45:30.607632 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1614/3198] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:30 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:31.049710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:31.059635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:31.071579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:31.073303 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd3e8804-d29d-4521-a38e-2364c14ec850 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.898214 Aug 03 04:45:31.073956 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1585/3199] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:30 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:31.619506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:31.620795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:31.636200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:31.644176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:31.645537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:31.646218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:32.102540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:32.106165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:32.118757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:32.120827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:32.121836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:32.122987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:32.181471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:32.201840 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6852a322-4d98-4ab5-86cf-b160517a13d1 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.586231 Aug 03 04:45:32.202721 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1615/3200] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:31 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:32.663643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:32.681612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:32.689544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:32.702009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1bcab365-8d7c-4428-ad29-317f8a63d00f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.592256 Aug 03 04:45:32.704892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1586/3201] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:32 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:33.223380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:33.224768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:33.245495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:33.250166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:33.250166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:33.250166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:33.665680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:33.705929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-437b4aab-e5de-4432-9dbf-ce4a4909ef62 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.465338 Aug 03 04:45:33.707153 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1616/3202] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:33 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:33.729855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:33.731315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:33.751870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:33.753053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:33.755494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:33.757021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:34.059011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:34.078336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:34.080481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:34.096106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b96dd9e5-81f0-41b2-bc37-4290f1ad8844 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.355901 Aug 03 04:45:34.096106 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1587/3203] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:33 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:34.467918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-77632fcc-666d-44aa-b2b5-abc3e21453ee req-88955f4c-6aec-443b-9139-94c966df33dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04882acc-4412-4a5b-b6c0-1aa229300708", "tag": "904a3c22-ea38-4af7-b562-4e816d27a4a0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:34.480175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:34.480917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:34.492081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-77632fcc-666d-44aa-b2b5-abc3e21453ee req-88955f4c-6aec-443b-9139-94c966df33dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:34.492507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-77632fcc-666d-44aa-b2b5-abc3e21453ee req-88955f4c-6aec-443b-9139-94c966df33dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:34.523621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-77632fcc-666d-44aa-b2b5-abc3e21453ee req-88955f4c-6aec-443b-9139-94c966df33dc service nova] Creating event network-changed:904a3c22-ea38-4af7-b562-4e816d27a4a0 for instance 04882acc-4412-4a5b-b6c0-1aa229300708 on n-h1-826756-5 Aug 03 04:45:34.530415 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-77632fcc-666d-44aa-b2b5-abc3e21453ee req-88955f4c-6aec-443b-9139-94c966df33dc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068635 Aug 03 04:45:34.532334 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1617/3204] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:34.734609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:34.735325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:34.758219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:34.760661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:34.761470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:34.761911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:34.787762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:34.789840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:34.799355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:34.799822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:34.800673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:34.805975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:35.429958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:35.443844 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a59bf694-ec0d-4187-95ea-1591178ac255 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.714324 Aug 03 04:45:35.447293 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1588/3205] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:34 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:35.458328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:35.468069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:35.468069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:35.468362 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eabd66b0-d0cb-44db-9699-0269d9f788f7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.685246 Aug 03 04:45:35.474690 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1618/3206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:34 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:35.476594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:35.477288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:35.478355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:35.479081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:35.496622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1002459566"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:35.500820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:35.508835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:35.509695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:35.510766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:35.511422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:35.746379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:35.760011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:35.760953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:35.764509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:35.766059 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d0e5238-f022-4f69-a233-0c0d9bebf405 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.317347 Aug 03 04:45:35.781573 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1589/3207] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:35 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:35.845973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:36.180225 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e702589b-dcab-47e7-9e9d-de57c8070675 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.686270 Aug 03 04:45:36.193430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:36.194190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:36.195851 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1619/3208] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:45:35 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 03 04:45:36.203304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.204021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:36.205135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.206294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:36.411870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:36.423806 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0b01d18-42f5-4d54-8f21-b9a44c1f08c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.235290 Aug 03 04:45:36.431213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1590/3209] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:36 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:36.470588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:36.471303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:36.478606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.479067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:36.479947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.480441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:36.676909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:36.695001 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e3934b4-e09c-4cab-b58a-d5fb12740ad5 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.223466 Aug 03 04:45:36.718501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1620/3210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:36 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:36.791980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:36.793177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:36.802156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.802889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:36.803673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:36.804113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:37.081959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:37.109602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:37.112192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:37.119659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f51ea67-b6fb-4d4a-b813-d73478a5c398 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1753 microversion: 2.20 time: 0.331975 Aug 03 04:45:37.121453 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1591/3211] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:36 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1753 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:37.455978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:37.456750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:37.465738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:37.466758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:37.468630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:37.469933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:37.718026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:37.718747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:37.727530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:37.728052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:37.728824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:37.729517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:37.792573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:37.806225 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e29dd0b1-8ca2-4a79-a942-cf29597f9cc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.352208 Aug 03 04:45:37.837462 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1621/3212] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:37 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:37.907342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:37.919926 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d56ba4d-a473-4f88-b9a7-e24142ba958d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.205672 Aug 03 04:45:37.920538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1592/3213] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:37 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:38.149903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:38.151484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:38.158148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.159063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:38.160145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.161472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:38.376655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:38.385691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:38.387276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:38.389283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-910010f6-ffaf-4c3d-84aa-7cf48a839e2f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.243457 Aug 03 04:45:38.389854 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1622/3214] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:38 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:38.787566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:38.788094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:38.794344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.794880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:38.795731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.796452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:38.849647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:45:38.873690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:38.875504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:38.903206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.904017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:38.904868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:38.905322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.116641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:39.126178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f43af6b-1c28-4596-9bee-568adcb5cf99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1687 microversion: 2.1 time: 0.268392 Aug 03 04:45:39.128918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1623/3215] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:38 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1687 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:39.134780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:39.135638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:39.145946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.146398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.147263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.147718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.329596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:39.364701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f41a6dba-dd48-429f-85f2-8445a2952070 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.222393 Aug 03 04:45:39.364701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1624/3216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:39 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:39.413546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:39.414467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:39.421568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.422110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.422981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.423496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.505428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-478446b6-ac5e-4c4c-a8f4-f926d9ee4024 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 204 len: 0 microversion: 2.42 time: 0.721623 Aug 03 04:45:39.506757 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1593/3217] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:45:38 2022] DELETE /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:45:39.516599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:39.517979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:39.534482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.535466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.537695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:39.538414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:39.592435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:39.839912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:39.866812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:39.873786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:39.879236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b966832e-0e4c-4f1c-9a56-1b1f9b256158 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.465673 Aug 03 04:45:39.880649 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1625/3218] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:39 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:45:39.999208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:40.016534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:40.019422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:40.020936 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49eaedfb-3cf1-467c-96a6-c6a6207d3881 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2959 microversion: 2.42 time: 0.509624 Aug 03 04:45:40.032462 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1594/3219] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:39 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2959 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:40.116025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-28ca82f2-d240-41b7-9afc-3d962f09865b req-5ab772bc-f8e0-4643-94a7-7276dda4abaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-unplugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:40.140085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-28ca82f2-d240-41b7-9afc-3d962f09865b req-5ab772bc-f8e0-4643-94a7-7276dda4abaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.142504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-28ca82f2-d240-41b7-9afc-3d962f09865b req-5ab772bc-f8e0-4643-94a7-7276dda4abaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.149025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:40.149745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:40.165259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.165627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-28ca82f2-d240-41b7-9afc-3d962f09865b req-5ab772bc-f8e0-4643-94a7-7276dda4abaf service nova] Creating event network-vif-unplugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:45:40.165756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.166529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.166978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.176388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-28ca82f2-d240-41b7-9afc-3d962f09865b req-5ab772bc-f8e0-4643-94a7-7276dda4abaf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064070 Aug 03 04:45:40.177735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1626/3220] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:40.378482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:40.379467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:40.390936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.393639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.397953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.398616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.437555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:40.445614 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf94a81e-8ab0-4baf-93be-6d1fd84fd5ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1687 microversion: 2.1 time: 0.300384 Aug 03 04:45:40.454196 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1595/3221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:40 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1687 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:40.753628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:40.779483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-249aa80f-b2bc-4641-8e5b-cdf54bf1258d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.405281 Aug 03 04:45:40.792869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1627/3222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:40 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:40.910963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:40.912339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:40.936397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.937106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:40.938748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:40.939396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.053167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:41.053795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:41.065163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.066796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.076500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.076964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.268352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.278096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.287484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.294372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edc3ae16-54ed-4b65-a9b2-136ad8ab56bb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.388005 Aug 03 04:45:41.308300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1596/3223] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:40 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:41.471374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:41.472003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:41.483175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.483647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.494296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.495838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.573261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.584120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.593547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.596461 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3063586a-3005-4726-a394-8bddddc64ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2959 microversion: 2.42 time: 0.548183 Aug 03 04:45:41.628636 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1628/3224] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:41 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2959 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:41.801796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:41.802849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:41.814970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.816699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.821930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:41.822730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:41.837287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:41.854934 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-06bc8cd6-71c8-4779-92d9-b6e9090821ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.387744 Aug 03 04:45:41.862499 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1597/3225] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:41 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:42.121083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:42.157250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34a24651-88c6-42c2-bda4-cd3af581810b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.357634 Aug 03 04:45:42.160227 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1629/3226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:41 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:42.323807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:42.326035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:42.344753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.344753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:42.344753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.344753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:42.626941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:42.627756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:42.643228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.644209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:42.645377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.652650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:42.792738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:42.802798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:42.814285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:42.815558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f07b24f2-a882-4154-87ae-a292df330440 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.497167 Aug 03 04:45:42.844646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1598/3227] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:42 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:42.886546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:42.887753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:42.892193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:42.910507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.911123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:42.912044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:42.912645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:43.268754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:43.290338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:43.292081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:43.303003 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-55d2d469-7661-4063-8800-01a425e5fd5b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2959 microversion: 2.42 time: 0.678906 Aug 03 04:45:43.303634 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1630/3228] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:42 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2959 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:43.319209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:43.325234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:43.345031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:43.345506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:43.346602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:43.350207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:43.370753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:43.389206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61899b55-bc1b-4849-8a74-2ad8e1e508e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.506614 Aug 03 04:45:43.409868 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1599/3229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:42 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:43.756725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:43.770600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbb202c4-2a9d-48d4-99d4-b129f56c71ed tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.464673 Aug 03 04:45:43.784343 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1631/3230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:43 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:43.849624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:43.850312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:43.877130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:43.880490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:43.881803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:43.883328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:44.280800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.294681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.296551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.299105 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40d457c5-2b8a-4c6a-b61c-d44d2c6c43c0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.459488 Aug 03 04:45:44.300229 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1600/3231] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:43 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:44.331918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:44.332719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:44.347241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:44.348152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:44.353442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:44.354220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:44.422611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:44.423240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:44.443923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:44.453586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:44.454597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:44.455057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:44.938004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.961435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.963354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:44.965761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b7c702e-d775-4bbb-90b7-c36b5dc6c56e tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2959 microversion: 2.42 time: 0.640674 Aug 03 04:45:44.969824 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1632/3232] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:44 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2959 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:44.986149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-56cfb4d2-0134-417c-b262-e06c197b8970 req-9c30f864-b3a9-42ad-9796-4c7c6be8c1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04882acc-4412-4a5b-b6c0-1aa229300708", "name": "network-vif-plugged", "status": "completed", "tag": "904a3c22-ea38-4af7-b562-4e816d27a4a0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:45.035053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-56cfb4d2-0134-417c-b262-e06c197b8970 req-9c30f864-b3a9-42ad-9796-4c7c6be8c1ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:45.037175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-56cfb4d2-0134-417c-b262-e06c197b8970 req-9c30f864-b3a9-42ad-9796-4c7c6be8c1ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:45.087192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:45.100694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1effa203-b30e-427d-a3d1-6ff09f7a9c9b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.682768 Aug 03 04:45:45.103575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1601/3233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:44 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:45.107375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-56cfb4d2-0134-417c-b262-e06c197b8970 req-9c30f864-b3a9-42ad-9796-4c7c6be8c1ed service nova] Creating event network-vif-plugged:904a3c22-ea38-4af7-b562-4e816d27a4a0 for instance 04882acc-4412-4a5b-b6c0-1aa229300708 on n-h1-826756-5 Aug 03 04:45:45.118567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:45.118567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:45.124811 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-56cfb4d2-0134-417c-b262-e06c197b8970 req-9c30f864-b3a9-42ad-9796-4c7c6be8c1ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149801 Aug 03 04:45:45.132376 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1633/3234] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:45.150221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:45.152985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:45.157314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:45.160473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:45.327319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:45.328405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:45.360198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:45.361677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:45.363012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:45.368438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:45.754864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:45.773450 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-710e70b6-4b2b-4c7b-8155-10c1e97207ea tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.661008 Aug 03 04:45:45.775026 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1602/3235] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:45 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:45.869543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:45.913530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:45.924328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:45.935499 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5ae6bfe-e471-4d57-9536-3a1004fdf949 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.614014 Aug 03 04:45:45.944416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1634/3236] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:45 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:46.001551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:46.002270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:46.024932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.025390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.026190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.026628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.126037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:46.126680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:46.142620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.143126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.150082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.150611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.772185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:46.791897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:46.801216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:46.801702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:46.804921 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1001827-63e8-45ef-aad8-553b39195aee tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2959 microversion: 2.42 time: 0.807877 Aug 03 04:45:46.808596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1603/3237] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:45 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2959 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:46.832731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:46.836342 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f74cf7e-88b9-4139-a191-e7d14f1130db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.712192 Aug 03 04:45:46.836492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:46.837016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1635/3238] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:46 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:46.851541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.852073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.852960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.854907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.968807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:46.971193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:46.983734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.984445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:46.985443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:46.990985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:47.303024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:47.313029 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f13398b4-1f33-4674-b902-1f3559278c92 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1316 microversion: 2.1 time: 0.502801 Aug 03 04:45:47.325541 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1604/3239] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:46 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:47.330836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-plugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-unplugged", "status": "completed", "tag": "c36f89be-660c-419c-bf69-4a19d016dfc3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:47.341919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:47.342720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:47.358312 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] Creating event network-vif-plugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:45:47.358981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] Creating event network-vif-unplugged:c36f89be-660c-419c-bf69-4a19d016dfc3 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:47.366789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9e39fbdf-3252-40f3-b791-b883f7385504 req-a8ce95a5-4811-40c4-889a-0dd7913790bf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039597 Aug 03 04:45:47.367026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:47.368293 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1605/3240] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:47.370941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:47.377949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:47.379682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:47.381003 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23bd1ab5-6baa-4101-ae7c-aa45449fb170 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.417722 Aug 03 04:45:47.381566 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1636/3241] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:46 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:47.853052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:47.863864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:47.864632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:47.865706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:47.876309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:47.877050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:47.878683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:47.879363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:47.909049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:47.909629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:47.910554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:47.910992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:48.485206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:48.502002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-390e1901-4111-4cd9-b2c2-dad3d3687fda tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.642618 Aug 03 04:45:48.508610 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1637/3242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:47 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:48.539184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:48.539817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:48.570004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:48.570671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:48.580830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:48.581413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:48.955229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:48.974651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:48.981401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:48.983225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1dbdbb7d-4e9a-4101-924c-43ee22ef552a tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2938 microversion: 2.42 time: 1.146813 Aug 03 04:45:49.011379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1606/3243] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:47 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2938 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:49.019810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:49.021024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:49.035075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:49.041947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:49.041947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:49.041947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:49.493032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:49.505929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b0f3826-c976-4ab4-81dd-0087eeb6521b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1506 microversion: 2.1 time: 0.982556 Aug 03 04:45:49.523199 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1638/3244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:48 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:49.539768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-607dc724-a1b9-4b9a-be8f-6fccd27be431 req-52df3074-e6ff-4408-8877-6ede9067edfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-unplugged", "status": "completed", "tag": "9684d68a-347d-42e1-9399-678e11531af5"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:49.572890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-607dc724-a1b9-4b9a-be8f-6fccd27be431 req-52df3074-e6ff-4408-8877-6ede9067edfd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:49.573407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-607dc724-a1b9-4b9a-be8f-6fccd27be431 req-52df3074-e6ff-4408-8877-6ede9067edfd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:49.609220 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-607dc724-a1b9-4b9a-be8f-6fccd27be431 req-52df3074-e6ff-4408-8877-6ede9067edfd service nova] Creating event network-vif-unplugged:9684d68a-347d-42e1-9399-678e11531af5 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:49.616864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:49.634133 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-607dc724-a1b9-4b9a-be8f-6fccd27be431 req-52df3074-e6ff-4408-8877-6ede9067edfd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107812 Aug 03 04:45:49.634790 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1639/3245] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:49.635293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:49.637362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:49.638938 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cedefabd-e1bc-40d8-b3bd-830e8f9f4d28 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.635422 Aug 03 04:45:49.639680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1607/3246] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:49 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:49.667388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:49.672196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:49.689044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:49.693766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:49.693766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:49.693766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:50.019586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:50.020929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:50.031270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:50.046089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:50.046089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:50.046089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:50.121885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:50.136338 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2353b675-3532-4aa4-8d10-32cab12aa533 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.494066 Aug 03 04:45:50.141186 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1640/3247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:49 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:50.607679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:50.639564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:50.639564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:50.640490 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d32edc0-8721-43eb-87db-89654ac31d2b tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2917 microversion: 2.42 time: 0.624918 Aug 03 04:45:50.657762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1608/3248] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:50 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2917 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:50.664415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:50.665078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:50.679988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:50.684557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:50.685498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:50.685930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.171736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:51.172608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:51.197256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:51.197712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.198514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:51.198955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.489327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:51.515212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:51.518431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:51.525590 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d72c271-a5e2-41c7-b7cd-b73dac6aa47c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.865317 Aug 03 04:45:51.533642 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1641/3249] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:50 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:51.673769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:51.676377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:51.720869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:51.721315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.722276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:51.722723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.776768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:51.786275 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7fab7aac-6a2d-4204-9662-29501ca38257 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.627201 Aug 03 04:45:51.798871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1609/3250] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:51 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:45:51.815223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-unplugged", "status": "completed", "tag": "a4a7926b-4815-4e3e-aac5-029768cff70d"}, {"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-unplugged", "status": "completed", "tag": "42ba03bc-4060-4d5a-99ff-f682a6a88a07"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:51.851560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:51.851560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:51.905153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] Creating event network-vif-unplugged:a4a7926b-4815-4e3e-aac5-029768cff70d for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:51.905672 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] Creating event network-vif-unplugged:42ba03bc-4060-4d5a-99ff-f682a6a88a07 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:51.927868 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-011ff990-c517-4cf6-9df7-65ff620a4e01 req-820afcf9-729b-4399-ab6c-0425c4850e31 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.125019 Aug 03 04:45:51.931449 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1610/3251] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:52.205852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-57a6ff57-8691-40e1-b7e2-942892d92de7 req-243d768d-19a3-40d8-8627-a20ffc0279c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-deleted", "tag": "a4a7926b-4815-4e3e-aac5-029768cff70d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:52.235039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57a6ff57-8691-40e1-b7e2-942892d92de7 req-243d768d-19a3-40d8-8627-a20ffc0279c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:52.236398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-57a6ff57-8691-40e1-b7e2-942892d92de7 req-243d768d-19a3-40d8-8627-a20ffc0279c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:52.272413 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-57a6ff57-8691-40e1-b7e2-942892d92de7 req-243d768d-19a3-40d8-8627-a20ffc0279c2 service nova] Creating event network-vif-deleted:a4a7926b-4815-4e3e-aac5-029768cff70d for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:52.287122 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-57a6ff57-8691-40e1-b7e2-942892d92de7 req-243d768d-19a3-40d8-8627-a20ffc0279c2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086156 Aug 03 04:45:52.288213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1611/3252] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:45:52.559554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:52.560795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:52.572395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:52.572908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:52.580597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:52.582235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:53.242219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.271776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.280032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.284997 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9e0e715e-d392-4854-8a1c-bbd4fe4eb633 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2871 microversion: 2.42 time: 1.616594 Aug 03 04:45:53.286039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1642/3253] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:51 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2871 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:53.302174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:53.303186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:53.326789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:53.328629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:53.332128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:53.337101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:53.500054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.516914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.521358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:53.530088 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5025c881-a33c-4450-9c65-be192aa878ef tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.976586 Aug 03 04:45:53.533257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1612/3254] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:52 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:45:53.986735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8e51a55c-975f-447d-a9e6-3e84ffeab54f req-df142c35-64e4-4e70-ad04-baa32605ec12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-unplugged", "status": "completed", "tag": "10a26f5b-9fa0-437a-a4c4-238615286fc1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:54.006158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8e51a55c-975f-447d-a9e6-3e84ffeab54f req-df142c35-64e4-4e70-ad04-baa32605ec12 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.006949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8e51a55c-975f-447d-a9e6-3e84ffeab54f req-df142c35-64e4-4e70-ad04-baa32605ec12 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.041143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:54.045514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8e51a55c-975f-447d-a9e6-3e84ffeab54f req-df142c35-64e4-4e70-ad04-baa32605ec12 service nova] Creating event network-vif-unplugged:10a26f5b-9fa0-437a-a4c4-238615286fc1 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:54.057973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8e51a55c-975f-447d-a9e6-3e84ffeab54f req-df142c35-64e4-4e70-ad04-baa32605ec12 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074724 Aug 03 04:45:54.059492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1613/3255] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:45:54.080217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:54.093520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5dc6a50-c0cf-4c03-a05f-7a7750fcc34d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.805571 Aug 03 04:45:54.110897 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1643/3256] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:53 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:54.213822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6e76903e-cfef-4934-81cb-68d1b06764b9"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:54.218154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:54.226409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.227196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.228153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.228793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.318055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:54.318756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:54.329748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.330281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.337194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.338723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.355514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] HTTP exception thrown: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Request method failure captured: Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708/os-volume_attachments/805694b1-25d3-43db-864f-cf39521e2406 HTTP/1.1 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 74 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f0BBgzQcyL5wPxnXvWE-kt1imMJQnJbR4Az08lEDTbTEwHZ3gXfZquIY_U7HoIgild_UpJoj1jIa2hFowoAy_Hxcp5vzm7wVcVWmMtYogYWt_YU09n1lO382r_DYF_7ELjAT_teIPLt8LXtdIA_4kwhPVa8zpJVCoGAiWFCUmkoPfA Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 619aaf8c3d1a47a5a15eac53ed915c67 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/619aaf8c3d1a47a5a15eac53ed915c67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 619aaf8c3d1a47a5a15eac53ed915c67 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-981760968 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesAdminNegativeTest-981760968-project-admin Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 448424855c62437a84bbf44ccf109699 Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesAdminNegativeTest-981760968-project-admin Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: {"volumeAttachment": {"volumeId": "6e76903e-cfef-4934-81cb-68d1b06764b9"}} Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: exception: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '04882acc-4412-4a5b-b6c0-1aa229300708', 'id': '805694b1-25d3-43db-864f-cf39521e2406', 'body': {'volumeAttachment': {'volumeId': '6e76903e-cfef-4934-81cb-68d1b06764b9'}}} Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. (HTTP 404) (Request-ID: req-85bf9966-20b4-404e-a95c-53a52e1a1f0a) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:45:54.357993 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. Aug 03 04:45:54.362832 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:45:54.373424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] Returning 404 to user: Volume 805694b1-25d3-43db-864f-cf39521e2406 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:45:54.373424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16a28b24-6ff4-4ca8-b025-55265d064dea tempest-VolumesAdminNegativeTest-981760968 tempest-VolumesAdminNegativeTest-981760968-project-admin] 10.222.0.72 "PUT /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708/os-volume_attachments/805694b1-25d3-43db-864f-cf39521e2406" status: 404 len: 109 microversion: 2.1 time: 0.158056 Aug 03 04:45:54.373584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1614/3257] 10.222.0.72 () {60 vars in 1433 bytes} [Wed Aug 3 04:45:54 2022] PUT /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708/os-volume_attachments/805694b1-25d3-43db-864f-cf39521e2406 => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:45:54.509897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0cf12272-95a7-4944-a357-6c2b29ed68a0 req-313044cf-642f-4fa2-acff-4751a0007a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-deleted", "tag": "9684d68a-347d-42e1-9399-678e11531af5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:45:54.554768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0cf12272-95a7-4944-a357-6c2b29ed68a0 req-313044cf-642f-4fa2-acff-4751a0007a73 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.561957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0cf12272-95a7-4944-a357-6c2b29ed68a0 req-313044cf-642f-4fa2-acff-4751a0007a73 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.601970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0cf12272-95a7-4944-a357-6c2b29ed68a0 req-313044cf-642f-4fa2-acff-4751a0007a73 service nova] Creating event network-vif-deleted:9684d68a-347d-42e1-9399-678e11531af5 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:45:54.612464 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0cf12272-95a7-4944-a357-6c2b29ed68a0 req-313044cf-642f-4fa2-acff-4751a0007a73 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106920 Aug 03 04:45:54.614492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1615/3258] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:45:54.626776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:54.629167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:54.646719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.647671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:54.653904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:54.654634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:56.151725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.171013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.174772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.186894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.190771 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3899cd4-9bb9-4ffb-ae94-141256753aab tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2711 microversion: 2.42 time: 1.876760 Aug 03 04:45:56.194682 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1644/3259] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:54 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2711 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:56.197466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.199926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:56.212378 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea3dcdc8-564f-4a61-9a05-7ab9953bb087 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 1.596358 Aug 03 04:45:56.217862 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1616/3260] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:54 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:56.232149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:56.234647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:56.266164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:56.270385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:56.274806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:56.274806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:57.223490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:57.224416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:57.252720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:57.253427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:57.254342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:57.255071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:57.398162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:57.407246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99880140-e03a-45c6-97fb-d5ce325ef214 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 1.195789 Aug 03 04:45:57.427352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1645/3261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:56 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:45:57.433404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:57.445829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:45:57.451647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=76 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:45:57.460181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:57.461108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:57.462634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:45:57.463345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:45:59.884843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:59.895860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:59.916806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:45:59.934392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b99d45e1-2c16-4796-b446-59d8e7bf4586 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2551 microversion: 2.42 time: 2.706341 Aug 03 04:45:59.937972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1617/3262] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:57 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2551 bytes in 2719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:45:59.944791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:45:59.945405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:00.033714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:00.034807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:00.040925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:00.048586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:00.156881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:00.184425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:00.186406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:00.187748 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fd16471-fb63-41b1-abde-efb94c438b93 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 2.758806 Aug 03 04:46:00.215289 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1646/3263] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:45:57 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:00.228608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0cddfeb7-e7e1-40d0-9d18-23a1480fac38 req-44000586-4883-433d-825d-99565d867a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-deleted", "tag": "c36f89be-660c-419c-bf69-4a19d016dfc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:00.286008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0cddfeb7-e7e1-40d0-9d18-23a1480fac38 req-44000586-4883-433d-825d-99565d867a8d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:00.298043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0cddfeb7-e7e1-40d0-9d18-23a1480fac38 req-44000586-4883-433d-825d-99565d867a8d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:00.340605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0cddfeb7-e7e1-40d0-9d18-23a1480fac38 req-44000586-4883-433d-825d-99565d867a8d service nova] Creating event network-vif-deleted:c36f89be-660c-419c-bf69-4a19d016dfc3 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:46:00.378609 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0cddfeb7-e7e1-40d0-9d18-23a1480fac38 req-44000586-4883-433d-825d-99565d867a8d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160910 Aug 03 04:46:00.386459 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1647/3264] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:00.969802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:00.970688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:00.990021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:00.992880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:00.998315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:01.002568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:01.702875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:01.718460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-593d6511-9d98-4eed-bdb1-3fadaf5bd9a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 1.779218 Aug 03 04:46:01.719111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1618/3265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:45:59 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:01.748240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:01.749797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:01.799063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:01.805826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:01.821006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:01.822319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:02.243012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.264700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.272517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.273707 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9815919-3c90-4cab-a4ff-89352006f800 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.542140 Aug 03 04:46:02.274297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1619/3266] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:01 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:02.387198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.407712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.410752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:02.420879 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-754a69d8-7707-43b3-9594-ac138c9d47fa tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2259 microversion: 2.42 time: 1.455107 Aug 03 04:46:02.424222 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1648/3267] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:00 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2259 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:02.429420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:02.430247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:02.438897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:02.439737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:02.440803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:02.441856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:02.532769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:46:02.868855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-58674b6b-b8c7-4a4a-a4f8-d551529fcb55 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Action: 'create', calling method: .version_select at 0x7fdd54809a60>, body: {"keypair": {"name": "tempest-keypair-1749063646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+vAwHdCGjRUuGBQ5Etorb+SxpDLa/lpki07wRCTP5k+yHb1tAt2FImjmAKdzbW8Q97QwYL0d7S/JYL3kMtoX0miTkNd14yxKryDIoXRDQzTrzwGpp1CflwTLtOpOHF4w=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:02.945731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-58674b6b-b8c7-4a4a-a4f8-d551529fcb55 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Getting quotas for project 4790a12623e141cb95544c8f2d9a8d3b. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:02.973460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-58674b6b-b8c7-4a4a-a4f8-d551529fcb55 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Getting quotas for user 7c388031750b407e8ed2bc15c5ff0bd3 and project 4790a12623e141cb95544c8f2d9a8d3b. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:03.194758 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-58674b6b-b8c7-4a4a-a4f8-d551529fcb55 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.914036 Aug 03 04:46:03.195468 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1620/3268] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:46:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:03.203268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:03.208533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:03.221311 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c81c2db8-2d5b-4bed-b0ca-d7b8a5b3341d tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "DELETE /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 204 len: 0 microversion: 2.1 time: 0.794854 Aug 03 04:46:03.221960 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1649/3269] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:46:02 2022] DELETE /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:46:03.228417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f4f1ea24-a26e-45da-b176-147707fe7452 req-dba4f4de-6169-450f-bfd0-30ad8110036e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-deleted", "tag": "42ba03bc-4060-4d5a-99ff-f682a6a88a07"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:03.250631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.255576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.264725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.266443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.269372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f4f1ea24-a26e-45da-b176-147707fe7452 req-dba4f4de-6169-450f-bfd0-30ad8110036e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.272575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f4f1ea24-a26e-45da-b176-147707fe7452 req-dba4f4de-6169-450f-bfd0-30ad8110036e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.316058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f4f1ea24-a26e-45da-b176-147707fe7452 req-dba4f4de-6169-450f-bfd0-30ad8110036e service nova] Creating event network-vif-deleted:42ba03bc-4060-4d5a-99ff-f682a6a88a07 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:46:03.340924 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f4f1ea24-a26e-45da-b176-147707fe7452 req-dba4f4de-6169-450f-bfd0-30ad8110036e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115742 Aug 03 04:46:03.346639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1650/3270] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:03.369226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:03.370042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:03.390438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.391089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.394474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.394952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.827222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:03.852963 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f0f619e-fa73-471f-bac1-f8928808778a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 0.638087 Aug 03 04:46:03.864296 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1621/3271] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:03 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:03.864296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:03.864296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:03.885504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.887034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:03.888129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:03.890213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:04.217418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:04.233105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb16e191-fe44-4e1a-9717-25cda21ad876 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1512 microversion: 2.1 time: 0.885088 Aug 03 04:46:04.252303 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1651/3272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:03 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1512 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:04.276208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:04.280006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:04.319601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:04.326731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:04.327750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:04.339873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:05.286449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.309170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.317424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.325637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e4c2207-e101-43cc-9f77-14cda215369a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 1.466950 Aug 03 04:46:05.326272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1622/3273] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:03 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:05.336965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:05.338208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:05.350270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:05.351541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:05.352368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:05.353746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:05.851071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.863245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.865251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:05.868416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-197d130e-4ba3-47cb-9fc0-725281c46b74 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 2099 microversion: 2.42 time: 1.613925 Aug 03 04:46:05.870546 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1652/3274] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:04 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 2099 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:05.888484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:05.889561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:05.903534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:05.903534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:05.903534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:05.903534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:06.609152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:06.618482 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-153864c5-3d16-41cd-aae8-bcd082441cad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1682 microversion: 2.1 time: 1.287332 Aug 03 04:46:06.619086 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1623/3275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:05 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1682 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:06.632519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-aa549399-6fbd-4acb-bcaa-3683a4377166 req-8b9803f8-9356-4b1a-b1cc-5e36d6f9c2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4760d1b6-5b26-493e-ae66-f1ae2e1f568f", "name": "network-vif-deleted", "tag": "10a26f5b-9fa0-437a-a4c4-238615286fc1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:06.673920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-aa549399-6fbd-4acb-bcaa-3683a4377166 req-8b9803f8-9356-4b1a-b1cc-5e36d6f9c2a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:06.673920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-aa549399-6fbd-4acb-bcaa-3683a4377166 req-8b9803f8-9356-4b1a-b1cc-5e36d6f9c2a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:06.710774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-aa549399-6fbd-4acb-bcaa-3683a4377166 req-8b9803f8-9356-4b1a-b1cc-5e36d6f9c2a2 service nova] Creating event network-vif-deleted:10a26f5b-9fa0-437a-a4c4-238615286fc1 for instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f on n-h2-826756-5 Aug 03 04:46:06.737164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-aa549399-6fbd-4acb-bcaa-3683a4377166 req-8b9803f8-9356-4b1a-b1cc-5e36d6f9c2a2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116338 Aug 03 04:46:06.742858 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1624/3276] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:06.766919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:06.771018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:06.801846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:06.810132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:06.810132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:06.810132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:07.203669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.208387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:07.222095 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7768cada-470e-48ff-bfbd-d5752bc993b7 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 200 len: 1512 microversion: 2.1 time: 1.337369 Aug 03 04:46:07.224064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1653/3277] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:05 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 1512 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:07.235393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:07.237120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:07.253883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:07.256889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:07.257995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:07.259496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:07.582949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.599545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.616937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.620995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.624108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-554526e3-30e8-4d4b-b651-7a52355a4b98 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.875840 Aug 03 04:46:07.626257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.628063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:07.628522 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1625/3278] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:06 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:07.634525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c696202c-2ebb-4ae0-a281-9c3f5b307219 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.407006 Aug 03 04:46:07.639289 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1654/3279] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:07 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:07.755597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1419571320", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:07.757201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1558188530", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "dc56bcd4-4a25-4442-a99f-e00c59071f08"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:07.919131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:46:07.929017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] validate_networks() for [('dc56bcd4-4a25-4442-a99f-e00c59071f08', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:46:08.570259 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 04:46:08.571049 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 04:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.72) !!! Aug 03 04:46:09.181312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:46:09.181785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:46:09.182281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:46:09.183357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:46:09.184166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:46:09.204581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.205143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.209342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.222896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.266151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:09.279556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:09.298442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:46:09.306278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:46:09.420938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:46:09.421715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:46:09.422665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:46:09.423163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:46:09.423648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:46:09.440314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.440842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.441662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.442299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.465159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Getting quotas for project dbcdf5fad12f4c6d91f2840aa7a482cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:09.471200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Getting quotas for user 4162f65c61d8401aa8ca4c606d68fd8c and project dbcdf5fad12f4c6d91f2840aa7a482cf. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:09.487905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:46:09.490687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:46:09.509961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f83ed6c-46d3-4988-94c3-058b902c7264 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879289 Aug 03 04:46:09.511242 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1626/3280] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:46:09.530041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-da9018f3-33f5-47ea-896f-50b8e1336adf req-0646d7aa-f7ef-402b-ac54-bf82a8e9b50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04882acc-4412-4a5b-b6c0-1aa229300708", "name": "network-vif-deleted", "tag": "904a3c22-ea38-4af7-b562-4e816d27a4a0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:09.560501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-da9018f3-33f5-47ea-896f-50b8e1336adf req-0646d7aa-f7ef-402b-ac54-bf82a8e9b50a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.561031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-da9018f3-33f5-47ea-896f-50b8e1336adf req-0646d7aa-f7ef-402b-ac54-bf82a8e9b50a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.591844 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-da9018f3-33f5-47ea-896f-50b8e1336adf req-0646d7aa-f7ef-402b-ac54-bf82a8e9b50a service nova] Creating event network-vif-deleted:904a3c22-ea38-4af7-b562-4e816d27a4a0 for instance 04882acc-4412-4a5b-b6c0-1aa229300708 on n-h1-826756-5 Aug 03 04:46:09.607801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-da9018f3-33f5-47ea-896f-50b8e1336adf req-0646d7aa-f7ef-402b-ac54-bf82a8e9b50a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085026 Aug 03 04:46:09.608847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1627/3281] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:09.617488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:09.618660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:09.628983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.630199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.631484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.632390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.786944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5dac6d34-b660-4d4c-9777-26b914b8e341 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146140 Aug 03 04:46:09.787534 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1655/3282] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:46:09.799122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:09.799767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 04882acc-4412-4a5b-b6c0-1aa229300708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:09.827366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.827802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.837384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.840170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.882781 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] HTTP exception thrown: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Request method failure captured: Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 HTTP/1.1 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fz3hN5R_2WWKaKi3UyI6unqUQD9fVLbSsNcWcN3651TbqbkEj5DrAcS-_3ZBOVY-m-YEOVaPQp1Z7uNBbQT8Zlr-xjwfdJgZ3fv0DpOdjm7gakaJ-Hq1c4cjRoXzja6xoW_0XtDf095lE3ubY2pN5kheXawMUaWt9UiXHEPoMFKj4A Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 45701dcd506c4c16a3f08445cdbfc30a Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 45701dcd506c4c16a3f08445cdbfc30a Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesAdminNegativeTest-1547310544-project Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 9367cfc645e04308aa18bddb0cd685f4 Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesAdminNegativeTest-1547310544-project Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '04882acc-4412-4a5b-b6c0-1aa229300708'} Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:09.884569 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. Aug 03 04:46:09.891558 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:09.906221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Returning 404 to user: Instance 04882acc-4412-4a5b-b6c0-1aa229300708 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:09.907367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d503295-3e74-4116-bc99-861b7b732d8f tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708" status: 404 len: 111 microversion: 2.1 time: 0.118882 Aug 03 04:46:09.908947 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1656/3283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:09 2022] GET /compute/v2.1/servers/04882acc-4412-4a5b-b6c0-1aa229300708 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:46:09.932143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:09.933512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:09.951549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.952136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:09.953121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:09.953835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.127819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.137699 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69ce34a6-47cf-4347-ae60-78f6e38b974c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.524371 Aug 03 04:46:10.138300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1628/3284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:09 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:10.172873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:10.172873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:10.203239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:10.206434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.211935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:10.217431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.401596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.414955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.420985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.422633 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad1b611b-b288-42a7-8a61-68bb8dcbb3de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.499070 Aug 03 04:46:10.426500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1657/3285] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:09 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:10.435330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05a10b44-3a74-456f-a514-cd99b3b73755 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:10.439826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05a10b44-3a74-456f-a514-cd99b3b73755 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:10.478290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.499778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.512927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.514170 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45d1e47b-fb7d-4096-af23-b056281e2b08 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.370526 Aug 03 04:46:10.514767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1629/3286] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:10 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:10.533330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a083dac6-6b12-480b-8210-5de2cf5e4e9f tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:10.533330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a083dac6-6b12-480b-8210-5de2cf5e4e9f tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:10.561008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05a10b44-3a74-456f-a514-cd99b3b73755 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.569346 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05a10b44-3a74-456f-a514-cd99b3b73755 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1215 microversion: 2.1 time: 0.141194 Aug 03 04:46:10.580553 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1658/3287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:10 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:10.595297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:10.596985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:10.607578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:10.608338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.609558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:10.610233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.631096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a083dac6-6b12-480b-8210-5de2cf5e4e9f tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.645802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a083dac6-6b12-480b-8210-5de2cf5e4e9f tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1217 microversion: 2.1 time: 0.122424 Aug 03 04:46:10.648487 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1630/3288] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:10 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:10.790257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-dafdda2f-258e-4c84-9957-6f174796162a req-5d8f112d-3683-4de2-97b3-e0d044f4cb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-unplugged", "status": "completed", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:10.810836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-dafdda2f-258e-4c84-9957-6f174796162a req-5d8f112d-3683-4de2-97b3-e0d044f4cb04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:10.811340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-dafdda2f-258e-4c84-9957-6f174796162a req-5d8f112d-3683-4de2-97b3-e0d044f4cb04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:10.857478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-dafdda2f-258e-4c84-9957-6f174796162a req-5d8f112d-3683-4de2-97b3-e0d044f4cb04 service nova] Creating event network-vif-unplugged:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:46:10.863441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-dafdda2f-258e-4c84-9957-6f174796162a req-5d8f112d-3683-4de2-97b3-e0d044f4cb04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077578 Aug 03 04:46:10.866737 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1631/3289] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:46:10.876652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "af2cf005-848b-4ec4-ac49-b31479796a9c"}], "security_groups": [{"name": "tempest-securitygroup--326955107"}], "key_name": "tempest-keypair-1749063646", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:10.936222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:10.949185 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9bdbb166-fd41-47a3-8128-2051233a62e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.367044 Aug 03 04:46:10.952135 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1659/3290] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:10 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:11.183196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] validate_networks() for [('af2cf005-848b-4ec4-ac49-b31479796a9c', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:46:11.458950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:11.459803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:11.471934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.487269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.494197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.494197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.829930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:46:11.830993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:46:11.831923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:46:11.832698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:46:11.833460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:46:11.847230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.847911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.848151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.849708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.850223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.859076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.861270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.866238 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa6d3fe6-4f89-4b73-9ff1-4976955bf4c4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.414949 Aug 03 04:46:11.867501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1660/3291] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:11 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:11.874232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:11.875147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:11.882124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.882872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.883984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:11.884635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:11.899021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Getting quotas for project 4790a12623e141cb95544c8f2d9a8d3b. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:11.901602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:11.912562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Getting quotas for user 7c388031750b407e8ed2bc15c5ff0bd3 and project 4790a12623e141cb95544c8f2d9a8d3b. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:11.928470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:46:11.954543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:46:11.967558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.983865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.998352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:11.999926 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-efa120c7-cbcf-4e96-a9de-5a796ee9f189 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.131249 Aug 03 04:46:12.007769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1661/3292] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:11 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:12.013789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:12.014730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:12.022159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.022640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:12.023446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.023947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:12.094909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:12.103477 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb05c188-9755-4aaa-be48-7224fdb639a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1219 microversion: 2.1 time: 0.094152 Aug 03 04:46:12.104004 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1662/3293] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:12 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:12.109529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e340ab36-38e2-4d9b-b1ae-1480f31dc764 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:12.110170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e340ab36-38e2-4d9b-b1ae-1480f31dc764 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:12.167091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e340ab36-38e2-4d9b-b1ae-1480f31dc764 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:12.191844 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e340ab36-38e2-4d9b-b1ae-1480f31dc764 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1217 microversion: 2.1 time: 0.073238 Aug 03 04:46:12.191844 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1663/3294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:12 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:12.308789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fd1c1b9-19b6-4d80-b08c-2b530ca8a4d6 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.438885 Aug 03 04:46:12.309913 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1632/3295] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:46:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:46:12.321554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-772655aa-79f7-46af-9f84-9903c24fb379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:12.322430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-772655aa-79f7-46af-9f84-9903c24fb379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:12.427148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-772655aa-79f7-46af-9f84-9903c24fb379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:12.453059 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-772655aa-79f7-46af-9f84-9903c24fb379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1226 microversion: 2.1 time: 0.135727 Aug 03 04:46:12.467291 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1664/3296] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:12 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:12.742441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:12.743145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:12.764915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.780705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:12.780705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.780705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:12.848163 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2caea8f5-655b-4893-9d44-7eeaa06e3caf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/ips" status: 200 len: 144 microversion: 2.1 time: 0.112835 Aug 03 04:46:12.867903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1633/3297] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:46:12 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/ips => generated 144 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:12.895190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:12.902263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:12.914469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.915202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:12.916250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:12.917589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.029584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:13.031187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:13.055003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.057480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.060233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.062900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.214291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.234589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.239612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.245349 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c9ea7ba-d42e-4e78-810d-180c2adf7ad1 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.223918 Aug 03 04:46:13.262343 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1634/3298] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:13 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:13.269487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:13.271722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:13.277154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.278557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.283098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.283748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.313647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.327483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.331987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.334118 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6120fcb-23b6-4e88-8003-dcb397709fe6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.447125 Aug 03 04:46:13.340053 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1665/3299] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:12 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:13.364795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:13.372892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:13.387277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.387697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.388525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:13.388968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:13.419304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.430870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45ee3b82-7092-4602-8864-9835808496ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1267 microversion: 2.1 time: 0.166254 Aug 03 04:46:13.432332 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1635/3300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:13 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:13.475031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9678e098-eecf-4320-af14-1836f316e982 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:13.475793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9678e098-eecf-4320-af14-1836f316e982 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:13.520630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.542330 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-838c15fb-61dc-4bf5-b5a1-18069b1af700 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1269 microversion: 2.1 time: 0.200530 Aug 03 04:46:13.549887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1666/3301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:13 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:13.608200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9678e098-eecf-4320-af14-1836f316e982 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:13.624345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9678e098-eecf-4320-af14-1836f316e982 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1226 microversion: 2.1 time: 0.153089 Aug 03 04:46:13.625765 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1636/3302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:13 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:14.275396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:14.276820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:14.288582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.293127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:14.294207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.298171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:14.364353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:14.365575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:14.384229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.385146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:14.389101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.389794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:14.804186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:14.830056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:14.830056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:14.830056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61be766c-3ae2-4508-82cc-1578c1db2082 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.556525 Aug 03 04:46:14.847337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1667/3303] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:14 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:14.860666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:14.861456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:14.874294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.874985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:14.875998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:14.876787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.115537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.126266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.135592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.139666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.152424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2bb230d0-cf5a-4d31-a5b4-c921841e4ad2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1275 microversion: 2.1 time: 0.303515 Aug 03 04:46:15.156584 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d59db81-bd5d-44f9-8135-920b3344035a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.797230 Aug 03 04:46:15.157435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1637/3304] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:14 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:15.169683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:15.171387 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1668/3305] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:14 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:15.179106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:15.190725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:15.191364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:15.201180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.201638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.204153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.206802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.218347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.218778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.219608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.220059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.277952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:15.448144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.457897 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb87216e-7386-4dd4-8a19-b9593b38b773 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1275 microversion: 2.1 time: 0.296890 Aug 03 04:46:15.464422 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1638/3306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:15 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:15.492932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:15.511070 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a4438ef-2084-4d66-93ad-713421c6ec8e tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1230 microversion: 2.1 time: 0.329159 Aug 03 04:46:15.512497 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1669/3307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:15 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1230 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:15.571853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b856f1c4-e170-4510-99e6-6806da403345 req-e1032014-1ff3-4ced-b129-033cf6cc0b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "name": "network-vif-plugged", "status": "completed", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:15.591977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b856f1c4-e170-4510-99e6-6806da403345 req-e1032014-1ff3-4ced-b129-033cf6cc0b49 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.592583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b856f1c4-e170-4510-99e6-6806da403345 req-e1032014-1ff3-4ced-b129-033cf6cc0b49 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.609351 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b856f1c4-e170-4510-99e6-6806da403345 req-e1032014-1ff3-4ced-b129-033cf6cc0b49 service nova] Creating event network-vif-plugged:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:46:15.616046 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b856f1c4-e170-4510-99e6-6806da403345 req-e1032014-1ff3-4ced-b129-033cf6cc0b49 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047885 Aug 03 04:46:15.620611 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1639/3308] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:15.690558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:15.691260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:15.702428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.707633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.709280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.709895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.861737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:15.867071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:15.888684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.892983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:15.894100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:15.894716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:16.415182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:16.430306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:16.432377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:16.437985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:16.443211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9bd8524b-a3b7-4d7e-ae1f-5a21e3e7d6b6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.591387 Aug 03 04:46:16.461203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52e4b889-5f59-40e0-81cd-92ee3393573e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.763602 Aug 03 04:46:16.468772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1640/3309] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:15 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:16.470411 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1670/3310] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:15 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:16.502646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:16.503188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:16.507229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:16.507866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:16.528350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:16.528615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:16.535605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:16.535759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:16.535880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:16.535880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:16.536069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:16.536069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.590911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.598726 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d8e0b99-b883-45e2-8543-5202430f895e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 1.115385 Aug 03 04:46:17.599313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1641/3311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:16 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:17.605947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:17.606566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:17.611367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.613286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.613774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.614553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.615151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.629180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.631110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.632612 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-deada59a-3f4c-4770-a2ca-8df321ab2648 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 1.148134 Aug 03 04:46:17.642011 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1671/3312] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:16 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:17.652045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:17.652848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:17.659296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.659789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.660636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.661359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.741625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.751506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7359ff86-af3a-4ef0-baba-58f5b5d335e3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1275 microversion: 2.1 time: 0.151121 Aug 03 04:46:17.752441 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1642/3313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:17 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:17.772482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:17.773610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:17.781871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.782650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.783708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.784361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.922270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:17.930082 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44722866-a1e5-42f4-b917-891266b529a2 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1296 microversion: 2.1 time: 0.162030 Aug 03 04:46:17.930665 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1643/3314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:17 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:17.936421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:17.937031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:17.943562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.944207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:17.945191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:17.945636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.066167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:18.075117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a907780c-c5a2-484c-9d25-2c222b85878d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.429163 Aug 03 04:46:18.075798 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1672/3315] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:17 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:18.094448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:18.097714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29189eb6-c295-4654-be85-2412221883d6"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:18.100654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:18.108334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.108657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:18.109257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.110297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.110916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.111045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:18.112597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76a05465-dc11-495b-b09a-5618718b70dc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.180750 Aug 03 04:46:18.113550 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1644/3316] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:17 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:18.121724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:18.122452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:18.130091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.133588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.133588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.133853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.505159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:18.517510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4684577-fcda-4ea8-8034-32bc5534c2fa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.402445 Aug 03 04:46:18.518824 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1645/3317] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:18 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:18.558675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:18.558675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:18.577312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.586818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.589275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:18.590758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:18.635725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:46:19.045792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:19.184733 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d5a40e3b-5cb4-4bc4-ac17-fdfb6bf5e693 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "DELETE /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 204 len: 0 microversion: 2.1 time: 0.664190 Aug 03 04:46:19.185844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1646/3318] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:46:18 2022] DELETE /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:46:19.194243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:19.196789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:19.203813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.204501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:19.205750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.205950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:19.298906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1cce83a-2faf-4b4d-9600-e94a7814124e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.208324 Aug 03 04:46:19.300357 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1673/3319] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:46:18 2022] POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:19.319295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:19.320028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:19.345197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.345660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:19.346515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.346959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:19.464019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:19.511201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4e7ed46-e03e-4675-8484-7d4b7ee322f9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.323697 Aug 03 04:46:19.512004 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1647/3320] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:46:19 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:46:19.518114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:19.530243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:19.536735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.537192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:19.537975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:19.538420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:20.231218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:20.248123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:20.253146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:20.257062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9431a863-10b1-4b3a-a8d4-516479da88d3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1809 microversion: 2.20 time: 0.742637 Aug 03 04:46:20.268508 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1648/3321] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:19 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1809 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:20.268508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:20.271013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:20.282512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:20.283150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:20.284057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:20.284634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:20.402359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:20.423486 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1cf333ba-e805-4c88-9175-5766b7d33553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 1.121665 Aug 03 04:46:20.425354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1674/3322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:19 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:20.436773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:20.436773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:20.472118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:20.476815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:20.476815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:20.481421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.237846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:21.248762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c669272a-7745-492d-b7a4-1690feaa4583 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.989347 Aug 03 04:46:21.254744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1649/3323] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:20 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:21.255623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:21.255739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:21.256479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:21.264502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.265246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.266879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.267533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.269778 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12d4c02f-c8d5-4d84-8f1b-f3ed36c72aa0 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.841262 Aug 03 04:46:21.281442 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1675/3324] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:20 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:21.301392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:21.308062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:21.309063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.309676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.310612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.311207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.814211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:21.824553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:21.826188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:21.827434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11a725eb-cf49-486d-94f9-bd7a91acd30f tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.576561 Aug 03 04:46:21.828304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1650/3325] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:21 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:21.833369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:21.836844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:21.843355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.844042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.845184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:21.845645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:21.864480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:22.353288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:22.362959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf00704b-94ff-4af1-ac1b-8e0a4424093b tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1682 microversion: 2.1 time: 1.080212 Aug 03 04:46:22.363734 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1676/3326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:21 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1682 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:22.374930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-60f141e4-3951-48fd-9ec3-0a066dd44e80 req-d7d5421e-eba0-4d5e-a984-b6e21fe43a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a337e213-31f3-4906-bfcb-aaf764643609", "tag": "9cf782b9-dac6-46db-b4ab-2701be2d153d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:22.385746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-60f141e4-3951-48fd-9ec3-0a066dd44e80 req-d7d5421e-eba0-4d5e-a984-b6e21fe43a62 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:22.386356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-60f141e4-3951-48fd-9ec3-0a066dd44e80 req-d7d5421e-eba0-4d5e-a984-b6e21fe43a62 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:22.399635 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-60f141e4-3951-48fd-9ec3-0a066dd44e80 req-d7d5421e-eba0-4d5e-a984-b6e21fe43a62 service nova] Creating event network-changed:9cf782b9-dac6-46db-b4ab-2701be2d153d for instance a337e213-31f3-4906-bfcb-aaf764643609 on n-h1-826756-5 Aug 03 04:46:22.405515 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-60f141e4-3951-48fd-9ec3-0a066dd44e80 req-d7d5421e-eba0-4d5e-a984-b6e21fe43a62 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 Aug 03 04:46:22.406225 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1677/3327] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:22.411649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:22.424355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:22.424355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:22.424355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:22.424355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:22.424355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:22.442107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:22.476840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:22.486876 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d1e01767-a6a5-4106-92aa-3ec1f4ce1edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.657294 Aug 03 04:46:22.488880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1651/3328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:21 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:22.495072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:22.496027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:22.505360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:22.506554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:22.507649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:22.508453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:22.983478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:22.992795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:22.994775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:22.996173 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1acc8362-98e8-48d4-93e5-e17ddc9a3691 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1796 microversion: 2.20 time: 0.588704 Aug 03 04:46:22.996777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1678/3329] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:22 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1796 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:23.001922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:23.002533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.008649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.009602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.011056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.011687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.050660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.052588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:23.055506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c192d7d0-7517-4b28-8c0a-414ebaa3cea1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.565207 Aug 03 04:46:23.056226 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1652/3330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:22 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:23.062253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:23.063258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.071619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.073391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.074912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.075672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.408998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.417910 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed74daa4-3aab-4a11-9ca2-02634732f966 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.419647 Aug 03 04:46:23.418638 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1679/3331] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:22 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:23.424767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:23.427492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.431149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.439881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27844fc8-0f17-4e62-bcb7-729f0eb6fcec tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.381666 Aug 03 04:46:23.441618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.442080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.442888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.444283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.452859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1653/3332] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:23 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:23.459426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:23.460036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.467235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.467680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.468476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.468908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.508546 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-855137f1-eaf1-4520-8947-c1b8dfdfc258 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 200 len: 322 microversion: 2.1 time: 0.088188 Aug 03 04:46:23.513796 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1680/3333] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:46:23 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:23.515484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:23.517159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.531924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.531924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.531924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.531924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.671104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.680670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa668992-2d7a-4ca2-acf8-bf06669b7104 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1614 microversion: 2.1 time: 0.169603 Aug 03 04:46:23.682187 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1681/3334] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:23 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1614 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:23.687576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:23.688508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:23.696096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.699719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.701131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:23.701780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:23.737997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=20 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:23.874867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.885093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.886876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:23.888212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1932b53-256e-41ba-9c22-322c19cb1ca6 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.434149 Aug 03 04:46:23.888812 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1654/3335] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:23 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:24.081119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:24.082041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:24.092944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:24.094334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:24.095445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:24.097218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:24.267046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:24.275031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fbee810d-b032-4fda-839f-032906bcdb90 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.591432 Aug 03 04:46:24.276803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1682/3336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:23 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:24.300643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:24.301435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:24.303590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:24.309231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:24.309861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:24.310752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:24.311355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.024246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:25.040737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b676638-a6fa-498d-8b52-1ea1deefa8ed tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.965833 Aug 03 04:46:25.054691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1655/3337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:24 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:25.060625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:25.061447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:25.076571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.077931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.080131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.080131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.139269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:25.148141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49e1eb40-1fc7-4428-8f9d-2aeade467524 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.852636 Aug 03 04:46:25.154334 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1683/3338] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:24 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:25.159527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:25.170852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:25.177082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.177663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.178536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.179176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.639262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:25.648644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-335cdcd3-41ba-4ab5-9503-67d0f247da47 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.592469 Aug 03 04:46:25.649459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1656/3339] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:25 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:25.655325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f799db-d065-4d8e-9f0b-66d16ecc35a7", "tag": "605b601d-055b-4fb3-b1cb-151897d7661f"}, {"name": "network-changed", "server_uuid": "46f67fd0-e13a-4470-9d23-b6a41cf62339", "tag": "45bb7cc3-6a83-4dd8-9c0e-c403736ebb65"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:25.673206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.673925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.694466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] Creating event network-changed:605b601d-055b-4fb3-b1cb-151897d7661f for instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 on n-h1-826756-5 Aug 03 04:46:25.695315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] Creating event network-changed:45bb7cc3-6a83-4dd8-9c0e-c403736ebb65 for instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 on n-h1-826756-5 Aug 03 04:46:25.703816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-48b2c655-f958-4f85-9335-01ba55e39dac req-393c64b2-26a0-4dfa-a31c-201f17107991 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052318 Aug 03 04:46:25.713759 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1657/3340] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:25.713759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:25.713759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:25.719858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.720433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.721308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.721895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.762310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.762709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.763171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lazy-loading 'fault' on Instance uuid 22e5184b-8e80-421f-a8c4-cb8e09bda213 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:46:25.928731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:25.937340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9367cfc645e04308aa18bddb0cd685f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45701dcd506c4c16a3f08445cdbfc30a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:25.942443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0673fccc-217d-4963-9cd3-1b3ec86f3468 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.786633 Aug 03 04:46:25.943216 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1684/3341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:25 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:25.949015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:25.949179 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2a47db7-4c97-41ad-9039-b25d47b993f6 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 200 len: 1331 microversion: 2.1 time: 0.242041 Aug 03 04:46:25.953563 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1658/3342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:25 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 1331 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:25.953698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:25.956790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.957486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.958738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.959393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.960038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:25.960704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:25.977664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.978044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:25.979716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:25.980823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.072892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.082975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.085087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.086620 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b2fa4b1-155e-466c-92e7-799d3db31c3d tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.142213 Aug 03 04:46:26.088381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1685/3343] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:25 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:26.093704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:26.094600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:26.101431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.102155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.103207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.108625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.269106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.278869 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-65d109dd-b93e-49b4-b18d-9d3ff245db09 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.328223 Aug 03 04:46:26.280865 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1659/3344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:25 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:26.294800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.300035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:26.300939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:26.303917 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b70c7922-6af1-4c99-b31e-c1b6dc5192b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.214182 Aug 03 04:46:26.305079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1686/3345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:26 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:26.312086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.312086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.312086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.312086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.449754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.457915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a7a3855-3ac4-492f-ad86-19b4d5c76c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.162324 Aug 03 04:46:26.458760 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1660/3346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:26.575827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1980276755", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "1f881aa8-baa3-4832-9e42-a4ace23e4798"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:26.635693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] validate_networks() for [('1f881aa8-baa3-4832-9e42-a4ace23e4798', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:46:26.670631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:26.671278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:26.678673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.679675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.680187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:26.681134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:26.953970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:26.966870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dbb42625-a70f-4457-b64d-26687efb0c0e tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.300670 Aug 03 04:46:26.977988 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1661/3347] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:26 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:26.991396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:26.992057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:27.003887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.004719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.006055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.007077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.229040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.237999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a00c1df-84a9-4d5f-b787-d39c1e9e657c tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.256736 Aug 03 04:46:27.249293 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1662/3348] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:26 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:27.256014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:46:27.256489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:46:27.257407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:46:27.257994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:46:27.258602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:46:27.261631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.262325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] [instance: 22e5184b-8e80-421f-a8c4-cb8e09bda213] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:27.269394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.270095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.270438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.271102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.271735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.271972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.273102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.273837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.290421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] HTTP exception thrown: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Request method failure captured: Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 HTTP/1.1 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fz3hN5R_2WWKaKi3UyI6unqUQD9fVLbSsNcWcN3651TbqbkEj5DrAcS-_3ZBOVY-m-YEOVaPQp1Z7uNBbQT8Zlr-xjwfdJgZ3fv0DpOdjm7gakaJ-Hq1c4cjRoXzja6xoW_0XtDf095lE3ubY2pN5kheXawMUaWt9UiXHEPoMFKj4A Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 45701dcd506c4c16a3f08445cdbfc30a Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/45701dcd506c4c16a3f08445cdbfc30a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 45701dcd506c4c16a3f08445cdbfc30a Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1547310544 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesAdminNegativeTest-1547310544-project Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9367cfc645e04308aa18bddb0cd685f4 Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesAdminNegativeTest-1547310544-project Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '22e5184b-8e80-421f-a8c4-cb8e09bda213'} Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:27.292621 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. Aug 03 04:46:27.298579 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:27.299590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:27.300103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:27.301499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Returning 404 to user: Instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:27.302597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be648fe8-0355-4963-ac56-6aa22ca91d12 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213" status: 404 len: 111 microversion: 2.1 time: 0.051926 Aug 03 04:46:27.303462 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1663/3349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:27 2022] GET /compute/v2.1/servers/22e5184b-8e80-421f-a8c4-cb8e09bda213 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:46:27.309521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.310966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:27.317468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.318177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.319191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.319783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.321611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:46:27.324893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:46:27.396459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.406491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.408025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.409252 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a3bb065-8c79-471b-8cdb-6765b64b7f71 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.104669 Aug 03 04:46:27.410257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1664/3350] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:27 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:27.415260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f472a411-e308-4b28-9b64-53f3a5036801 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] Calling method '.version_select at 0x7fdd47e46b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.521825 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-827d45f9-5c5a-4542-8e76-d957b3c93af5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950663 Aug 03 04:46:27.522698 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1687/3351] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:46:27.528538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.529528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:27.536293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.536781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.537599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.538051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.543442 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f472a411-e308-4b28-9b64-53f3a5036801 tempest-VolumesAdminNegativeTest-1547310544 tempest-VolumesAdminNegativeTest-1547310544-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467888322" status: 202 len: 0 microversion: 2.1 time: 0.131837 Aug 03 04:46:27.549140 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1665/3352] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467888322 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:46:27.554786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cbffaf64-cfa0-46f3-966f-becffbb5b8b1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.562394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cbffaf64-cfa0-46f3-966f-becffbb5b8b1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:27.636305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cbffaf64-cfa0-46f3-966f-becffbb5b8b1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.647362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cbffaf64-cfa0-46f3-966f-becffbb5b8b1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1215 microversion: 2.1 time: 0.096813 Aug 03 04:46:27.651109 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1666/3353] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:27 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:27.739447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-abf37cb4-b42c-4ea3-84e5-3ac1cf6b6d3e req-cdd14745-f305-4c0a-9b5c-7b7cf79c2b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e5184b-8e80-421f-a8c4-cb8e09bda213", "name": "network-vif-deleted", "tag": "d3173d89-684c-4855-bf3c-1df7eac9560b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:27.769519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abf37cb4-b42c-4ea3-84e5-3ac1cf6b6d3e req-cdd14745-f305-4c0a-9b5c-7b7cf79c2b06 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:27.771877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abf37cb4-b42c-4ea3-84e5-3ac1cf6b6d3e req-cdd14745-f305-4c0a-9b5c-7b7cf79c2b06 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:27.799362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:27.810332 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af62fae9-5194-49f1-9846-94a2b9d8b4dc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.286521 Aug 03 04:46:27.811918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1688/3354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:27 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:27.823352 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-abf37cb4-b42c-4ea3-84e5-3ac1cf6b6d3e req-cdd14745-f305-4c0a-9b5c-7b7cf79c2b06 service nova] Creating event network-vif-deleted:d3173d89-684c-4855-bf3c-1df7eac9560b for instance 22e5184b-8e80-421f-a8c4-cb8e09bda213 on n-h1-826756-5 Aug 03 04:46:27.828539 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-abf37cb4-b42c-4ea3-84e5-3ac1cf6b6d3e req-cdd14745-f305-4c0a-9b5c-7b7cf79c2b06 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095237 Aug 03 04:46:27.829472 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1667/3355] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:46:27.998257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:27.998257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:28.003062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.003444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.005423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.008045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.265385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:28.266220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:28.274099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.274738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.275537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.276574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.434798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:28.443365 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83a82b6c-fcd1-42ed-9345-bcf68cd200f3 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.456702 Aug 03 04:46:28.448297 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1689/3356] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:27 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:28.459908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:28.461709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:28.475087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.476383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.477422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:28.478819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:28.904160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:28.917361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:28.920209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:28.922310 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d3a56f8-f7da-497e-a130-a6adf6c8a261 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1604 microversion: 2.42 time: 0.470248 Aug 03 04:46:28.923385 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1690/3357] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:28 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1604 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:46:28.934853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6102203b-2d8f-4811-9d92-392990fa45da tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:28.937951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6102203b-2d8f-4811-9d92-392990fa45da tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:29.043356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:29.051810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ed31e1f-7d1e-4ff4-8194-5f9347047379 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.792191 Aug 03 04:46:29.065065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1668/3358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:28 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:29.069408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:29.070031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:29.081446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.082569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.083796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.084414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.088768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6102203b-2d8f-4811-9d92-392990fa45da tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:29.095955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6102203b-2d8f-4811-9d92-392990fa45da tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1215 microversion: 2.1 time: 0.170900 Aug 03 04:46:29.098279 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1691/3359] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:28 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:29.386210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:29.396309 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bb7aed5-9039-474b-bda8-b6d849ada223 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.330621 Aug 03 04:46:29.397721 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1669/3360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:29 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:29.473451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:29.473451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:29.482288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.482924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.483970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.484919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.655603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8d0e2c1d-9fac-40d5-9a67-f6eb03bd7c7d req-4ca68cf4-cf80-4e22-8d7a-613cad016c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a337e213-31f3-4906-bfcb-aaf764643609", "name": "network-vif-plugged", "status": "completed", "tag": "9cf782b9-dac6-46db-b4ab-2701be2d153d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:29.673654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8d0e2c1d-9fac-40d5-9a67-f6eb03bd7c7d req-4ca68cf4-cf80-4e22-8d7a-613cad016c1a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.674588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8d0e2c1d-9fac-40d5-9a67-f6eb03bd7c7d req-4ca68cf4-cf80-4e22-8d7a-613cad016c1a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.692838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8d0e2c1d-9fac-40d5-9a67-f6eb03bd7c7d req-4ca68cf4-cf80-4e22-8d7a-613cad016c1a service nova] Creating event network-vif-plugged:9cf782b9-dac6-46db-b4ab-2701be2d153d for instance a337e213-31f3-4906-bfcb-aaf764643609 on n-h1-826756-5 Aug 03 04:46:29.699719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8d0e2c1d-9fac-40d5-9a67-f6eb03bd7c7d req-4ca68cf4-cf80-4e22-8d7a-613cad016c1a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054179 Aug 03 04:46:29.700800 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1670/3361] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:46:29.936032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:29.949218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:29.949990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:29.959851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:29.961191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:29.970837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d3e27fc-658f-472f-8b49-160d34b9d9d5 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.501209 Aug 03 04:46:29.970978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.971111 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1692/3362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:29 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:29.971254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:29.971502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:29.972964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.036886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.037611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.039012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lazy-loading 'fault' on Instance uuid 4760d1b6-5b26-493e-ae66-f1ae2e1f568f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:46:30.082579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:30.085489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:30.096447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.097738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.098877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.099478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.294674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.304541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.306466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd96499f359754477bb86641588910734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c98112c887420bbbcabf877421d0fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.308287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e191794-c035-402b-9b1d-05e19dd58d47 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 200 len: 1609 microversion: 2.42 time: 0.364892 Aug 03 04:46:30.309622 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1671/3363] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:29 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 1609 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:46:30.314515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:30.315226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:30.321493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.323162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.324431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.325303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.425335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.434510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4303de4-cee3-4d5b-b312-4aed3b27d7a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1267 microversion: 2.1 time: 0.123616 Aug 03 04:46:30.435246 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1672/3364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:30 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:30.450087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:30.451180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:30.458270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.463771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.463771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:30.463771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:30.464207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.471339 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-328caf47-6d4f-42be-8d5a-2f1c2baa108a tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.398306 Aug 03 04:46:30.472521 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1693/3365] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:30 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:30.481660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:30.813421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:30.820836 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a0a8535-1a13-4e5a-ae52-80cef6c8cbd8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1315 microversion: 2.1 time: 0.384351 Aug 03 04:46:30.821418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1673/3366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:30 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:30.990470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:30.991421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:30.999647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.003393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.003393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.003393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.272075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:31.317166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-886b9c26-acfd-4860-bf5c-39f7c749213a tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.328803 Aug 03 04:46:31.336063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:31.344922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:31.345413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1694/3367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:30 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:31.346017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.346652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.347868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.348493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.374790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] HTTP exception thrown: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Request method failure captured: Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f HTTP/1.1 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ft9TkUE-l7tzs7PIJq--5BCL7m9maNRY1--ajKznaoxTFzqlFv0WTte7_wi9QJbAzDlfLH9lWviS1E1_1ubRbfQd25YoaNaWMXDnTk4eN44zkmzOwPo_VFbolzTvGy7zNwiAi_-imerVtwFNeB7DTZ13wBM66oyPvl4PayNwZ_L-dw Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d96499f359754477bb86641588910734 Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4760d1b6-5b26-493e-ae66-f1ae2e1f568f'} Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:31.376525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Returning 404 to user: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-340e9804-90d3-486e-84a9-75b86b23f099 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 404 len: 111 microversion: 2.42 time: 0.048828 Aug 03 04:46:31.381664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1674/3368] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:31 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:46:31.404157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ada83910-eb46-4a1c-9768-1abea172eff0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '.version_select at 0x7fdd59e6e0d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:31.461752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:31.463761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:31.471639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.472095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.473263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.474407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.494113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ada83910-eb46-4a1c-9768-1abea172eff0 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340200873" status: 204 len: 0 microversion: 2.42 time: 0.104405 Aug 03 04:46:31.495304 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1695/3369] 10.222.0.72 () {60 vars in 1259 bytes} [Wed Aug 3 04:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340200873 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:46:31.503398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:31.505992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:31.519686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.520524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.522067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.522862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.554518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:31.564027 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a2d0e88-c11e-494e-bd42-b14603cdf596 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1273 microversion: 2.1 time: 0.110241 Aug 03 04:46:31.569410 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1675/3370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:31 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:31.689575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:31.709007 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5d41c12-6072-451c-ab1c-d16718c44604 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.211199 Aug 03 04:46:31.709700 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1696/3371] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:31 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:31.729322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c2ad2668-c559-422b-8500-e9b9230232f7 req-970618b0-1455-4bd2-8471-a4ff80ffae65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f67fd0-e13a-4470-9d23-b6a41cf62339", "name": "network-vif-plugged", "status": "completed", "tag": "45bb7cc3-6a83-4dd8-9c0e-c403736ebb65"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:31.742605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c2ad2668-c559-422b-8500-e9b9230232f7 req-970618b0-1455-4bd2-8471-a4ff80ffae65 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.743085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c2ad2668-c559-422b-8500-e9b9230232f7 req-970618b0-1455-4bd2-8471-a4ff80ffae65 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.756842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c2ad2668-c559-422b-8500-e9b9230232f7 req-970618b0-1455-4bd2-8471-a4ff80ffae65 service nova] Creating event network-vif-plugged:45bb7cc3-6a83-4dd8-9c0e-c403736ebb65 for instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 on n-h1-826756-5 Aug 03 04:46:31.761978 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c2ad2668-c559-422b-8500-e9b9230232f7 req-970618b0-1455-4bd2-8471-a4ff80ffae65 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043693 Aug 03 04:46:31.762905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1676/3372] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:31.843679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:31.844646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:31.855571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.856501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:31.857465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:31.858204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.339869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:32.340840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:32.351222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.352063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.353323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.357923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.708585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:32.718286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf187494-3424-4068-a706-9938de8fe641 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1503 microversion: 2.1 time: 0.880036 Aug 03 04:46:32.732786 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1697/3373] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:31 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1503 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:32.738296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:32.739107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:32.746731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.748714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.748714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.749473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.790800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:32.802667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77642cf3-bbdd-4844-8426-5cf188f84d87 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.468325 Aug 03 04:46:32.803782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1677/3374] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:32 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:32.812971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:32.814360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:32.840803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.840803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:32.840803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:32.840803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.225057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:33.233446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:33.233626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e097b751-c154-409b-af33-0e8529eec554 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.499278 Aug 03 04:46:33.234163 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1698/3375] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:32 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:33.238985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:33.239688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:33.246834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.247215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.248627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.249240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.255720 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5193d81a-d397-405c-9119-b6b4fd4b614b tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.450679 Aug 03 04:46:33.256607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1678/3376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:32 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:33.281041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:46:33.730563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5262b049-14c5-448b-b2b5-f70ded28767e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 204 len: 0 microversion: 2.1 time: 0.494843 Aug 03 04:46:33.736948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1699/3377] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:46:33 2022] DELETE /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:46:33.742913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:33.743577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:33.752854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.753329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.754123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.755725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.789686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-fa6badd9-fd47-47ae-8378-d34b3f027461 req-712f0f8d-ce6b-4dd1-9fe5-f4ce9900156e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310064db-388e-49e3-adb3-437a7dfe0567", "tag": "df7f5560-d681-44e6-b63a-3cd5f48a9b5e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:33.830715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa6badd9-fd47-47ae-8378-d34b3f027461 req-712f0f8d-ce6b-4dd1-9fe5-f4ce9900156e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.831231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa6badd9-fd47-47ae-8378-d34b3f027461 req-712f0f8d-ce6b-4dd1-9fe5-f4ce9900156e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.853691 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-fa6badd9-fd47-47ae-8378-d34b3f027461 req-712f0f8d-ce6b-4dd1-9fe5-f4ce9900156e service nova] Creating event network-changed:df7f5560-d681-44e6-b63a-3cd5f48a9b5e for instance 310064db-388e-49e3-adb3-437a7dfe0567 on n-h2-826756-5 Aug 03 04:46:33.865884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-fa6badd9-fd47-47ae-8378-d34b3f027461 req-712f0f8d-ce6b-4dd1-9fe5-f4ce9900156e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082113 Aug 03 04:46:33.867114 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1700/3378] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:33.883560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d91f9ecb-38c2-4bfd-a2ef-b9f31a0d08cd req-0f9d5243-c834-4d60-9939-5ce41fd964c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f799db-d065-4d8e-9f0b-66d16ecc35a7", "name": "network-vif-plugged", "status": "completed", "tag": "605b601d-055b-4fb3-b1cb-151897d7661f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:33.896757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d91f9ecb-38c2-4bfd-a2ef-b9f31a0d08cd req-0f9d5243-c834-4d60-9939-5ce41fd964c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.902715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d91f9ecb-38c2-4bfd-a2ef-b9f31a0d08cd req-0f9d5243-c834-4d60-9939-5ce41fd964c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.910545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d91f9ecb-38c2-4bfd-a2ef-b9f31a0d08cd req-0f9d5243-c834-4d60-9939-5ce41fd964c5 service nova] Creating event network-vif-plugged:605b601d-055b-4fb3-b1cb-151897d7661f for instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 on n-h1-826756-5 Aug 03 04:46:33.916612 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d91f9ecb-38c2-4bfd-a2ef-b9f31a0d08cd req-0f9d5243-c834-4d60-9939-5ce41fd964c5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047910 Aug 03 04:46:33.917214 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1701/3379] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:33.932460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:33.933418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:33.940013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.942996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:33.942996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:33.942996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:34.127844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:34.150632 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d32f235-680e-407a-ac24-b314e9d6398f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1509 microversion: 2.1 time: 0.411648 Aug 03 04:46:34.168723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1679/3380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:33 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:34.260045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:34.263316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:34.266209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:34.278079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:34.279010 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7de8cb27-56b7-4beb-9385-a673aed00cee tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1317 microversion: 2.1 time: 0.351258 Aug 03 04:46:34.279811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1702/3381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:33 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:34.280457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:34.285232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:34.285840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:34.289653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:34.290329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:34.310794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:34.311153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:34.312122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:34.312592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:34.570670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:34.573606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:34.583076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93c2ec54-92b7-4113-b511-82b9632d6942 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.328759 Aug 03 04:46:34.584973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-281a240f-020a-4c4a-8dde-dad0ebd8bd51 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.303228 Aug 03 04:46:34.585861 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1680/3382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:34 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:34.600547 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1703/3383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:34 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:35.176486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:35.177902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:35.187352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.192820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.202752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.206251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.302578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:35.303312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:35.310483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.310930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.311711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.312155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.717380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:35.724685 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ed645797-ef3c-4de6-ac3a-a8b0400dfbaa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1509 microversion: 2.1 time: 0.551800 Aug 03 04:46:35.739483 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1681/3384] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:35 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:35.746627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:35.747196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:35.753693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.754147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.754935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.755379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.787260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:35.799202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-570f0084-f41e-4efc-bf7a-7db1a0b169fd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1505 microversion: 2.1 time: 0.500426 Aug 03 04:46:35.801877 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1704/3385] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:35 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:35.822076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:35.824646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:35.831225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.831698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:35.832526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:35.832966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.073600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:36.085689 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f7d2ab7-011c-4c03-ade0-bd34466b1439 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1351 microversion: 2.1 time: 0.344602 Aug 03 04:46:36.103480 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1682/3386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:35 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1351 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:36.108909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.109404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.117429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.117881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.119220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.119857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.157045 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd2dead5-0db9-4306-a945-7d150ad6b479 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips" status: 200 len: 108 microversion: 2.1 time: 0.047776 Aug 03 04:46:36.158063 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1683/3387] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:46:36 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:36.178270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.182057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.187649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.188550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.189532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.190138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.236261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0cfd4eb-7d27-42d6-801d-786853fbbf0b tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips" status: 200 len: 108 microversion: 2.1 time: 0.068909 Aug 03 04:46:36.237211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1684/3388] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:46:36 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips => generated 108 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:36.247441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:36.266875 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e7975662-eaef-41f1-8295-3bf74abb8300 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.463799 Aug 03 04:46:36.270744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.274474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.283101 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1705/3389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:35 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:36.290913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.291940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.297521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.297521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.332916 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-204f4fb8-7c29-4ca6-85bf-c40fa773fccd tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips/tempest-ServerAddressesTestJSON-403306251-network" status: 200 len: 93 microversion: 2.1 time: 0.076265 Aug 03 04:46:36.334582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1685/3390] 10.222.0.72 () {58 vars in 1398 bytes} [Wed Aug 3 04:46:36 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339/ips/tempest-ServerAddressesTestJSON-403306251-network => generated 93 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:46:36.346386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.347075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.360034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.361444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.362497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.364524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.418499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:46:36.753230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.755212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.784211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.787213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.809641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.810242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.831254 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e9d4edc-9c9e-492c-8854-09179daa9596 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "DELETE /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 204 len: 0 microversion: 2.1 time: 0.489517 Aug 03 04:46:36.831969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1706/3391] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:46:36 2022] DELETE /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:46:36.841176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:36.842080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:36.875206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.876386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:36.877658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:36.878290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.283238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:37.299256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:37.309309 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d07b5c7b-f86b-4cf1-9541-b4e2b49cbf20 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1509 microversion: 2.1 time: 0.566459 Aug 03 04:46:37.310385 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1686/3392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:36 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:37.318375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:37.319252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:37.333512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.334943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.336137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.336899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.349590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:37.365886 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfc92f4a-67a4-404d-8e72-207701b310e2 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1511 microversion: 2.1 time: 0.528546 Aug 03 04:46:37.368129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1707/3393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:36 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1511 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:37.386622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-173ec7f9-18ef-48b8-98d5-0e2ef8379097 req-fd07889c-ae91-4a6b-af7d-295355da4198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a337e213-31f3-4906-bfcb-aaf764643609", "name": "network-vif-deleted", "tag": "9cf782b9-dac6-46db-b4ab-2701be2d153d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:37.403211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-173ec7f9-18ef-48b8-98d5-0e2ef8379097 req-fd07889c-ae91-4a6b-af7d-295355da4198 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.408058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-173ec7f9-18ef-48b8-98d5-0e2ef8379097 req-fd07889c-ae91-4a6b-af7d-295355da4198 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.433762 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-173ec7f9-18ef-48b8-98d5-0e2ef8379097 req-fd07889c-ae91-4a6b-af7d-295355da4198 service nova] Creating event network-vif-deleted:9cf782b9-dac6-46db-b4ab-2701be2d153d for instance a337e213-31f3-4906-bfcb-aaf764643609 on n-h1-826756-5 Aug 03 04:46:37.439548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-173ec7f9-18ef-48b8-98d5-0e2ef8379097 req-fd07889c-ae91-4a6b-af7d-295355da4198 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064707 Aug 03 04:46:37.440814 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1708/3394] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:37.446503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:37.447738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:37.454682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.455623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.457173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.457843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.485925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:37.645325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:37.722594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:37.729374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:37.733276 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d08686fd-80ff-4cc1-8e5f-d8707d887d16 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1541 microversion: 2.1 time: 0.421483 Aug 03 04:46:37.733956 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1687/3395] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:37 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1541 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:37.758456 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95367736-cdb4-4b6c-9d97-101171388125 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.316159 Aug 03 04:46:37.764219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:37.774935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:37.775526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1709/3396] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:37 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:37.776344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.777211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.778161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:37.778675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:37.865659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f808d69-f257-48c4-a6d2-31c7f1d33a0d tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105377 Aug 03 04:46:37.866267 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1688/3397] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:46:37 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:38.098085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc0a1add-8f03-4458-965d-c87766a0d3cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:38.108413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0a1add-8f03-4458-965d-c87766a0d3cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.110099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0a1add-8f03-4458-965d-c87766a0d3cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.142029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc0a1add-8f03-4458-965d-c87766a0d3cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:46:38.213488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.214316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:38.226339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.228538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.230970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.231432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.264079 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] HTTP exception thrown: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Request method failure captured: Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f HTTP/1.1 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ft9TkUE-l7tzs7PIJq--5BCL7m9maNRY1--ajKznaoxTFzqlFv0WTte7_wi9QJbAzDlfLH9lWviS1E1_1ubRbfQd25YoaNaWMXDnTk4eN44zkmzOwPo_VFbolzTvGy7zNwiAi_-imerVtwFNeB7DTZ13wBM66oyPvl4PayNwZ_L-dw Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d96499f359754477bb86641588910734 Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4760d1b6-5b26-493e-ae66-f1ae2e1f568f'} Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:38.268038 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.272885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.277342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Returning 404 to user: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:38.279007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-989ba7fe-5d73-4610-bd3c-a509d2e14a41 tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 404 len: 111 microversion: 2.42 time: 0.071809 Aug 03 04:46:38.282083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1689/3398] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:46:38 2022] DELETE /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:46:38.289452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.295096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] [instance: 4760d1b6-5b26-493e-ae66-f1ae2e1f568f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:38.310727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.311285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.311972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.312441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.355276 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] HTTP exception thrown: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Request method failure captured: Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f HTTP/1.1 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ft9TkUE-l7tzs7PIJq--5BCL7m9maNRY1--ajKznaoxTFzqlFv0WTte7_wi9QJbAzDlfLH9lWviS1E1_1ubRbfQd25YoaNaWMXDnTk4eN44zkmzOwPo_VFbolzTvGy7zNwiAi_-imerVtwFNeB7DTZ13wBM66oyPvl4PayNwZ_L-dw Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.42 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_37c98112c887420bbbcabf877421d0fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/37c98112c887420bbbcabf877421d0fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 37c98112c887420bbbcabf877421d0fb Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-31640938 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d96499f359754477bb86641588910734 Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TaggedBootDevicesTest_v242-31640938-project Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4760d1b6-5b26-493e-ae66-f1ae2e1f568f'} Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.358353 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] Returning 404 to user: Instance 4760d1b6-5b26-493e-ae66-f1ae2e1f568f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f4818d1-4be8-4997-bc69-ddae7b327ffc tempest-TaggedBootDevicesTest_v242-31640938 tempest-TaggedBootDevicesTest_v242-31640938-project] 10.222.0.72 "GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f" status: 404 len: 111 microversion: 2.42 time: 0.072870 Aug 03 04:46:38.362986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1690/3399] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:46:38 2022] GET /compute/v2.1/servers/4760d1b6-5b26-493e-ae66-f1ae2e1f568f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:46:38.378007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.385495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:38.397815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.399909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.402378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.403010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.421495 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc0a1add-8f03-4458-965d-c87766a0d3cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.329726 Aug 03 04:46:38.423201 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1710/3400] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:46:38 2022] POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:46:38.455202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.456636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:38.489129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.489733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.493065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.495287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.538723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:38.555502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a53c4d8-6480-4b26-a7b0-14269ded152a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 200 len: 1300 microversion: 2.1 time: 0.183642 Aug 03 04:46:38.559903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1691/3401] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:38 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 1300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:38.569063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.569994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:38.580919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.581831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.582768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:38.583587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:38.947270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:38.959631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c27899ff-4a62-40ee-bd49-16e7f2a1ae99 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1511 microversion: 2.1 time: 0.534840 Aug 03 04:46:38.961262 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1711/3402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:38 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:38.977682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:38.978964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:39.005682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:39.005961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:39.005961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:39.005961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:39.005961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:39.008668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8afeaff-4ba7-41de-a006-eb0064c96faa tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.437016 Aug 03 04:46:39.012144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1692/3403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:38 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:39.096436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:39.421350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:39.435305 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5515c59-bbd3-4977-8cf9-c3a554ede6c2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.469983 Aug 03 04:46:39.454386 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1712/3404] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:38 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:39.566839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6c46c1e8-4989-44b6-9cfc-05a489d4a61d req-ac0370c0-ebd3-4d8a-a7b6-5e423c7d6b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f67fd0-e13a-4470-9d23-b6a41cf62339", "name": "network-vif-deleted", "tag": "45bb7cc3-6a83-4dd8-9c0e-c403736ebb65"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:39.581306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:39.581941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:39.585438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6c46c1e8-4989-44b6-9cfc-05a489d4a61d req-ac0370c0-ebd3-4d8a-a7b6-5e423c7d6b19 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:39.588362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6c46c1e8-4989-44b6-9cfc-05a489d4a61d req-ac0370c0-ebd3-4d8a-a7b6-5e423c7d6b19 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:39.592611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:39.595472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:39.596708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:39.597320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:39.606207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6c46c1e8-4989-44b6-9cfc-05a489d4a61d req-ac0370c0-ebd3-4d8a-a7b6-5e423c7d6b19 service nova] Creating event network-vif-deleted:45bb7cc3-6a83-4dd8-9c0e-c403736ebb65 for instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 on n-h1-826756-5 Aug 03 04:46:39.622447 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6c46c1e8-4989-44b6-9cfc-05a489d4a61d req-ac0370c0-ebd3-4d8a-a7b6-5e423c7d6b19 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058306 Aug 03 04:46:39.624015 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1693/3405] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:39.645838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 HTTP/1.1 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a337e213-31f3-4906-bfcb-aaf764643609'} Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:39.647594 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba6bc3f9-c357-4a6f-ad39-2f7599904be2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 404 len: 111 microversion: 2.1 time: 0.072278 Aug 03 04:46:39.652742 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1713/3406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:39 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:46:39.719405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-733858539", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:39.864951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:46:39.991315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:39.993425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:40.010339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.012390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.013164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.015694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.108154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.109053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.109913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lazy-loading 'fault' on Instance uuid 46f67fd0-e13a-4470-9d23-b6a41cf62339 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:46:40.374561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4162f65c61d8401aa8ca4c606d68fd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcdf5fad12f4c6d91f2840aa7a482cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:40.398308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f91aa1b-6604-4a73-b7d7-74ad41a50f50 tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 200 len: 1307 microversion: 2.1 time: 0.415421 Aug 03 04:46:40.416147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1714/3407] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:39 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:40.439902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:40.440792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:40.447593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.448319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.449340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.450012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.664545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:40.681374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e11fc819-23bb-4387-ae6c-a02952bf7ad4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.263192 Aug 03 04:46:40.682194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1715/3408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:40 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:40.686810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:40.698092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:40.707623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.711276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:40.719318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:40.719842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.068204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:41.086410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d532cd8e-97ab-419e-af73-37b449b6de73 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.396801 Aug 03 04:46:41.086410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1716/3409] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:40 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:41.169836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1f793cb0-c808-4019-8379-f2665ed921f5 req-1551fada-f06a-4be1-bb90-d66451d99814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310064db-388e-49e3-adb3-437a7dfe0567", "name": "network-vif-plugged", "status": "completed", "tag": "df7f5560-d681-44e6-b63a-3cd5f48a9b5e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:41.189998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:41.192187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f793cb0-c808-4019-8379-f2665ed921f5 req-1551fada-f06a-4be1-bb90-d66451d99814 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.194107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f793cb0-c808-4019-8379-f2665ed921f5 req-1551fada-f06a-4be1-bb90-d66451d99814 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.225063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1f793cb0-c808-4019-8379-f2665ed921f5 req-1551fada-f06a-4be1-bb90-d66451d99814 service nova] Creating event network-vif-plugged:df7f5560-d681-44e6-b63a-3cd5f48a9b5e for instance 310064db-388e-49e3-adb3-437a7dfe0567 on n-h2-826756-5 Aug 03 04:46:41.237651 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1f793cb0-c808-4019-8379-f2665ed921f5 req-1551fada-f06a-4be1-bb90-d66451d99814 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072247 Aug 03 04:46:41.243896 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1717/3410] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:41.281676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:46:41.282734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:46:41.283409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:46:41.284049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:46:41.284832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:46:41.303616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.305621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.308726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.311636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.331090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:46:41.337639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:46:41.351408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:46:41.354874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:46:41.425792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:41.426514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] [instance: 46f67fd0-e13a-4470-9d23-b6a41cf62339] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:41.442139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.443322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.445016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.446868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.473034 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] HTTP exception thrown: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Request method failure captured: Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 HTTP/1.1 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2Pazw2mh0zMs20G-YUb1i6Dh0P4H79Uq9PvFBv-bdh4JyAJz8zOvfz-v_c_lofqDRFxMSEY6p9nc4Cgm38aQf703Eb3YnS5XFQHV1q97x_reynn_fZhtGUs-LLLzATVyvLZsc4WVs7sjIRN4BhXlXwy75knes9h6VNMztpJC_aS88 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: dbcdf5fad12f4c6d91f2840aa7a482cf Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerAddressesTestJSON-1483183683 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbcdf5fad12f4c6d91f2840aa7a482cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/dbcdf5fad12f4c6d91f2840aa7a482cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_dbcdf5fad12f4c6d91f2840aa7a482cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/dbcdf5fad12f4c6d91f2840aa7a482cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerAddressesTestJSON-1483183683 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: dbcdf5fad12f4c6d91f2840aa7a482cf Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1483183683 Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerAddressesTestJSON-1483183683-project Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4162f65c61d8401aa8ca4c606d68fd8c Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerAddressesTestJSON-1483183683-project Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '46f67fd0-e13a-4470-9d23-b6a41cf62339'} Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:41.475123 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. Aug 03 04:46:41.480055 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:41.481476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] Returning 404 to user: Instance 46f67fd0-e13a-4470-9d23-b6a41cf62339 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:41.482549 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-070fad2c-b6e4-4417-bc3c-7bc124a0079c tempest-ServerAddressesTestJSON-1483183683 tempest-ServerAddressesTestJSON-1483183683-project] 10.222.0.72 "GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339" status: 404 len: 111 microversion: 2.1 time: 0.063034 Aug 03 04:46:41.483553 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1718/3411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:41 2022] GET /compute/v2.1/servers/46f67fd0-e13a-4470-9d23-b6a41cf62339 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:46:41.522901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c90c63c2-478d-4059-b7d2-2d177a889f3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.808448 Aug 03 04:46:41.523834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1694/3412] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:46:41.540599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b0ae2cc0-e9be-4297-bb8f-b1e721ae4368 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:41.543908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b0ae2cc0-e9be-4297-bb8f-b1e721ae4368 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:41.714462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:41.716227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:41.730196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b0ae2cc0-e9be-4297-bb8f-b1e721ae4368 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:41.737573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b0ae2cc0-e9be-4297-bb8f-b1e721ae4368 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1214 microversion: 2.1 time: 0.201442 Aug 03 04:46:41.752062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1719/3413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:41 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:41.752321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.752321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.752535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-13dc173a-5490-441f-a92a-aac0a62819ee req-45395ecd-8704-4179-8569-f6cdd91c525f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f799db-d065-4d8e-9f0b-66d16ecc35a7", "tag": "605b601d-055b-4fb3-b1cb-151897d7661f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:41.759768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.760373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.807594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-13dc173a-5490-441f-a92a-aac0a62819ee req-45395ecd-8704-4179-8569-f6cdd91c525f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:41.808068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-13dc173a-5490-441f-a92a-aac0a62819ee req-45395ecd-8704-4179-8569-f6cdd91c525f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:41.832029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:41.845152 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-13dc173a-5490-441f-a92a-aac0a62819ee req-45395ecd-8704-4179-8569-f6cdd91c525f service nova] Creating event network-changed:605b601d-055b-4fb3-b1cb-151897d7661f for instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 on n-h1-826756-5 Aug 03 04:46:41.865728 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-13dc173a-5490-441f-a92a-aac0a62819ee req-45395ecd-8704-4179-8569-f6cdd91c525f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122003 Aug 03 04:46:41.866934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1720/3414] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:42.106587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:42.107322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:42.120740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:42.121217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:42.122043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:42.122534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:42.585554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:42.596871 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21d33562-8569-4e74-9588-f60466d14c28 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.891036 Aug 03 04:46:42.597469 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1695/3415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:41 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:42.736845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:42.750966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cff87e53-aa83-4e67-a95f-c9572ebb0eaa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1315 microversion: 2.1 time: 0.648565 Aug 03 04:46:42.752738 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1721/3416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:42 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:42.773861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-941c5196-4094-4868-ac29-99021ae318b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:42.775410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-941c5196-4094-4868-ac29-99021ae318b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:42.966101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-941c5196-4094-4868-ac29-99021ae318b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:42.981370 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-941c5196-4094-4868-ac29-99021ae318b2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1214 microversion: 2.1 time: 0.213367 Aug 03 04:46:42.989749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1696/3417] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:42 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:43.621908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:43.624821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:43.633221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:43.635564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:43.635564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:43.635564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:43.776281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:43.777616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:43.788854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:43.789639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:43.792698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:43.793392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:44.050181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:44.062312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9839ac3-4be7-4658-9b4e-c71e48f2d261 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.444726 Aug 03 04:46:44.062632 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1722/3418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:43 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:44.067709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:44.068456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:44.075785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:44.076802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:44.077666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:44.078282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:44.190704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:44.207457 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-564dc2b6-43df-4d37-b044-15897980d371 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1501 microversion: 2.1 time: 0.429765 Aug 03 04:46:44.208597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1697/3419] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:43 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1501 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:44.213958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:44.223420 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0e9a2c7-0fd4-4614-905a-9ed6a249af07 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1266 microversion: 2.1 time: 0.159739 Aug 03 04:46:44.224631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1723/3420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:44 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:44.234217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55e97524-3e90-4c41-99c1-29ebcfa789c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:44.244515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e97524-3e90-4c41-99c1-29ebcfa789c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:44.245258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e97524-3e90-4c41-99c1-29ebcfa789c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:44.336623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55e97524-3e90-4c41-99c1-29ebcfa789c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Going to try to stop instance {{(pid=120831) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:46:44.605390 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55e97524-3e90-4c41-99c1-29ebcfa789c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567/action" status: 202 len: 0 microversion: 2.1 time: 0.376101 Aug 03 04:46:44.606193 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1698/3421] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:46:44 2022] POST /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:46:44.620832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:44.621541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:44.639669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:44.640128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:44.640983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:44.641420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:45.088496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:45.089795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:45.105759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:45.109298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:45.114775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:45.114775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:45.604316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:45.613025 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-60f512ab-7e54-4707-a1cd-8d710af8a7d3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 1.002545 Aug 03 04:46:45.621002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:45.628966 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1724/3422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:44 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:45.637104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:45.638005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:45.641492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-489b00c8-806e-42ed-9d4d-5f0613499208 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.558734 Aug 03 04:46:45.643392 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1699/3423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:45 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:45.646284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:45.646751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:45.647596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:45.648078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:45.755944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:45.775847 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b3b7a10-b680-4544-8af4-ca71b3151de9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1272 microversion: 2.1 time: 0.145422 Aug 03 04:46:45.777041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1725/3424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:45 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:46.637773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:46.639082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:46.653511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:46.654874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:46.656048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:46.657313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:46.667556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:46.669034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:46.678171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:46.679013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:46.681525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:46.682338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:47.161577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:47.171749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:47.173586 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45ed7f44-7a4f-4668-94e4-83e3c879b0d0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.513379 Aug 03 04:46:47.174436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1726/3425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:46 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:47.180158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:47.182199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:47.182635 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf06a42c-00ed-4055-b75c-f07b5237b977 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.551064 Aug 03 04:46:47.183724 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1700/3426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:46 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:47.187899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:47.188524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:47.189400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:47.189939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:47.430721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:47.443206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e4eec7b0-f8cc-4e7f-af7b-e1e325756423 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.267446 Aug 03 04:46:47.443818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1727/3427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:47 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:48.203576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:48.204876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:48.206642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:48.207268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:48.221482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.223530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.228944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.228944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.230394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.235654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.236580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.237045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.297896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:48.649952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:48.657892 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc930a06-2cc5-41fe-b89f-8b7d4454882a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.463302 Aug 03 04:46:48.659168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1701/3428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:48 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:48.662227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:48.664391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fc543470-67c3-437e-8ade-baabcca7fa05 req-1033e29c-0412-4264-9c25-82e98eca0d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052aabd9-41dd-49ad-a810-45f88f53dc96", "tag": "2128aec4-7299-4107-93b9-1ffa5c2c6186"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:48.676581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc543470-67c3-437e-8ade-baabcca7fa05 req-1033e29c-0412-4264-9c25-82e98eca0d01 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.677384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc543470-67c3-437e-8ade-baabcca7fa05 req-1033e29c-0412-4264-9c25-82e98eca0d01 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.681077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b380f1d2-7ee8-4655-b1da-f80811793f2c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.477516 Aug 03 04:46:48.681755 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1728/3429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:48 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:48.720025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fc543470-67c3-437e-8ade-baabcca7fa05 req-1033e29c-0412-4264-9c25-82e98eca0d01 service nova] Creating event network-changed:2128aec4-7299-4107-93b9-1ffa5c2c6186 for instance 052aabd9-41dd-49ad-a810-45f88f53dc96 on n-h1-826756-5 Aug 03 04:46:48.746138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fc543470-67c3-437e-8ade-baabcca7fa05 req-1033e29c-0412-4264-9c25-82e98eca0d01 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077625 Aug 03 04:46:48.749730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1702/3430] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:48.765477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:48.767519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:48.786648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.787341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.791322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:48.791784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:48.940336 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb2558ef-6fe4-4971-9b92-75f99da61de8 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.257482 Aug 03 04:46:48.941711 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1729/3431] 10.222.0.72 () {58 vars in 1128 bytes} [Wed Aug 3 04:46:48 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 04:46:48.954433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c0561d8-058d-4d35-9d4f-e1c120e3b713 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Calling method '.version_select at 0x7fdd59d30700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:48.985232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6c0561d8-058d-4d35-9d4f-e1c120e3b713 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] HTTP exception thrown: Image not found. Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c0561d8-058d-4d35-9d4f-e1c120e3b713 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Request method failure captured: Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f24xERsHv1mLwU5-5HaYS7aL0IEChM0aXyprT2go1BUWBzJ1gMx4Hi9JeE02_J7bPyaJ6_n3Ot1fIWUE-Ov7QYH-yZkIaZ7u21spbrjQMx8adHh3cukWe1dFUE2MGIvDdr9c87xZcts_5ZFuUAlPsPI-u9Dd9XPBpvdWTi5_zlfsBU Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f85db32950a4283b027ec139966d2c5 Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '-1'} Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.987644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:46:48.993505 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:48.997154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c0561d8-058d-4d35-9d4f-e1c120e3b713 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:48.998890 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c0561d8-058d-4d35-9d4f-e1c120e3b713 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.049108 Aug 03 04:46:49.000028 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1730/3432] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 3 04:46:48 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:46:49.011475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b058655-71c2-4a19-8439-7836aa41347a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Calling method '.version_select at 0x7fdd5504b310>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.038227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4b058655-71c2-4a19-8439-7836aa41347a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] HTTP exception thrown: Image not found. Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b058655-71c2-4a19-8439-7836aa41347a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Request method failure captured: Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/fc136572-8c56-48d6-9166-cd0f58b26a4j HTTP/1.1 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f24xERsHv1mLwU5-5HaYS7aL0IEChM0aXyprT2go1BUWBzJ1gMx4Hi9JeE02_J7bPyaJ6_n3Ot1fIWUE-Ov7QYH-yZkIaZ7u21spbrjQMx8adHh3cukWe1dFUE2MGIvDdr9c87xZcts_5ZFuUAlPsPI-u9Dd9XPBpvdWTi5_zlfsBU Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f85db32950a4283b027ec139966d2c5 Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'fc136572-8c56-48d6-9166-cd0f58b26a4j'} Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc136572-8c56-48d6-9166-cd0f58b26a4j to delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc136572-8c56-48d6-9166-cd0f58b26a4j could not be found. Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.040610 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:46:49.045374 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.049304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b058655-71c2-4a19-8439-7836aa41347a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:49.050423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b058655-71c2-4a19-8439-7836aa41347a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/fc136572-8c56-48d6-9166-cd0f58b26a4j" status: 404 len: 62 microversion: 2.1 time: 0.045502 Aug 03 04:46:49.051442 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1731/3433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:49 2022] DELETE /compute/v2.1/images/fc136572-8c56-48d6-9166-cd0f58b26a4j => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:46:49.063324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2edd2d62-50dc-466d-bc47-f34a74fcb75d tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Calling method '.version_select at 0x7fdd59d308b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.086497 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2edd2d62-50dc-466d-bc47-f34a74fcb75d tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] HTTP exception thrown: Image not found. Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2edd2d62-50dc-466d-bc47-f34a74fcb75d tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Request method failure captured: Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/85530f08-7fb8-4307-bf41-6093a32042d91 HTTP/1.1 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f24xERsHv1mLwU5-5HaYS7aL0IEChM0aXyprT2go1BUWBzJ1gMx4Hi9JeE02_J7bPyaJ6_n3Ot1fIWUE-Ov7QYH-yZkIaZ7u21spbrjQMx8adHh3cukWe1dFUE2MGIvDdr9c87xZcts_5ZFuUAlPsPI-u9Dd9XPBpvdWTi5_zlfsBU Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f85db32950a4283b027ec139966d2c5 Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '85530f08-7fb8-4307-bf41-6093a32042d91'} Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 85530f08-7fb8-4307-bf41-6093a32042d91 to delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85530f08-7fb8-4307-bf41-6093a32042d91 could not be found. Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.090517 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2edd2d62-50dc-466d-bc47-f34a74fcb75d tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:49.094642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2edd2d62-50dc-466d-bc47-f34a74fcb75d tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/85530f08-7fb8-4307-bf41-6093a32042d91" status: 404 len: 62 microversion: 2.1 time: 0.035727 Aug 03 04:46:49.100317 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1732/3434] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:46:49 2022] DELETE /compute/v2.1/images/85530f08-7fb8-4307-bf41-6093a32042d91 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:46:49.122991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b6afb1e-a9b3-498b-be71-6415aac0c191 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Calling method '.version_select at 0x7fdd59cef700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.151237 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1b6afb1e-a9b3-498b-be71-6415aac0c191 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] HTTP exception thrown: Image not found. Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b6afb1e-a9b3-498b-be71-6415aac0c191 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Request method failure captured: Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/tempest-invalid-380527475 HTTP/1.1 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f24xERsHv1mLwU5-5HaYS7aL0IEChM0aXyprT2go1BUWBzJ1gMx4Hi9JeE02_J7bPyaJ6_n3Ot1fIWUE-Ov7QYH-yZkIaZ7u21spbrjQMx8adHh3cukWe1dFUE2MGIvDdr9c87xZcts_5ZFuUAlPsPI-u9Dd9XPBpvdWTi5_zlfsBU Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f85db32950a4283b027ec139966d2c5 Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'tempest-invalid-380527475'} Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-380527475 to delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-380527475 could not be found. Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.153485 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b6afb1e-a9b3-498b-be71-6415aac0c191 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b6afb1e-a9b3-498b-be71-6415aac0c191 tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/tempest-invalid-380527475" status: 404 len: 62 microversion: 2.1 time: 0.053492 Aug 03 04:46:49.157907 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1733/3435] 10.222.0.72 () {58 vars in 1203 bytes} [Wed Aug 3 04:46:49 2022] DELETE /compute/v2.1/images/tempest-invalid-380527475 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:46:49.166201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6a608f-2438-4cf6-9267-b62e29a1165a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Calling method '.version_select at 0x7fdd54f25d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.199142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fb6a608f-2438-4cf6-9267-b62e29a1165a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] HTTP exception thrown: Image not found. Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6a608f-2438-4cf6-9267-b62e29a1165a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Request method failure captured: Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/images/1f4d87df-6433-45e8-a91d-156a77a342b4 HTTP/1.1 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f24xERsHv1mLwU5-5HaYS7aL0IEChM0aXyprT2go1BUWBzJ1gMx4Hi9JeE02_J7bPyaJ6_n3Ot1fIWUE-Ov7QYH-yZkIaZ7u21spbrjQMx8adHh3cukWe1dFUE2MGIvDdr9c87xZcts_5ZFuUAlPsPI-u9Dd9XPBpvdWTi5_zlfsBU Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_72c30ec1dc014678abb34e7c23779074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/72c30ec1dc014678abb34e7c23779074"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 72c30ec1dc014678abb34e7c23779074 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1f85db32950a4283b027ec139966d2c5 Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1160639851-project Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: exception: Image not found. Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1f4d87df-6433-45e8-a91d-156a77a342b4'} Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1f4d87df-6433-45e8-a91d-156a77a342b4 to delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f4d87df-6433-45e8-a91d-156a77a342b4 could not be found. Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.202060 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6a608f-2438-4cf6-9267-b62e29a1165a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] Returning 404 to user: Image not found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb6a608f-2438-4cf6-9267-b62e29a1165a tempest-ImagesDeleteNegativeTestJSON-1160639851 tempest-ImagesDeleteNegativeTestJSON-1160639851-project] 10.222.0.72 "DELETE /compute/v2.1/images/1f4d87df-6433-45e8-a91d-156a77a342b4" status: 404 len: 62 microversion: 2.1 time: 0.043738 Aug 03 04:46:49.206402 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1734/3436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:49 2022] DELETE /compute/v2.1/images/1f4d87df-6433-45e8-a91d-156a77a342b4 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:46:49.235115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:49.245711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e7f944d-c725-48d8-912c-a8cedd40cf8d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.493408 Aug 03 04:46:49.246582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1703/3437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:48 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:49.690336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.690336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:49.696372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:49.697268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:49.698255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:49.698906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:49.706014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:49.707073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:49.714079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:49.714862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:49.715723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:49.716238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:49.994431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:50.004533 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac3a82cb-c4f1-492a-b589-c44532b3069e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.325255 Aug 03 04:46:50.005380 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1735/3438] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:49 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:50.047344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:50.058403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7429be7-119f-49f4-a3c9-09a5a1b8f316 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.356093 Aug 03 04:46:50.068772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1704/3439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:49 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:50.267848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:50.269226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:50.278663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:50.279428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:50.281185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:50.282523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:50.618568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:50.626637 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5746bf93-32ba-4f54-9cdf-b32c2a1b5567 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.363392 Aug 03 04:46:50.627227 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1736/3440] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:50 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:51.029085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:51.029713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:51.037655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.038110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.042016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.042590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.081346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:51.082015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:51.092425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.093220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.094084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.094681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.235998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:51.239773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b1db8af-4e9d-4d66-b311-ea9401308e24 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.216706 Aug 03 04:46:51.244533 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1705/3441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:51 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:51.280809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:51.293453 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2b2d9287-ebf5-4f23-9e89-db30d3743627 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.216186 Aug 03 04:46:51.309277 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1737/3442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:51 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:51.650498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:51.651271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:51.653382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:51.658459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.659183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.668466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:51.668466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:51.815821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:51.827072 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d49c515-b2fb-4d66-a18a-79d597e88269 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.181825 Aug 03 04:46:51.836395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1706/3443] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:51 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:52.273941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:52.275786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:52.291954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:52.298086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.299293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.300290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.300787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.317069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:52.318262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:52.329264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.329941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.331195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.331921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.551925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:52.559975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:52.565681 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e09dc850-a343-4830-810f-c2cf2318bd8d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.306824 Aug 03 04:46:52.568253 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee41e977-fd69-4605-a370-4fc9e8cea7e4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.255713 Aug 03 04:46:52.568987 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1707/3444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:52 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:52.572823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1738/3445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:52 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:52.848850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:52.849469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:52.856296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.856919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.857678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:52.858184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:52.980164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:53.068738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:53.076841 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca0a244c-6111-462f-af68-41b0726536de tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.231933 Aug 03 04:46:53.077432 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1708/3446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:52 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:53.205802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:53.206300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:53.214031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.214491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.215273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.215716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.246431 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4d22238-197d-45cb-80c7-c22134bd4f90 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments/58126c97-6649-4c8d-b8e2-b9068823c39e" status: 200 len: 194 microversion: 2.20 time: 0.045204 Aug 03 04:46:53.252737 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1739/3447] 10.222.0.72 () {60 vars in 1454 bytes} [Wed Aug 3 04:46:53 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments/58126c97-6649-4c8d-b8e2-b9068823c39e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:46:53.348584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:53.349752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:53.357517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.358272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.359274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.359927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.477435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'services' on Instance uuid 72531f91-6fd2-475e-bbe2-c4a450af9ee0 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:46:53.597207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:53.599882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:53.614223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.615145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.617376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.618562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.812756 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7359caec-9ec8-4a32-a5ba-0e9aeec54f29 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments/58126c97-6649-4c8d-b8e2-b9068823c39e" status: 202 len: 0 microversion: 2.20 time: 0.467643 Aug 03 04:46:53.818400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1709/3448] 10.222.0.72 () {60 vars in 1457 bytes} [Wed Aug 3 04:46:53 2022] DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments/58126c97-6649-4c8d-b8e2-b9068823c39e => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:46:53.825800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:53.845655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:53.855610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.863567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.863567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.863567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.898063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:53.909216 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16c0d1ec-39ea-47fd-bea5-485769dd717c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.322855 Aug 03 04:46:53.910697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1740/3449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:53 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:53.929584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:53.932461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:53.942596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.949823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.949823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:53.949823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:53.979878 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ab8c006-77e9-45c2-89ba-85519fba9e26 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067601 Aug 03 04:46:53.986128 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1741/3450] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:53 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:46:54.099425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:54.100186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:54.112073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:54.113997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:54.120174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:54.120889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:54.151285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:54.171154 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f7ae78e-a016-4bb3-9d6d-8c26fc9969b5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.351104 Aug 03 04:46:54.184447 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1710/3451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:53 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:54.325575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:54.334322 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8b39499-33a3-407b-8efb-cf799bb13c46 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.239252 Aug 03 04:46:54.335657 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1742/3452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:54 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:54.935449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:54.936800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:54.953351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:54.955165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:54.957094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:54.959294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:54.993545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:54.996623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:55.017116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.019347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.022794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.023703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.105793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a3b9abe-869a-4ffd-9800-90acd409416b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116205 Aug 03 04:46:55.111078 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1743/3453] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:54 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:46:55.204261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:55.206806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:55.230949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.232580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.236039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.238363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.442680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:55.464884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b177530-3b7b-419b-80fa-8ebc1c79e7eb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.535435 Aug 03 04:46:55.466120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1711/3454] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:54 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:55.477824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:55.478817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:55.490313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:55.493036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.493782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.494762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:55.495525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:55.501587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:55.771978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:55.782332 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ce1ffbf-f23a-44be-b6c2-840c06425adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.590693 Aug 03 04:46:55.784879 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1744/3455] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:55 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:55.871106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:55.882031 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e16fe8d-6a20-42ef-938b-fb22f00f2993 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.414403 Aug 03 04:46:55.908152 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1712/3456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:55 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:56.120622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:56.123119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:56.159059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.161597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.189291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.192467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.315820 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a99cdb3-c28f-4411-835b-ba0758f69f05 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201036 Aug 03 04:46:56.328704 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1713/3457] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:56 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:46:56.455497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d5de19f5-f579-4411-b62c-6becf8e009ab req-51ba828e-db5a-42d6-8e8a-e54b8654d93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052aabd9-41dd-49ad-a810-45f88f53dc96", "name": "network-vif-plugged", "status": "completed", "tag": "2128aec4-7299-4107-93b9-1ffa5c2c6186"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:46:56.484000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d5de19f5-f579-4411-b62c-6becf8e009ab req-51ba828e-db5a-42d6-8e8a-e54b8654d93c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.485594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d5de19f5-f579-4411-b62c-6becf8e009ab req-51ba828e-db5a-42d6-8e8a-e54b8654d93c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.494456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:56.495078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:56.501886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.509880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.510994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.511602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.514885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d5de19f5-f579-4411-b62c-6becf8e009ab req-51ba828e-db5a-42d6-8e8a-e54b8654d93c service nova] Creating event network-vif-plugged:2128aec4-7299-4107-93b9-1ffa5c2c6186 for instance 052aabd9-41dd-49ad-a810-45f88f53dc96 on n-h1-826756-5 Aug 03 04:46:56.521557 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d5de19f5-f579-4411-b62c-6becf8e009ab req-51ba828e-db5a-42d6-8e8a-e54b8654d93c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449247 Aug 03 04:46:56.523490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1745/3458] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:46:56.807250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:56.808090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:56.856497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.859098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:56.864060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:56.866220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:57.068150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:57.084140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7bbe4094-23fb-4b6f-b119-9b41d7e0c84f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.593771 Aug 03 04:46:57.093718 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1714/3459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:56 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:57.108002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:57.111501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:57.123824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:57.124537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:57.125129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:57.125565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:57.242325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:57.251356 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-437ac493-1235-4e9c-8e33-24d8da3b8d59 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.449606 Aug 03 04:46:57.271990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1746/3460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:56 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:57.335039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:57.337997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:57.357793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:57.358586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:57.359839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:57.360544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:57.403047 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18232612-f4c6-4dd5-b76c-b54a672bfd13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072644 Aug 03 04:46:57.405449 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1747/3461] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:57 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:46:57.455079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:57.466247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-820d5c74-3def-4958-bde4-1890568fafb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1314 microversion: 2.1 time: 0.371327 Aug 03 04:46:57.480966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1715/3462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:57 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:58.109741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:58.112567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:58.143308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.145109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.148692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.151096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.280070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:58.281720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:58.289367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.290181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.291659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.292343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.518737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:58.534321 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-066ffd3f-f7cb-4718-9b2b-e42307c1c162 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1722 microversion: 2.1 time: 0.430222 Aug 03 04:46:58.535282 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1748/3463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:58 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:58.543765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:58.559566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:58.579101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.579627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.598005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.600720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.672938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:58.676149 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-313d44ac-3efc-4f2b-91a4-712231124018 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137552 Aug 03 04:46:58.681515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1749/3464] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:58 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:46:58.686033 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b828d15-459c-4313-8f85-4b7a5f36be5e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.410339 Aug 03 04:46:58.687845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:58.688082 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1716/3465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:58 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:46:58.716158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:58.716158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.716158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:58.716158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:58.716158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.274590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:46:59.282802 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bed8c209-073f-4ee2-8fa1-1e5bbdfcf3ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1502 microversion: 2.1 time: 0.599566 Aug 03 04:46:59.287687 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1750/3466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:58 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:46:59.558758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:59.559414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:59.574730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.579251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.580262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.580894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.689379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:59.693154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:59.710106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.715446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.718212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.720880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.770048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:46:59.824401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a5e3e22-9839-4f92-be04-73c530324e02 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139069 Aug 03 04:46:59.831294 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1751/3467] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:46:59 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:46:59.894137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:00.857568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:00.869705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef5a45d9-93d5-496e-afea-b9c2269a3fc4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1699 microversion: 2.1 time: 1.316144 Aug 03 04:47:00.894111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1717/3468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:59 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1699 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:00.909435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd22a42f-9386-4852-aa21-bf3c92704433 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:00.934795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd22a42f-9386-4852-aa21-bf3c92704433 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:00.947465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd22a42f-9386-4852-aa21-bf3c92704433 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:01.005012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd22a42f-9386-4852-aa21-bf3c92704433 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Going to try to start instance {{(pid=120831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 04:47:01.047865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:01.063768 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24dbce0b-783a-4da0-a813-04a632b54b4e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 1.231115 Aug 03 04:47:01.064869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1752/3469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:46:59 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:01.083548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:01.090693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:01.115680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:01.118838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:01.121457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:01.125850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:01.253597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f9d3bbe-9023-4c1c-99aa-d13e5c23478f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181232 Aug 03 04:47:01.254399 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1753/3470] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:47:01 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:47:01.299356 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd22a42f-9386-4852-aa21-bf3c92704433 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.402545 Aug 03 04:47:01.300239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1718/3471] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:00 2022] POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:01.309409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:01.310039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:01.331533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:01.332300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:01.336387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:01.345988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.091624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:02.092938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:02.108227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.110434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.111528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.113675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.159804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:02.185622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae7f5509-f034-482d-9f84-9bfdb1b4e039 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1708 microversion: 2.1 time: 0.880064 Aug 03 04:47:02.186419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1754/3472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:01 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1708 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:02.267379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:02.269703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:02.302388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.302842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.303640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.304076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.345294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b66a316-a828-4311-bd09-241cc587b02a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.081944 Aug 03 04:47:02.345905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1755/3473] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:47:02 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:02.495829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:02.497344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:02.505391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.505858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.506760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:02.507216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:02.589250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:02.715306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:02.732318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c388320e-f3f9-4d16-be39-f83f0ba6ed3d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.643440 Aug 03 04:47:02.752518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1719/3474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:02 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:03.153965 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f211c20d-b724-4791-985b-2521b1a9b10b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 204 len: 0 microversion: 2.20 time: 0.667884 Aug 03 04:47:03.159156 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1756/3475] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:47:02 2022] DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:47:03.165637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:03.166297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:03.184911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.185581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.187210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.187210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.222613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:03.224051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:03.246530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.247236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.250243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.250913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.654693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:03.669520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0016c683-cf06-4bd2-b047-06371a129b56 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1708 microversion: 2.1 time: 0.450804 Aug 03 04:47:03.686429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:03.688688 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1757/3476] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:03 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1708 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:03.700420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:03.702432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:03.703912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1911578b-686b-4b16-9e7d-946fb9af585c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.544643 Aug 03 04:47:03.721023 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1720/3477] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:03 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:03.761954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:03.762722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:03.769991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.770527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.771364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.772062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.958382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a56b206-7a13-4924-9fef-e488417bd630"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:03.963939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:03.971528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.972347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:03.973344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:03.973986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:04.065102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:04.075756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b40a585d-6f1b-4c49-8de6-3021612f4724 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.319122 Aug 03 04:47:04.077606 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1758/3478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:03 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:04.721696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:04.723305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:04.740627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:04.749025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:04.749025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:04.749025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:05.146816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:05.156517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e60f0b02-2e43-4bd9-af48-4f53cd2cc856 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1708 microversion: 2.1 time: 0.465115 Aug 03 04:47:05.163554 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1759/3479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:04 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1708 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:05.177939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:05.180861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:05.195352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:05.198291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:05.201557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:05.202275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:05.307277 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ebd3bd73-3db9-4448-a18a-f1ecd85001dd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.354298 Aug 03 04:47:05.307928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1721/3480] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:47:03 2022] POST /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96/os-volume_attachments => generated 194 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:05.334218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:05.339167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:05.365726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:05.365726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:05.368588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:05.369261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:05.941273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:05.953569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:05.955104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:05.956758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cb64ed7-88be-4f4a-a0cf-36cc7cd864df tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1724 microversion: 2.20 time: 0.790348 Aug 03 04:47:05.956944 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1760/3481] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:05 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1724 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:06.104177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1834693482", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "4e4e17d3-1ea9-4bc5-a5b8-5e239e3965a8"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:06.114646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:06.123061 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1be5f6a5-e804-41f7-9cd8-695c2d2b9e24 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.808426 Aug 03 04:47:06.131879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1722/3482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:05 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:06.208736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:06.208736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:06.208942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] validate_networks() for [('4e4e17d3-1ea9-4bc5-a5b8-5e239e3965a8', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:06.209099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:06.209099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:06.209099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:06.209099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:07.097499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:07.121010 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b83ddc0a-3076-485d-9a53-152991959b8a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1712 microversion: 2.1 time: 0.939230 Aug 03 04:47:07.124370 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1723/3483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:06 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1712 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:07.255058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2076379714", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "d34ae285-e43d-49e7-9472-964dce7772aa"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:07.358798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] validate_networks() for [('d34ae285-e43d-49e7-9472-964dce7772aa', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:08.293562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:08.294909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:08.295617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:08.296254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:08.297598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:08.321300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:08.322176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:08.323387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:08.324343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:08.351787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Getting quotas for project 8e3eb4bb3e724625a61fdf30987f8532. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:08.369719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Getting quotas for user aee731667f2944269001bff55f3b9cb4 and project 8e3eb4bb3e724625a61fdf30987f8532. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:08.396513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:08.399028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:08.655535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc52fa86-33fb-4dc2-85e3-73798642fb0b tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.695026 Aug 03 04:47:08.663018 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1761/3484] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:47:08.676861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:08.677797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:08.694636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:08.696950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:08.697444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:08.700836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:08.703631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.120902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:09.136016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:09.137956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:09.139729 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29d5722b-a5de-4fb2-a572-a2343412acc0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1656 microversion: 2.20 time: 0.475225 Aug 03 04:47:09.164040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1762/3485] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:08 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1656 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:09.168931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:09.169558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:09.188864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:09.195394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.195394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:09.195394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.436166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:09.438019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:09.439306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:09.445419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:09.445419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:09.478141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:09.479576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.479576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:09.479966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.636625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Getting quotas for project 92ba953c1d44403cbaadd3513e4cbabb. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:09.643408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Getting quotas for user 5b912a198efa4647be186db7b9e04a43 and project 92ba953c1d44403cbaadd3513e4cbabb. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:09.679615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:09.682329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:09.812376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:09.834839 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-805a8e5c-984d-4887-8c1d-713c6d797558 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1511 microversion: 2.1 time: 0.664844 Aug 03 04:47:09.837683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1763/3486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:09 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1511 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:09.857642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a772064a-8785-4869-8e67-7514188823cb tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:09.865686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a772064a-8785-4869-8e67-7514188823cb tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:09.870329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fb10729-1795-45fd-aed8-8c0aa584204a tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.746487 Aug 03 04:47:09.871007 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1724/3487] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:47:09.875729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2046c218-146c-4255-b3be-23de42e909ca req-271d5723-b5da-4a21-bfea-ab2bfbbf492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72531f91-6fd2-475e-bbe2-c4a450af9ee0", "name": "network-vif-deleted", "tag": "85034c38-2f0a-46f3-a072-132a253f579b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:09.927184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2046c218-146c-4255-b3be-23de42e909ca req-271d5723-b5da-4a21-bfea-ab2bfbbf492d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:09.929721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2046c218-146c-4255-b3be-23de42e909ca req-271d5723-b5da-4a21-bfea-ab2bfbbf492d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:09.968866 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2046c218-146c-4255-b3be-23de42e909ca req-271d5723-b5da-4a21-bfea-ab2bfbbf492d service nova] Creating event network-vif-deleted:85034c38-2f0a-46f3-a072-132a253f579b for instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 on n-h1-826756-5 Aug 03 04:47:09.986422 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2046c218-146c-4255-b3be-23de42e909ca req-271d5723-b5da-4a21-bfea-ab2bfbbf492d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114083 Aug 03 04:47:09.988911 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1725/3488] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:10.000252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-910b87a3-e6ab-4261-905a-7795ff478692 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:10.001290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-910b87a3-e6ab-4261-905a-7795ff478692 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:10.204524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a772064a-8785-4869-8e67-7514188823cb tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:10.213792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a772064a-8785-4869-8e67-7514188823cb tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1216 microversion: 2.1 time: 0.368147 Aug 03 04:47:10.217598 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1764/3489] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:09 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1216 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:10.223275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:10.226535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:10.233165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-910b87a3-e6ab-4261-905a-7795ff478692 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:10.249077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-910b87a3-e6ab-4261-905a-7795ff478692 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1216 microversion: 2.1 time: 0.256435 Aug 03 04:47:10.249687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:10.251749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:10.253027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:10.254497 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1726/3490] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:09 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1216 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:10.254630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:10.308522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:10.308989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:10.309457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'fault' on Instance uuid 72531f91-6fd2-475e-bbe2-c4a450af9ee0 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:10.418041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:10.428491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:10.433448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:10.449207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ae078bb-c9ee-456a-8d3a-c2959bdbbc76 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 200 len: 1372 microversion: 2.20 time: 0.232640 Aug 03 04:47:10.450000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1765/3491] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:10 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:10.859676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:10.860533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:10.879421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:10.879902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:10.880749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:10.881203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.235357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:11.236639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:11.255262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.255717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.256550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.258106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.323032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:11.340508 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6280debd-c52f-465c-971a-fa60e2becb87 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1488 microversion: 2.1 time: 0.482575 Aug 03 04:47:11.342195 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1727/3492] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:10 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1488 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:11.354741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d061ab0-d681-4aa5-8366-b6841b1f7fea tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:11.362716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d061ab0-d681-4aa5-8366-b6841b1f7fea tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:11.446853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:11.451278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3958556b-3039-4a68-a814-24dbd696b2ce tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1212 microversion: 2.1 time: 0.219692 Aug 03 04:47:11.459049 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1766/3493] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:11 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1212 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:11.465021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:11.483635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d061ab0-d681-4aa5-8366-b6841b1f7fea tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:11.488643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:11.493837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d061ab0-d681-4aa5-8366-b6841b1f7fea tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1216 microversion: 2.1 time: 0.149838 Aug 03 04:47:11.494844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1728/3494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:11 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:11.499514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.502948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:11.503307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.504380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.504615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:11.505196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.518288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.519024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.523523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.524423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.547802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 HTTP/1.1 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '72531f91-6fd2-475e-bbe2-c4a450af9ee0'} Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:11.550012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:47:11.555888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:11.558528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:11.559628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f8f0db9-89e9-4774-8985-b6e551a5983f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 404 len: 111 microversion: 2.20 time: 0.063409 Aug 03 04:47:11.564172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1729/3495] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:11 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:47:11.571993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b0446b17-edea-4eaf-bc08-943060fed1e0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '.version_select at 0x7fdd54848280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:11.610380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfa3abdf-93a2-439a-bafc-fb69f3db744a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 200 len: 156 microversion: 2.1 time: 0.149700 Aug 03 04:47:11.611284 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1767/3496] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:11 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 156 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:11.622324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:11.623402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:11.643244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.644053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.646915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:11.649126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:11.689345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b0446b17-edea-4eaf-bc08-943060fed1e0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008770153" status: 204 len: 0 microversion: 2.20 time: 0.123546 Aug 03 04:47:11.690252 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1730/3497] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008770153 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:47:11.735755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:12.073351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:12.084177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8f6bbcc-16e3-4aba-9531-260f3889a390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.466092 Aug 03 04:47:12.101764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1768/3498] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:11 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:12.123475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:12.124834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:12.137853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:12.138549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:12.139569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:12.140509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:12.168239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:12.485213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:12.485843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:12.501070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:12.501294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:12.502237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:12.502684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:13.354598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:13.368353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d238317e-f2ca-4fc9-82dc-993b23cb2855 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1276 microversion: 2.1 time: 0.885104 Aug 03 04:47:13.374301 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1769/3499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:12 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1276 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:13.380714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:13.383926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:13.406098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:13.408740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:13.409713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:13.412228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:13.661900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:13.676677 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-478ad795-27e2-48d5-8d69-cfcf775de9b9 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1268 microversion: 2.1 time: 0.305435 Aug 03 04:47:13.677298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:13.678820 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1770/3500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:13 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1268 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:13.700131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-549396a5-c953-4845-a75d-50ac84c33561 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 1.580087 Aug 03 04:47:13.700815 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1731/3501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:12 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:13.726514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:13.727504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:13.734543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:13.735387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:13.736499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:13.737191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.073268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:14.089654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcc8853d-02e9-4235-b533-58c12baa1583 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.370124 Aug 03 04:47:14.100762 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1771/3502] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:13 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:14.110273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:14.111004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:14.119817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.120442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.121331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.121870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.394049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:14.394722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:14.421202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.423037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.423980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.427735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.566069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:14.579157 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91ea243a-6897-485a-beeb-25e3612e972c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1274 microversion: 2.1 time: 0.189348 Aug 03 04:47:14.579877 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1772/3503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:14 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:14.627361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:14.672347 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f563207d-31ea-4f99-aec2-cdf2f3e21f1e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.565758 Aug 03 04:47:14.673872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eb4ef306-fbbd-46f1-b442-8adc5f81862f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: .version_select at 0x7fdd545e6ee0>, body: {"keypair": {"name": "tempest-keypair-1162757894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECPf9Igl+9OXr7/IA0B8T6VYKverXJeQxn/VM7YFeMI8BuBUYoY87xZXp3YPP3NcUAXPEJ1HChkoEUtVjts12KTjMfqs+9MCGLPJooXTBdeeu4dep7aB90qn2aYx1wdOw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:14.680359 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1732/3504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:14 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:14.701757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:14.702624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:14.707501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-eb4ef306-fbbd-46f1-b442-8adc5f81862f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for project 93a21344add4431685ff685ac8aa43a4. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:14.714078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.714923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.719965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:14.720974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:14.725233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-eb4ef306-fbbd-46f1-b442-8adc5f81862f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for user 19c105bc7f2d4207bb168dfe3c19052f and project 93a21344add4431685ff685ac8aa43a4. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:14.821027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:14.832255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad2ea474-f119-4496-a4b1-9da81bfc59aa tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1274 microversion: 2.1 time: 0.134712 Aug 03 04:47:14.833496 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1733/3505] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:14 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:14.840161 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eb4ef306-fbbd-46f1-b442-8adc5f81862f tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.170266 Aug 03 04:47:14.846922 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1773/3506] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:47:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:47:14.847051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-414004931", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "1f881aa8-baa3-4832-9e42-a4ace23e4798"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:14.913760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] validate_networks() for [('1f881aa8-baa3-4832-9e42-a4ace23e4798', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:15.607991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:15.609076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:15.621155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:15.621584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:15.622157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:15.622780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:15.623135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:15.625463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.626287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.627300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.627959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.634147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.635372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.640599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.641128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.687046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:15.693121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:15.722145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:15.724973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:15.920555 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5569c7e-b8c4-4437-ae49-4499693a142d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085083 Aug 03 04:47:15.922046 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1734/3507] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:47:15.927252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:15.928897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:15.930420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:15.937656 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61f09ab4-3768-45d0-82aa-eb53874d2008 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.333143 Aug 03 04:47:15.938488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1774/3508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:15 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:15.939435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.940086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.941251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.941946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.949821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:15.950707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:15.965117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.965858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.966944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:15.967655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:15.974537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:16.278054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:16.289046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-021741ff-b0cd-4185-8bb4-542752f75ed3 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.345266 Aug 03 04:47:16.289895 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1775/3509] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:15 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:16.297085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89c808a3-d533-45ae-9378-5efe7ca08e8c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:16.301035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89c808a3-d533-45ae-9378-5efe7ca08e8c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:16.438653 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e4ae7ac-13a3-42db-8c5d-1afc4127c21f tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "DELETE /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 204 len: 0 microversion: 2.1 time: 0.514814 Aug 03 04:47:16.439690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1735/3510] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:15 2022] DELETE /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:47:16.441544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89c808a3-d533-45ae-9378-5efe7ca08e8c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:16.451995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:16.452626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89c808a3-d533-45ae-9378-5efe7ca08e8c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1214 microversion: 2.1 time: 0.160488 Aug 03 04:47:16.452889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:16.453929 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1776/3511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:16 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:16.461887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:16.462762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:16.464243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:16.466368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:16.732020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:16.743000 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-706e5c3c-ddd4-4c4f-b4e8-a4933e2bf2bf tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1665 microversion: 2.1 time: 0.298270 Aug 03 04:47:16.743922 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1736/3512] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:16 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1665 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:16.959291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:16.960522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:16.972200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4652d61a-108b-4633-9fbb-7cb8cd347860 req-25cd933d-adc6-471e-9376-08b8e57d2826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b1e944-a222-4291-a323-a93b3348c0db", "tag": "d5895581-e9c3-46e1-a2e0-0f90b5734980"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:16.974007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:16.974489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:16.975308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:16.975899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:16.987338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4652d61a-108b-4633-9fbb-7cb8cd347860 req-25cd933d-adc6-471e-9376-08b8e57d2826 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:16.987796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4652d61a-108b-4633-9fbb-7cb8cd347860 req-25cd933d-adc6-471e-9376-08b8e57d2826 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:16.999455 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4652d61a-108b-4633-9fbb-7cb8cd347860 req-25cd933d-adc6-471e-9376-08b8e57d2826 service nova] Creating event network-changed:d5895581-e9c3-46e1-a2e0-0f90b5734980 for instance 11b1e944-a222-4291-a323-a93b3348c0db on n-h2-826756-5 Aug 03 04:47:17.005941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4652d61a-108b-4633-9fbb-7cb8cd347860 req-25cd933d-adc6-471e-9376-08b8e57d2826 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331445 Aug 03 04:47:17.007031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1777/3513] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:17.200673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:17.206007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3c4d13eb-2049-4332-8b6f-d9a45eef41de req-706b4ccf-d8a6-487c-a850-c38c2b636c6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7208809e-2315-4bbf-b326-8175c2410c68", "tag": "ad51a34f-6260-479b-91b8-5ff1583f9dd7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:17.210218 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b1ab730-ccd4-49ed-b95f-5b47266832dc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.254677 Aug 03 04:47:17.212545 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1737/3514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:16 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:17.220379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3c4d13eb-2049-4332-8b6f-d9a45eef41de req-706b4ccf-d8a6-487c-a850-c38c2b636c6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.220379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3c4d13eb-2049-4332-8b6f-d9a45eef41de req-706b4ccf-d8a6-487c-a850-c38c2b636c6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.230838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3c4d13eb-2049-4332-8b6f-d9a45eef41de req-706b4ccf-d8a6-487c-a850-c38c2b636c6c service nova] Creating event network-changed:ad51a34f-6260-479b-91b8-5ff1583f9dd7 for instance 7208809e-2315-4bbf-b326-8175c2410c68 on n-h1-826756-5 Aug 03 04:47:17.235927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3c4d13eb-2049-4332-8b6f-d9a45eef41de req-706b4ccf-d8a6-487c-a850-c38c2b636c6c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106125 Aug 03 04:47:17.236866 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1778/3515] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:17.311309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:17.312415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:17.320502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.320958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.321741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.322174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.476234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:17.477261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:17.483804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.484309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.485315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.485756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.606035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:17.609363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:17.614273 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48e0b7cc-0551-4973-85e7-328104ebd2bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1218 microversion: 2.1 time: 0.142881 Aug 03 04:47:17.619624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1779/3516] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:17 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:17.630850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b86b11e-266c-488c-9451-c1781595ce48 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.323544 Aug 03 04:47:17.631492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1738/3517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:17 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:17.768708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:17.769721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:17.778780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.779450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:17.780400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:17.781035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:18.117045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:18.125802 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed615b45-ff1b-4091-8a3d-17cdc5e200bd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1665 microversion: 2.1 time: 0.361153 Aug 03 04:47:18.126381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1780/3518] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:17 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:18.240453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:18.241753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:18.249207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:18.249668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:18.253362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:18.253362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:18.639262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:18.640151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:18.647618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:18.650489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:18.651584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:18.653149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:18.654722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:19.038352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:19.046445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82227eaf-cb64-4c96-b465-e3aeb5df0390 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1218 microversion: 2.1 time: 0.412599 Aug 03 04:47:19.057752 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1781/3519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:18 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1218 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:19.068598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:19.069932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:19.076472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:19.076933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:19.077866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:19.078500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:19.105299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:19.113016 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-691190b3-421b-4373-a2c2-73ca5519ff69 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.876600 Aug 03 04:47:19.113608 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1739/3520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:18 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:19.150655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:19.151616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:19.163354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:19.172091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:19.172091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:19.172091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:19.540768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:19.549618 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3beb2b30-9b6e-4641-905a-1977dd5d1fa7 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.490366 Aug 03 04:47:19.550205 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1782/3521] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:19 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:19.583665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:19.591538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3cd5db8b-33b4-4449-b358-2e8194b93856 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1665 microversion: 2.1 time: 0.446519 Aug 03 04:47:19.592204 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1740/3522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:19 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1665 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:20.073499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:20.074893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:20.086710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.087301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.088200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.088866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.142858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:20.146151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:20.162984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.183731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.184797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.185252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.257993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:20.268539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a44b055d-d3bf-4344-85d6-3206661d480b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1274 microversion: 2.1 time: 0.200724 Aug 03 04:47:20.269141 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1783/3523] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:20 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:20.382434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f521efd2-e09b-4121-b729-ce7ecf1fed7a req-a37f4898-0c1a-403e-add0-d59fee61d9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f799db-d065-4d8e-9f0b-66d16ecc35a7", "name": "network-vif-deleted", "tag": "605b601d-055b-4fb3-b1cb-151897d7661f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:20.411746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f521efd2-e09b-4121-b729-ce7ecf1fed7a req-a37f4898-0c1a-403e-add0-d59fee61d9f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.412194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f521efd2-e09b-4121-b729-ce7ecf1fed7a req-a37f4898-0c1a-403e-add0-d59fee61d9f4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.469725 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f521efd2-e09b-4121-b729-ce7ecf1fed7a req-a37f4898-0c1a-403e-add0-d59fee61d9f4 service nova] Creating event network-vif-deleted:605b601d-055b-4fb3-b1cb-151897d7661f for instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 on n-h1-826756-5 Aug 03 04:47:20.491472 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f521efd2-e09b-4121-b729-ce7ecf1fed7a req-a37f4898-0c1a-403e-add0-d59fee61d9f4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107756 Aug 03 04:47:20.491472 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1784/3524] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:20.523951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-192467738", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "737954b7-73c1-40c1-8374-956026effeb0"}], "security_groups": [{"name": "tempest-securitygroup--979894646"}], "key_name": "tempest-keypair-1162757894", "user_data": "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:20.567821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:20.584470 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f961e176-cd03-4b01-bae2-a75a92e6c96c tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.452822 Aug 03 04:47:20.586208 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1741/3525] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:20 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:20.595524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:20.596495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:20.605759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:20.612493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.613068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.614073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.614591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.715275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] validate_networks() for [('737954b7-73c1-40c1-8374-956026effeb0', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:20.871447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:20.882780 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27d7c4f9-7c0e-485c-8e2f-2518de8c18b0 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.295167 Aug 03 04:47:20.884110 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1742/3526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:20 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:20.903382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:20.904307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:20.917731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.924431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:20.929311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:20.930570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.095700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:21.106513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efda97d2-7524-4761-8d18-1cd27f6198cd tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1598 microversion: 2.1 time: 0.221098 Aug 03 04:47:21.107106 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1743/3527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:20 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1598 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:21.114122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:21.121443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:21.130748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.130748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.130748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.130748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.180618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:21.348028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:21.348900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:21.349504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:21.349929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:21.351010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:21.361231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.361684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.362490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.362956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.384210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for project 93a21344add4431685ff685ac8aa43a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:21.392132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Getting quotas for user 19c105bc7f2d4207bb168dfe3c19052f and project 93a21344add4431685ff685ac8aa43a4. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:21.408163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:21.410797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:21.577128 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94cdcbea-d15b-4f29-834a-1c67ace87c8c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.061694 Aug 03 04:47:21.586129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1785/3528] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:47:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 04:47:21.594996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:21.612082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:21.632817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.633921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.634973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.635688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.669773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-14c1ddfd-e317-4f93-8061-a38e38767473 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 204 len: 0 microversion: 2.1 time: 0.561125 Aug 03 04:47:21.671209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1744/3529] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:21 2022] DELETE /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:47:21.684318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:21.689611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:21.791221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:21.808354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:21.817808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:21.820217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e3598b02-5cfd-4660-ad20-9ae1c2e2c6c7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1281 microversion: 2.20 time: 0.143246 Aug 03 04:47:21.820906 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1745/3530] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:21 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:21.866879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:21.866879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:21.877923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.878968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.879969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:21.880639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:21.926413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:22.062171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.073529 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbeadd30-38ef-43a1-8317-1bd04436182e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.485782 Aug 03 04:47:22.091796 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1786/3531] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:21 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:22.097832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:22.099460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:22.109202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.110267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.112638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.113429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.280632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.292674 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ebad13b-4764-4dab-a3eb-c86c63092430 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.439131 Aug 03 04:47:22.308523 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1746/3532] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:21 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:22.315424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:22.316348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:22.324986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.325701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.326913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.327664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.427089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.443132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80320441-27de-4dd6-8e82-d23b7676ca8b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1554 microversion: 2.1 time: 0.348972 Aug 03 04:47:22.445285 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1787/3533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:22 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1554 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:22.452951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:22.453857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:22.464204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.464935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.465730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.466175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.499310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.500026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.500743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lazy-loading 'fault' on Instance uuid 58f799db-d065-4d8e-9f0b-66d16ecc35a7 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:22.664382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c388031750b407e8ed2bc15c5ff0bd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4790a12623e141cb95544c8f2d9a8d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.684608 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-934da4a8-7dbc-4985-a447-7ff70b37bcfa tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 200 len: 1316 microversion: 2.1 time: 0.237656 Aug 03 04:47:22.686203 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1788/3534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:22 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:22.704120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.718617 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f579ca53-3854-4f43-90fc-e104c452ee58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.407422 Aug 03 04:47:22.719586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1747/3535] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:22 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:22.845888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:22.846505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:22.924001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.938760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.941951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:22.946418 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-699d9eb9-1baa-436a-b9ea-f0dc0a0b9a79 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1281 microversion: 2.20 time: 0.104555 Aug 03 04:47:22.954659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e83e8f46-bf6a-45c1-aa39-5dddce4e32fc req-a1dc4ae7-f884-4651-8a3f-a8df79d379a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1", "tag": "05afef8c-d78a-4971-b296-05e6a67fd88b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:22.958600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1789/3536] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:22 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:22.966216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e83e8f46-bf6a-45c1-aa39-5dddce4e32fc req-a1dc4ae7-f884-4651-8a3f-a8df79d379a9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:22.966714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e83e8f46-bf6a-45c1-aa39-5dddce4e32fc req-a1dc4ae7-f884-4651-8a3f-a8df79d379a9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:22.979637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e83e8f46-bf6a-45c1-aa39-5dddce4e32fc req-a1dc4ae7-f884-4651-8a3f-a8df79d379a9 service nova] Creating event network-changed:05afef8c-d78a-4971-b296-05e6a67fd88b for instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 on n-h2-826756-5 Aug 03 04:47:22.984686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e83e8f46-bf6a-45c1-aa39-5dddce4e32fc req-a1dc4ae7-f884-4651-8a3f-a8df79d379a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035284 Aug 03 04:47:22.985677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1748/3537] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:23.103452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:23.104039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:23.121574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.121953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:23.122757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.123213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:23.128810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:23.326430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:23.332661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:23.350444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.352681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:23.353830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.354512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:23.386149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:23.397615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-245b6462-76b6-45c2-9556-2cd267baace7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.297185 Aug 03 04:47:23.400651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1790/3538] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:23 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:23.466928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:23.467561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:23.473846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.474307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:23.475703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:23.480357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.271202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.279355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.282809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66e6c385-5509-4d34-b0da-e4fab9a012bf tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.968504 Aug 03 04:47:24.292683 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1749/3539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:23 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:24.294129 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36b87a3f-98b2-4af8-bc1f-5e46f2d88c8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1554 microversion: 2.1 time: 0.831393 Aug 03 04:47:24.295285 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1791/3540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:23 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1554 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:24.300098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:24.300932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:24.307379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.307685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:24.307836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.308637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.309080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.319489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] [instance: 58f799db-d065-4d8e-9f0b-66d16ecc35a7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:24.327649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.328171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.331969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.331969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.346186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] HTTP exception thrown: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Request method failure captured: Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 HTTP/1.1 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2JXcTrRCUAN6sP2Z7ELlFWo-blJlgWXJPB_2LE_hpLJcOar4j3vp_o3iM3yRIYKUp--bnnKIbE_b14zT6hfcOzXo3A7PclYqc1_pmBs4b9KEzstIKA-c3NtEuGa2RH2vPTS4juR33qsfV0RJvYp94DT0_bu8_i0_8m6vHaGZ1uwHw Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 4790a12623e141cb95544c8f2d9a8d3b Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestFqdnHostnames-748760292 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4790a12623e141cb95544c8f2d9a8d3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4790a12623e141cb95544c8f2d9a8d3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4790a12623e141cb95544c8f2d9a8d3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4790a12623e141cb95544c8f2d9a8d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestFqdnHostnames-748760292 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 4790a12623e141cb95544c8f2d9a8d3b Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-748760292 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestFqdnHostnames-748760292-project Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 7c388031750b407e8ed2bc15c5ff0bd3 Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestFqdnHostnames-748760292-project Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '58f799db-d065-4d8e-9f0b-66d16ecc35a7'} Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:24.348296 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. Aug 03 04:47:24.353162 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:24.356754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Returning 404 to user: Instance 58f799db-d065-4d8e-9f0b-66d16ecc35a7 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:24.357967 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bca9016d-9b1f-459f-a604-e011dbaa6164 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7" status: 404 len: 111 microversion: 2.1 time: 0.063660 Aug 03 04:47:24.363134 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1750/3541] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:24 2022] GET /compute/v2.1/servers/58f799db-d065-4d8e-9f0b-66d16ecc35a7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:24.374777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:24.374777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:24.376733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.377434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.378425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.379314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.527187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.541299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.543190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.544868 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9bbcacc1-11fa-4699-aea1-aed0b3c88510 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1333 microversion: 2.20 time: 0.180584 Aug 03 04:47:24.545921 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1751/3542] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:24 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:24.567251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ccaf42d-6659-4228-bd94-75b9b8740ea7 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] Calling method '.version_select at 0x7fdd47e464c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:24.701216 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9ccaf42d-6659-4228-bd94-75b9b8740ea7 tempest-ServersTestFqdnHostnames-748760292 tempest-ServersTestFqdnHostnames-748760292-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749063646" status: 202 len: 0 microversion: 2.1 time: 0.153255 Aug 03 04:47:24.702207 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1752/3543] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1749063646 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:24.706792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:24.707402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:24.715270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:24.718435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.719121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.720708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:24.721429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:24.741869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3209c4d0-40c6-4792-ae55-c8300a693562 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.442752 Aug 03 04:47:24.749335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1792/3544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:24 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:25.153281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.167853 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e670a408-a179-4c53-8fb8-4824909e291c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.464771 Aug 03 04:47:25.169038 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1753/3545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:24 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:25.285356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d65b79b0-3f11-43b1-b0a6-e6b3941d8e9a req-a8db1d25-3cfc-4460-8111-258579d926aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b1e944-a222-4291-a323-a93b3348c0db", "name": "network-vif-plugged", "status": "completed", "tag": "d5895581-e9c3-46e1-a2e0-0f90b5734980"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:25.300144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d65b79b0-3f11-43b1-b0a6-e6b3941d8e9a req-a8db1d25-3cfc-4460-8111-258579d926aa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.305438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d65b79b0-3f11-43b1-b0a6-e6b3941d8e9a req-a8db1d25-3cfc-4460-8111-258579d926aa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.322061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:25.323680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:25.335989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.336786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.337982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.338205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d65b79b0-3f11-43b1-b0a6-e6b3941d8e9a req-a8db1d25-3cfc-4460-8111-258579d926aa service nova] Creating event network-vif-plugged:d5895581-e9c3-46e1-a2e0-0f90b5734980 for instance 11b1e944-a222-4291-a323-a93b3348c0db on n-h2-826756-5 Aug 03 04:47:25.338977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.356678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d65b79b0-3f11-43b1-b0a6-e6b3941d8e9a req-a8db1d25-3cfc-4460-8111-258579d926aa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062705 Aug 03 04:47:25.357677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1793/3546] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:25.364015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:25.365016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:25.368080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:25.382576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.383326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.384298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.384905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.560102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.570899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdaa8bd0-f5e6-4a18-9656-ec75ea31782f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1512 microversion: 2.1 time: 0.211940 Aug 03 04:47:25.585436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1794/3547] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:25 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:25.599761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8a44169d-9201-4489-9729-5a464421adae req-bc191622-6a44-4817-8a21-bec0f6c041d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052aabd9-41dd-49ad-a810-45f88f53dc96", "name": "network-vif-deleted", "tag": "2128aec4-7299-4107-93b9-1ffa5c2c6186"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:25.609893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8a44169d-9201-4489-9729-5a464421adae req-bc191622-6a44-4817-8a21-bec0f6c041d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.610600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8a44169d-9201-4489-9729-5a464421adae req-bc191622-6a44-4817-8a21-bec0f6c041d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.623779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8a44169d-9201-4489-9729-5a464421adae req-bc191622-6a44-4817-8a21-bec0f6c041d5 service nova] Creating event network-vif-deleted:2128aec4-7299-4107-93b9-1ffa5c2c6186 for instance 052aabd9-41dd-49ad-a810-45f88f53dc96 on n-h1-826756-5 Aug 03 04:47:25.629079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8a44169d-9201-4489-9729-5a464421adae req-bc191622-6a44-4817-8a21-bec0f6c041d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042073 Aug 03 04:47:25.630290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1795/3548] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:25.642753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:25.642753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:25.645466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.646114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.647403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.648022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.650498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:25.674843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.685412 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9ed64e1-3345-4dab-a645-2d2f031f6f84 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.370249 Aug 03 04:47:25.697625 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1754/3549] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:25 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:25.776633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:25.777511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:25.785419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.785944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.786651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.788645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:25.789353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:25.804337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.805883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:25.816557 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a5b699f-0580-48e5-bb31-2f071cbb93a8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1339 microversion: 2.20 time: 0.181534 Aug 03 04:47:25.817215 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1796/3550] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:25 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:26.108825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:26.120812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-383f099a-7a9e-459e-bbe2-015c0d900561 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 0.352045 Aug 03 04:47:26.122772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1755/3551] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:25 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:26.197453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:26.197453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:26.205560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.206175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.207107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.207663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.608381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:26.609109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:26.621629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.626560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.627654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.628431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.773092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:26.780051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:26.786617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29305554-9948-4159-953f-826887720cfa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.598625 Aug 03 04:47:26.790164 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1797/3552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:26 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:26.792650 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a11aba3-1802-48c2-aaa6-02bddf56da35 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1345 microversion: 2.1 time: 0.189416 Aug 03 04:47:26.805715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:26.809329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:26.809462 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1756/3553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:26 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1345 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:26.819526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.820375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.821477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.822842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.842447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:26.843073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:26.856886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.859768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:26.860723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:26.861170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:27.000916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:27.010427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:27.017403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:27.028992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e78d0ce9-e9b5-45a5-96d4-dc1bac96f1be tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1339 microversion: 2.20 time: 0.190051 Aug 03 04:47:27.030640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1757/3554] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:26 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1339 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:27.147972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:27.150770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:27.162016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:27.169654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:27.170901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:27.171512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:27.670195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:27.679081 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7349731a-015c-45a3-9b75-275ea873a562 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.885270 Aug 03 04:47:27.687724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1798/3555] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:26 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:27.687724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1c30a676-e698-47a4-a3be-565c6329ff00 req-161224e5-a439-4ff4-979b-9d90ec43c0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7208809e-2315-4bbf-b326-8175c2410c68", "name": "network-vif-plugged", "status": "completed", "tag": "ad51a34f-6260-479b-91b8-5ff1583f9dd7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:27.718136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1c30a676-e698-47a4-a3be-565c6329ff00 req-161224e5-a439-4ff4-979b-9d90ec43c0f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:27.718987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1c30a676-e698-47a4-a3be-565c6329ff00 req-161224e5-a439-4ff4-979b-9d90ec43c0f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:27.757358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1c30a676-e698-47a4-a3be-565c6329ff00 req-161224e5-a439-4ff4-979b-9d90ec43c0f7 service nova] Creating event network-vif-plugged:ad51a34f-6260-479b-91b8-5ff1583f9dd7 for instance 7208809e-2315-4bbf-b326-8175c2410c68 on n-h1-826756-5 Aug 03 04:47:27.764636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1c30a676-e698-47a4-a3be-565c6329ff00 req-161224e5-a439-4ff4-979b-9d90ec43c0f7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080456 Aug 03 04:47:27.765482 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1799/3556] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:27.825128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:27.830796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:27.851961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:27.852826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:27.853843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:27.854665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.326410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:28.336903 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f3bc4a7-4545-4e8d-b8cc-55436d0b1433 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1316 microversion: 2.1 time: 1.195212 Aug 03 04:47:28.355811 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1758/3557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:27 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1316 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:28.361305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:28.362252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:28.370702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.371411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.372512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.372953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.577816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:28.589574 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7045a00-588e-44da-8d5a-6868cf0f51d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1345 microversion: 2.1 time: 0.232231 Aug 03 04:47:28.592919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1759/3558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:28 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1345 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:28.603810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:28.608461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:28.621609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.625543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.626449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.627760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.801098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:28.810679 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f930f6cb-8326-42c0-871d-75b58c8c08e5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 1.000922 Aug 03 04:47:28.811836 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1800/3559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:27 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:28.816595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:28.829269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:28.841108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.841574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:28.842372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:28.842817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.574006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.591288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.592367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.597731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2655939-e6cc-4117-ad48-adbc691e3c44 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.998139 Aug 03 04:47:29.598800 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1760/3560] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:28 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:29.608681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:29.609324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:29.628212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.628733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.629548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.630076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.673319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.684788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83a85c58-0d9f-4b06-af8f-96be2e5f64b3 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1316 microversion: 2.1 time: 0.869472 Aug 03 04:47:29.701065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1801/3561] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:28 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1316 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:29.710672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:29.712226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:29.721455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.722144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.723083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.723688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.891118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.904860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:29.908864 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd13db7e-73f2-4358-88f7-a7748cc63cc0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1345 microversion: 2.1 time: 0.205655 Aug 03 04:47:29.909711 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1802/3562] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:29 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:29.917922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-045c50c5-4433-418e-bdd3-d6019d754006 req-6463479c-9981-496b-9387-f954ad11ead2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1", "name": "network-vif-plugged", "status": "completed", "tag": "05afef8c-d78a-4971-b296-05e6a67fd88b"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:29.930282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99a65935-a2db-4af5-a0bf-7102d4f040fe tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1503 microversion: 2.1 time: 0.330352 Aug 03 04:47:29.941485 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1761/3563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:29 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:29.946586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-045c50c5-4433-418e-bdd3-d6019d754006 req-6463479c-9981-496b-9387-f954ad11ead2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.947317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-045c50c5-4433-418e-bdd3-d6019d754006 req-6463479c-9981-496b-9387-f954ad11ead2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.956624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:29.957506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:29.976825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.977465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.981115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:29.981868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:29.987533 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-045c50c5-4433-418e-bdd3-d6019d754006 req-6463479c-9981-496b-9387-f954ad11ead2 service nova] Creating event network-vif-plugged:05afef8c-d78a-4971-b296-05e6a67fd88b for instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 on n-h2-826756-5 Aug 03 04:47:30.011173 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-045c50c5-4433-418e-bdd3-d6019d754006 req-6463479c-9981-496b-9387-f954ad11ead2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092912 Aug 03 04:47:30.011173 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1803/3564] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:30.015569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:30.023330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:30.033881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.036907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:30.041093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.042705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:30.080527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:30.467670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:30.500053 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2b07e55-7723-480c-8785-5b07d5ff63cd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.556902 Aug 03 04:47:30.500710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1762/3565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:29 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:30.549020 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-875bd602-5e11-4813-98ec-597eb36236d8 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "DELETE /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 204 len: 0 microversion: 2.1 time: 0.538551 Aug 03 04:47:30.550829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1804/3566] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:30 2022] DELETE /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:47:30.559841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:30.560572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:30.573136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.576563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:30.577510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.579911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:30.632652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:30.633931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:30.652497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.653114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:30.656243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:30.658584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3dc8cd00-6991-49dc-8869-12f960b4f760 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1509 microversion: 2.1 time: 0.417353 Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1763/3567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:30 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.029785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.030854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.031342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.031342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.031670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.031670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.031670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a04e2bc-48c8-4b4e-a120-3301f539c88b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.395925 Aug 03 04:47:31.031670 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1805/3568] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:30 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:31.031670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b6ce1565-c17a-4ff0-bde7-adea71665484 req-b5c74bec-6be0-44fd-9bef-2eabc4a9d78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:31.034613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b6ce1565-c17a-4ff0-bde7-adea71665484 req-b5c74bec-6be0-44fd-9bef-2eabc4a9d78e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.035073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b6ce1565-c17a-4ff0-bde7-adea71665484 req-b5c74bec-6be0-44fd-9bef-2eabc4a9d78e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.048052 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b6ce1565-c17a-4ff0-bde7-adea71665484 req-b5c74bec-6be0-44fd-9bef-2eabc4a9d78e service nova] Creating event network-changed:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h1-826756-5 Aug 03 04:47:31.055114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b6ce1565-c17a-4ff0-bde7-adea71665484 req-b5c74bec-6be0-44fd-9bef-2eabc4a9d78e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040556 Aug 03 04:47:31.055744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1806/3569] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:31.066322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.067043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.077619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.078143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.078957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.082433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.331671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.358371 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c704c6b-ddf9-45f9-a8d3-f7598f704e6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1345 microversion: 2.1 time: 0.293542 Aug 03 04:47:31.359386 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1807/3570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:31 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1345 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:31.536990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.536990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.539926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:31.545826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.546324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.548592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.549061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.567321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.581441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dfceeeb-ee4a-4b1b-a744-e5d9edc79397 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1504 microversion: 2.1 time: 0.605370 Aug 03 04:47:31.587623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:31.587782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1764/3571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:30 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:31.607226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.607737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.614154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.616224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.616224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.616539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.656876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:31.799747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:31.857605 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6df05b9-8444-45bc-a62a-74532e4bb4f8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.254183 Aug 03 04:47:31.859019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1765/3572] 10.222.0.72 () {58 vars in 1296 bytes} [Wed Aug 3 04:47:31 2022] DELETE /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68/os-server-password => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:47:31.870327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.871473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.878087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.878852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.879938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.881221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.928052 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1ebc202-0cad-40c8-9ded-d3e4fa139ee9 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.057290 Aug 03 04:47:31.933646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1766/3573] 10.222.0.72 () {58 vars in 1293 bytes} [Wed Aug 3 04:47:31 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68/os-server-password => generated 16 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:31.941960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:31.946448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:31.949405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:31.962796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.965115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.969633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:31.970596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:31.992460 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f0a9a60-e891-4970-b5db-0bb5a4bb90ab tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.469564 Aug 03 04:47:32.001476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1808/3574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:31 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:32.030905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:32.043046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:32.043685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:32.058870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.064884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.065966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.066643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.421191 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efeaf512-24d8-40c4-a436-57c29e7785a8 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 204 len: 0 microversion: 2.1 time: 0.480806 Aug 03 04:47:32.421191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1767/3575] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:31 2022] DELETE /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:47:32.424078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:32.424819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:32.431890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.432679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.433948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.434451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.492943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:32.506172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:32.508406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:32.510145 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f248c4ad-12be-408c-bb89-f801f1346c1c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.472207 Aug 03 04:47:32.511040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1809/3576] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:32 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:32.516243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:32.516895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:32.535804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.537062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.537247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:32.537664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:32.930686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:33.008043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.025043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f2ff38f-82c7-4f2e-85a5-d4a86a82b0ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1345 microversion: 2.1 time: 0.509953 Aug 03 04:47:33.025970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1810/3577] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:32 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1345 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:33.030819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:33.031438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:33.046235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.046815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.050081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.050081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.190935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.198785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34cad300-38de-4faa-83e6-f989443adc57 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1509 microversion: 2.1 time: 0.778986 Aug 03 04:47:33.211413 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1768/3578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:32 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1509 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:33.211413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:33.211413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:33.211413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.211874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.212417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.213044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.381619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.391561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-533ad094-6fde-4eb9-a024-a0db016f4fcc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1510 microversion: 2.1 time: 0.364336 Aug 03 04:47:33.392328 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1811/3579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:33 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:33.464831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.472878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6af16e2c-5675-47c9-ac8a-5fb669a762b4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1314 microversion: 2.1 time: 0.272414 Aug 03 04:47:33.477480 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1769/3580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:33 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:33.538385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:33.539050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:33.554243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.557858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.581003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:33.584656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:33.790409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.813159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.813159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:33.816487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c436e32a-b560-4f41-b758-f97bba6e1fbb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.285153 Aug 03 04:47:33.833847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1812/3581] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:33 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:33.861891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2004376775", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "dabe301f-1225-4dd1-9b67-e56ff348be76"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:33.926443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] validate_networks() for [('dabe301f-1225-4dd1-9b67-e56ff348be76', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:34.046659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:34.047835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:34.054767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.061091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.062091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.062700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.125691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.126503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.127146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lazy-loading 'fault' on Instance uuid 052aabd9-41dd-49ad-a810-45f88f53dc96 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:34.231292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:34.261185 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-416ea98e-587a-4871-a2c0-bc8865acedf7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 200 len: 1350 microversion: 2.1 time: 0.217539 Aug 03 04:47:34.272307 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1813/3582] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:34 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 1350 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:34.277212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4d594b48-67d7-447c-ac56-1822c60d97b1 req-c5073f5e-fd71-42c2-aaea-65fdd57b1166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b1e944-a222-4291-a323-a93b3348c0db", "name": "network-vif-deleted", "tag": "d5895581-e9c3-46e1-a2e0-0f90b5734980"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:34.291789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d594b48-67d7-447c-ac56-1822c60d97b1 req-c5073f5e-fd71-42c2-aaea-65fdd57b1166 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.292788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d594b48-67d7-447c-ac56-1822c60d97b1 req-c5073f5e-fd71-42c2-aaea-65fdd57b1166 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.307043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4d594b48-67d7-447c-ac56-1822c60d97b1 req-c5073f5e-fd71-42c2-aaea-65fdd57b1166 service nova] Creating event network-vif-deleted:d5895581-e9c3-46e1-a2e0-0f90b5734980 for instance 11b1e944-a222-4291-a323-a93b3348c0db on n-h2-826756-5 Aug 03 04:47:34.312570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4d594b48-67d7-447c-ac56-1822c60d97b1 req-c5073f5e-fd71-42c2-aaea-65fdd57b1166 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041361 Aug 03 04:47:34.316660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1814/3583] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:34.333326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:34.335796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:34.342751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.344055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.345228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.345922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.452496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:34.481135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:34.482016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:34.482248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad119df1-82aa-40d0-b3a1-4663d1653b9f tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1467 microversion: 2.1 time: 0.164264 Aug 03 04:47:34.482683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:34.482847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1815/3584] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:34 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1467 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:34.483284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:34.484170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:34.498184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.498760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.499681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.500159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:34.500333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.500831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:34.513796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.514437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.515408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.516662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.531556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Getting quotas for project 1ddf87ba4bf444aea56c784114bfeda0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:34.539360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Getting quotas for user 4c6d243898f449928f73450d5066b73a and project 1ddf87ba4bf444aea56c784114bfeda0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:34.553704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Going to run 3 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:34.556061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:34.816135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:34.821138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=c2a93714-1069-4444-b6ee-1cd8daabec92,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:34.826282 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c837373-7bad-4f8a-b8e0-8e10a1dfd437 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1510 microversion: 2.1 time: 0.342372 Aug 03 04:47:34.852360 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1816/3585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:34 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:34.864044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:34.865236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:34.878156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.881019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:34.882871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:34.883610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.007918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:35.113258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.125115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1c0d784-4d0d-460a-b4b0-d7eb3bd61ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1500 microversion: 2.1 time: 0.271388 Aug 03 04:47:35.125712 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1817/3586] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:34 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1500 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:35.130802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.131424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.145205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.150890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.150890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.150890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.218171 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73662a23-f6b8-4fad-aaf3-77744af085fc tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.579476 Aug 03 04:47:35.219141 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1770/3587] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:47:35.224552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:35.227005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.234996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.235677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.236715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.237314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.284167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-517745fb-1d69-47ec-871e-211b964ce954 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.063288 Aug 03 04:47:35.286176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1771/3588] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:35 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:35.293331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.299999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.301241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:47:35.391050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.391516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.392894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.393333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.468356 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e350e3d6-3702-4ca6-82a3-19ff4a4ef6d0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.179754 Aug 03 04:47:35.469050 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1772/3589] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers => generated 1018 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:35.478728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.479653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.487681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:35.505132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.510015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.511291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.513062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.513858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.519052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.526413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.527601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfe17148-a428-4ad6-8c9b-7c963b1d27b4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.400683 Aug 03 04:47:35.528190 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1818/3590] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:35.537722 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.551034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-31e39ed3-7383-475a-925c-370093f132f9 req-d27c0629-1233-4719-9530-609ad142c096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7208809e-2315-4bbf-b326-8175c2410c68", "name": "network-vif-deleted", "tag": "ad51a34f-6260-479b-91b8-5ff1583f9dd7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 HTTP/1.1 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '052aabd9-41dd-49ad-a810-45f88f53dc96'} Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:35.559531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.571177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:35.576519 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6766a512-57f1-48a7-beb7-2769b7d0abbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 404 len: 111 microversion: 2.1 time: 0.102866 Aug 03 04:47:35.578564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-31e39ed3-7383-475a-925c-370093f132f9 req-d27c0629-1233-4719-9530-609ad142c096 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.579027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-31e39ed3-7383-475a-925c-370093f132f9 req-d27c0629-1233-4719-9530-609ad142c096 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.585711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1773/3591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:35.591373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a5f721f-ad97-4708-830a-11f342f80840 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.592086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5a5f721f-ad97-4708-830a-11f342f80840 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.614882 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-31e39ed3-7383-475a-925c-370093f132f9 req-d27c0629-1233-4719-9530-609ad142c096 service nova] Creating event network-vif-deleted:ad51a34f-6260-479b-91b8-5ff1583f9dd7 for instance 7208809e-2315-4bbf-b326-8175c2410c68 on n-h1-826756-5 Aug 03 04:47:35.623578 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-31e39ed3-7383-475a-925c-370093f132f9 req-d27c0629-1233-4719-9530-609ad142c096 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088888 Aug 03 04:47:35.635167 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1819/3592] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:35.654759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.655920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.678970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.680734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.681536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.681979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.726832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5a5f721f-ad97-4708-830a-11f342f80840 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.747812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a5f721f-ad97-4708-830a-11f342f80840 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1223 microversion: 2.1 time: 0.160698 Aug 03 04:47:35.763502 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1774/3593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1223 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:35.774854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.774854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.775549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lazy-loading 'fault' on Instance uuid 11b1e944-a222-4291-a323-a93b3348c0db {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:35.838681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.841114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.851165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.851636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.852465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.856723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.871115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b912a198efa4647be186db7b9e04a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ba953c1d44403cbaadd3513e4cbabb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:35.876458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96/os-volume_attachments HTTP/1.1 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '052aabd9-41dd-49ad-a810-45f88f53dc96'} Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:35.879616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:47:35.890909 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:35.891738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f7f2d4c-339d-425c-b27b-cd6434cc4d03 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 200 len: 1306 microversion: 2.1 time: 0.251132 Aug 03 04:47:35.891829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:35.891829 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2439ba2c-4ee9-4ebe-93e3-9611ca9bb3c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054329 Aug 03 04:47:35.891829 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1775/3594] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:47:35.893146 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1820/3595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 1306 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:35.898455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:35.899379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:35.907763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.908542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.909761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.910768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.967325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:35.968078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:35.968732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lazy-loading 'fault' on Instance uuid 7208809e-2315-4bbf-b326-8175c2410c68 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:36.043581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee731667f2944269001bff55f3b9cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e3eb4bb3e724625a61fdf30987f8532', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:36.052031 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf252bb9-b26a-4f9d-9eff-a09909f26cfc tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 200 len: 1306 microversion: 2.1 time: 0.161124 Aug 03 04:47:36.053710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1776/3596] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:35 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:36.113718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1048987146", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:36.177112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:36.298589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:36.301581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:36.328807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.329758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.330880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.331637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.379141 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-06e4c538-261e-4afe-b5e1-ba62a7d0c2ea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.085477 Aug 03 04:47:36.383527 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1777/3597] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:36 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:47:36.556577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:36.557212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:36.572586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.572586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.578895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.579545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.791164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:36.791612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:36.792088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:36.792531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:36.793278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:36.812591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.813067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.813903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:36.814359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:36.838829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:36.847563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:36.853904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:36.864762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:36.865554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:36.867105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:36.868596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f026325-8188-4b5e-a2df-16647c896b3e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.317250 Aug 03 04:47:36.868758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:36.884973 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1778/3598] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:36 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:47:36.895901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ef05623-dcea-40bb-a724-4a6cfb1e923a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:36.895901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ef05623-dcea-40bb-a724-4a6cfb1e923a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:36.989735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ef05623-dcea-40bb-a724-4a6cfb1e923a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:36.999904 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ef05623-dcea-40bb-a724-4a6cfb1e923a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1223 microversion: 2.1 time: 0.113609 Aug 03 04:47:37.000431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1779/3599] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:36 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:37.026898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.027855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.036220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.037529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.038423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.038877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.054612 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db HTTP/1.1 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '11b1e944-a222-4291-a323-a93b3348c0db'} Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.056467 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5e76614-7366-442d-bc9b-5da2037ebd2d tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 404 len: 111 microversion: 2.1 time: 0.042964 Aug 03 04:47:37.061408 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1780/3600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:37 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:37.067587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1125281526", "metadata": {"image_type": "test"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:37.070656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.077305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.077895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.080084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.080084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.095060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db/action HTTP/1.1 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 112 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1125281526", "metadata": {"image_type": "test"}}} Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '11b1e944-a222-4291-a323-a93b3348c0db', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1125281526', 'metadata': {'image_type': 'test'}}}} Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 04:47:37.096749 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ba3c0b4-f047-4516-9c53-a18d246de262 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "POST /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db/action" status: 404 len: 111 microversion: 2.1 time: 0.035049 Aug 03 04:47:37.101976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1781/3601] 10.222.0.72 () {60 vars in 1279 bytes} [Wed Aug 3 04:47:37 2022] POST /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:47:37.110024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.110653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] [instance: 7208809e-2315-4bbf-b326-8175c2410c68] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.120454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.120850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.121649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.122096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.139805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] HTTP exception thrown: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Request method failure captured: Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 HTTP/1.1 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3J9pf4HgZ61JvuJOOWgyMCJ_2T9lfSnAwTC_R-vGIR245cKloamperMYfyE9Ko7crh2iscXPryXVqgv5f3E9oBCuXATzopJLieIoEYjzTJ4kSDyWHg4IbG2kiNbNmrNsDLxCxRlLGexuJ6dyn_oEpCEDtFGHpOe2Ae9STFEHJClsE Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8e3eb4bb3e724625a61fdf30987f8532 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerPasswordTestJSON-993562419 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e3eb4bb3e724625a61fdf30987f8532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8e3eb4bb3e724625a61fdf30987f8532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8e3eb4bb3e724625a61fdf30987f8532"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8e3eb4bb3e724625a61fdf30987f8532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerPasswordTestJSON-993562419 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8e3eb4bb3e724625a61fdf30987f8532 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerPasswordTestJSON-993562419 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerPasswordTestJSON-993562419-project Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: aee731667f2944269001bff55f3b9cb4 Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerPasswordTestJSON-993562419-project Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '7208809e-2315-4bbf-b326-8175c2410c68'} Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.141405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] Returning 404 to user: Instance 7208809e-2315-4bbf-b326-8175c2410c68 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4016390-2a6d-4177-8501-2a114c075961 tempest-ServerPasswordTestJSON-993562419 tempest-ServerPasswordTestJSON-993562419-project] 10.222.0.72 "GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68" status: 404 len: 111 microversion: 2.1 time: 0.042406 Aug 03 04:47:37.148223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1782/3602] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:37 2022] GET /compute/v2.1/servers/7208809e-2315-4bbf-b326-8175c2410c68 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:37.149261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1727600456", "metadata": {"image_type": "test"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:37.152057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Failed to fetch instance by id tempest-invalid-119768568 {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:47:37.152614 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance tempest-invalid-119768568 could not be found. Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/tempest-invalid-119768568/action HTTP/1.1 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 112 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1727600456", "metadata": {"image_type": "test"}}} Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance tempest-invalid-119768568 could not be found. Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'tempest-invalid-119768568', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1727600456', 'metadata': {'image_type': 'test'}}}} Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-119768568 could not be found. Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.154297 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-119768568 could not be found. Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-119768568 could not be found. Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance tempest-invalid-119768568 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15cc11a4-0113-4a9e-bad0-061d75ab6178 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "POST /compute/v2.1/servers/tempest-invalid-119768568/action" status: 404 len: 100 microversion: 2.1 time: 0.011645 Aug 03 04:47:37.158902 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1783/3603] 10.222.0.72 () {60 vars in 1246 bytes} [Wed Aug 3 04:47:37 2022] POST /compute/v2.1/servers/tempest-invalid-119768568/action => generated 100 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:37.171032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1471471807"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:37.173398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:47:37.173920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 57 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-test-snap-1471471807"}} Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1471471807'}}} Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.175525 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5dd2b66e-0a4c-44ef-9177-40de863c8e37 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.012257 Aug 03 04:47:37.180455 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1784/3604] 10.222.0.72 () {60 vars in 1275 bytes} [Wed Aug 3 04:47:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:47:37.197513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-764929701"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:37.205907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:47:37.206474 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.211220 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e955133-04e2-406a-8a5c-3df116c1e2ae tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102660 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 56 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: {"createImage": {"name": "tempest-test-snap-764929701"}} Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-764929701'}}} Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.217651 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4543b4b-32cd-4e95-b511-9f5b99677255 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.034189 Aug 03 04:47:37.221895 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1785/3606] 10.222.0.72 () {60 vars in 1281 bytes} [Wed Aug 3 04:47:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:47:37.223963 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1821/3606] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:47:37.229752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7884b9ab-ee48-4f05-b708-9b946097c426 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.230489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7884b9ab-ee48-4f05-b708-9b946097c426 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.230934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.231444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.239485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.240242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.241090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.241592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.256668 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db HTTP/1.1 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '11b1e944-a222-4291-a323-a93b3348c0db'} Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.258667 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.263555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.268441 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb6217f3-cd15-4bc8-bff6-fae48ab2da58 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "DELETE /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 404 len: 111 microversion: 2.1 time: 0.037621 Aug 03 04:47:37.268441 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1822/3607] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:37 2022] DELETE /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:47:37.281144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.281777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] [instance: 11b1e944-a222-4291-a323-a93b3348c0db] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.292283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.292758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.294457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.295618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.301950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7884b9ab-ee48-4f05-b708-9b946097c426 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:37.316245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7884b9ab-ee48-4f05-b708-9b946097c426 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0" status: 200 len: 1215 microversion: 2.1 time: 0.095212 Aug 03 04:47:37.317239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1786/3608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:37 2022] GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:37.337052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.337675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.338289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] HTTP exception thrown: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Request method failure captured: Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db HTTP/1.1 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f3Jtg7MmnxT-7DVBv4guiGfpvONBaf5RBy8lUxCAMSXBP4NsiLPxS52IBa_O0lm1DzZKL7B-W3NCVHq9pqFWgJIKkBruqCKe0Exxh_H1t_73KHT9yH0rpeL4Z4PIH1dFWq1IC7gRJOapIDAM3kgMhZ2C7lnrPREgxCs_VV5j-wieNU Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/92ba953c1d44403cbaadd3513e4cbabb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 92ba953c1d44403cbaadd3513e4cbabb Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1194266455 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b912a198efa4647be186db7b9e04a43 Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ImagesNegativeTestJSON-1194266455-project Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '11b1e944-a222-4291-a323-a93b3348c0db'} Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:37.341465 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. Aug 03 04:47:37.346518 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:37.349783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] Returning 404 to user: Instance 11b1e944-a222-4291-a323-a93b3348c0db could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:37.351927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c31197f6-7262-417c-a21a-b680af8fc736 tempest-ImagesNegativeTestJSON-1194266455 tempest-ImagesNegativeTestJSON-1194266455-project] 10.222.0.72 "GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db" status: 404 len: 111 microversion: 2.1 time: 0.075856 Aug 03 04:47:37.360433 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1823/3609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:37 2022] GET /compute/v2.1/servers/11b1e944-a222-4291-a323-a93b3348c0db => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:37.383303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:47:37.391699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:37.394068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.403112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.404037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.405812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.406431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.492792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5f61204-380e-4c9f-a356-2e37974e15e1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.104627 Aug 03 04:47:37.493720 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1824/3610] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:37 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:37.899438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:37.901538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:37.931245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.931705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:37.937834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:37.938299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:38.243229 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.scheduler.client.report [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Deleted allocations for instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 Aug 03 04:47:38.249517 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.compute.api [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Instance Mapping does not exist while attempting local delete cleanup. Aug 03 04:47:38.250454 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84318962-ddd2-4852-bf4c-2321cd8cfb4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0" status: 204 len: 0 microversion: 2.1 time: 0.918472 Aug 03 04:47:38.252085 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1787/3611] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:47:37 2022] DELETE /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:47:38.281439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:38.282986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d10ebc5b-f1f9-4c6c-9b7a-b34b1ac80deb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:38.284003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d10ebc5b-f1f9-4c6c-9b7a-b34b1ac80deb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:38.293783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:38.298924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:38.302711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-778bc862-784d-45f3-ae28-6ba46ee311de tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.408224 Aug 03 04:47:38.303822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1825/3612] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:37 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:47:38.321392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:38.322283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:38.331642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 HTTP/1.1 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'ddff9eeb-e236-44a8-904a-d96a4275e1c0'} Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:38.335720 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ceb2156-1620-4b5c-abd4-e3f8cb7ea41b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0" status: 404 len: 111 microversion: 2.1 time: 0.032309 Aug 03 04:47:38.341494 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1826/3613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:38 2022] GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:47:38.391576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d10ebc5b-f1f9-4c6c-9b7a-b34b1ac80deb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:38.404541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d10ebc5b-f1f9-4c6c-9b7a-b34b1ac80deb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1223 microversion: 2.1 time: 0.148719 Aug 03 04:47:38.405802 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1788/3614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:38 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:38.435522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-404449703", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:38.505758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:38.507018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:38.509316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:38.517593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:38.518141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:38.519132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:38.519578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:38.563791 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e2e9fac-e29c-4f14-9c32-93d51ab384c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.062536 Aug 03 04:47:38.564849 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1789/3615] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:38 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:47:39.220677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:39.256689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:39.259068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:39.259887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:39.260763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:39.290295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.292797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.302369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.302369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.329539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:39.335752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:39.350796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.351555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.352566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.354780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.363003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:39.387206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:39.414950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:39.423196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:39.437096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:39.651647 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ecffcc0f-42da-4bbe-83db-570bb6d8b53a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220888 Aug 03 04:47:39.652339 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1827/3616] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:47:39.663910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:39.664869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:39.689158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.691545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.693523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.694166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.787478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:39.796082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:39.802997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:39.806696 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c60146e-449b-49c6-b93f-7a9b74d49f13 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.484215 Aug 03 04:47:39.807282 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1790/3617] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:39 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:39.814785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:39.817164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:39.844991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.845455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.846274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:39.846894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:39.916939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:39.959713 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d184c412-b373-4252-bcd5-65fbb06b91a7 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1227 microversion: 2.1 time: 0.297833 Aug 03 04:47:39.965669 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1828/3618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:39 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1227 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:39.973805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88948b2d-f959-43f9-86b2-8332d89c4d19 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:39.974969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88948b2d-f959-43f9-86b2-8332d89c4d19 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:40.075754 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef565fb7-1868-4d23-8d1c-5608ec6c2dee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.262859 Aug 03 04:47:40.078038 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1791/3619] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:39 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:40.089945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88948b2d-f959-43f9-86b2-8332d89c4d19 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:40.094109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-25013c17-7680-4273-a6d0-9a48c451e143 req-1f2caafe-9db6-4f32-920f-36b98388cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-plugged", "status": "completed", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:40.098511 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88948b2d-f959-43f9-86b2-8332d89c4d19 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1214 microversion: 2.1 time: 0.131833 Aug 03 04:47:40.102869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1829/3620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:39 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:40.144415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-25013c17-7680-4273-a6d0-9a48c451e143 req-1f2caafe-9db6-4f32-920f-36b98388cc26 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:40.148075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-25013c17-7680-4273-a6d0-9a48c451e143 req-1f2caafe-9db6-4f32-920f-36b98388cc26 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:40.185849 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-25013c17-7680-4273-a6d0-9a48c451e143 req-1f2caafe-9db6-4f32-920f-36b98388cc26 service nova] Creating event network-vif-plugged:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h1-826756-5 Aug 03 04:47:40.201900 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-25013c17-7680-4273-a6d0-9a48c451e143 req-1f2caafe-9db6-4f32-920f-36b98388cc26 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120040 Aug 03 04:47:40.203047 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1792/3621] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:40.839079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:40.841289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:40.863416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:40.863416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:40.864238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:40.864812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:40.992287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:40.993022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:41.018089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.018821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.021507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.021507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.481648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:41.488216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:41.494017 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9317688d-05ea-4bcc-9489-b2d876e31a36 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1275 microversion: 2.1 time: 0.507258 Aug 03 04:47:41.499231 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1793/3622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:40 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1275 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:41.513140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:41.515694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:41.525953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.528859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.529931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.532828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.635858 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-941ec952-ce23-46ae-858f-24f99c7e11bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.133651 Aug 03 04:47:41.635858 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1794/3623] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:41 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:41.650040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:41.651178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:41.661199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.662901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.664126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:41.664874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:41.686831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:41.691193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:41.710274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:41.715660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:41.722845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d979591-9382-43f8-b734-359c2aba1930 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.888782 Aug 03 04:47:41.724832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1830/3624] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:40 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:41.811788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:41.825573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70a3e67d-7c0b-44b3-89e5-8838e6b3fa02 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1210 microversion: 2.1 time: 0.187964 Aug 03 04:47:41.827037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1795/3625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:41 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:42.528537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:42.529172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:42.544541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.545006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.545804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.546249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.646915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:42.649206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:42.666010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.666480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.667357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.667815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.757666 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-440def36-954e-4f07-b946-28ddc6cb4eb6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.115279 Aug 03 04:47:42.758555 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1796/3626] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:42 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:47:42.764712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:42.765421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:42.773661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.774688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.775665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.776509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.846343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:42.858788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05461e05-0ae9-41ad-85d7-d423b03ed460 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1281 microversion: 2.1 time: 0.335660 Aug 03 04:47:42.860043 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1831/3627] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:42 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:42.867328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:42.868599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:42.877065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.878027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:42.879158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:42.879827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:43.047434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:43.060383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e43e27f8-32d6-4bc7-954f-7c5232060d76 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1266 microversion: 2.1 time: 0.198591 Aug 03 04:47:43.065355 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1832/3628] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:42 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:43.179663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:43.200135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:43.202387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:43.207014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50209667-ba07-47df-8a6e-59f855fb4097 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1406 microversion: 2.20 time: 0.446177 Aug 03 04:47:43.223716 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1797/3629] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:42 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:43.770150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:43.773361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:43.797141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:43.798420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:43.799475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:43.800231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:43.873143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a5cac85-7705-48ae-9ca3-fcf90c1db79c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.106607 Aug 03 04:47:43.874716 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1833/3630] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:43 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:43.883555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:43.884830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:43.898557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:43.899031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:43.899838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:43.900374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.044496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:44.059112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d9e4407-78f2-4829-9b03-3f5042b2d332 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1281 microversion: 2.1 time: 0.182320 Aug 03 04:47:44.060144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1798/3631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:43 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:44.096365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:44.097911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:44.138574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.139093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.140004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.140513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.231780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:44.232500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:44.243829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.244309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.245108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.245559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.398903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:44.414691 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d56ecbcc-0549-4abb-ae90-1970003a1051 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1272 microversion: 2.1 time: 0.327592 Aug 03 04:47:44.431263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1834/3632] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:44 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1272 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:44.903481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:44.903481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:44.922736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:44.932793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.933394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.933603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:44.935036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.935495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:44.935635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.936781 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b613d7b6-4293-422b-b0b6-8e8173152e56 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1598 microversion: 2.20 time: 0.709314 Aug 03 04:47:44.937394 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1799/3633] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:47:44 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1598 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:47:44.967800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:44.968361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:44.980255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.981826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.982984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:44.986394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:44.998327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f31802c5-abbe-4f6a-8c83-f8f5944d9174 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.111699 Aug 03 04:47:45.001874 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1835/3634] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:44 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:47:45.080696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:45.081784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:45.112156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:45.112156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:45.112156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:45.112156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:45.441588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:45.608542 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf2d4fb3-fbff-4050-9685-491f5e95d953 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.645130 Aug 03 04:47:45.609378 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1800/3635] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:47:44 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-interface => generated 284 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 04:47:45.614953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:45.615538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:45.623599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:45.624432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:45.626484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:45.627794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:45.857283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:45.871798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f347fa9-b3f8-46ff-99e5-a4ebd0185609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1272 microversion: 2.1 time: 0.260526 Aug 03 04:47:45.874370 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1801/3636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:45 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:46.013556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:46.015376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:46.027006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:46.028643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:46.029966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:46.032900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:46.068656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:46.086182 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c40694a-67a0-4402-bf45-87bde5d14b69 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 1.009913 Aug 03 04:47:46.101268 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1836/3637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:45 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:46.118401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0b95d69e-7df6-455b-a39b-5217c7322e96 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.111498 Aug 03 04:47:46.119918 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1802/3638] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:46 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:46.903807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:46.904978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:46.918023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:46.919843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:46.920945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:46.924906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.118548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:47.120104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:47.139502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:47.141179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.142498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:47.143158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.479010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:47.492438 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45f1adee-353c-4b75-9225-36e9a72cfa9d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.387176 Aug 03 04:47:47.495786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1803/3639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:47 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:47.516005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:47.522541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:47.526265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:47.527216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.528167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:47.528869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.587107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9471f2e-682f-4bde-a87e-814830eda5aa tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.088299 Aug 03 04:47:47.591691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1804/3640] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:47 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:47.599346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-987d9f3c-c79f-4c5b-bbf6-b103390a2277 req-e3030b33-1e52-4b47-b6bd-296fe42d8843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a93714-1069-4444-b6ee-1cd8daabec92", "tag": "76d0694a-fe0e-4bc0-9f61-8854e113e196"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:47.616900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-987d9f3c-c79f-4c5b-bbf6-b103390a2277 req-e3030b33-1e52-4b47-b6bd-296fe42d8843 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:47.617555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-987d9f3c-c79f-4c5b-bbf6-b103390a2277 req-e3030b33-1e52-4b47-b6bd-296fe42d8843 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:47.629435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-987d9f3c-c79f-4c5b-bbf6-b103390a2277 req-e3030b33-1e52-4b47-b6bd-296fe42d8843 service nova] Creating event network-changed:76d0694a-fe0e-4bc0-9f61-8854e113e196 for instance c2a93714-1069-4444-b6ee-1cd8daabec92 on n-h2-826756-5 Aug 03 04:47:47.638040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-987d9f3c-c79f-4c5b-bbf6-b103390a2277 req-e3030b33-1e52-4b47-b6bd-296fe42d8843 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044350 Aug 03 04:47:47.639092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1805/3641] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:47.693039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:47.703474 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8af200d-4c23-4f01-b4da-135819eff526 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.812232 Aug 03 04:47:47.717377 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1837/3642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:46 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:48.028149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:48.029177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:48.036753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.036753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.037842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.038478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.133162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'services' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:47:48.398942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:48.434766 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0359d1b6-1a82-4f85-bec3-e982ca005527 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments/29189eb6-c295-4654-be85-2412221883d6" status: 202 len: 0 microversion: 2.1 time: 0.411179 Aug 03 04:47:48.436473 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1806/3643] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:47:48 2022] DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments/29189eb6-c295-4654-be85-2412221883d6 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:48.522987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:48.528989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:48.557470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.558441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.565853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.566268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.581063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9d6d892f-a138-4217-bc92-40fe138b9dbe req-5599f576-184b-4add-a217-0bd25b98ff0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c", "tag": "cea175d0-06d0-49a8-90fb-b2d4629d4ac3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:48.603643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9d6d892f-a138-4217-bc92-40fe138b9dbe req-5599f576-184b-4add-a217-0bd25b98ff0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.604103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9d6d892f-a138-4217-bc92-40fe138b9dbe req-5599f576-184b-4add-a217-0bd25b98ff0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.635418 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9d6d892f-a138-4217-bc92-40fe138b9dbe req-5599f576-184b-4add-a217-0bd25b98ff0f service nova] Creating event network-changed:cea175d0-06d0-49a8-90fb-b2d4629d4ac3 for instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c on n-h1-826756-5 Aug 03 04:47:48.641554 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9d6d892f-a138-4217-bc92-40fe138b9dbe req-5599f576-184b-4add-a217-0bd25b98ff0f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065129 Aug 03 04:47:48.642913 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1807/3644] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:48.650326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:48.653416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:48.662345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.663139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.664107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.664740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.746774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f3f429c-68ca-4517-9e74-6cce9e8868a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 14 microversion: 2.1 time: 0.102110 Aug 03 04:47:48.749249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1808/3645] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:48 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:47:48.757224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:48.758122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:48.770010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.771145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:48.772635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:48.773298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:49.326750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:49.846088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:49.857085 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b51a2a72-9f18-441f-a7f6-58cba333ae3d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 1.105997 Aug 03 04:47:49.861280 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1809/3646] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:48 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:49.866936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9f3e94d1-6321-4a89-8510-d10b75c64587 req-0a2253c6-dab0-4ec0-843d-04d13b4fea58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa67fbca-5bec-4caa-b2e0-da6853e94f8b", "tag": "117b712f-9906-4e90-be43-bb84624d5340"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:49.880118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9f3e94d1-6321-4a89-8510-d10b75c64587 req-0a2253c6-dab0-4ec0-843d-04d13b4fea58 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:49.884307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9f3e94d1-6321-4a89-8510-d10b75c64587 req-0a2253c6-dab0-4ec0-843d-04d13b4fea58 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:49.901781 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9f3e94d1-6321-4a89-8510-d10b75c64587 req-0a2253c6-dab0-4ec0-843d-04d13b4fea58 service nova] Creating event network-changed:117b712f-9906-4e90-be43-bb84624d5340 for instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b on n-h2-826756-5 Aug 03 04:47:49.918097 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9f3e94d1-6321-4a89-8510-d10b75c64587 req-0a2253c6-dab0-4ec0-843d-04d13b4fea58 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053799 Aug 03 04:47:49.919379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1810/3647] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:49.928825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:49.932537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:49.941039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:49.941877 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb71e0f5-13f1-4487-9f94-63353fadd10c tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 1.423335 Aug 03 04:47:49.945237 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1838/3648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:48 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:49.955635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:49.956363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:49.957259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:49.959788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:50.686360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:50.827198 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a7546f8-775b-404e-a034-259a7a976f99 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action" status: 200 len: 8202 microversion: 2.1 time: 0.903601 Aug 03 04:47:50.829834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1811/3649] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:49 2022] POST /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1/action => generated 8202 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:50.851928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "795e0524-9b2c-4ec3-acf8-648505e27711", "tag": "097f43bf-02ca-4ac9-862d-5414599e0be3"}, {"name": "network-changed", "server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:50.920004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:50.921579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:50.944780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-520178144", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "99c0ee9f-a8ef-403a-bf35-8d7bf69be295"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:50.952112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] Creating event network-changed:097f43bf-02ca-4ac9-862d-5414599e0be3 for instance 795e0524-9b2c-4ec3-acf8-648505e27711 on n-h1-826756-5 Aug 03 04:47:50.961076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] Creating event network-changed:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h1-826756-5 Aug 03 04:47:50.972304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-23e00ef1-3e4d-4b59-a403-0e8773fc362f req-ba879fd8-a65c-472c-9eaf-040b38e336db service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.140624 Aug 03 04:47:50.977741 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1812/3650] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:51.002683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:51.002683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:51.009911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:51.013789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:51.015135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:51.019417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:51.065926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] validate_networks() for [('99c0ee9f-a8ef-403a-bf35-8d7bf69be295', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:51.472921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:51.482707 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74470bd1-db26-4c58-a520-77ba263f3a2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.503066 Aug 03 04:47:51.484209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1813/3651] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:50 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:51.490774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:51.491745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:51.498572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:51.499930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:51.502518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:51.503176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.214009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:52.221698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:52.227950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a32bd590-3a4b-49f5-ad77-a778f7a224d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.740491 Aug 03 04:47:52.227950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1814/3652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:51 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:52.251757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:52.255578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:52.274679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.278405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.279319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.279845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.570507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:52.584132 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ed20eb5-cb5a-47ef-9906-a52e3012e8dd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.346640 Aug 03 04:47:52.600367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1815/3653] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:52 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:52.611075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:52.611762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:52.624894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:52.627676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.629552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.630905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.631593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.877668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:52.897736 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-413cf6ff-bcec-47ed-b2e4-64f27736e9a1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.296046 Aug 03 04:47:52.901365 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1816/3654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:52 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:52.922915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:52.923545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:52.934002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.934409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:52.935198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:52.935763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.228851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:53.233018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:53.233946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:53.234585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:53.235169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:53.256260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.258826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.258826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.258826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.282290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Getting quotas for project 8562bcdca71d4b7a8b1569f260ba44e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:53.292947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Getting quotas for user e75e90a0802a4a8f8e7b0762e3eaf8bd and project 8562bcdca71d4b7a8b1569f260ba44e8. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:53.311762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:53.314635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:53.400451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:53.412821 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1963f42e-a1ab-4081-abda-9cd355144129 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.494001 Aug 03 04:47:53.428628 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1817/3655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:52 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:53.434833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-221f6082-ec6e-49c0-9c27-92c3022761bf tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47f77940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:53.487219 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-221f6082-ec6e-49c0-9c27-92c3022761bf tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189" status: 200 len: 661 microversion: 2.1 time: 0.057212 Aug 03 04:47:53.499977 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1818/3656] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:53 2022] GET /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:53.505752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:53.506616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:53.513345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.514045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.515017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.515650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.528039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c981a31-d886-4636-9c05-a5dbc3cf05ce tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.846724 Aug 03 04:47:53.531258 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1839/3657] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:47:53.540259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:53.553979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:53.570968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.571432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.572228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:53.572690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:53.946343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:53.956572 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0373ff46-3dab-4e1e-ae56-1d41dbe9d654 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.424166 Aug 03 04:47:53.958433 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1840/3658] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:53 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:53.960321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:53.969556 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-adb99476-9522-4f9d-9412-0290e9c88553 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.468137 Aug 03 04:47:53.976748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77be3c54-10d4-4848-925d-e7b737e5d5c4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47ded040>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:53.986762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1819/3659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:53 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:53.996810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-067ecac7-5e23-41da-9f2f-ef1dadfc5f9a tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:53.997439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-067ecac7-5e23-41da-9f2f-ef1dadfc5f9a tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:54.033120 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77be3c54-10d4-4848-925d-e7b737e5d5c4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189" status: 200 len: 661 microversion: 2.1 time: 0.070577 Aug 03 04:47:54.042133 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1841/3660] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:53 2022] GET /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189 => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:54.069028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:54.070937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:54.094935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.095803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.096859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.097814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.107072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-067ecac7-5e23-41da-9f2f-ef1dadfc5f9a tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:54.122088 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-067ecac7-5e23-41da-9f2f-ef1dadfc5f9a tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1216 microversion: 2.1 time: 0.134107 Aug 03 04:47:54.123295 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1820/3661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:53 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:54.128818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:54.129645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:54.143839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.144344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.148886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.149375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.325595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:54.335156 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04a0347a-d70d-41ac-9e14-5369976e4108 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.297464 Aug 03 04:47:54.335751 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1842/3662] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:54 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:54.455796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Locking {{(pid=120831) lock /opt/stack/nova/nova/compute/api.py:4781}} Aug 03 04:47:54.689030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1417dc74-4c32-44a5-a779-1624ad25c789 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.564097 Aug 03 04:47:54.695035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1821/3663] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:54 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:54.699170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:54.701017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:54.709007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.710093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.711105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:54.711762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:54.993692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:54.994541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:55.003729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.006474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.010609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.011381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.278281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:55.288485 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8021d3fa-a7b1-47ad-8c6b-dae1cec14d0a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.593156 Aug 03 04:47:55.295031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1843/3664] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:54 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:55.300458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:55.303148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:55.319134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.320528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.321901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.324474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.449449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:55.464213 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b64d481-0474-428b-b637-556142dd100f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1220 microversion: 2.1 time: 0.167311 Aug 03 04:47:55.465218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1844/3665] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:55 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:55.477370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:55.494315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f02a113d-44b4-44fe-80cd-f43c9d7e7b4d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.504529 Aug 03 04:47:55.495691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:55.496287 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1822/3666] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:54 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:55.505295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.506195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.510995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:55.511888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:55.527886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.528371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.529162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.529606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.577744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action HTTP/1.1 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: {"os-stop": {}} Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba', 'body': {'os-stop': {}}} Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked Aug 03 04:47:55.579495 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:47:55.584890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 409 to user: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba is locked {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:47:55.592358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ee24869-3aac-4847-99fd-be128a7d2474 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 409 len: 107 microversion: 2.1 time: 0.125982 Aug 03 04:47:55.592969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1845/3667] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:55 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 107 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:47:55.605569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:55.606119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:55.621218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.621685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.622483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:55.622930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:55.875195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Unlocking {{(pid=120832) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 03 04:47:55.903642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:55.912867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56982fad-207f-4c16-b52b-ce4036729b4a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.415137 Aug 03 04:47:55.929393 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1823/3668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:55 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:56.108951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3bfb71b7-7355-4d53-8770-7b98694b0698 req-0dd31b63-cfe2-4f16-8aff-e9d9e5e51715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a93714-1069-4444-b6ee-1cd8daabec92", "name": "network-vif-plugged", "status": "completed", "tag": "76d0694a-fe0e-4bc0-9f61-8854e113e196"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:56.127841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bfb71b7-7355-4d53-8770-7b98694b0698 req-0dd31b63-cfe2-4f16-8aff-e9d9e5e51715 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.129250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bfb71b7-7355-4d53-8770-7b98694b0698 req-0dd31b63-cfe2-4f16-8aff-e9d9e5e51715 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.153236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3bfb71b7-7355-4d53-8770-7b98694b0698 req-0dd31b63-cfe2-4f16-8aff-e9d9e5e51715 service nova] Creating event network-vif-plugged:76d0694a-fe0e-4bc0-9f61-8854e113e196 for instance c2a93714-1069-4444-b6ee-1cd8daabec92 on n-h2-826756-5 Aug 03 04:47:56.163701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3bfb71b7-7355-4d53-8770-7b98694b0698 req-0dd31b63-cfe2-4f16-8aff-e9d9e5e51715 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059295 Aug 03 04:47:56.171976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1824/3669] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:56.201322 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-170c580f-1366-416a-8404-ba5dc1933adf tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.599746 Aug 03 04:47:56.204341 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1846/3670] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:55 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:56.212591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b033084b-9c3e-4166-9196-e8c281aca342 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:56.225659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b033084b-9c3e-4166-9196-e8c281aca342 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.226116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b033084b-9c3e-4166-9196-e8c281aca342 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.235785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc99f821-1bd9-430b-a1c0-7d9aac1e3488 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59da51f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:56.291969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b033084b-9c3e-4166-9196-e8c281aca342 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Going to try to stop instance {{(pid=120831) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:47:56.311405 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc99f821-1bd9-430b-a1c0-7d9aac1e3488 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead" status: 200 len: 661 microversion: 2.1 time: 0.079621 Aug 03 04:47:56.312399 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1847/3671] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:56 2022] GET /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:56.325776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61d42219-360f-480f-bb93-280814b30c04 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e02dc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:56.384595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61d42219-360f-480f-bb93-280814b30c04 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead" status: 200 len: 661 microversion: 2.1 time: 0.062814 Aug 03 04:47:56.388192 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1848/3672] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:56 2022] GET /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:56.489983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:56.491923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:56.501108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.501840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.502921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.503698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.570641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b033084b-9c3e-4166-9196-e8c281aca342 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.363884 Aug 03 04:47:56.576657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1825/3673] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:56 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:56.577680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:56.578443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:56.586307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.586776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.587604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.588245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.678129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:56.680669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:47:56.687532 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-206bd2f2-a1ba-44aa-bf43-33929a5b02e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1268 microversion: 2.1 time: 0.203274 Aug 03 04:47:56.689109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1849/3674] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:56 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:47:56.695923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:56.696961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:56.705291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.706201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:56.709032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:56.709768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.275241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:57.290694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6bb6ee9e-3f34-4c8e-a4ad-ac613e99a88d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.714080 Aug 03 04:47:57.291345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1826/3675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:56 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:57.305085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:57.307231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:57.315490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.315956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.317826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.318475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.411851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:57.419735 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8d6f137-8d11-4072-a6cb-0d9061ba9e58 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.729122 Aug 03 04:47:57.420330 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1850/3676] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:56 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:57.424879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47d7949f-ec9e-4de7-9b0b-5428f77c2117 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:57.431743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d7949f-ec9e-4de7-9b0b-5428f77c2117 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.432207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d7949f-ec9e-4de7-9b0b-5428f77c2117 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.462256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47d7949f-ec9e-4de7-9b0b-5428f77c2117 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:47:57.654755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47d7949f-ec9e-4de7-9b0b-5428f77c2117 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.233071 Aug 03 04:47:57.659079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1851/3677] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:47:57 2022] POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:47:57.665092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:57.665802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:57.689340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.690106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.706056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.706937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.711076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:57.720677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40c8f0cd-6360-4bc4-aa51-c4acaec52ed5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.426919 Aug 03 04:47:57.722358 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1827/3678] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:57 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:57.740017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:57.740934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:57.747602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.748369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.751067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:57.751067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:57.997596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:58.009701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5013aafa-91e6-4ac3-9990-6b6bd0f26ee3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1274 microversion: 2.1 time: 0.287339 Aug 03 04:47:58.016500 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1828/3679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:57 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:58.136681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:58.149560 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0b678c5-7d78-472a-9012-ececa216d072 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.489150 Aug 03 04:47:58.150865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1852/3680] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:57 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:58.313976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:58.315394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:58.328134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:58.329101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:58.332931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:58.333494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:58.346979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba66b579-54e5-45ce-b4af-52615fc73349 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54600040>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:58.406218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba66b579-54e5-45ce-b4af-52615fc73349 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd" status: 200 len: 661 microversion: 2.1 time: 0.064494 Aug 03 04:47:58.407061 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1853/3681] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:58 2022] GET /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:47:58.423719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f362399-b03e-44da-950d-ff71de0a57b8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e15f70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:58.474410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f362399-b03e-44da-950d-ff71de0a57b8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd" status: 200 len: 661 microversion: 2.1 time: 0.056929 Aug 03 04:47:58.484820 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1854/3682] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:47:58 2022] GET /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:58.498762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:58.499532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:58.507071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:58.507529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:58.508313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:58.509064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.052989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:59.067078 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db8adabd-c479-47bb-bf4d-66eefe53c0cd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.758204 Aug 03 04:47:59.067886 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1829/3683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:58 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:59.074721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1969148299", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:59.143264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:47:59.229532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:59.241063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac7d5e1c-32e0-4bcf-bb94-735842616c14 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.754008 Aug 03 04:47:59.242373 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1855/3684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:58 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:59.247116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:59.248054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:59.256136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.256697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.257560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.258074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.726222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:47:59.733859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:47:59.734498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:47:59.735152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:47:59.735750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:47:59.736380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:47:59.743110 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a8340b9-f01f-451f-9782-2c94fdd8c5b5 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.493504 Aug 03 04:47:59.743110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1856/3685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:59 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:47:59.747598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.748332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.749338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.749965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.758655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-255b2cab-916d-4908-a3c3-0154503b89bd req-370a378c-064b-4b8e-ada9-86db58ed553b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0524-9b2c-4ec3-acf8-648505e27711", "name": "network-vif-plugged", "status": "completed", "tag": "097f43bf-02ca-4ac9-862d-5414599e0be3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:47:59.769442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-255b2cab-916d-4908-a3c3-0154503b89bd req-370a378c-064b-4b8e-ada9-86db58ed553b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.770523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-255b2cab-916d-4908-a3c3-0154503b89bd req-370a378c-064b-4b8e-ada9-86db58ed553b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.771734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Getting quotas for project 95202d0336b14e40bca85fca08129f99. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:47:59.778775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Getting quotas for user ef386a1ba5d64e77bd0107ddafbf5d0f and project 95202d0336b14e40bca85fca08129f99. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:47:59.788937 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-255b2cab-916d-4908-a3c3-0154503b89bd req-370a378c-064b-4b8e-ada9-86db58ed553b service nova] Creating event network-vif-plugged:097f43bf-02ca-4ac9-862d-5414599e0be3 for instance 795e0524-9b2c-4ec3-acf8-648505e27711 on n-h1-826756-5 Aug 03 04:47:59.794114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:47:59.794521 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-255b2cab-916d-4908-a3c3-0154503b89bd req-370a378c-064b-4b8e-ada9-86db58ed553b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052965 Aug 03 04:47:59.795150 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1857/3686] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:47:59.797384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:47:59.802122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:47:59.803140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:47:59.811198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.812185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.813665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:47:59.814726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:47:59.999713 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad753092-b529-4111-8b9e-0a28b1bb492a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929384 Aug 03 04:48:00.001088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1830/3687] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:00.006652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:00.007588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:00.019461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.020209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.021320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.021994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.059250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:00.180446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:00.198872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3819e2e3-f49d-4517-b3c4-073233d49090 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.399787 Aug 03 04:48:00.213164 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1858/3688] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:47:59 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:00.218967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-425639372", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:00.304758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] validate_networks() for None {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:00.432996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:00.441328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-911c34b1-8ba7-44af-8859-b2242d75e739 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.438767 Aug 03 04:48:00.444431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1831/3689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:00 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:00.455395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:00.455395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:00.457863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.458599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.459583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.460946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.815397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:00.823556 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5127934d-29fc-4cc0-a0c4-17ff008fe931 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1314 microversion: 2.1 time: 0.377858 Aug 03 04:48:00.824155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1832/3690] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:00 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:00.829750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:00.830363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:00.840215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.841035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.841945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.842531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.868236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:00.868696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:00.869172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:00.869583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:00.869993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:00.884844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.885145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.885996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:00.886567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:00.919042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Getting quotas for project 95202d0336b14e40bca85fca08129f99. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:00.925996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Getting quotas for user ef386a1ba5d64e77bd0107ddafbf5d0f and project 95202d0336b14e40bca85fca08129f99. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:00.947627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:00.950443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:01.110495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:01.120455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbf64892-c4d1-41e9-834b-3c97f506fc7a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.294256 Aug 03 04:48:01.135210 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1833/3691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:00 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:01.141198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:01.141998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:01.147268 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68e724a7-d07c-415d-b29a-749650340651 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932694 Aug 03 04:48:01.147956 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1859/3692] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:01.156362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.159221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b189e98f-7675-44ff-a019-a6b0125a9334 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:01.159854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b189e98f-7675-44ff-a019-a6b0125a9334 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:01.160493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.163013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.165799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.329708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b189e98f-7675-44ff-a019-a6b0125a9334 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:01.342964 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b189e98f-7675-44ff-a019-a6b0125a9334 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1217 microversion: 2.1 time: 0.188013 Aug 03 04:48:01.344118 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1860/3693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:01 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:01.350382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:01.356598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:01.376347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.376813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.377613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.378063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.584771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:01.595337 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bdb4e645-150f-4fab-896c-1936fd22c8e2 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.458268 Aug 03 04:48:01.609798 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1834/3694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:01 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:01.625966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:01.626791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:01.636801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.637548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.638513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.639118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.749201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:01.760142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff9abbf7-0217-4524-b18c-917e60e28d5f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.414107 Aug 03 04:48:01.762660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1861/3695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:01 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:01.810831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c", "name": "network-vif-plugged", "status": "completed", "tag": "cea175d0-06d0-49a8-90fb-b2d4629d4ac3"}, {"server_uuid": "fa67fbca-5bec-4caa-b2e0-da6853e94f8b", "name": "network-vif-plugged", "status": "completed", "tag": "117b712f-9906-4e90-be43-bb84624d5340"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:01.824778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.825462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.840295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] Creating event network-vif-plugged:cea175d0-06d0-49a8-90fb-b2d4629d4ac3 for instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c on n-h1-826756-5 Aug 03 04:48:01.841098 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] Creating event network-vif-plugged:117b712f-9906-4e90-be43-bb84624d5340 for instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b on n-h2-826756-5 Aug 03 04:48:01.855168 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cbd798fb-840a-4f97-9030-1c007ec29a4a req-ae5747bd-f5ec-409b-83e5-639378091ad8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047850 Aug 03 04:48:01.855939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:01.857008 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1862/3696] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:01.872156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:01.876960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:01.883121 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6acbf36-71b7-4275-9be9-11f7eacb8a98 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.261430 Aug 03 04:48:01.904114 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1835/3697] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:01 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:01.904438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.904438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:01.904438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:01.904438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.099732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:02.107667 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-810758ba-aeba-4e96-9d01-dc659917e57e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1501 microversion: 2.1 time: 0.249091 Aug 03 04:48:02.115393 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1863/3698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:01 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:02.130416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:02.131600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.143238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.145418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.149286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.149443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:02.149940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.150748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.151255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.159949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.161051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.161921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.165888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.371068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:02.379754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8bd37228-b850-4b05-9279-088536cefe93 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.240524 Aug 03 04:48:02.380421 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1864/3699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:02.386093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-42eba53b-a448-4042-a38d-5fa92c36df59 req-b8b2bb63-86fc-4686-ad1a-6c9c36f4d798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14fd57a8-202c-4f2b-ba0a-f33a3714457f", "tag": "a9fe8225-dc7c-48ca-88cc-8ecfd1ced288"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:02.396542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-42eba53b-a448-4042-a38d-5fa92c36df59 req-b8b2bb63-86fc-4686-ad1a-6c9c36f4d798 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.396992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-42eba53b-a448-4042-a38d-5fa92c36df59 req-b8b2bb63-86fc-4686-ad1a-6c9c36f4d798 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.409863 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-42eba53b-a448-4042-a38d-5fa92c36df59 req-b8b2bb63-86fc-4686-ad1a-6c9c36f4d798 service nova] Creating event network-changed:a9fe8225-dc7c-48ca-88cc-8ecfd1ced288 for instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f on n-h1-826756-5 Aug 03 04:48:02.423566 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-42eba53b-a448-4042-a38d-5fa92c36df59 req-b8b2bb63-86fc-4686-ad1a-6c9c36f4d798 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033770 Aug 03 04:48:02.424257 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1865/3700] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:02.434147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22dfb22a-9bb9-4099-82c7-cbe8eeef090d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.437412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22dfb22a-9bb9-4099-82c7-cbe8eeef090d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.437561 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e997d4d-1b31-4719-b31c-d5454bba1a33 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711/action" status: 202 len: 0 microversion: 2.1 time: 0.310253 Aug 03 04:48:02.437561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1836/3701] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:02 2022] POST /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:02.456377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.465289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.485347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.486009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.487102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.489471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.547748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22dfb22a-9bb9-4099-82c7-cbe8eeef090d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:02.555840 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22dfb22a-9bb9-4099-82c7-cbe8eeef090d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1217 microversion: 2.1 time: 0.126148 Aug 03 04:48:02.568703 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1866/3702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:02.618910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.619544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.630607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.631078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.631880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.632380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.710473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:02.719435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d464a758-b228-45f7-afce-d752334d72f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1506 microversion: 2.1 time: 0.268409 Aug 03 04:48:02.724115 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1837/3703] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:02.789129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.790137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.799787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.800645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.803749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.804564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.853706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:02.861591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b14dc978-b86e-4ba5-947c-b02dc142da86 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.247830 Aug 03 04:48:02.875893 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1867/3704] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:02.914945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:02.916851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:02.938917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.942371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:02.946394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:02.949246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.174184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:03.181569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:03.187140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8adcdb14-903d-44a8-9451-63b966902f7c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.274817 Aug 03 04:48:03.187140 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1868/3705] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:03.193204 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6779033b-3c62-402d-a612-7c4135259088 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.408043 Aug 03 04:48:03.193520 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1838/3706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:02 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:03.402430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:03.403056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:03.418354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.424217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.424217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.424217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.578793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:03.579800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:03.593505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.594261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.595263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.599773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.630502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:03.640471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44f317ab-b17a-4ff5-b5be-c9c30cd393bb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.242512 Aug 03 04:48:03.661954 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1869/3707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:03 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:03.723690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:03.731532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0dd23dfa-183e-4c43-96d4-500890d26158 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1269 microversion: 2.1 time: 0.156773 Aug 03 04:48:03.732139 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1839/3708] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:03 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:03.743530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:03.744160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:03.751975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.753433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.755091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.755799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.885181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:03.885802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:03.903762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.904499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:03.907731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:03.907731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.046640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:04.060449 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-79feac34-1fe4-49d2-87eb-aebab0014046 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1486 microversion: 2.1 time: 0.320683 Aug 03 04:48:04.070032 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1870/3709] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:03 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1486 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:04.096146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:04.096700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:04.110325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.113011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.114398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.118122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.154937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:04.169413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:04.223252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:04.232074 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f77b75cc-7b7e-425b-b6a3-cc0964c8f86a tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1323 microversion: 2.1 time: 0.350788 Aug 03 04:48:04.238032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1840/3710] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:03 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:04.244100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:04.244928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:04.253514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.255192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.256316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.256941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.524711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff894129-5063-4670-a0f6-fba4bfea7c0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 204 len: 0 microversion: 2.1 time: 0.432099 Aug 03 04:48:04.527610 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1871/3711] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:04 2022] DELETE /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:48:04.537071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:04.548917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:04.556535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.558955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:04.559888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:04.563176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:05.051888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:05.060080 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b61fd1bb-2c67-45d4-99a5-dac3cc229ba7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.820063 Aug 03 04:48:05.060886 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1841/3712] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:04 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:05.174667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:05.179879 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4f9ff51-60dc-4ee0-951c-ca041faa94e3 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.650363 Aug 03 04:48:05.180820 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1872/3713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:04 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:05.188041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:05.188704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:05.199229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-416520346", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:05.203204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:05.203204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:05.203204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:05.203664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:05.259173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:05.492722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:05.502181 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a64eabe-ea16-470e-aa62-4425d952ddc9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1492 microversion: 2.1 time: 0.320201 Aug 03 04:48:05.503543 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1873/3714] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:05 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1492 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:05.646087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:05.646708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:05.654361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:05.655186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:05.655633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:05.656070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.156714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:06.166264 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-873e225e-4dad-48b7-80a1-52f702593450 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.661282 Aug 03 04:48:06.180926 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1874/3715] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:05 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:06.187851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.188698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.199151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.199715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.200607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.201124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.225657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:06.227235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:06.227235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:06.227447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:06.227853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:06.239478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.239866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.240738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.241216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.259230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:06.264939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:06.279800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:06.282168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:06.292217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:06.306070 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6be594c0-fe0e-4c3b-9894-eac7036737cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1275 microversion: 2.1 time: 0.123762 Aug 03 04:48:06.307003 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1875/3716] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:06.311699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.312636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.320661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.321675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.324453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.324453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.498347 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cfc86cc2-4c5e-4dcf-9683-3001d309912d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436172 Aug 03 04:48:06.499015 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1842/3717] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:06.503945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.508744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.515577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.517165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.517394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.518171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.578057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:06.588983 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ff3eee9-1e75-4ec0-a720-9cf4aee5ffd0 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1516 microversion: 2.1 time: 0.280665 Aug 03 04:48:06.590181 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1876/3718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:06.596222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.597099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.605516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.610176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.610176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.610176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.791341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:06.799181 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf5b0015-bf19-4b05-bece-42e5bc765837 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.299145 Aug 03 04:48:06.807996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1843/3719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:06.807996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e6878fd-59ad-4067-a339-6edfc8969f52 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.807996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e6878fd-59ad-4067-a339-6edfc8969f52 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.906371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0e6878fd-59ad-4067-a339-6edfc8969f52 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:06.923885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e6878fd-59ad-4067-a339-6edfc8969f52 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1192 microversion: 2.1 time: 0.122801 Aug 03 04:48:06.924807 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1844/3720] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:06.930446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:06.931715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:06.938770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.939457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:06.940450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:06.940933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.133221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:07.143636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3865bdb8-ce68-43ae-b69b-07faf5d3924b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.551526 Aug 03 04:48:07.147491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1877/3721] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:07.167486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:07.168132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:07.186338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.186800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.187666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.190235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.643023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:07.652553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f205b53-dab2-407c-88d3-a2d127d3bbd9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1492 microversion: 2.1 time: 0.725621 Aug 03 04:48:07.653166 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1845/3722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:06 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1492 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:07.658375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:07.659243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:07.667106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.667958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.668716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.669166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.702665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:07.718654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3935f32a-1ca7-468c-8404-567993935abe tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 200 len: 1516 microversion: 2.1 time: 0.573216 Aug 03 04:48:07.719363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1878/3723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:07 2022] GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 1516 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:07.726841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:07.732008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:07.741068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.741941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.742991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:07.743518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:07.983461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:08.002042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b68166be-2161-4cf6-9d11-e8db5b144d9b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1275 microversion: 2.1 time: 0.280346 Aug 03 04:48:08.003231 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1879/3724] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:07 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:08.011530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:08.012352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:08.022198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.022823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:08.024164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.024828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:08.323078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:08.333628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07929cf7-db75-4a81-81dd-fdaa0677bbed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.679172 Aug 03 04:48:08.351568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1846/3725] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:07 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:08.351568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:08.351568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:08.363806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.363806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:08.363806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.363806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:08.931664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:08.940707 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49f65e96-889d-438d-b33e-44300d5cb770 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 200 len: 1515 microversion: 2.1 time: 0.935130 Aug 03 04:48:08.945112 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1880/3726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:08 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 1515 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:08.950665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:08.951297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:08.960384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.961096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:08.962647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:08.963365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.094644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:09.104777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-186252d1-f463-4ab7-9223-f993d69fb0f3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1196 microversion: 2.1 time: 0.158217 Aug 03 04:48:09.116302 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1881/3727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:08 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1196 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:09.116302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:09.116302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:09.121096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.121732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.122578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.123096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.173112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:09.181182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ab6dbaa-4a7e-4d44-9003-3bfec7d8ba2b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.845935 Aug 03 04:48:09.181773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1847/3728] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:08 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:09.186270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:09.187405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:09.193974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.194430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.195415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.195860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.600710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:09.609392 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1925b7ef-9576-4573-954a-9603871894ca tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.502336 Aug 03 04:48:09.624622 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1882/3729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:09 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:09.630401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:09.631218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:09.637813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.638587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.639565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.645144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.675075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:09.719828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:09.722369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:09.731595 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02330007-b50f-4bfe-88e8-63bf566614d7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1492 microversion: 2.1 time: 0.548751 Aug 03 04:48:09.733191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1848/3730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:09 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1492 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:09.742314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:09.743207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:09.751514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.752195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:09.754084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:09.754895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.052740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.060526 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-106e729e-4199-423c-b6be-31457543825b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.323970 Aug 03 04:48:10.061125 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1849/3731] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:09 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.067149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.067149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.073380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.073839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.074832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.075284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.224237 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28238d97-298e-4cc8-a6a5-bbf9f4a07bec tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 204 len: 0 microversion: 2.1 time: 0.597845 Aug 03 04:48:10.228054 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1883/3732] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:09 2022] DELETE /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:10.231368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f3cd7d91-8e0d-46c0-9bfe-0a6c1a04f0a3 req-63243139-e554-4440-ae86-4ce63e1c934b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "795e0524-9b2c-4ec3-acf8-648505e27711", "name": "network-vif-deleted", "tag": "097f43bf-02ca-4ac9-862d-5414599e0be3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:10.242773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3cd7d91-8e0d-46c0-9bfe-0a6c1a04f0a3 req-63243139-e554-4440-ae86-4ce63e1c934b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.243287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3cd7d91-8e0d-46c0-9bfe-0a6c1a04f0a3 req-63243139-e554-4440-ae86-4ce63e1c934b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.256679 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f3cd7d91-8e0d-46c0-9bfe-0a6c1a04f0a3 req-63243139-e554-4440-ae86-4ce63e1c934b service nova] Creating event network-vif-deleted:097f43bf-02ca-4ac9-862d-5414599e0be3 for instance 795e0524-9b2c-4ec3-acf8-648505e27711 on n-h1-826756-5 Aug 03 04:48:10.261836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f3cd7d91-8e0d-46c0-9bfe-0a6c1a04f0a3 req-63243139-e554-4440-ae86-4ce63e1c934b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035240 Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1884/3733] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.278714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.390941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.407705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7daa071-0437-455e-a57b-eb46df8a4d39 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1244 microversion: 2.1 time: 0.143623 Aug 03 04:48:10.413986 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1885/3734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.417217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.421685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.422514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.429440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab889344-9bd7-4e26-b8f5-f0633c4ca845 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.367032 Aug 03 04:48:10.430634 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1850/3735] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.433174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.433844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.434633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.435075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.436508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.438986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.440802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:10.444991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.445532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.446392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.447079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.459419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:10.756785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.760596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.765058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ad962e6-8789-45d0-b225-f315ec25f66b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.349636 Aug 03 04:48:10.765639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1886/3736] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.768435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e56246a2-99fa-43b6-a7e0-dc470392708b tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 200 len: 1521 microversion: 2.1 time: 0.336537 Aug 03 04:48:10.769007 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1851/3737] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.773474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.775545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.780189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.780691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.781452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.781887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.790616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:10.791230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:10.798069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.799283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.800112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.801414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.823943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:10.824714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:10.825335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lazy-loading 'fault' on Instance uuid 795e0524-9b2c-4ec3-acf8-648505e27711 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:10.892745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:10.901832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aff6842c-5f13-4b8d-9dc4-6646d1a50ad8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 200 len: 1304 microversion: 2.1 time: 0.131795 Aug 03 04:48:10.902523 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1852/3738] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:10.905581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:11.101045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:11.101487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:11.114681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.115144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.115946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.116788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.220781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:11.230448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6705498-8937-4192-910a-c880a1196469 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.446292 Aug 03 04:48:11.231091 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1887/3739] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:10 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.506079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24318ca2-0da6-4265-9736-36cc958f2e56 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.357935 Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1853/3740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:11 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.507329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.535169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:11.542759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56f09ac3-a550-4164-b224-85d27106edec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1252 microversion: 2.1 time: 0.116259 Aug 03 04:48:11.544005 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1888/3741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:11 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1252 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:11.719903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:11.732323 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66f01ec5-2112-4c38-996f-16db95718da7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.276416 Aug 03 04:48:11.732916 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1854/3742] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:11 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:11.790487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:11.792440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:11.798333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.798535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:11.799130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:11.799282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.805698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.805698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.806943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.807399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:11.808500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:11.808944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.004588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:12.007853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:12.012198 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44f68bab-cbd6-4e59-aa1a-48e467c0dcc9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.225739 Aug 03 04:48:12.012882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1889/3743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:11 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:12.015878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3df6ea4-fcf4-41dc-86fa-5700acdf2cb6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 200 len: 1521 microversion: 2.1 time: 0.221947 Aug 03 04:48:12.016646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1855/3744] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:11 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:12.017816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:12.018663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:12.024906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.025669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.026501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.027025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.035540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c7f6a634-8a99-4b11-824a-6a5201b16a9c req-07241fc8-4eba-4fab-a316-aab82608bb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fd57a8-202c-4f2b-ba0a-f33a3714457f", "name": "network-vif-plugged", "status": "completed", "tag": "a9fe8225-dc7c-48ca-88cc-8ecfd1ced288"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:12.041006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 HTTP/1.1 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '795e0524-9b2c-4ec3-acf8-648505e27711'} Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:12.042592 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8411e946-6465-4e42-90b8-bf4079d33205 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 404 len: 111 microversion: 2.1 time: 0.029879 Aug 03 04:48:12.047990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1890/3745] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:12 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:12.048898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7f6a634-8a99-4b11-824a-6a5201b16a9c req-07241fc8-4eba-4fab-a316-aab82608bb6d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.048898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7f6a634-8a99-4b11-824a-6a5201b16a9c req-07241fc8-4eba-4fab-a316-aab82608bb6d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.058541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c7f6a634-8a99-4b11-824a-6a5201b16a9c req-07241fc8-4eba-4fab-a316-aab82608bb6d service nova] Creating event network-vif-plugged:a9fe8225-dc7c-48ca-88cc-8ecfd1ced288 for instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f on n-h1-826756-5 Aug 03 04:48:12.063818 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c7f6a634-8a99-4b11-824a-6a5201b16a9c req-07241fc8-4eba-4fab-a316-aab82608bb6d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034020 Aug 03 04:48:12.064622 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1856/3746] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:12.154423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-215361611", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:12.212401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:12.252146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:12.253256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:12.260375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.265029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.265029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.265029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.463540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:12.471287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11852a74-a960-47a4-8c87-7c542fa9a0d9 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.223759 Aug 03 04:48:12.475213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1857/3747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:12 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:12.478009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}, {"name": "network-changed", "server_uuid": "47c4b733-ed81-4164-8448-5bc667788e1d", "tag": "48db9db0-6b04-4c02-b8c3-06fcac1fd327"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:12.488562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.489018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.501864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] Creating event network-changed:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:48:12.502373 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] Creating event network-changed:48db9db0-6b04-4c02-b8c3-06fcac1fd327 for instance 47c4b733-ed81-4164-8448-5bc667788e1d on n-h1-826756-5 Aug 03 04:48:12.508657 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9f50dd72-437e-419d-b8aa-ec031574ea71 req-a8098c1c-6994-49f1-9fee-0b7ef09473f7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034078 Aug 03 04:48:12.516838 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1858/3748] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:12.516838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:12.516838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:12.522181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.522635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.523396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.523832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.552770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:12.822795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:12.837409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-744720df-68ad-4002-bf5a-d1f4eaf7c19a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.326668 Aug 03 04:48:12.882250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1859/3749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:12 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:12.882250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:12.882250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:12.883239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:12.883239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:12.883239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:12.883239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:12.883239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:12.883738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.883738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.883738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.883738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.884092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.884092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.884092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.884092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.890849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:12.902002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:12.911942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:12.916996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:12.942463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:12.952776 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-57b11fa6-3b0e-470f-a0a0-25a6679c617f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1250 microversion: 2.1 time: 0.113183 Aug 03 04:48:12.953367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1860/3750] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:12 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1250 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:12.964661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:12.965503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:12.974149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.974602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:12.984249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:12.984816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.076749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6f78ec0-69ad-4186-ac48-4ad2ee47acc5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925989 Aug 03 04:48:13.084916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1891/3751] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:13.090836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:13.091668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:13.100308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.100998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.101975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.102574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.273930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:13.287281 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fd65f3d-f6a1-494e-8634-2dbfcb7c813c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.332519 Aug 03 04:48:13.288451 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1861/3752] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:12 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:13.293909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:13.294936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:13.308377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.308377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.308377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.309050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.379004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:13.391142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f69375d-4e2b-4dee-a565-2f19e45efd47 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1676 microversion: 2.1 time: 0.300545 Aug 03 04:48:13.392621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1892/3753] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:13 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1676 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:13.421892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-177456de-2d85-4576-af8f-50314d8fa0df tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:13.425887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-177456de-2d85-4576-af8f-50314d8fa0df tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:13.859912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-177456de-2d85-4576-af8f-50314d8fa0df tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:13.869626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-177456de-2d85-4576-af8f-50314d8fa0df tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1214 microversion: 2.1 time: 0.459709 Aug 03 04:48:13.871806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1893/3754] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:13 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1214 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:13.884998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:13.886061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:13.901503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.901957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:13.902789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:13.903175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.061722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.072143 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2e7dc96-b542-46cb-a859-1f0a08a394ff tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 200 len: 1521 microversion: 2.1 time: 0.782317 Aug 03 04:48:14.077028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1862/3755] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:13 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 1521 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.092192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cb346151-2425-4ca4-94ae-178ee5c677a0 req-42b5160f-10c3-4b42-b17f-23cddf21fa83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a93714-1069-4444-b6ee-1cd8daabec92", "name": "network-vif-deleted", "tag": "76d0694a-fe0e-4bc0-9f61-8854e113e196"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:14.151866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cb346151-2425-4ca4-94ae-178ee5c677a0 req-42b5160f-10c3-4b42-b17f-23cddf21fa83 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.155159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cb346151-2425-4ca4-94ae-178ee5c677a0 req-42b5160f-10c3-4b42-b17f-23cddf21fa83 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.186316 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cb346151-2425-4ca4-94ae-178ee5c677a0 req-42b5160f-10c3-4b42-b17f-23cddf21fa83 service nova] Creating event network-vif-deleted:76d0694a-fe0e-4bc0-9f61-8854e113e196 for instance c2a93714-1069-4444-b6ee-1cd8daabec92 on n-h2-826756-5 Aug 03 04:48:14.197177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cb346151-2425-4ca4-94ae-178ee5c677a0 req-42b5160f-10c3-4b42-b17f-23cddf21fa83 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118589 Aug 03 04:48:14.200058 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1863/3756] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:14.212995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:14.217997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:14.234085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.234085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.237681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.238924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.336010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.352434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6998a223-4017-4d30-b51d-5485be025478 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.478136 Aug 03 04:48:14.356384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1894/3757] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:13 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.361940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:14.363489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:14.371625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.372654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.373701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.374603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.619824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.635655 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5557f3a5-9fa0-41a7-a583-0be8eb50ae87 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.430918 Aug 03 04:48:14.637792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1864/3758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:14 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.651803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:14.652966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:14.662671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.663552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.664048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.664867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.665315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.668560 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cc49f07-d499-4cc3-97c4-4173236c3bf0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.311886 Aug 03 04:48:14.671018 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1895/3759] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:14 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.677161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:14.677991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:14.686101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.686878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.688167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.688803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.895743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.897378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:14.905275 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57361f08-d833-4f4f-8e0b-8a46663afb81 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1653 microversion: 2.1 time: 0.232961 Aug 03 04:48:14.906108 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1896/3760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:14 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1653 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.911464 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bae47efb-8422-4815-9bad-50c104c2cd54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1656 microversion: 2.1 time: 0.271478 Aug 03 04:48:14.911664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:14.912565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:14.922716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.924210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.926485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.927064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.932516 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1865/3761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:14 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1656 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:14.939045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-274bbfeb-7c86-4e3f-91c1-df54f019aa16 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:14.947861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274bbfeb-7c86-4e3f-91c1-df54f019aa16 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:14.948579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-274bbfeb-7c86-4e3f-91c1-df54f019aa16 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:14.975803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-274bbfeb-7c86-4e3f-91c1-df54f019aa16 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Going to try to start instance {{(pid=120831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 04:48:14.991549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:15.008518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:15.017409 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-585920a1-d842-45bb-95c6-07dd75e65329 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1218 microversion: 2.1 time: 0.110195 Aug 03 04:48:15.018206 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1897/3762] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:14 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:15.039124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c9e5aab-3f57-47c4-a115-988bd50ed5dc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:15.045506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c9e5aab-3f57-47c4-a115-988bd50ed5dc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.045969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c9e5aab-3f57-47c4-a115-988bd50ed5dc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.073992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9c9e5aab-3f57-47c4-a115-988bd50ed5dc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Going to try to start instance {{(pid=120832) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 04:48:15.221284 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-274bbfeb-7c86-4e3f-91c1-df54f019aa16 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.287384 Aug 03 04:48:15.227510 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1866/3763] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:14 2022] POST /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:15.227510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:15.228119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:15.234692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.235137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.236085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.236580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.298936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.299671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.300747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lazy-loading 'fault' on Instance uuid c2a93714-1069-4444-b6ee-1cd8daabec92 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:15.360833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:15.367129 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c9e5aab-3f57-47c4-a115-988bd50ed5dc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.339153 Aug 03 04:48:15.367752 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1898/3764] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:15 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:15.373763 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11f07959-bb79-4b2b-b1dd-b73178cf85c3 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 200 len: 1313 microversion: 2.1 time: 0.150284 Aug 03 04:48:15.374676 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1867/3765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:15 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:15.380098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:15.380749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:15.389350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.389537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:15.389815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.390121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:15.390599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.391048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.392158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:15.399120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.399649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.400793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.400899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.699856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:15.710872 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84e4fbf0-4af8-444b-b2db-9a561613c595 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.335125 Aug 03 04:48:15.711464 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1868/3766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:15 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:15.718280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:15.718280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:15.718530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:15.725070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.725523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.726301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.726738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.728783 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-338f541d-29dd-4ef6-b5da-fbd3c39ed3f3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1662 microversion: 2.1 time: 0.359255 Aug 03 04:48:15.729481 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1899/3767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:15 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1662 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:15.734586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:15.735528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:15.743819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.744292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:15.745268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:15.746099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.039717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.047458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70c4a822-f1bf-46b9-91a6-5150102b556d tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1316 microversion: 2.1 time: 0.334421 Aug 03 04:48:16.055330 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1869/3768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:15 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:16.055330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.055330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:16.060339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.060947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.061796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.062365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.092527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.100572 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ca3217d-bbfd-4e48-a0e3-7a6117a7572c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.369800 Aug 03 04:48:16.101607 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1900/3769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:15 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:16.118165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.124940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:16.132036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.132516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.133303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.133802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.234927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.243564 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1060e58-36d1-4614-8143-0e9f7f1b1538 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1266 microversion: 2.1 time: 0.129386 Aug 03 04:48:16.256901 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1901/3770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:16.256901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9dc815f2-f6ac-4710-bdba-32eef61314ee req-52ddc8b1-76a5-408c-93c8-171ab29f1d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48875e1-28b9-4057-86dc-3698445d0163", "tag": "698e9060-e53c-40b6-9b7b-9b2f003db458"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:16.259342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:16.259802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9dc815f2-f6ac-4710-bdba-32eef61314ee req-52ddc8b1-76a5-408c-93c8-171ab29f1d8a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.259942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9dc815f2-f6ac-4710-bdba-32eef61314ee req-52ddc8b1-76a5-408c-93c8-171ab29f1d8a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.273789 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9dc815f2-f6ac-4710-bdba-32eef61314ee req-52ddc8b1-76a5-408c-93c8-171ab29f1d8a service nova] Creating event network-changed:698e9060-e53c-40b6-9b7b-9b2f003db458 for instance c48875e1-28b9-4057-86dc-3698445d0163 on n-h2-826756-5 Aug 03 04:48:16.279442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9dc815f2-f6ac-4710-bdba-32eef61314ee req-52ddc8b1-76a5-408c-93c8-171ab29f1d8a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034139 Aug 03 04:48:16.280334 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1902/3771] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:16.298982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.307847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75d2ba42-5af6-4197-9998-e6b45578e604 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.258561 Aug 03 04:48:16.314338 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1870/3772] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:16.396317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.397139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:16.405609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.408039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.408039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.408039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.424165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] HTTP exception thrown: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 HTTP/1.1 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c2a93714-1069-4444-b6ee-1cd8daabec92'} Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.427188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 404 to user: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17037403-ae89-400b-a8c1-d266098c89d4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 404 len: 111 microversion: 2.1 time: 0.037352 Aug 03 04:48:16.433783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1903/3773] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:16.439005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.444899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.445796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:16.451934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.452422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.453224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.453662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.533446 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04b61a24-d67e-4c68-a2b3-977ef38e1904 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.098327 Aug 03 04:48:16.533953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1871/3774] 10.222.0.72 () {58 vars in 1230 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:48:16.546862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f7c8ecd-b608-4fcf-a8b3-de672cffacd4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f7c8ecd-b608-4fcf-a8b3-de672cffacd4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: action_args: {} Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 04:48:16.551466 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f7c8ecd-b608-4fcf-a8b3-de672cffacd4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f7c8ecd-b608-4fcf-a8b3-de672cffacd4 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010211 Aug 03 04:48:16.556905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1904/3775] 10.222.0.72 () {58 vars in 1182 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:48:16.563477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.568224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.568955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:16.574293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.574736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.575520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.575954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.601975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:48:16.630215 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75a17ad1-92de-4256-b615-df66981399b1 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.070079 Aug 03 04:48:16.631278 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1872/3776] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers => generated 683 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:16.643259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.649106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.649577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.servers [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Removing options 'limit' from query {{(pid=120832) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 04:48:16.650394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:16.655760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.656156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.656978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.657414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.682729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:48:16.715792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9e4ff2c-6352-45c8-b75b-68e3bd9feea9 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.075842 Aug 03 04:48:16.716410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1905/3777] 10.222.0.72 () {58 vars in 1144 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:16.729344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e939bb66-1d86-4bda-b328-b893d249eabb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e939bb66-1d86-4bda-b328-b893d249eabb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi '-1' Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 04:48:16.733359 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e939bb66-1d86-4bda-b328-b893d249eabb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e939bb66-1d86-4bda-b328-b893d249eabb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.009255 Aug 03 04:48:16.744460 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1873/3778] 10.222.0.72 () {58 vars in 1142 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:48:16.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:16.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.746976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.746976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.749973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:16.750671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f75c68f-45b9-4ed5-8969-877c9981aa04 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f75c68f-45b9-4ed5-8969-877c9981aa04 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: action_args: {} Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'testing' Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 03 04:48:16.754998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f75c68f-45b9-4ed5-8969-877c9981aa04 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:16.760533 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f75c68f-45b9-4ed5-8969-877c9981aa04 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013642 Aug 03 04:48:16.763545 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1874/3779] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:48:16.770645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.782374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:16.782374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.782374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.782374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:16.782374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:16.913269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:16.962592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.965472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.971638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-75309207-4786-4cae-8a74-d81d8766627c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.238004 Aug 03 04:48:16.973398 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1906/3780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:16.978088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2ea49d5-aab5-4ff1-a641-cfd7c5a1d328 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:16.983579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2ea49d5-aab5-4ff1-a641-cfd7c5a1d328 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:16.984588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2ea49d5-aab5-4ff1-a641-cfd7c5a1d328 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:16.988002 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1e28945-1be2-4b1c-a925-185ac6755459 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1662 microversion: 2.1 time: 0.223221 Aug 03 04:48:16.988650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1875/3781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1662 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:16.994151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.servers [None req-b2ea49d5-aab5-4ff1-a641-cfd7c5a1d328 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Flavor 'non_existing_flavor' could not be found {{(pid=120832) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 03 04:48:16.995585 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2ea49d5-aab5-4ff1-a641-cfd7c5a1d328 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021102 Aug 03 04:48:16.996550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1907/3782] 10.222.0.72 () {58 vars in 1178 bytes} [Wed Aug 3 04:48:16 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:48:17.012369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.021652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.022583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:17.031967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.032451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.033246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.033688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.072553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.072553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.078739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.079367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.080348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.080882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.123836 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc9ccd3f-8895-40cd-a6f1-e7dcd5434cfb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.115136 Aug 03 04:48:17.128945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1876/3783] 10.222.0.72 () {58 vars in 1174 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:48:17.135610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.136497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.142796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.143253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.144235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.144715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.306914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.316784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdf6ca3a-0f3f-475d-af10-c9d290cdd1bb tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1505 microversion: 2.1 time: 0.251099 Aug 03 04:48:17.317664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1908/3784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:17.322961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.328314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.329180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:17.337243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.337706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.338522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.342068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.423572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.429760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0733e832-63cd-436d-aba5-efc6a04bb993 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.111207 Aug 03 04:48:17.432463 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1909/3785] 10.222.0.72 () {58 vars in 1184 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:48:17.437165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.437910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.443430 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-753a5772-7643-48ba-b51a-f5291c5fa868 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.313031 Aug 03 04:48:17.444652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1877/3786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:17.449527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.449961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.452350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.452350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.452576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.453253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.464860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.465821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.468882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.470176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.600531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.617316 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a0526d6-4f94-41ec-b4fd-24c20fbab802 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1274 microversion: 2.1 time: 0.177558 Aug 03 04:48:17.617316 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1910/3787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:17.619872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.621009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.633026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.634068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.634873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.635323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.671089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.672595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7536e0f-d34e-4c6b-b1a5-19a288f5881f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/os-instance-actions/req-5c981a31-d886-4636-9c05-a5dbc3cf05ce" status: 200 len: 313 microversion: 2.1 time: 0.056233 Aug 03 04:48:17.673329 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1911/3788] 10.222.0.72 () {58 vars in 1419 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/os-instance-actions/req-5c981a31-d886-4636-9c05-a5dbc3cf05ce => generated 313 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:17.673329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:17.684524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.687325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:17.691932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.692485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.693548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.694408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.729460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.737251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:48:17.738249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-44763a68-f3e5-4cfc-b1c2-b41fc324f52a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.291477 Aug 03 04:48:17.738839 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1878/3789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:17.746452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:17.749214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:17.755741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.756505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.757453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.758053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:17.816786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:17.824769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:17.825214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.012562 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da470d68-7ca4-4287-8441-1b7deab3513b tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "POST /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/action" status: 202 len: 0 microversion: 2.1 time: 0.269586 Aug 03 04:48:18.013325 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1879/3790] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:17 2022] POST /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:18.019831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.020880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.027619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.028406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.029557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.030167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.036396 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86e1e147-f8da-4cb5-8903-493f4429c510 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.361884 Aug 03 04:48:18.052562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1912/3791] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:48:17 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:18.061641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.062262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.069163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.069616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.070447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.070945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.361398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:18.373539 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f915ff54-3726-44ac-a6db-416d233e279b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.358510 Aug 03 04:48:18.374428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1880/3792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:18.382018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.383149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.394665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.396461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.399092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.400414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.412449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:18.427664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e2239cb-c359-45b3-bc85-197b00d26bcd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1662 microversion: 2.1 time: 0.367515 Aug 03 04:48:18.431218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1913/3793] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1662 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:18.439266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-030c56c5-e4a4-4a85-99dc-fa7f2eeb85f8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.444382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-030c56c5-e4a4-4a85-99dc-fa7f2eeb85f8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:18.445472 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-030c56c5-e4a4-4a85-99dc-fa7f2eeb85f8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013245 Aug 03 04:48:18.462293 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1914/3794] 10.222.0.72 () {58 vars in 1178 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:48:18.614080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.614732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.621650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.622255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.623139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.623704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.663017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a49b1f9-5263-4e0f-8c6d-e38f1e0ad4eb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/ips" status: 200 len: 151 microversion: 2.20 time: 0.204533 Aug 03 04:48:18.663860 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1915/3795] 10.222.0.72 () {60 vars in 1289 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/ips => generated 151 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:48:18.669015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.676241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:18.677405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Searching by: {'deleted': False, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:48:18.682998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.683660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.684661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.685358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.712686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:18.720823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be9c6bfd-4fa4-427d-8ef7-c1cd13f0a7ea tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1507 microversion: 2.1 time: 0.344270 Aug 03 04:48:18.721090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1881/3796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:18.729506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.733474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.747282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.747531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.748524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.749444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.758347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:48:18.815102 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c7c4586-e8b1-421a-85a1-2012773d17db tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.149713 Aug 03 04:48:18.816551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1916/3797] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers => generated 683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:18.823345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-47519fc8-526d-47ee-87cb-a710d48d37ed req-943746b5-337d-42ad-baa8-9b8c19d3dc86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-plugged", "status": "completed", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:18.835303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-47519fc8-526d-47ee-87cb-a710d48d37ed req-943746b5-337d-42ad-baa8-9b8c19d3dc86 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.835943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-47519fc8-526d-47ee-87cb-a710d48d37ed req-943746b5-337d-42ad-baa8-9b8c19d3dc86 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.850749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-47519fc8-526d-47ee-87cb-a710d48d37ed req-943746b5-337d-42ad-baa8-9b8c19d3dc86 service nova] Creating event network-vif-plugged:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:48:18.857607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-47519fc8-526d-47ee-87cb-a710d48d37ed req-943746b5-337d-42ad-baa8-9b8c19d3dc86 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039227 Aug 03 04:48:18.858977 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1917/3798] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:18.866260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:18.867718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:18.876838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.878817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:18.881490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:18.882340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.054827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:19.064944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10a3d176-2f31-443b-8729-85c6062ad037 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1272 microversion: 2.1 time: 0.204256 Aug 03 04:48:19.076301 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1918/3799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:19.076301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.079122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.116422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.116793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.119368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.120063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.126297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:19.140235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16f3e13d-4bbe-45ba-9345-af11f6ce621b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.414347 Aug 03 04:48:19.141228 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1882/3800] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:18 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:19.165001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.165001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.172031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.172552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.173584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.198425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.244668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] HTTP exception thrown: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 HTTP/1.1 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c2a93714-1069-4444-b6ee-1cd8daabec92'} Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:19.246404 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:19.251819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 404 to user: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:19.257306 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41d93257-ff48-46e8-880b-10b167bcb1fd tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 404 len: 111 microversion: 2.1 time: 0.098030 Aug 03 04:48:19.258208 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1883/3801] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:19 2022] DELETE /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:19.271318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.271838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.279756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.280227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.281208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.283181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.350295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:19.368356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:19.462671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:19.473706 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a75089d5-4b64-4cd8-9f90-e12f119f92a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.401857 Aug 03 04:48:19.475121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1919/3802] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:19 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:19.481325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.482300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.490683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.491481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.492540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.493251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.718515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:19.727158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00e1ef09-fa2f-498e-93d3-7efe211e887c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.250586 Aug 03 04:48:19.729545 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1920/3803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:19 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:19.736255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.737727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.756957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.758586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.758762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.759667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.813745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-031c8c3b-fe00-47fb-b419-389aeff4e203 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 204 len: 0 microversion: 2.1 time: 0.548454 Aug 03 04:48:19.814358 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1884/3804] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:19 2022] DELETE /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:19.820942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.821805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.828092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.828837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.829620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.830061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.969172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:19.977075 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-472072f2-50fb-400c-914f-2fb403e24824 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1666 microversion: 2.1 time: 0.245335 Aug 03 04:48:19.977875 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1921/3805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:19 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1666 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:19.982228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:19.982835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:19.989392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.989924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:19.990694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:19.991131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.009516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:20.017756 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3fdbe797-4865-4cbb-8ee6-41af3ccba618 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1507 microversion: 2.1 time: 0.202238 Aug 03 04:48:20.018914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1885/3806] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:19 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:20.023795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.024420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.031488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.032245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.033292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.033833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.064455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:20.152976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:20.164813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c766129-feb8-465b-a71a-e8e2bee8182a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.185585 Aug 03 04:48:20.172403 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1922/3807] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:19 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:20.173234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.180414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.181993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.182875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.183677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.184118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.337708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:20.345873 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b081627-0b7a-429e-8e08-f0df94584fe1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.178990 Aug 03 04:48:20.347562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1923/3808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:20 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:20.352255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.353023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.359264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.359784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.367037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.367037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.518311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:20.528085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-630f86c1-0935-43cb-b40d-d297e38e1a83 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.179605 Aug 03 04:48:20.528712 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1924/3809] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:20 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:20.538280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:20.538896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.545800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.546335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.549407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.549407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.564009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:20.572344 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-692033c3-e6c8-4f96-805d-28826803c3c8 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 204 len: 0 microversion: 2.1 time: 0.551836 Aug 03 04:48:20.573150 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1886/3810] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:20 2022] DELETE /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:20.579638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c3ae22d8-046e-4e74-8c59-0a418d0f62f5 req-cf08c97e-9889-4683-82ff-bed43897d1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb81dbc-92a7-4589-b911-665d67b1a77e", "tag": "dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:20.589871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c3ae22d8-046e-4e74-8c59-0a418d0f62f5 req-cf08c97e-9889-4683-82ff-bed43897d1da service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.590377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c3ae22d8-046e-4e74-8c59-0a418d0f62f5 req-cf08c97e-9889-4683-82ff-bed43897d1da service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.607858 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c3ae22d8-046e-4e74-8c59-0a418d0f62f5 req-cf08c97e-9889-4683-82ff-bed43897d1da service nova] Creating event network-changed:dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc for instance 0eb81dbc-92a7-4589-b911-665d67b1a77e on n-h2-826756-5 Aug 03 04:48:20.613898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c3ae22d8-046e-4e74-8c59-0a418d0f62f5 req-cf08c97e-9889-4683-82ff-bed43897d1da service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039112 Aug 03 04:48:20.614510 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1887/3811] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:20.619906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.620654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.627410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.627901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.628765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.629203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.759718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Unlocking {{(pid=120832) unlock /opt/stack/nova/nova/compute/api.py:4810}} Aug 03 04:48:20.795148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:20.803936 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4bc581b1-d5bb-46cf-a6ce-673a27a3a8c2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.188282 Aug 03 04:48:20.804614 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1888/3812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:20 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:20.809176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.810386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: c2a93714-1069-4444-b6ee-1cd8daabec92] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.818604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.819259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.819888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.820420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.836034 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] HTTP exception thrown: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 HTTP/1.1 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c2a93714-1069-4444-b6ee-1cd8daabec92'} Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:20.837723 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 404 to user: Instance c2a93714-1069-4444-b6ee-1cd8daabec92 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d89341f-0181-4579-9991-84f63f0ca6bb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92" status: 404 len: 111 microversion: 2.1 time: 0.033581 Aug 03 04:48:20.846988 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1889/3813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:20 2022] GET /compute/v2.1/servers/c2a93714-1069-4444-b6ee-1cd8daabec92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:20.849402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:20.850012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:20.856170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.856643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:20.857944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:20.857944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.103614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:21.111724 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b98fe2e9-0256-4d62-897e-dfea75f8f270 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 200 len: 1522 microversion: 2.1 time: 0.267201 Aug 03 04:48:21.114526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1890/3814] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:20 2022] GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:21.116895 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e77399cd-119e-4dba-857a-f21979517bea tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.584095 Aug 03 04:48:21.117312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-41d12afa-b493-4f23-8776-6430a6187f0d req-8d1b2019-5f37-41dc-be6e-0fa8f007fff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c4b733-ed81-4164-8448-5bc667788e1d", "name": "network-vif-plugged", "status": "completed", "tag": "48db9db0-6b04-4c02-b8c3-06fcac1fd327"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:21.117886 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1925/3815] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:20 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:21.125247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.125247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.132834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.133487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.133846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41d12afa-b493-4f23-8776-6430a6187f0d req-8d1b2019-5f37-41dc-be6e-0fa8f007fff6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.134289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41d12afa-b493-4f23-8776-6430a6187f0d req-8d1b2019-5f37-41dc-be6e-0fa8f007fff6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.134403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.134916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.147576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-41d12afa-b493-4f23-8776-6430a6187f0d req-8d1b2019-5f37-41dc-be6e-0fa8f007fff6 service nova] Creating event network-vif-plugged:48db9db0-6b04-4c02-b8c3-06fcac1fd327 for instance 47c4b733-ed81-4164-8448-5bc667788e1d on n-h1-826756-5 Aug 03 04:48:21.153280 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-41d12afa-b493-4f23-8776-6430a6187f0d req-8d1b2019-5f37-41dc-be6e-0fa8f007fff6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039233 Aug 03 04:48:21.154161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1891/3816] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:21.160707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.160707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.166558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.167008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.167852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.168303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.656694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:21.661257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:21.665733 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6504cdd5-44a2-4135-863f-3a8cbf287c74 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1512 microversion: 2.1 time: 0.546859 Aug 03 04:48:21.666610 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1926/3817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:21.669449 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af4cb37a-48dc-4405-81ea-91dc02cb6e82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.514340 Aug 03 04:48:21.680537 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1892/3818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:21.680710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.680710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.680928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.680928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.681128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.681128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.681128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.681128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.682612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.683178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.684018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.684901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.882943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:21.891063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:21.900612 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d007bdf9-3c67-4302-98f6-061520e45817 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.233020 Aug 03 04:48:21.903237 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1927/3819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:21.908520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.909933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.912529 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27b7ff16-ef12-4fba-b75c-c33623dfa47f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.241300 Aug 03 04:48:21.925600 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1893/3820] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:21.933054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:21.933819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:21.941300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.945009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.945864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.946213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.946881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.947113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:21.947542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:21.947672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.286171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:22.296023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0f06c15-efe9-4e51-96ea-6b6125efb093 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.369068 Aug 03 04:48:22.296635 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1894/3821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.310318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.320109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:22.330101 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0198e067-1c30-4152-ba1e-96dd2904f500 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.425228 Aug 03 04:48:22.343886 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1928/3822] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:21 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:22.343886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:22.343886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:22.350319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.350776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.351557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.351996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.381900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'flavor' on Instance uuid d032b7f3-b746-4288-8eb9-2ef11fa839f7 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:22.540259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:22.548055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ce191b1-400e-48fb-80ac-22a4abd0c4df tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 200 len: 1522 microversion: 2.1 time: 0.250414 Aug 03 04:48:22.548755 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1895/3823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:22 2022] GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:22.554552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:22.555166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:22.562685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.563148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.564031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.564506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.742036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:22.750062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0e422e3-79ae-4ffc-97d7-db317ff1f7eb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.200315 Aug 03 04:48:22.750795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1896/3824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:22 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:22.755497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:22.756104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:22.762232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.762682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:22.763446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:22.763947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.006860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.015975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95ec53f3-82d5-4e9f-bd74-90635fa1c5da tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1505 microversion: 2.1 time: 0.263941 Aug 03 04:48:23.017334 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1897/3825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:22 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.032220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:23.032865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.045446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.047890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.048434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c59dc736-e0db-40af-b87f-086aa14acd7a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/action" status: 202 len: 0 microversion: 2.20 time: 0.711569 Aug 03 04:48:23.048975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.052367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1929/3826] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:48:22 2022] POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:23.053182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.055714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.056456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.067025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.067478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.068499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.068939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.214059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.222398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-582bfdcc-e559-4ea8-a0ae-5b949ee84b52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.171507 Aug 03 04:48:23.222984 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1930/3827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.227781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.228636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.235040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.235186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.236104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.236717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.338131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a127608e-dccf-4464-980d-4530f596eade tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.319081 Aug 03 04:48:23.341792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1898/3828] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:23 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:23.345018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b08961f8-d0c1-4fd7-bf3b-69fdd93f929d req-69404952-9397-49e2-b5de-c741db55a121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c", "name": "network-vif-deleted", "tag": "cea175d0-06d0-49a8-90fb-b2d4629d4ac3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:23.355297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b08961f8-d0c1-4fd7-bf3b-69fdd93f929d req-69404952-9397-49e2-b5de-c741db55a121 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.355746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b08961f8-d0c1-4fd7-bf3b-69fdd93f929d req-69404952-9397-49e2-b5de-c741db55a121 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.385119 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b08961f8-d0c1-4fd7-bf3b-69fdd93f929d req-69404952-9397-49e2-b5de-c741db55a121 service nova] Creating event network-vif-deleted:cea175d0-06d0-49a8-90fb-b2d4629d4ac3 for instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c on n-h1-826756-5 Aug 03 04:48:23.390068 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b08961f8-d0c1-4fd7-bf3b-69fdd93f929d req-69404952-9397-49e2-b5de-c741db55a121 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049408 Aug 03 04:48:23.390945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1899/3829] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:23.398350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '.version_select at 0x7fdd59c66160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.399049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.405418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.405875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.406768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.407165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.407329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.412966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:23.416920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41774b58-bff2-4c1b-9249-111b5e809c53 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1317 microversion: 2.1 time: 0.192902 Aug 03 04:48:23.431193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1931/3830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.436058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.436734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.440802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-772a6c1c-91c4-4175-a96a-6a8f21ba2646 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.048524 Aug 03 04:48:23.442308 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1900/3831] 10.222.0.72 () {58 vars in 1296 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f/os-instance-actions => generated 611 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:23.446196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.446196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.446196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.446196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.447679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-060dbbba-b182-4ef3-b262-9decb9b68ce9 req-5fb897c3-9f4b-4728-a17d-e76a817b7748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48875e1-28b9-4057-86dc-3698445d0163", "name": "network-vif-plugged", "status": "completed", "tag": "698e9060-e53c-40b6-9b7b-9b2f003db458"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:23.458193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-060dbbba-b182-4ef3-b262-9decb9b68ce9 req-5fb897c3-9f4b-4728-a17d-e76a817b7748 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.458775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-060dbbba-b182-4ef3-b262-9decb9b68ce9 req-5fb897c3-9f4b-4728-a17d-e76a817b7748 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.479805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-060dbbba-b182-4ef3-b262-9decb9b68ce9 req-5fb897c3-9f4b-4728-a17d-e76a817b7748 service nova] Creating event network-vif-plugged:698e9060-e53c-40b6-9b7b-9b2f003db458 for instance c48875e1-28b9-4057-86dc-3698445d0163 on n-h2-826756-5 Aug 03 04:48:23.484904 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-060dbbba-b182-4ef3-b262-9decb9b68ce9 req-5fb897c3-9f4b-4728-a17d-e76a817b7748 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041218 Aug 03 04:48:23.485821 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1901/3832] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:23.491854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.492585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.499473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.499921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.500718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.501200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.664161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.672325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.673931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.675946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a414d5d-3b07-4b6c-b359-343331b52b75 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.243645 Aug 03 04:48:23.676770 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1932/3833] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:23.681406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.682105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.695264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.695264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.695264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.695264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.695714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.701061 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1287c4b4-62a2-4da9-a5e7-0d7f54182655 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.213977 Aug 03 04:48:23.701652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1902/3834] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.708335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.709131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.718230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.718699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.719648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.720324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.749241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:23.853057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.861202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34c80f07-5a07-4506-9817-b251c2993b0b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1674 microversion: 2.1 time: 0.183457 Aug 03 04:48:23.861831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1933/3835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.867841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:23.868509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:23.879740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.879740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.879740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.879740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.911249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.911826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.912319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lazy-loading 'fault' on Instance uuid cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:23.958506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:23.966491 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fefc0a2-e3a8-4bed-afa4-fdaa4e87f773 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 200 len: 1313 microversion: 2.1 time: 0.102473 Aug 03 04:48:23.967090 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1934/3836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:23 2022] GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 1313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:23.971750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5fc61e19-94f0-49aa-8e66-a98ab8b08fdf req-12b49c75-3750-4ca0-8fb7-5bbd0108bd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa67fbca-5bec-4caa-b2e0-da6853e94f8b", "name": "network-vif-deleted", "tag": "117b712f-9906-4e90-be43-bb84624d5340"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:23.981918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5fc61e19-94f0-49aa-8e66-a98ab8b08fdf req-12b49c75-3750-4ca0-8fb7-5bbd0108bd59 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:23.982373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5fc61e19-94f0-49aa-8e66-a98ab8b08fdf req-12b49c75-3750-4ca0-8fb7-5bbd0108bd59 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:23.994716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5fc61e19-94f0-49aa-8e66-a98ab8b08fdf req-12b49c75-3750-4ca0-8fb7-5bbd0108bd59 service nova] Creating event network-vif-deleted:117b712f-9906-4e90-be43-bb84624d5340 for instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b on n-h2-826756-5 Aug 03 04:48:23.999507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5fc61e19-94f0-49aa-8e66-a98ab8b08fdf req-12b49c75-3750-4ca0-8fb7-5bbd0108bd59 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Aug 03 04:48:24.000098 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1935/3837] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:24.193974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b64cefcf-6c1a-469b-8b11-35d409a1397c tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 204 len: 0 microversion: 2.1 time: 0.490754 Aug 03 04:48:24.196848 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1903/3838] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:23 2022] DELETE /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:24.204142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.206006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.212918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.213455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.214241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.214688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.244609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.245488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.251745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.252290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.253164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.253666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.402814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.410818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8a3848a-5e81-4e00-af4a-6540a209770f tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1511 microversion: 2.1 time: 0.210958 Aug 03 04:48:24.411404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1936/3839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:24.426316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.434047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b1281ac-11dc-487b-ac83-753a747357b3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.193461 Aug 03 04:48:24.437796 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1904/3840] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:24.438524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.439143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.446678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.447030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.447800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.448234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.578651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.583189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:24.587573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21948ca1-6f51-4714-b20f-8397e0fb886c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1467 microversion: 2.1 time: 0.152971 Aug 03 04:48:24.588142 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1937/3841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1467 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:24.613824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.614457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.621349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.621800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.622560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.623000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.702035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.702989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.710192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.710654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.711438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.711883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.791055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.798406 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d06a2dcb-a61b-4b7e-b449-799e8daa292d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1468 microversion: 2.1 time: 0.188940 Aug 03 04:48:24.798976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1905/3842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:24.804207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.804839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.810981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.811427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.812444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.813106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.895181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.903901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.905670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.908113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00247b6a-a441-480c-8c91-839bd53da5ff tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.209041 Aug 03 04:48:24.916847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1938/3843] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:48:24.930565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-968469717"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:24.933077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:24.939636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.940616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.941572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:24.942078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:24.980422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:24.989127 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8a716d1-55fc-42c9-a733-b6e1cc00e4ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.188453 Aug 03 04:48:24.989712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1906/3844] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:24.994841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:24.995646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.002297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.005508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.005508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.005508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.180816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:25.189862 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a0e2b648-7259-4e76-a7d4-01bf550142a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1674 microversion: 2.1 time: 0.198990 Aug 03 04:48:25.190597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1907/3845] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:24 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:25.196515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.197139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.204409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.204936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.206532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.207554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.222065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] HTTP exception thrown: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c HTTP/1.1 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c'} Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:25.223885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 404 to user: Instance cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae51180d-1cc6-4748-8cef-e42493e72a82 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c" status: 404 len: 111 microversion: 2.1 time: 0.033602 Aug 03 04:48:25.232215 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1908/3846] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/servers/cf4e51b2-2832-4046-a23d-0f2fdbbc0f1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:25.233905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.234574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.241483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.241935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.242745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.243186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.318075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:25.326165 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1edbafda-4f2c-495f-a16c-e7998aed29eb tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1308 microversion: 2.1 time: 0.095877 Aug 03 04:48:25.326757 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1909/3847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:25.414283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae7d03a3-7d69-4d2f-ac81-e8a3cc2d8d19 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "POST /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd/action" status: 202 len: 0 microversion: 2.1 time: 0.496185 Aug 03 04:48:25.414928 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1939/3848] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:24 2022] POST /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:48:25.425913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-430957a8-1e32-4f43-ba13-87b7571f8100 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd548a6160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.431453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.432144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.438853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.439307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.440334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.440930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.479162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-430957a8-1e32-4f43-ba13-87b7571f8100 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.057734 Aug 03 04:48:25.479738 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1910/3849] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.496496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.620614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:25.628207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f929f3b3-2249-4bf3-a8c6-77511661e3e8 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1511 microversion: 2.1 time: 0.200855 Aug 03 04:48:25.628829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1940/3850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1511 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:25.709390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:25.716923 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d557ae57-9e6e-4f22-b08d-39c3bcce8b37 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.235915 Aug 03 04:48:25.717556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1911/3851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:25.934438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:25.934976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:25.942503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.942955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:25.943726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:25.944165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.021068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.021924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.028673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.029162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.029945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.030570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.189109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.197501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.207591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.207591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81f24814-802c-457a-b6a5-f4508ef46500 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.270048 Aug 03 04:48:26.207591 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1941/3852] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:25 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:26.222241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.223207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.226996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.229855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.230137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.230916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.231362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.236712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a8d78211-f0a4-49c5-ba09-415129e32600 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.219423 Aug 03 04:48:26.250907 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1912/3853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:26.347481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.348174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.355867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.357752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.357752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.357752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.398577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.399032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.399494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lazy-loading 'fault' on Instance uuid fa67fbca-5bec-4caa-b2e0-da6853e94f8b {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:26.455052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6d243898f449928f73450d5066b73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ddf87ba4bf444aea56c784114bfeda0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.461954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.464160 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f3a1d5d-60c8-4f1f-b6b5-53bc832a65a6 tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 200 len: 1313 microversion: 2.1 time: 0.120863 Aug 03 04:48:26.464943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1913/3854] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 1313 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:26.469546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-39dd7e19-f139-4534-bf90-b86b6d92c15e req-cb641c6d-cd28-47bb-a566-c7f41b024bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14fd57a8-202c-4f2b-ba0a-f33a3714457f", "name": "network-vif-deleted", "tag": "a9fe8225-dc7c-48ca-88cc-8ecfd1ced288"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:26.470046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97e46c4a-67bf-4f72-b0d4-8ce5c967f2ed tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1654 microversion: 2.1 time: 0.252469 Aug 03 04:48:26.470742 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1942/3855] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1654 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:26.479410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-39dd7e19-f139-4534-bf90-b86b6d92c15e req-cb641c6d-cd28-47bb-a566-c7f41b024bbc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.479868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-39dd7e19-f139-4534-bf90-b86b6d92c15e req-cb641c6d-cd28-47bb-a566-c7f41b024bbc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.491543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:26.492075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.494837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-39dd7e19-f139-4534-bf90-b86b6d92c15e req-cb641c6d-cd28-47bb-a566-c7f41b024bbc service nova] Creating event network-vif-deleted:a9fe8225-dc7c-48ca-88cc-8ecfd1ced288 for instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f on n-h1-826756-5 Aug 03 04:48:26.499742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-39dd7e19-f139-4534-bf90-b86b6d92c15e req-cb641c6d-cd28-47bb-a566-c7f41b024bbc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033595 Aug 03 04:48:26.500215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.501186 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1914/3856] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:26.501407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.503390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.503846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.507288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a77929be-ac3c-4882-acca-f74fd1cfeeb9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd5497c790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.566254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a77929be-ac3c-4882-acca-f74fd1cfeeb9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.063801 Aug 03 04:48:26.567027 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1915/3857] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:26.650783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.651543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.660315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.660819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.661607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.662040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.741245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e90a0802a4a8f8e7b0762e3eaf8bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8562bcdca71d4b7a8b1569f260ba44e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.749066 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-841d43c4-f076-49db-9270-60c95c22a064 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 200 len: 1301 microversion: 2.1 time: 0.102469 Aug 03 04:48:26.749647 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1916/3858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:26.754942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.755548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.762115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.762658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.763819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.764236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.770672 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4dc2ffc4-6543-4635-b878-49098b94cb74 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.283217 Aug 03 04:48:26.771812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1943/3859] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:26 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:48:26.779861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:26.780691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:26.787326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.788246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.788794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:26.789296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:26.977161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:26.984657 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-087b6be3-7643-4ea0-b292-bbb5cecccfde tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.233992 Aug 03 04:48:26.985236 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1917/3860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:26.996235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:27.005122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-765202ec-027b-4388-9333-50f71cd3d668 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1661 microversion: 2.1 time: 0.229496 Aug 03 04:48:27.005698 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1944/3861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1661 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:27.224826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:27.225365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:27.227365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:27.232443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.232807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.233580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.234043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.259200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:27.260687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:27.265946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.266405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.267179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.267623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.429367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:27.431570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:27.440575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:27.442099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:27.442820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:27.444806 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c36b330-9059-461a-a7a5-152759165a15 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.225841 Aug 03 04:48:27.445607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1918/3862] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:27 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:27.450268 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91d65dfd-25e3-48c7-80f7-6a1633efffe2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1292 microversion: 2.1 time: 0.194856 Aug 03 04:48:27.450921 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1945/3863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:27 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1292 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:27.488944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:27.489595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] [instance: fa67fbca-5bec-4caa-b2e0-da6853e94f8b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:27.495833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.508731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.508731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.508731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.514171 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] HTTP exception thrown: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Request method failure captured: Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b HTTP/1.1 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f3lgUzYsnHljcQDC8jtQPKIH_fMgxdMUL1L0lTY_7-qbfMrbyVSpCmcF_qIeWBhS41HPucjmn43aYIYeEr2_wYjXruijCCi1VMEK7fEweUn18xuUjYINunmQdERv_lG6wI-JhLMXVyJfMgsRaEKkUN-VOul1NVrrd1ao-4MYFGM2SU Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1ddf87ba4bf444aea56c784114bfeda0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1ddf87ba4bf444aea56c784114bfeda0 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-23009263 Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 4c6d243898f449928f73450d5066b73a Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServersNegativeTestJSON-23009263-project Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fa67fbca-5bec-4caa-b2e0-da6853e94f8b'} Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:27.515945 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] Returning 404 to user: Instance fa67fbca-5bec-4caa-b2e0-da6853e94f8b could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1adcd8fe-e999-40de-ac32-6c54b7c4796d tempest-ListServersNegativeTestJSON-23009263 tempest-ListServersNegativeTestJSON-23009263-project] 10.222.0.72 "GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b" status: 404 len: 111 microversion: 2.1 time: 0.033097 Aug 03 04:48:27.523871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1919/3864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:27 2022] GET /compute/v2.1/servers/fa67fbca-5bec-4caa-b2e0-da6853e94f8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:27.583660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e48621a-57b0-4254-8388-f5f49ea7ae8e tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d85e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:27.630390 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9e48621a-57b0-4254-8388-f5f49ea7ae8e tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.052305 Aug 03 04:48:27.630941 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1946/3865] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:27 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:27.774810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:27.776229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] [instance: 14fd57a8-202c-4f2b-ba0a-f33a3714457f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:27.785940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.786648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.787455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:27.788308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:27.805609 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] HTTP exception thrown: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Request method failure captured: Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f HTTP/1.1 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f32n_t5E7KIDfFUMPgWaPfF011NvIvtUsBWI63AUVlriVMAyQQSHVV_HihGBTKoRUL3T6sBjpuXm3qXt_p8ukTjzUBcyUWN2qPbT051lDybFHSKxo81YSkdurNEaSMU-YgYSwbqn_apfhL--1m7ACIXDHkAlg7oKhF_ikQsN3P0V4s Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8562bcdca71d4b7a8b1569f260ba44e8 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-InstanceActionsTestJSON-1095842277 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8562bcdca71d4b7a8b1569f260ba44e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8562bcdca71d4b7a8b1569f260ba44e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8562bcdca71d4b7a8b1569f260ba44e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8562bcdca71d4b7a8b1569f260ba44e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-InstanceActionsTestJSON-1095842277 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8562bcdca71d4b7a8b1569f260ba44e8 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1095842277 Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-InstanceActionsTestJSON-1095842277-project Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e75e90a0802a4a8f8e7b0762e3eaf8bd Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-InstanceActionsTestJSON-1095842277-project Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '14fd57a8-202c-4f2b-ba0a-f33a3714457f'} Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:27.807548 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] Returning 404 to user: Instance 14fd57a8-202c-4f2b-ba0a-f33a3714457f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a01ca3fb-b383-4acf-ac6b-df5a97ea02c0 tempest-InstanceActionsTestJSON-1095842277 tempest-InstanceActionsTestJSON-1095842277-project] 10.222.0.72 "GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f" status: 404 len: 111 microversion: 2.1 time: 0.041202 Aug 03 04:48:27.812100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1920/3866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:27 2022] GET /compute/v2.1/servers/14fd57a8-202c-4f2b-ba0a-f33a3714457f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:28.013287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.013846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.015977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:28.030375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.030375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.030691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.030691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.030923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.030923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.037562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.038384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.039489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.040159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.356009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.367006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a82f2dab-08ac-4e46-923e-8bb0590688eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.364922 Aug 03 04:48:28.373789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.382674 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f5418d06-9f52-4e3b-b27c-4d65a43384ad tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.359974 Aug 03 04:48:28.383260 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1921/3867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:28.389000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1947/3868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:28.405223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.405844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.412002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.412498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.413617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.413750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.472908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.473669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.488440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.489342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.490680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.492855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.680492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.690553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92cc0d4d-d266-434e-9ede-d0760558cff9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.288128 Aug 03 04:48:28.697443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1922/3869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:28.711354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:28.717331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.719687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.739979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.741846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.745820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.748615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.793112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.800897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.802408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:28.807130 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2215b278-bd6b-409d-9b4a-16ea2960fa9a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.341314 Aug 03 04:48:28.807883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1948/3870] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:28.812629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb99f780-e978-4645-a46b-5c4784d2304b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d85af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.894320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb99f780-e978-4645-a46b-5c4784d2304b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.085400 Aug 03 04:48:28.902200 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1949/3871] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:28.907877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:28.909043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:28.916395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.917196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:28.918231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:28.918896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:29.166884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:29.182511 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6d20f7e-0592-401f-8656-46a98a5bb5f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1473 microversion: 2.1 time: 0.481422 Aug 03 04:48:29.183356 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1923/3872] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1473 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:29.269716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:29.279148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1476905224", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:29.302589 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8378c94-1595-4a1e-9ad7-547c94ff6ec4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.387206 Aug 03 04:48:29.302589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1950/3873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:28 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:29.322420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:29.323306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:29.329427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:29.343161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:29.345314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:29.345314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:29.345667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:29.392651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:30.315699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:30.333630 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5bf2a6c3-eafe-407a-bd4a-9e5fbe8d8043 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 1.015149 Aug 03 04:48:30.334847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1951/3874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:29 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:30.339714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:30.340571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:30.352789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:30.358345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:30.359453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:30.360082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:30.917156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:30.918041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:30.918806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:30.919613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:30.920389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:30.942975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:30.943428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:30.944243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:30.947268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:30.969265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:30.974062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:30.981680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:30.985406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1261cb9-dd57-4c14-ac67-417d5c63f8f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.648586 Aug 03 04:48:30.985717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1952/3875] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:30 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:30.990573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:30.991394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:30.998161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:31.009285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.010592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.011598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.012405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.012540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:31.177476 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73a779c6-dbfd-4d31-86c2-356636740ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902334 Aug 03 04:48:31.178377 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1924/3876] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:31.183571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c818db95-c8ad-4f63-a6a7-5d2a9fd3c420 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd547415e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:31.308846 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c818db95-c8ad-4f63-a6a7-5d2a9fd3c420 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.129022 Aug 03 04:48:31.310668 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1925/3877] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:31 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:31.320572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:31.327852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:31.343136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.343800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.344703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.347371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:31.348524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.358094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:31.374668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:31.379737 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d85a244-fc01-4d30-9a76-dbfe7b49fdf6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.392828 Aug 03 04:48:31.389337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1953/3878] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:30 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:31.433211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1ba4c0af-cc5f-44c7-9b74-dd48741d7ef0 req-abfda15a-a569-4e1f-ba70-d0cd53c5c1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-plugged", "status": "completed", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:31.479407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1ba4c0af-cc5f-44c7-9b74-dd48741d7ef0 req-abfda15a-a569-4e1f-ba70-d0cd53c5c1e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.481821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1ba4c0af-cc5f-44c7-9b74-dd48741d7ef0 req-abfda15a-a569-4e1f-ba70-d0cd53c5c1e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.508874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:31.512781 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1ba4c0af-cc5f-44c7-9b74-dd48741d7ef0 req-abfda15a-a569-4e1f-ba70-d0cd53c5c1e4 service nova] Creating event network-vif-plugged:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:48:31.530294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1ba4c0af-cc5f-44c7-9b74-dd48741d7ef0 req-abfda15a-a569-4e1f-ba70-d0cd53c5c1e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137862 Aug 03 04:48:31.532165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1954/3879] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:31.544876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:31.546393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:31.591433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:31.805790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:31.819308 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bac54a3b-06ad-40c3-965e-be6c4f41539a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.504411 Aug 03 04:48:31.820257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1926/3880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:31 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:31.841133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:31.842084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:31.858672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.863193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:31.865850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:31.866276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:32.202857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:32.212087 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-551fa3aa-ad32-45cf-964b-f20707c32c5c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.374864 Aug 03 04:48:32.224963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1927/3881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:31 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:32.232256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:32.233588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:32.242499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:32.256738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:32.258018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:32.261243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:32.347135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.scheduler.client.report [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Deleted allocations for instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 Aug 03 04:48:32.354871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Instance Mapping does not exist while attempting local delete cleanup. Aug 03 04:48:32.357230 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9be2d9f-48e2-4e39-9000-c0a8198e4a9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298" status: 204 len: 0 microversion: 2.1 time: 0.821601 Aug 03 04:48:32.363072 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1955/3882] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:31 2022] DELETE /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:32.372790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07e3cd3e-18a6-4f0d-b8ea-febcbdcc34d6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d8ff70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:32.523625 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07e3cd3e-18a6-4f0d-b8ea-febcbdcc34d6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.161816 Aug 03 04:48:32.524742 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1956/3883] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:32 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:32.541237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:32.543074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:32.559806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:32.567186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 HTTP/1.1 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8e71b753-b10d-4a4b-92a6-645cb1f39298'} Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:48:32.569194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:48:32.575928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e35999a9-0c6e-4efc-aeca-922c3e887bda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298" status: 404 len: 111 microversion: 2.1 time: 0.043671 Aug 03 04:48:32.576505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1957/3884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:32 2022] GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:48:32.589031 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e61bf54e-2f37-4808-bdce-14d05bf0ba3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.361376 Aug 03 04:48:32.590259 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1928/3885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:32 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:32.601141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:32.603167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:32.622083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:32.622783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:32.624865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:32.631200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:32.674419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1043268643", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:32.815866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:33.169996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:33.184438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:33.186970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:33.190324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3416a18d-9470-4580-890e-00cb9b41c56b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.612341 Aug 03 04:48:33.203771 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1958/3886] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:32 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:33.544801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cc96efe-efa9-428d-839c-a1e9f4a0d6d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47cd71f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:33.618952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cc96efe-efa9-428d-839c-a1e9f4a0d6d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.083613 Aug 03 04:48:33.630419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1959/3887] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:33 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:33.637289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:33.638294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:33.647200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:33.648049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:33.649110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:33.649783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.192972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:34.194092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:34.194966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:34.195590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:34.196183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:34.200367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:34.219660 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f3d4c79-5f8d-491d-853c-0073e408065c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.584740 Aug 03 04:48:34.220615 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1960/3888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:33 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:34.226958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6124a3f6-f053-4623-8aae-1590c8ffd9f4 req-93293847-ef78-43ac-b3ab-7843f993234a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb81dbc-92a7-4589-b911-665d67b1a77e", "name": "network-vif-plugged", "status": "completed", "tag": "dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:34.233512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:34.233966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.235076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:34.235540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.244508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6124a3f6-f053-4623-8aae-1590c8ffd9f4 req-93293847-ef78-43ac-b3ab-7843f993234a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:34.245149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6124a3f6-f053-4623-8aae-1590c8ffd9f4 req-93293847-ef78-43ac-b3ab-7843f993234a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.257781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:34.267002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6124a3f6-f053-4623-8aae-1590c8ffd9f4 req-93293847-ef78-43ac-b3ab-7843f993234a service nova] Creating event network-vif-plugged:dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc for instance 0eb81dbc-92a7-4589-b911-665d67b1a77e on n-h2-826756-5 Aug 03 04:48:34.270260 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6124a3f6-f053-4623-8aae-1590c8ffd9f4 req-93293847-ef78-43ac-b3ab-7843f993234a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Aug 03 04:48:34.272438 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1961/3889] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:34.278243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:34.279255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:34.286007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:34.286459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.287125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:34.287326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:34.287659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:34.305978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:34.308536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:34.563859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:34.573629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:34.575419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:34.576688 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-428e93ee-63f2-48b7-b82c-e123f249f712 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.303061 Aug 03 04:48:34.577474 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1962/3890] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:34 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:34.639356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-85e7788d-dc7f-42df-b00d-3e94108394cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47cae4c0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:34.697704 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-85e7788d-dc7f-42df-b00d-3e94108394cb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.067984 Aug 03 04:48:34.698799 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1963/3891] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:34 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:34.750683 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bcb63c71-b12f-4f3e-a979-5f9e3d3e3044 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.080871 Aug 03 04:48:34.751356 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1929/3892] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:34.763268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1187c9a4-c39d-400b-aaef-c61e123261f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:34.763882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1187c9a4-c39d-400b-aaef-c61e123261f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:34.895164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1187c9a4-c39d-400b-aaef-c61e123261f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:34.905853 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1187c9a4-c39d-400b-aaef-c61e123261f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1221 microversion: 2.1 time: 0.146411 Aug 03 04:48:34.912904 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1964/3893] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:34 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:35.244342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:35.248486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:35.250757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:35.282929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:35.282929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:35.284345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:35.284967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:35.600537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:35.601909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:35.612836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:35.615503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:35.620569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:35.620569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:35.673133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:35.687225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3adcc5f-1f66-45e9-bac5-d2628c536676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1314 microversion: 2.1 time: 0.446748 Aug 03 04:48:35.687922 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1930/3894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:35 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:35.716388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e2fb0ee-ebc4-4448-ada8-3a34f9679a0d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54809820>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:35.795729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e2fb0ee-ebc4-4448-ada8-3a34f9679a0d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.085826 Aug 03 04:48:35.805233 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1931/3895] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:35 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:35.890865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:35.903753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:35.905338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:35.906531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99434ec1-1e13-4935-9dec-fe2443412f42 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.310167 Aug 03 04:48:35.909894 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1965/3896] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:35 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:35.929152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a13f87f-398e-4ebc-b51e-799c52e152e2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:35.930042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a13f87f-398e-4ebc-b51e-799c52e152e2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:36.013230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a13f87f-398e-4ebc-b51e-799c52e152e2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:36.020878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a13f87f-398e-4ebc-b51e-799c52e152e2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1221 microversion: 2.1 time: 0.095647 Aug 03 04:48:36.039826 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1932/3897] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:35 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:36.716471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:36.716981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:36.742484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.742987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:36.743767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.744208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:36.812764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a744af02-148a-4e08-be06-d5b14cc776f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd547ebaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:36.872312 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a744af02-148a-4e08-be06-d5b14cc776f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.063595 Aug 03 04:48:36.873290 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1933/3898] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:36 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:36.936194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:36.946657 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a466a5fa-82ac-4ffc-87c2-f5b78a37b137 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1501 microversion: 2.1 time: 0.236622 Aug 03 04:48:36.947749 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1966/3899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:36 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1501 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:36.968716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:36.978745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:36.983511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:36.984114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:36.993893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.995845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.996924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:36.997968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.998096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:36.998826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:36.999458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:36.999912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:37.104632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lazy-loading 'flavor' on Instance uuid 0eb81dbc-92a7-4589-b911-665d67b1a77e {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:48:37.230435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:37.242959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:37.248979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:37.251220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea7c397f-eab8-4ca6-8584-bc3cd223e455 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.321364 Aug 03 04:48:37.254962 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1934/3900] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:36 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:37.265505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:37.267586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:37.289613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:37.290456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:37.291505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:37.292160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:37.385167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:37.394022 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-895c6494-4947-49f5-9ce2-5d6cd867cbf6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1273 microversion: 2.1 time: 0.135926 Aug 03 04:48:37.399831 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1935/3901] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:37 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:37.885359 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45a13544-5b80-406c-8c43-accee0d467a5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e/action" status: 202 len: 0 microversion: 2.1 time: 0.903786 Aug 03 04:48:37.886003 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1967/3902] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:36 2022] POST /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:48:37.895275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4141ca1-b410-4733-b5a2-c85819350b7f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd546095e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:37.899050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:37.899787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:37.908981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:37.909783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:37.910780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:37.911463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:37.970042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4141ca1-b410-4733-b5a2-c85819350b7f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.084089 Aug 03 04:48:37.979573 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1936/3903] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:37 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:38.287144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:38.289409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:38.296688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:38.299355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:38.301690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:38.302136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:38.787217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:38.823950 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40e1c57a-5c37-49c0-b48f-9a54228a21ce tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.933261 Aug 03 04:48:38.825926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:38.840337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:38.842299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:38.843834 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d75699b-6e6c-42c3-9dbb-249cf6d3a971 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.561862 Aug 03 04:48:38.844405 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1968/3904] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:37 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:38.855462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:38.856321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:38.868733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1937/3905] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:38 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:38.874914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:38.878801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:38.880155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:38.882481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:38.964696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:38.974679 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed26ec8d-ecdb-47b4-95e7-ffd3baaf0289 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1291 microversion: 2.1 time: 0.128993 Aug 03 04:48:38.975281 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1969/3906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:38 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1291 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:38.986627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ceb9edbf-173e-442e-a7d9-f21559984fd5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54609e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:39.042417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ceb9edbf-173e-442e-a7d9-f21559984fd5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.060031 Aug 03 04:48:39.043276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1938/3907] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:38 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:39.861904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:39.862869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:39.872040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:39.873068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:39.895553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:39.896293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:39.896647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:39.897330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:39.898749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:39.899509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:39.902175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:39.907239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:40.464373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:40.467710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:40.476599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:40.478700 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7967b8b1-b554-4860-828e-1a0b4d94f8db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.624405 Aug 03 04:48:40.478843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:40.479890 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e6b6acd-6118-471b-a009-ce05069f5da2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1743 microversion: 2.20 time: 0.613315 Aug 03 04:48:40.480790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1939/3908] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:39 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1743 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:40.483172 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1970/3909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:39 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:40.494978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46439f16-d5a1-4f87-bdc1-86fef3fe85b2 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47c5b550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:40.499410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:40.500628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:40.508100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:40.508693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:40.509920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:40.510428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:40.601103 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46439f16-d5a1-4f87-bdc1-86fef3fe85b2 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1454 microversion: 2.1 time: 0.116591 Aug 03 04:48:40.601704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1971/3910] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:40 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:40.610504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:40.620462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17ef938f-3b5f-4370-9881-5aae161b0404 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1279 microversion: 2.1 time: 0.136717 Aug 03 04:48:40.621789 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1940/3911] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:40 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:41.505416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:41.506383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:41.523865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:41.524665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:41.527794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:41.530859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:41.555747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1527706857", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "b2c11a15-9dc8-41ca-841c-085d0c3d918a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:41.704085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] validate_networks() for [('b2c11a15-9dc8-41ca-841c-085d0c3d918a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:42.003163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:42.014470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:42.018036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:42.025714 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b091ae93-f43b-46f7-8b8c-d8c39f485eac tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.524800 Aug 03 04:48:42.026609 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1941/3912] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:41 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:48:42.053137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:42.053137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:42.065652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:42.069562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:42.070594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:42.071204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:42.553199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:42.565809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d4a30d8-e9f9-43a5-bb55-b9b9661cc07c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.527011 Aug 03 04:48:42.567230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1942/3913] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:42 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:42.585513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f7c501b-0a6d-4be6-a98a-e2b50ad780d1 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd547914c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:42.619327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:42.624676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:42.624676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:42.624676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:42.625788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:42.669847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:42.671590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:42.672775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:42.678797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:42.752798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:42.779513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for user 07bf1b2f15da4f8b88961d0a089cb1fa and project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:42.831586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:42.854134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:43.148223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80001eb9-e85d-4b99-849c-82ce40fee871 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780151 Aug 03 04:48:43.151103 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1972/3914] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:43.160938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:43.162038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:43.183350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:43.184186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:43.185875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:43.187932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:43.813688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:43.832608 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-acc24e8c-d638-4323-b601-d23c95691807 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1321 microversion: 2.1 time: 0.679639 Aug 03 04:48:43.839225 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1973/3915] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:43 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1321 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:43.851594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5d60d434-2fc7-4257-ad2b-0c289815d957 req-4ed8034a-e1b8-425c-ab94-3ea14545c033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37bff9a7-ab46-42fc-9ef5-c390179c05eb", "tag": "c67f1c44-04c6-44a0-8702-8cf9bb45b52f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:43.880964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5d60d434-2fc7-4257-ad2b-0c289815d957 req-4ed8034a-e1b8-425c-ab94-3ea14545c033 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:43.882091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5d60d434-2fc7-4257-ad2b-0c289815d957 req-4ed8034a-e1b8-425c-ab94-3ea14545c033 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:43.911795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5d60d434-2fc7-4257-ad2b-0c289815d957 req-4ed8034a-e1b8-425c-ab94-3ea14545c033 service nova] Creating event network-changed:c67f1c44-04c6-44a0-8702-8cf9bb45b52f for instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb on n-h1-826756-5 Aug 03 04:48:43.928880 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5d60d434-2fc7-4257-ad2b-0c289815d957 req-4ed8034a-e1b8-425c-ab94-3ea14545c033 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087717 Aug 03 04:48:43.929769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1974/3916] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:43.951299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:43.952635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:43.968846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:43.972835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:43.974097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:43.977108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:44.293871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:44.467889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:44.479598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:44.482037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:44.485408 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be8753c8-c4e1-4f57-951b-de4b1c6664ba tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.552860 Aug 03 04:48:44.486054 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1975/3917] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:43 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:44.506396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-184426485", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "b2c11a15-9dc8-41ca-841c-085d0c3d918a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:46.017324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:46.501717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f7c501b-0a6d-4be6-a98a-e2b50ad780d1 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1463 microversion: 2.1 time: 3.934059 Aug 03 04:48:46.502690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1943/3918] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:42 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1463 bytes in 3936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:46.518127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] validate_networks() for [('b2c11a15-9dc8-41ca-841c-085d0c3d918a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:46.520426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:46.521254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:46.542307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:46.542765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:46.543559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:46.544001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:47.195535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:47.208433 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01166ee5-62e5-405f-bab5-dc56e29bf676 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.703429 Aug 03 04:48:47.225912 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1944/3919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:46 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:47.233875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:47.239766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:47.256460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:47.258664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:47.259718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:47.262150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:47.320257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:48.169948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:48.180416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:48.182802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:48.186457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:48.186794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:48.190606 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c6ac940-bd63-48a6-a778-625c5ffc3899 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1321 microversion: 2.1 time: 0.963147 Aug 03 04:48:48.192606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:48.200136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1945/3920] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:47 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1321 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:48.211785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:48.215239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.216762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:48.218446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.219553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.220646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.227447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.228231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.229279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.230467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.309119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:48.326257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for user 07bf1b2f15da4f8b88961d0a089cb1fa and project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:48.369103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:48.378496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:48.503552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:48.514721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:48.516523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:48.519196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b10813ad-0543-4956-abeb-4d30a91b8415 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.316537 Aug 03 04:48:48.520314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1946/3921] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:48 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:48.525534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a94c075-22d0-4b4c-8ba5-4462a7ecaab6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54604dc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:48.592746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7d806af-21a8-4d7f-9e7f-970ea0ce4b88 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.103729 Aug 03 04:48:48.593960 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1976/3922] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:48.607861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b55b877f-0104-4822-90a9-1c81c6fbd322 req-0120f947-571e-4221-ba61-c82057cd320f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-plugged", "status": "completed", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:48.639149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a94c075-22d0-4b4c-8ba5-4462a7ecaab6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 200 len: 1463 microversion: 2.1 time: 0.117203 Aug 03 04:48:48.640464 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1947/3923] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:48 2022] GET /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 1463 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:48.643584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b55b877f-0104-4822-90a9-1c81c6fbd322 req-0120f947-571e-4221-ba61-c82057cd320f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.644025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b55b877f-0104-4822-90a9-1c81c6fbd322 req-0120f947-571e-4221-ba61-c82057cd320f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.648251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:48.654380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:48.657479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.658257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.659374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.661702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.678218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b55b877f-0104-4822-90a9-1c81c6fbd322 req-0120f947-571e-4221-ba61-c82057cd320f service nova] Creating event network-vif-plugged:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h1-826756-5 Aug 03 04:48:48.705987 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b55b877f-0104-4822-90a9-1c81c6fbd322 req-0120f947-571e-4221-ba61-c82057cd320f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110395 Aug 03 04:48:48.709073 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1977/3924] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:48.744905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:48.744905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:48.753801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.754483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:48.755859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:48.756511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:49.043893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:49.050116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:49.055247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d042c51b-ab62-434e-8f0d-5a0a6a4a5f07 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1468 microversion: 2.1 time: 0.341647 Aug 03 04:48:49.055994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1978/3925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:48 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1468 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:49.058461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-037ef230-90a9-417c-b0ec-de6eb4a16030 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.416740 Aug 03 04:48:49.059578 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1948/3926] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:48 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:49.077718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-946531570", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "451", "networks": [{"uuid": "b2c11a15-9dc8-41ca-841c-085d0c3d918a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:49.077959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-230373709"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:49.081293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:49.096246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:49.096671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:49.102188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:49.102721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:49.193248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] validate_networks() for [('b2c11a15-9dc8-41ca-841c-085d0c3d918a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:49.953609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:49.954900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:49.956238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:49.957813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:49.958438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:49.972838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:49.974216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:49.975497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:49.976470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.033905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:50.053890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Getting quotas for user 07bf1b2f15da4f8b88961d0a089cb1fa and project cdfed9e0c2c14644a125d453e5666756. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:50.088777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:50.097650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:50.122632 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9757250d-bedb-4c8e-bebd-27d2ae1ae2d8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "POST /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d/action" status: 202 len: 0 microversion: 2.1 time: 1.048334 Aug 03 04:48:50.139270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:50.143336 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1949/3927] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:48:49 2022] POST /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d/action => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 03 04:48:50.162114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:50.162114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:50.175075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.180334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.181456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.181906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.342025 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ed63982-6b1a-4ffe-bc48-c0831e52aca8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284046 Aug 03 04:48:50.353865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1979/3928] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:50.358799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:50.369890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:50.389661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.400364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.403943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.406485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.472219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:48:50.663995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:50.683496 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91392576-c2dc-43cd-af7b-914196dd24ce tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1321 microversion: 2.1 time: 0.538448 Aug 03 04:48:50.684580 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1950/3929] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:50 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:50.713951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:50.713951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:50.740629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.741150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.741879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:50.742317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:50.934867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:50.947999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:50.949794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:50.951148 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a1854b6-41e0-42f9-81cc-c1a7a81ae872 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.601332 Aug 03 04:48:50.952211 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1980/3930] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:50 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:50.958602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8c6e7c7-07f0-47bf-b05d-1b06dc2bb1bd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d69c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:51.057594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8c6e7c7-07f0-47bf-b05d-1b06dc2bb1bd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.104029 Aug 03 04:48:51.058192 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1981/3931] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:50 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:51.082965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e112fbbb-d1df-4ae5-9de7-0cff9b4ba2d1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:51.083338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e112fbbb-d1df-4ae5-9de7-0cff9b4ba2d1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:51.096167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:51.107123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a93a062c-3907-4a78-a5f7-1fa440eb5aa7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.419137 Aug 03 04:48:51.122504 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1951/3932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:50 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:51.130421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-42233c64-ea38-46e6-8a97-bed422c7965b req-c4ddece1-beed-48c1-8764-e126b4d5ec0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bff9a7-ab46-42fc-9ef5-c390179c05eb", "name": "network-vif-plugged", "status": "completed", "tag": "c67f1c44-04c6-44a0-8702-8cf9bb45b52f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:51.147397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-42233c64-ea38-46e6-8a97-bed422c7965b req-c4ddece1-beed-48c1-8764-e126b4d5ec0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:51.148126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-42233c64-ea38-46e6-8a97-bed422c7965b req-c4ddece1-beed-48c1-8764-e126b4d5ec0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:51.162827 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-42233c64-ea38-46e6-8a97-bed422c7965b req-c4ddece1-beed-48c1-8764-e126b4d5ec0f service nova] Creating event network-vif-plugged:c67f1c44-04c6-44a0-8702-8cf9bb45b52f for instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb on n-h1-826756-5 Aug 03 04:48:51.168703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-42233c64-ea38-46e6-8a97-bed422c7965b req-c4ddece1-beed-48c1-8764-e126b4d5ec0f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044790 Aug 03 04:48:51.170650 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1952/3933] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:51.209929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e112fbbb-d1df-4ae5-9de7-0cff9b4ba2d1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:51.222675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e112fbbb-d1df-4ae5-9de7-0cff9b4ba2d1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1220 microversion: 2.1 time: 0.156379 Aug 03 04:48:51.231998 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1982/3934] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:51 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:51.722631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:51.724845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:51.750832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:51.752440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:51.755077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:51.756128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:51.980334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:51.985052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:52.007856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.011990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.013981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.015094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.022187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.038575 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3814aa75-c8fc-4a4d-84c8-b5ab22d5a2d3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1321 microversion: 2.1 time: 0.329218 Aug 03 04:48:52.039112 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1953/3935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:51 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:52.080587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-973f609b-324e-4e42-acc3-66ec31326a8f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d38e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:52.194953 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-973f609b-324e-4e42-acc3-66ec31326a8f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.124808 Aug 03 04:48:52.203251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1954/3936] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:52 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:52.217226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:52.229331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:52.250325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.255248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.259898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.262542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.569431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.577953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.586366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.587927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3eac954a-7454-4460-84ba-495c86d17be6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.612667 Aug 03 04:48:52.603983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1983/3937] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:51 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:48:52.625852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:52.626790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:52.633590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.634322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.635265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.635863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.751454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.765227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-67682606-b2ce-4656-b977-291e02ecaacc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.560790 Aug 03 04:48:52.776742 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1955/3938] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:52 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:52.810614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:52.834016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1aafda2f-61d4-4674-959e-1c16b7790689 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1224 microversion: 2.1 time: 0.228488 Aug 03 04:48:52.846341 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1984/3939] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:52 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:52.852036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e973ac94-a568-4b21-a9e3-7646474c8633 req-725488b5-3b84-4f07-b811-28903b6163e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a15ff99-abc6-4711-a3a9-bf78fa3d8de7", "tag": "2eb0d2c9-7698-477b-a6ba-cc066049ba48"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:52.883673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e973ac94-a568-4b21-a9e3-7646474c8633 req-725488b5-3b84-4f07-b811-28903b6163e2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:52.884118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e973ac94-a568-4b21-a9e3-7646474c8633 req-725488b5-3b84-4f07-b811-28903b6163e2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:52.893726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-302943033", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:52.958577 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e973ac94-a568-4b21-a9e3-7646474c8633 req-725488b5-3b84-4f07-b811-28903b6163e2 service nova] Creating event network-changed:2eb0d2c9-7698-477b-a6ba-cc066049ba48 for instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 on n-h2-826756-5 Aug 03 04:48:52.980042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e973ac94-a568-4b21-a9e3-7646474c8633 req-725488b5-3b84-4f07-b811-28903b6163e2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130442 Aug 03 04:48:52.987149 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1985/3940] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:52.997218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] validate_networks() for [('0888ee50-224e-4ac2-bb97-47c4f0527711', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:53.067235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:53.067235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:53.077176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.077631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.080646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.081113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.415825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:53.424525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cda2bf26-1133-4064-8b1e-d095866f531d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1321 microversion: 2.1 time: 0.367785 Aug 03 04:48:53.429435 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1986/3941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:53 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:48:53.443727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97d18910-a894-469f-babc-dd13813449d6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d69670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:53.523919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97d18910-a894-469f-babc-dd13813449d6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.084024 Aug 03 04:48:53.530745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1987/3942] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:53 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:53.536167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d2734579-e3d1-4960-a372-1688208dfd5b req-a6693fbf-2de3-472f-b3c7-43eb64681ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-unplugged", "status": "completed", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:53.564243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d2734579-e3d1-4960-a372-1688208dfd5b req-a6693fbf-2de3-472f-b3c7-43eb64681ff9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.565083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d2734579-e3d1-4960-a372-1688208dfd5b req-a6693fbf-2de3-472f-b3c7-43eb64681ff9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.588563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d2734579-e3d1-4960-a372-1688208dfd5b req-a6693fbf-2de3-472f-b3c7-43eb64681ff9 service nova] Creating event network-vif-unplugged:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:48:53.602352 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d2734579-e3d1-4960-a372-1688208dfd5b req-a6693fbf-2de3-472f-b3c7-43eb64681ff9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072932 Aug 03 04:48:53.602352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1988/3943] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:53.620781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:53.621976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:53.636510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.638580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.641988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.643886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.975513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:53.979778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:53.982587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:53.983070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:53.984036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:53.997539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.998005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:53.998822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:53.999275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.054517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.071301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:54.074430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.086369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.091012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-002d3258-79d0-4238-8716-4094fe1e562e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.477268 Aug 03 04:48:54.094288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1989/3944] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:53 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:48:54.099935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for user 776b1938a6ea44a68923f368fd03fd8a and project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:54.119793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:54.124183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:54.137044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:54.139102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.139573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:54.140009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.143897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.144594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.349407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-184a4418-693f-4141-b46d-55693d97d796 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.569951 Aug 03 04:48:54.352422 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1956/3945] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:54.369273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:54.369273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:54.389485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.390338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.400136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.403714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.508874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.525577 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e589ab0-8f9c-4958-8744-1c5b784df765 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.422605 Aug 03 04:48:54.527983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1990/3946] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:54 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:54.543461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c853bcbf-20a0-40db-afb2-b3bfefe22fe5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:54.563635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c853bcbf-20a0-40db-afb2-b3bfefe22fe5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:54.594549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.607442 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05d535a5-7414-4141-9b59-c255d1b63c8c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1280 microversion: 2.1 time: 0.252504 Aug 03 04:48:54.608884 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1957/3947] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:54 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:54.617145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:54.619176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:54.632237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.633517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.635210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:54.636417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:54.818481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c853bcbf-20a0-40db-afb2-b3bfefe22fe5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:54.829785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c853bcbf-20a0-40db-afb2-b3bfefe22fe5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1221 microversion: 2.1 time: 0.297657 Aug 03 04:48:54.831567 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1991/3948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:54 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1221 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:54.843805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ac5841c-0a4d-4df9-8bf6-61bd783f475b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47c8ad30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:54.953603 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ac5841c-0a4d-4df9-8bf6-61bd783f475b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.120458 Aug 03 04:48:54.960378 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1992/3949] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:54 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:55.121790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:55.122784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:55.139287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:55.139639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:55.149464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:55.150285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:55.398064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:55.408903 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cde3a6c3-18ce-455f-8b07-b2cd2793d7fd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1502 microversion: 2.1 time: 0.798355 Aug 03 04:48:55.411740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1958/3950] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:54 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1502 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:55.418981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-307207863", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:55.649402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:55.663266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:55.664863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:55.667790 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0390530-fd63-49f5-a337-1de04047cf20 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.551066 Aug 03 04:48:55.671557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1993/3951] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:55 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:48:55.677289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:55.678138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:55.684901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:55.685558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:55.686816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:55.687460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:56.010602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] validate_networks() for [('0888ee50-224e-4ac2-bb97-47c4f0527711', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:48:56.294620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:56.303825 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e050d73-23ed-4d4d-9982-151b406b8a16 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1502 microversion: 2.1 time: 0.630984 Aug 03 04:48:56.308375 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1994/3952] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:55 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1502 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:56.321190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:56.323402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:56.372285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:56.373162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:56.375239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:56.376554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:57.446350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:57.454736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1297e7b-8e18-45bd-8fdf-2611b74c3342 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 1.144313 Aug 03 04:48:57.455416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1995/3953] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:56 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:57.468230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:57.473707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:57.490238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:57.491307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:57.495470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:57.495470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:57.677637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:57.692349 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-573ce1bd-c1cb-4a5c-aaf9-9d89e922f569 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1278 microversion: 2.1 time: 0.230767 Aug 03 04:48:57.696028 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1996/3954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:57 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:48:57.703641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b48d792a-bd9a-4b27-a219-bc79536b4f54 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47cb7430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:57.736575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:48:57.737168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:48:57.737588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:48:57.738070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:48:57.738559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:48:57.758492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:57.759176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:57.760217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:57.761007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:57.804671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:48:57.816994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for user 776b1938a6ea44a68923f368fd03fd8a and project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:48:57.848226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:48:57.850525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:48:58.166479 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-305a1fcf-92c3-41e7-96ff-5a5760112902 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.753496 Aug 03 04:48:58.170587 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1959/3955] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:48:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:48:58.200162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:58.201165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:58.245600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:58.246611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:58.249236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:58.249969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:58.370010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:48:58.919147 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50ca7299-696d-48cb-90b0-90e20b70c935 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 204 len: 0 microversion: 2.1 time: 0.745162 Aug 03 04:48:58.922134 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1960/3956] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:48:58 2022] DELETE /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:48:58.941940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b50df1eb-05df-4210-8221-33f54024bd4c req-bdfc72e6-ec58-41f7-aa8a-3afd354f5f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c4b733-ed81-4164-8448-5bc667788e1d", "name": "network-vif-plugged", "status": "completed", "tag": "48db9db0-6b04-4c02-b8c3-06fcac1fd327"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:48:58.967053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b50df1eb-05df-4210-8221-33f54024bd4c req-bdfc72e6-ec58-41f7-aa8a-3afd354f5f51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:58.971523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b50df1eb-05df-4210-8221-33f54024bd4c req-bdfc72e6-ec58-41f7-aa8a-3afd354f5f51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:59.021326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b50df1eb-05df-4210-8221-33f54024bd4c req-bdfc72e6-ec58-41f7-aa8a-3afd354f5f51 service nova] Creating event network-vif-plugged:48db9db0-6b04-4c02-b8c3-06fcac1fd327 for instance 47c4b733-ed81-4164-8448-5bc667788e1d on n-h1-826756-5 Aug 03 04:48:59.035684 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b50df1eb-05df-4210-8221-33f54024bd4c req-bdfc72e6-ec58-41f7-aa8a-3afd354f5f51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110096 Aug 03 04:48:59.039257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1961/3957] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:48:59.056202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:59.058534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:48:59.077866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:59.079825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:59.107609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:48:59.113351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:48:59.659770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:59.671337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:59.678276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:48:59.680127 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa473b08-6729-4a52-ba13-828781330260 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.639275 Aug 03 04:48:59.683348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1962/3958] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:48:59 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:48:59.702051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a96eb6c5-8dfd-40b9-827e-b231d561d681 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:48:59.702754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a96eb6c5-8dfd-40b9-827e-b231d561d681 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:00.014684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:00.159628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a96eb6c5-8dfd-40b9-827e-b231d561d681 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:00.167938 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a96eb6c5-8dfd-40b9-827e-b231d561d681 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1221 microversion: 2.1 time: 0.483232 Aug 03 04:49:00.172734 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1963/3959] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:48:59 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1221 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:00.192920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:00.196201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:00.226314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:00.226893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:00.233278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:00.233278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:00.323714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:01.852888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:01.868089 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5729368-3ff9-4190-92cb-c3bf6ef96d24 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 1.692646 Aug 03 04:49:01.879069 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1964/3960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:00 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:01.884154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:01.885239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:01.905020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:01.905466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:01.906465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:01.906756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:02.491336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:02.503564 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-718daba1-9b72-4a7d-ad6e-332d1c163e7e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.623208 Aug 03 04:49:02.504493 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1965/3961] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:01 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:02.511147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:02.511837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:02.518814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:02.519380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:02.520225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:02.520892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:02.737994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:02.746012 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c7cfaa3-6a11-4163-8be8-63b206c4a87c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1508 microversion: 2.1 time: 0.239852 Aug 03 04:49:02.746611 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1966/3962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:02 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:02.752473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:02.754631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:02.761354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:02.762424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:02.763460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:02.763903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.089785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:03.106137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:03.106974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:03.108422 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82a5750f-4bc7-43cb-8bf0-4455c2d64936 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.360623 Aug 03 04:49:03.109003 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1967/3963] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:02 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:03.128261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:03.134698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:03.139248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:03.180540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.192811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.194397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.196809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.556167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:03.569182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4e5c200-cc4f-41ce-83f2-2f62339dcd86 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1281 microversion: 2.1 time: 0.445566 Aug 03 04:49:03.581367 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1968/3964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:03 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1281 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:03.599134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-26787929-47af-423c-8a49-b5b603ba6f3c req-a31d869f-9eb1-4520-9786-cdd25bdf0a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0115c2a-45de-4fbd-8ccb-31ca1ecbb589", "tag": "42a55e06-c04f-4f02-9f07-2dfb6708f955"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:03.639392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26787929-47af-423c-8a49-b5b603ba6f3c req-a31d869f-9eb1-4520-9786-cdd25bdf0a51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.640470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26787929-47af-423c-8a49-b5b603ba6f3c req-a31d869f-9eb1-4520-9786-cdd25bdf0a51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.660596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-26787929-47af-423c-8a49-b5b603ba6f3c req-a31d869f-9eb1-4520-9786-cdd25bdf0a51 service nova] Creating event network-changed:42a55e06-c04f-4f02-9f07-2dfb6708f955 for instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 on n-h1-826756-5 Aug 03 04:49:03.667768 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-26787929-47af-423c-8a49-b5b603ba6f3c req-a31d869f-9eb1-4520-9786-cdd25bdf0a51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083952 Aug 03 04:49:03.674490 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1969/3965] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:03.682337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-26a87a47-42a9-48c3-9a29-e4d9eb0ed46c req-af84d8fd-0d20-4006-ad0a-81acf5f39795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a15ff99-abc6-4711-a3a9-bf78fa3d8de7", "name": "network-vif-plugged", "status": "completed", "tag": "2eb0d2c9-7698-477b-a6ba-cc066049ba48"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:03.693599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26a87a47-42a9-48c3-9a29-e4d9eb0ed46c req-af84d8fd-0d20-4006-ad0a-81acf5f39795 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.694972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26a87a47-42a9-48c3-9a29-e4d9eb0ed46c req-af84d8fd-0d20-4006-ad0a-81acf5f39795 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.718373 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-26a87a47-42a9-48c3-9a29-e4d9eb0ed46c req-af84d8fd-0d20-4006-ad0a-81acf5f39795 service nova] Creating event network-vif-plugged:2eb0d2c9-7698-477b-a6ba-cc066049ba48 for instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 on n-h2-826756-5 Aug 03 04:49:03.724917 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-26a87a47-42a9-48c3-9a29-e4d9eb0ed46c req-af84d8fd-0d20-4006-ad0a-81acf5f39795 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048620 Aug 03 04:49:03.733438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1970/3966] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:03.739945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-784d4f0f-b491-4e0d-b7ab-a8626605c245 req-b83fd0c6-1fdc-41d3-a9f5-9f64d726f2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4786d26-74a5-4327-90aa-9d70b19e447c", "tag": "542af35f-4bfd-4340-9808-6dfdb66d975e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:03.753532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-784d4f0f-b491-4e0d-b7ab-a8626605c245 req-b83fd0c6-1fdc-41d3-a9f5-9f64d726f2a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.754508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-784d4f0f-b491-4e0d-b7ab-a8626605c245 req-b83fd0c6-1fdc-41d3-a9f5-9f64d726f2a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.796844 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-784d4f0f-b491-4e0d-b7ab-a8626605c245 req-b83fd0c6-1fdc-41d3-a9f5-9f64d726f2a5 service nova] Creating event network-changed:542af35f-4bfd-4340-9808-6dfdb66d975e for instance c4786d26-74a5-4327-90aa-9d70b19e447c on n-h2-826756-5 Aug 03 04:49:03.799867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-784d4f0f-b491-4e0d-b7ab-a8626605c245 req-b83fd0c6-1fdc-41d3-a9f5-9f64d726f2a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064610 Aug 03 04:49:03.800995 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1971/3967] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:03.809102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:03.810050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:03.820474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.821364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:03.822389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:03.824661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.069143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:04.088747 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51c05e25-3d09-4b3f-88d1-71b5a0a3af90 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.279617 Aug 03 04:49:04.099709 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1972/3968] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:03 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:04.099709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:04.099709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:04.121973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:04.122482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.123282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:04.123728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.678335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:04.697757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70e0ed03-8d74-47c7-843c-eaa899642f72 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.607232 Aug 03 04:49:04.702061 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1973/3969] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:04 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:04.703982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:04.704859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:04.724974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:04.731153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.737293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:04.739475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.809338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:04.810034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:04.810675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid 37bff9a7-ab46-42fc-9ef5-c390179c05eb {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:04.824110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=26 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:04.993036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:05.003636 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-140880de-5bc7-465d-b5d9-416dbc38cae2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 200 len: 1311 microversion: 2.1 time: 0.303883 Aug 03 04:49:05.008968 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1974/3970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:04 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 1311 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:05.015219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:05.016940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:05.023664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.024783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.026106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.027226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.165539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b48d792a-bd9a-4b27-a219-bc79536b4f54 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 7.471362 Aug 03 04:49:05.173478 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1997/3971] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:48:57 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 7475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:05.180198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:05.180995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:05.189483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.190305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.191338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.192039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.219648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:05.233898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:05.235954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:05.237242 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7c8669d-fc18-40a1-b4c4-f51487f75865 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1738 microversion: 2.20 time: 0.226060 Aug 03 04:49:05.237816 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1975/3972] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:05 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:05.261000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:05.261981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:05.270161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.270854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.271870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.272742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.363290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:05.373294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ea295c79-a20e-40de-a76c-08ea2d83c364 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1279 microversion: 2.1 time: 0.196917 Aug 03 04:49:05.376612 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1998/3973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:05 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:05.723384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:05.724050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:05.733844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.734303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:05.735993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:05.736489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.429971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:06.451974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:06.466465 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb9e4ed0-3835-40c7-8f09-54a712f15b8c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 1.211816 Aug 03 04:49:06.491237 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3eadfad-00d7-4a00-bde2-9af76e96f281 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.772123 Aug 03 04:49:06.492330 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1976/3974] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:05 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:06.494076 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 1999/3975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:05 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:06.500441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a76f51-ee4a-4741-a0e3-1eb82fcc5815", "tag": "0df6a0bd-e77f-4de2-89c0-848cfde435aa"}, {"server_uuid": "37bff9a7-ab46-42fc-9ef5-c390179c05eb", "name": "network-vif-deleted", "tag": "c67f1c44-04c6-44a0-8702-8cf9bb45b52f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:06.504661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:06.511863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:06.522221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.523012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.523996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.524491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.524941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.525435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.542732 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:49:06.542997 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] Creating event network-changed:0df6a0bd-e77f-4de2-89c0-848cfde435aa for instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 on n-h1-826756-5 Aug 03 04:49:06.543691 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] Creating event network-vif-deleted:c67f1c44-04c6-44a0-8702-8cf9bb45b52f for instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb on n-h1-826756-5 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb HTTP/1.1 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '37bff9a7-ab46-42fc-9ef5-c390179c05eb'} Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:06.546126 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ae96e50-c157-4f5e-9dfb-b0c3cc080b5e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 404 len: 111 microversion: 2.1 time: 0.052574 Aug 03 04:49:06.552049 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2000/3976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:06 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:06.561331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5684b199-2402-4cd5-8dc0-fe1bbd53675d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47c71d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:06.566186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7d415529-18dc-4967-a1db-605ea658e6a8 req-c99894a5-52e0-4bd7-bef8-7192ed4ccf4b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.072014 Aug 03 04:49:06.569892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1977/3977] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:06.576230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:06.577291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:06.586291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.587157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.589436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.590060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.639427 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5684b199-2402-4cd5-8dc0-fe1bbd53675d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.089574 Aug 03 04:49:06.647913 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2001/3978] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:06 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:06.653371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:06.654315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:06.663407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.664150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.665140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:06.666073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:06.870803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:06.880570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88983d39-1836-48a6-8ab8-97a314a76eba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1279 microversion: 2.1 time: 0.230997 Aug 03 04:49:06.888646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2002/3979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:06 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:06.895191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f24a623-3f76-44d4-911a-ff53e572b1cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: .version_select at 0x7fdd47c713a0>, body: {"keypair": {"name": "tempest-key-1714771515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIOHsCmDn2Dt9Np4PjAo6ylNsMVSuAjtvJVudiFfm68h1eHBC4F1ktwVHn41/XJF5WZXW09RyEV8y6JMLaHgt8jo/VtiRSYtDHBvU9gNIq79/l8w0KZ+JMPSdA1nGuoZA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:06.917982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5f24a623-3f76-44d4-911a-ff53e572b1cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:49:06.928052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5f24a623-3f76-44d4-911a-ff53e572b1cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:49:07.064942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:07.075417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:07.076960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:07.078327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75592413-866d-4d2d-aa60-45b981a4004d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1720 microversion: 2.20 time: 0.506940 Aug 03 04:49:07.088681 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1978/3980] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:06 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1720 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:07.115484 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f24a623-3f76-44d4-911a-ff53e572b1cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.225204 Aug 03 04:49:07.117216 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2003/3981] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:49:06 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:07.136492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c71ec6df-47f1-4e7a-9df9-46a053876c32 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '.version_select at 0x7fdd59d38040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:07.141898 n-d-826756-5 devstack@n-api.service[120831]: WARNING oslo_db.sqlalchemy.utils [None req-c71ec6df-47f1-4e7a-9df9-46a053876c32 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:49:07.161960 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c71ec6df-47f1-4e7a-9df9-46a053876c32 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.029124 Aug 03 04:49:07.162569 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1979/3982] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:49:07 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:07.349505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-351025793", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-key-1714771515", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:07.454505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:49:07.499545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:07.501834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:07.524056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:07.530462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:07.530462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:07.532922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:07.785558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:07.947900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:07.958813 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-67f18689-fe3e-4af3-b3aa-52143d95ecbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.463650 Aug 03 04:49:07.969620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1980/3983] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:07 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:07.978345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:07.979297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:07.987040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:07.991376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:07.991376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:07.991376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:08.680142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:08.708838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-020427e5-0d0a-4835-a59f-4a8983172a5d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.732408 Aug 03 04:49:08.709267 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1981/3984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:07 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:08.728187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bcf2ef72-0b59-4e7a-83a5-cf6799d0feb5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd5473c8b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:08.811644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bcf2ef72-0b59-4e7a-83a5-cf6799d0feb5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.099858 Aug 03 04:49:08.822106 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1982/3985] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:08 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:08.829992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:08.830972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:08.850388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:08.851076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:08.852106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:08.852811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:08.871524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:49:08.872091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:49:08.872691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:49:08.872988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:49:08.873399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:49:08.886895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:08.887341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:08.888148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:08.888616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:08.948556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:49:08.960129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:49:08.978605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:49:08.981778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:49:09.223502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc659b06-fd02-4856-941f-3ede53991eda tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878522 Aug 03 04:49:09.226804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2004/3986] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:49:09.240006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:09.240743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:09.266822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:09.267403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:09.268347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:09.268904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:09.646271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:09.659794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:09.665553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:09.667258 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5a81264-19f9-4e5a-9b48-6bc408c53666 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1720 microversion: 2.20 time: 0.437639 Aug 03 04:49:09.667998 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2005/3987] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:09 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1720 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:09.686758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:09.688840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:09.701898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:09.705918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:09.707270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:09.708195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:09.878187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:09.900164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f7006cd-ee3c-4b23-8964-0268e6be87c5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 1.076483 Aug 03 04:49:09.904456 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1983/3988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:08 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:09.907270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d761a46f-516e-41d1-b36b-6d334a552797 req-02581015-c3c4-46ab-8475-451200348d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0115c2a-45de-4fbd-8ccb-31ca1ecbb589", "name": "network-vif-plugged", "status": "completed", "tag": "42a55e06-c04f-4f02-9f07-2dfb6708f955"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:09.922522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d761a46f-516e-41d1-b36b-6d334a552797 req-02581015-c3c4-46ab-8475-451200348d04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:09.923570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d761a46f-516e-41d1-b36b-6d334a552797 req-02581015-c3c4-46ab-8475-451200348d04 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:09.944077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d761a46f-516e-41d1-b36b-6d334a552797 req-02581015-c3c4-46ab-8475-451200348d04 service nova] Creating event network-vif-plugged:42a55e06-c04f-4f02-9f07-2dfb6708f955 for instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 on n-h1-826756-5 Aug 03 04:49:09.949886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d761a46f-516e-41d1-b36b-6d334a552797 req-02581015-c3c4-46ab-8475-451200348d04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046853 Aug 03 04:49:09.951181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1984/3989] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:09.957612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-755f25e0-c955-44a5-9a90-3a94aade0657 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:09.958619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-755f25e0-c955-44a5-9a90-3a94aade0657 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:09.975987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:09.992973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40471521-ebd6-4ebc-849c-6799ec60a4eb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.323023 Aug 03 04:49:10.021712 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2006/3990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:09 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:10.032375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:10.032770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:10.040262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.040994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:10.041994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.043792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:10.091714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-755f25e0-c955-44a5-9a90-3a94aade0657 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:10.103681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-755f25e0-c955-44a5-9a90-3a94aade0657 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1228 microversion: 2.1 time: 0.149656 Aug 03 04:49:10.104797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1985/3991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:09 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1228 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:10.122292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff81a0b4-2978-4609-bb21-7f56280611eb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54809b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:10.178365 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff81a0b4-2978-4609-bb21-7f56280611eb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.071913 Aug 03 04:49:10.178996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1986/3992] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:10 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:10.264445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:10.277295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:10.284403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fdb8a2d3-ae98-4cbf-bc2b-6f402750dc3e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.261072 Aug 03 04:49:10.285268 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2007/3993] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:10 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:10.716836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:10.717767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:10.731816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.735682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:10.735682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.735682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:10.905918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:10.915425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:10.917052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:10.918479 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54f419d9-83e8-4e91-8553-e059c1eafa6d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1720 microversion: 2.20 time: 0.231659 Aug 03 04:49:10.926378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:10.927713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:10.936909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.938088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:10.941011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1987/3994] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:10 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:10.943593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:10.944608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.025368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:11.026334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:11.035456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.036343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.037406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.038289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.043311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:11.433655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:11.442948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e22f91ab-10f9-4057-ae95-7d42107e9c61 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.521348 Aug 03 04:49:11.443691 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2008/3995] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:10 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:11.449278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:11.449926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:11.458042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.458529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.459632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.460202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.563474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:11.623311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-665796aa-40e9-4803-bfbc-f90f89c83b0c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.553710 Aug 03 04:49:11.623311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1988/3996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:11 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:11.623311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af3f3b1c-5765-4443-b348-17858c9e01e8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d439d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:11.630639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:11.630639 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-418a182d-37f9-429c-9498-c0b2f0ae5991 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1232 microversion: 2.1 time: 0.166055 Aug 03 04:49:11.630639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2009/3997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:11 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1232 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:11.630639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:11.630639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:11.631684 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af3f3b1c-5765-4443-b348-17858c9e01e8 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.054454 Aug 03 04:49:11.631684 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1989/3998] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:11 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:11.648241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.648821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.649697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.650210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.947827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:11.948580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:11.956919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.957630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.958483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:11.958870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:11.969439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:11.985967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-122596d6-7adf-46e8-9c0d-7ccb2bd41372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.371295 Aug 03 04:49:11.987445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2010/3999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:11 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:12.051070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-unplugged", "status": "completed", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}, {"server_uuid": "c4786d26-74a5-4327-90aa-9d70b19e447c", "name": "network-vif-plugged", "status": "completed", "tag": "542af35f-4bfd-4340-9808-6dfdb66d975e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:12.071609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.072527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.096731 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] Creating event network-vif-unplugged:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h1-826756-5 Aug 03 04:49:12.097892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] Creating event network-vif-plugged:542af35f-4bfd-4340-9808-6dfdb66d975e for instance c4786d26-74a5-4327-90aa-9d70b19e447c on n-h2-826756-5 Aug 03 04:49:12.111448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-57bf0498-f626-4d35-a3ea-90363197503e req-c3de8707-3e83-49cc-b8ad-9f29fbd76f7b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068979 Aug 03 04:49:12.118771 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2011/4000] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:12.181649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:12.190478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:12.192142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:12.193438 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-107eee57-ed9a-4d39-afac-ab9a6e09458c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1723 microversion: 2.20 time: 0.249573 Aug 03 04:49:12.194070 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1990/4001] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:11 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:12.219110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbadbeb8-4ed1-4422-b513-0875c9f39c47"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:12.224414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:12.248400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.249042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.250476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.251017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.467935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:12.469304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:12.475806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.476538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.482179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.482179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.651659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:12.659769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7845c3a5-eaf7-4936-b335-991733253924 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.195759 Aug 03 04:49:12.660436 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1991/4002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:12 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:12.665186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-328ce475-23c0-4201-a9eb-6737c4a47b1b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540891f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:12.732779 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-328ce475-23c0-4201-a9eb-6737c4a47b1b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1454 microversion: 2.1 time: 0.069382 Aug 03 04:49:12.732779 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1992/4003] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:12 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:12.741073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:12.741690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:12.747970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.748515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.749297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.749788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.817139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:12.827083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-048c072e-7dc4-4b2f-8ff7-93bbc867c1cb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1280 microversion: 2.1 time: 0.094193 Aug 03 04:49:12.828046 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1993/4004] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:12 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:12.860347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:12.996448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:13.024055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0014e11a-18fe-4546-b4e7-bf52613148f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.191026 Aug 03 04:49:13.036941 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1994/4005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:12 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:13.056121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9fecaa58-fc48-4c0c-8f1d-40fa023e4b00 req-5462634d-406a-448f-9472-f42c31861b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb71887-715d-4774-a22b-d690ca968fc1", "tag": "5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:13.068125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9fecaa58-fc48-4c0c-8f1d-40fa023e4b00 req-5462634d-406a-448f-9472-f42c31861b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.068616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9fecaa58-fc48-4c0c-8f1d-40fa023e4b00 req-5462634d-406a-448f-9472-f42c31861b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.083888 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9fecaa58-fc48-4c0c-8f1d-40fa023e4b00 req-5462634d-406a-448f-9472-f42c31861b6c service nova] Creating event network-changed:5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3 for instance 0fb71887-715d-4774-a22b-d690ca968fc1 on n-h1-826756-5 Aug 03 04:49:13.088717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9fecaa58-fc48-4c0c-8f1d-40fa023e4b00 req-5462634d-406a-448f-9472-f42c31861b6c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050022 Aug 03 04:49:13.094270 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1995/4006] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:13.098002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:13.098741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:13.105239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.105688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.106463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.106917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.307964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:13.317158 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6d7d4a8-f124-4a7a-b117-8a2882c4b5d9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.225016 Aug 03 04:49:13.323168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1996/4007] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:13 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:13.682362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:13.683427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:13.690464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.691550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.693462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.694146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.866970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-badd3cd8-ecc1-4c6d-a140-f503e17329c5 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.653476 Aug 03 04:49:13.871703 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2012/4008] 10.222.0.72 () {62 vars in 1364 bytes} [Wed Aug 3 04:49:12 2022] POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments => generated 188 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:49:13.882484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b748976-92a3-44b9-ab4b-f3fef1dcce4c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47cea9d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:13.888441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:13.908602 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5125475c-fb0f-4520-8015-fc0d182d72fb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.230786 Aug 03 04:49:13.924319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1997/4009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:13 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:13.930234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:13.935939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:13.938660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.939394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.940468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:13.941258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:13.950551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b748976-92a3-44b9-ab4b-f3fef1dcce4c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1463 microversion: 2.1 time: 0.076865 Aug 03 04:49:13.951884 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2013/4010] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:13 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1463 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:13.987900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78eac44e-7b78-457c-9ea5-d18b26aa44b9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47c12430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:14.037662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:14.046269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78eac44e-7b78-457c-9ea5-d18b26aa44b9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 200 len: 1463 microversion: 2.1 time: 0.071831 Aug 03 04:49:14.049937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2014/4011] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:13 2022] GET /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:14.058043 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2b3ff9d0-77d8-4f5a-a8d9-c15c4bc37278 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1298 microversion: 2.1 time: 0.132177 Aug 03 04:49:14.058818 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1998/4012] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:13 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:14.063795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:14.064599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.066108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:14.066738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.076910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.079923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.080071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.080515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.080638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.081923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.082454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.084220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.287882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:14.296608 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-638d3115-69b7-4b7a-a9da-f72e3973eacb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.236437 Aug 03 04:49:14.298517 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 1999/4013] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:14 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:14.303401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:14.304410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.311043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.311595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.312423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.312875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.513166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:14.522455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3034b2b4-cd2c-42d1-b3e0-652e85ac2538 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1467 microversion: 2.1 time: 0.222825 Aug 03 04:49:14.525032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2000/4014] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:14 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1467 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:14.527792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-75f7ba95-131b-458c-9908-e968483c0b9f req-251aa7bc-4a8e-4daa-8ec0-ebb610ec145d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a76f51-ee4a-4741-a0e3-1eb82fcc5815", "name": "network-vif-plugged", "status": "completed", "tag": "0df6a0bd-e77f-4de2-89c0-848cfde435aa"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:14.538282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-75f7ba95-131b-458c-9908-e968483c0b9f req-251aa7bc-4a8e-4daa-8ec0-ebb610ec145d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.538663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-75f7ba95-131b-458c-9908-e968483c0b9f req-251aa7bc-4a8e-4daa-8ec0-ebb610ec145d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.550863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-75f7ba95-131b-458c-9908-e968483c0b9f req-251aa7bc-4a8e-4daa-8ec0-ebb610ec145d service nova] Creating event network-vif-plugged:0df6a0bd-e77f-4de2-89c0-848cfde435aa for instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 on n-h1-826756-5 Aug 03 04:49:14.555686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-75f7ba95-131b-458c-9908-e968483c0b9f req-251aa7bc-4a8e-4daa-8ec0-ebb610ec145d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Aug 03 04:49:14.559691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2001/4015] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:14.561521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:14.562262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.569429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.569883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.570656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.571090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.770105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5bc7e86-ab2f-43c6-8938-0a4646e9f407 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments/bbadbeb8-4ed1-4422-b513-0875c9f39c47" status: 202 len: 0 microversion: 2.20 time: 0.720083 Aug 03 04:49:14.771702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2015/4016] 10.222.0.72 () {60 vars in 1457 bytes} [Wed Aug 3 04:49:14 2022] DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments/bbadbeb8-4ed1-4422-b513-0875c9f39c47 => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:14.778502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-898315268"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:14.784640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.799859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.799859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.799859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.799859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.860653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:14.873803 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45c6157b-32a0-44f5-9984-b3815f10ada6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1320 microversion: 2.1 time: 0.311399 Aug 03 04:49:14.873803 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2002/4017] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:14 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:14.874148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:14.875037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:14.881952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.882643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.883713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:14.884185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:14.940090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120831) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 04:49:15.345675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-256744fc-1a72-4e8b-8865-a5f4fd5a9d6e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/action" status: 202 len: 0 microversion: 2.20 time: 0.474676 Aug 03 04:49:15.349527 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2003/4018] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:49:14 2022] POST /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:15.354631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:15.355255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:15.369039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4763e344-c9d5-4ad5-a211-380e9e374ae4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "POST /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd/action" status: 202 len: 0 microversion: 2.1 time: 0.595108 Aug 03 04:49:15.372282 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2016/4019] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:14 2022] POST /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 04:49:15.380191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:15.382027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.382485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.383450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.383882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.388728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:15.396456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.396916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.397695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.398135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.690414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:15.703366 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a738347c-029f-4e06-9428-5016a8e200f7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.352832 Aug 03 04:49:15.719055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2004/4020] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:15 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:15.721776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:15.722583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:15.728991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.729629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.730776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.731297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.905315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:15.913112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23677cd6-c8dc-4774-8e43-cf28dfc988f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.539649 Aug 03 04:49:15.913698 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2017/4021] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:15 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:15.932370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:15.933006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:15.940548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.941050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:15.941884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:15.942331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.369302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.392182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d39d5d77-278d-42a0-ab0a-675bc12bf0ee tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.673965 Aug 03 04:49:16.393137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2005/4022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:15 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:16.398346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-96b7adce-8a7e-4239-93a7-f5f38ae560c6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd5497cdc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:16.450032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-96b7adce-8a7e-4239-93a7-f5f38ae560c6 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.055825 Aug 03 04:49:16.450615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2006/4023] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:16 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:16.459468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:16.460949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:16.468639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.470521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.482699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.484397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.556408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.566790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.572417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.572417 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa907e6f-554d-4410-81c6-9dbf67fb7d2a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1671 microversion: 2.20 time: 0.644503 Aug 03 04:49:16.572417 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2018/4024] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:15 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1671 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:16.576700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-29fc3b6c-a5fd-499b-b617-37bae53fc8e4 req-5eccfe98-0836-4f0b-86fb-ba420e2ef4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c4b733-ed81-4164-8448-5bc667788e1d", "name": "network-vif-unplugged", "status": "completed", "tag": "48db9db0-6b04-4c02-b8c3-06fcac1fd327"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:16.587963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-29fc3b6c-a5fd-499b-b617-37bae53fc8e4 req-5eccfe98-0836-4f0b-86fb-ba420e2ef4dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.588892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-29fc3b6c-a5fd-499b-b617-37bae53fc8e4 req-5eccfe98-0836-4f0b-86fb-ba420e2ef4dc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.603171 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-29fc3b6c-a5fd-499b-b617-37bae53fc8e4 req-5eccfe98-0836-4f0b-86fb-ba420e2ef4dc service nova] Creating event network-vif-unplugged:48db9db0-6b04-4c02-b8c3-06fcac1fd327 for instance 47c4b733-ed81-4164-8448-5bc667788e1d on n-h1-826756-5 Aug 03 04:49:16.608254 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-29fc3b6c-a5fd-499b-b617-37bae53fc8e4 req-5eccfe98-0836-4f0b-86fb-ba420e2ef4dc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036736 Aug 03 04:49:16.608902 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2019/4025] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:16.727231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:16.728332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:16.731716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:16.737061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.739029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.740790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.741472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.795812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.804707 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8be2613a-880b-4ad9-b418-01b83297732d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1511 microversion: 2.1 time: 0.350512 Aug 03 04:49:16.812708 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2007/4026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:16 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:16.826804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:16.827475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:16.834770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.834975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.835755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:16.836194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:16.840290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:16.981684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:16.992066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-731c5364-5910-448f-8a4a-72c25fb09aa5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.270114 Aug 03 04:49:16.992691 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2020/4027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:16 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:16.997168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5c3e3626-9039-4a66-8e4c-d28a84a68761 req-007a57c8-c768-4154-8b1e-e4299ee247f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa850f20-ff78-4986-b56a-f27f324c1955", "tag": "52f77edc-0b3c-4dce-b437-073b2f8d8961"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:17.012248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5c3e3626-9039-4a66-8e4c-d28a84a68761 req-007a57c8-c768-4154-8b1e-e4299ee247f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.017008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5c3e3626-9039-4a66-8e4c-d28a84a68761 req-007a57c8-c768-4154-8b1e-e4299ee247f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.027287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5c3e3626-9039-4a66-8e4c-d28a84a68761 req-007a57c8-c768-4154-8b1e-e4299ee247f6 service nova] Creating event network-changed:52f77edc-0b3c-4dce-b437-073b2f8d8961 for instance fa850f20-ff78-4986-b56a-f27f324c1955 on n-h1-826756-5 Aug 03 04:49:17.033805 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5c3e3626-9039-4a66-8e4c-d28a84a68761 req-007a57c8-c768-4154-8b1e-e4299ee247f6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039922 Aug 03 04:49:17.034542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2021/4028] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:17.037988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.041573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.042387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:17.045748 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56545a70-b382-4f0e-86fb-1f6acb4f26fc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1513 microversion: 2.1 time: 0.223718 Aug 03 04:49:17.047580 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2008/4029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:16 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:17.050622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.051082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.051868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.052339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.057401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:17.068436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.069086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:17.075442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.080848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.080848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.080848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.346103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.349661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.353898 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6630b8b-9a17-4fd3-8cbd-907761c3a059 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.317774 Aug 03 04:49:17.354571 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2022/4030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:17.359981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d959a8e1-cd3c-430a-9099-42c0c162999f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1511 microversion: 2.1 time: 0.296063 Aug 03 04:49:17.360719 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2009/4031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:17.385903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.392681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.393825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:17.409479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.410240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.411062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.411545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.416740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.417568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:17.426992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.427658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.428504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.428982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.514269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:17.587837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.595290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.600950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.649141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.656494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-925b8d2c-247e-46f7-8202-d0a8c54860ba tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.246649 Aug 03 04:49:17.657076 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2010/4032] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:17.675022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a8a1c53-c73e-4832-8961-7ed3698dde4a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd5497c790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.734786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a8a1c53-c73e-4832-8961-7ed3698dde4a tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.064606 Aug 03 04:49:17.735379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2011/4033] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:17.740094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.740736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:17.747587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.748085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.749325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.750351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.797421 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1e6f586-0887-405e-a62d-66d6e6aab7db tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.414860 Aug 03 04:49:17.798177 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2023/4034] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:17.821138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:17.826750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.830807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1527706857', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:17.834138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.834687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.835490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:17.835916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:17.896297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.904874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.906622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:17.907856 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee1589c9-f472-4a37-b0f6-c1fa26020de1 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.171521 Aug 03 04:49:17.908863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2012/4035] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:17.938462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:18.006475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.012528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.012778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.012967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.013559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:18.020151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.020602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.021456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.021903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.194376 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfe5a9f5-e24d-4384-8e39-e894ac54a2d3 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1527706857" status: 200 len: 1516 microversion: 2.1 time: 0.377317 Aug 03 04:49:18.195608 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2024/4036] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:49:17 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1527706857 => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:18.207196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.217785 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-512b0545-ac5b-4a1b-a0b6-0f9a77be2bc8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.208736 Aug 03 04:49:18.219233 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2013/4037] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:18.222511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.231894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.233561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:18.243413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.244224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.245515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.246064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.347578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:18.376592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.377654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:18.384285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.385112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.386791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.387471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.431200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.440788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.441531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.615222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.623478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-607381aa-c2e2-45f4-a1c5-982e436f8583 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.250791 Aug 03 04:49:18.624250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2014/4038] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:18.632594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34d851d3-8dec-4448-b2ef-b9e4adc314bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.417685 Aug 03 04:49:18.636306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2025/4039] 10.222.0.72 () {58 vars in 1173 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:18.660204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.666494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.667170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.servers [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Removing options 'limit' from query {{(pid=120831) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 04:49:18.668032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:18.675278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.675786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.676706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.677149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.677262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.677832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:18.683835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.684339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.685132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.685529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.708346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=17 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:18.712319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.718865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.719662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.896120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.902205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35cf959f-3b17-4255-a979-c3ab72d3a4a5 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.247071 Aug 03 04:49:18.903001 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2015/4040] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:18.908621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3115765c-1d79-49d5-8c08-2d443dfa192f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54a80d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.923233 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0bfb4ad5-53eb-4cd2-8f08-c4a942584913 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.249692 Aug 03 04:49:18.930847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2026/4041] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:18.931646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.936533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:18.937372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:18.942717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.943901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.944649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.945080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.957363 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3115765c-1d79-49d5-8c08-2d443dfa192f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.052769 Aug 03 04:49:18.958365 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2016/4042] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:18.963021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:18.963855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:18.971543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.972013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:18.972847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:18.973294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.040589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:19.107714 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d664f59a-4fa4-40e0-a582-9b19a900e05d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.181675 Aug 03 04:49:19.110540 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2027/4043] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:19.124840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.138312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.138797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.servers [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Removing options 'limit' from query {{(pid=120832) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 04:49:19.139777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:19.156927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.156927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.156927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.158176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.195078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:19.228744 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46015ce2-4726-4125-9d93-a929bb314991 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.110407 Aug 03 04:49:19.229827 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2028/4044] 10.222.0.72 () {58 vars in 1150 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:19.235902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.238306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:19.245219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.245732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.248667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.248667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.249159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.256866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.258455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.259697 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2565ad1-9aa7-4678-9c0e-84d8ddfce27c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.300373 Aug 03 04:49:19.284672 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2017/4045] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:18 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:19.286277 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2894e914-947d-42ea-b2e8-5b9724e6e5b7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054998 Aug 03 04:49:19.294067 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2029/4046] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:49:19.294231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.294348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.294348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:19.299600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.300314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:19.301717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.302484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.303913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.304475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.306411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.306863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.307656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.308259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.355272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:19.393939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b656e6b-7c29-49c5-8f7f-aeff571440c6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.108059 Aug 03 04:49:19.402632 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2018/4047] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers => generated 1010 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:19.408419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fd0ba1ce-60e3-4abf-aeb5-0ad9ebd30dc5 req-87fbe8c9-8033-4ef3-b602-e0204dfddbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:19.416611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:19.421692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fd0ba1ce-60e3-4abf-aeb5-0ad9ebd30dc5 req-87fbe8c9-8033-4ef3-b602-e0204dfddbc4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.422319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fd0ba1ce-60e3-4abf-aeb5-0ad9ebd30dc5 req-87fbe8c9-8033-4ef3-b602-e0204dfddbc4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.437509 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fd0ba1ce-60e3-4abf-aeb5-0ad9ebd30dc5 req-87fbe8c9-8033-4ef3-b602-e0204dfddbc4 service nova] Creating event network-changed:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h2-826756-5 Aug 03 04:49:19.442426 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fd0ba1ce-60e3-4abf-aeb5-0ad9ebd30dc5 req-87fbe8c9-8033-4ef3-b602-e0204dfddbc4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038187 Aug 03 04:49:19.443418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2019/4048] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:19.449256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.449833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:19.457041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.457491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.458260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.458692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.486039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:49:19.565983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.574907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9578e83d-3e8d-4d86-b7ca-9b738c07a641 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.285746 Aug 03 04:49:19.575477 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2030/4049] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:19.582844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.598184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.598184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:19.603163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.603613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.604456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.604895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.701513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:19.767669 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d688802-3a9d-4a3d-9b3c-0c76e8d470b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.190691 Aug 03 04:49:19.777189 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2031/4050] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:19.777189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.777189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:19.782582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.782582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.782582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.782883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.928596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.936525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed74a3db-7626-44cd-81b5-35bc606dcbe6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.167188 Aug 03 04:49:19.937746 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2032/4051] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:19.942485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.947700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:19.947860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.servers [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Removing options 'limit' from query {{(pid=120832) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 04:49:19.948474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:19.954459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.954912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.955712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.956150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.983353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-62c6c4bf-ae2b-4a48-abd0-a78c33488267 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.044167 Aug 03 04:49:19.984632 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2033/4052] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:19.989482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:19.991956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:19.997011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.997459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:19.998246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:19.998679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.061202 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f701b053-c4ab-4072-a686-bea1d0e82ded tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 204 len: 0 microversion: 2.1 time: 0.615669 Aug 03 04:49:20.063260 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2020/4053] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:49:19 2022] DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:20.068731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02280055-135c-461d-b40e-d37c8b7a4451 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d38940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.119788 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02280055-135c-461d-b40e-d37c8b7a4451 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.051774 Aug 03 04:49:20.119788 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2021/4054] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:20.122292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.128538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.129478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1527706857', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:20.136419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.137191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.138241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.139041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.141604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.150624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd4faa55-d42c-4917-90f0-85ae4a2b97fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.164957 Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2034/4055] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:19 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.166214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.230335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:20.290065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab2d37ff-d82b-4a70-8e12-e69fa227c26c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1527706857" status: 200 len: 346 microversion: 2.1 time: 0.171858 Aug 03 04:49:20.290661 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2022/4056] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1527706857 => generated 346 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:20.301155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.301978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:20.307316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.308089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.308579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.309360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.309801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.316712 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dcb7e859-05c9-4115-9d22-00a8697a8df7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1672 microversion: 2.1 time: 0.164365 Aug 03 04:49:20.328350 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2035/4057] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:20.328350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c11faf9f-ef23-4f7f-9e92-8e04f37cb889 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:20.332208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c11faf9f-ef23-4f7f-9e92-8e04f37cb889 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.332208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c11faf9f-ef23-4f7f-9e92-8e04f37cb889 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.334482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:20.357262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c11faf9f-ef23-4f7f-9e92-8e04f37cb889 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:49:20.475908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.484814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.486319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.487548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68ff733c-3d45-4a01-93ae-65ff6a3b5df2 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.195962 Aug 03 04:49:20.488406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2023/4058] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:20.603576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.604192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:20.614280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.614740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.615515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.615951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.647066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c11faf9f-ef23-4f7f-9e92-8e04f37cb889 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "POST /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7/action" status: 202 len: 0 microversion: 2.1 time: 0.328583 Aug 03 04:49:20.651135 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2036/4059] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:20 2022] POST /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:49:20.661638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.662854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:20.673618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.674292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.675302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.675749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.839590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.849685 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c74eed8-ea14-4abf-af59-0c42ff56ce97 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.251342 Aug 03 04:49:20.860293 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2024/4060] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:20.860293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-03772423-28be-440a-bf73-6a35d7e5e48d req-5a564eca-d66d-4f5d-bad4-f433db9b8576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb71887-715d-4774-a22b-d690ca968fc1", "name": "network-vif-plugged", "status": "completed", "tag": "5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:20.869271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-03772423-28be-440a-bf73-6a35d7e5e48d req-5a564eca-d66d-4f5d-bad4-f433db9b8576 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:20.869922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-03772423-28be-440a-bf73-6a35d7e5e48d req-5a564eca-d66d-4f5d-bad4-f433db9b8576 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:20.882337 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-03772423-28be-440a-bf73-6a35d7e5e48d req-5a564eca-d66d-4f5d-bad4-f433db9b8576 service nova] Creating event network-vif-plugged:5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3 for instance 0fb71887-715d-4774-a22b-d690ca968fc1 on n-h1-826756-5 Aug 03 04:49:20.887764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-03772423-28be-440a-bf73-6a35d7e5e48d req-5a564eca-d66d-4f5d-bad4-f433db9b8576 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032155 Aug 03 04:49:20.888584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2025/4061] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:20.891808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:20.904767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ce8661d-1e9d-4bfe-bc40-840efa0a3372 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.247879 Aug 03 04:49:20.904767 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2037/4062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:20.996909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:20.997831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.006942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.007601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.008864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.009751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.133621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-080bb906-483b-4328-b613-6c3321f0b9ef tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e00e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:21.188178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-080bb906-483b-4328-b613-6c3321f0b9ef tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.058251 Aug 03 04:49:21.189086 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2038/4063] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:21 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:21.200576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:21.201500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.212062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.221104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.222725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.223857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.237370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.244379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:21.248060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d223f34c-1c94-4349-a8c0-30a51e53455f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.281357 Aug 03 04:49:21.248688 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2026/4064] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:20 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:21.340566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:21.341556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.349369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.350097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.351137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.351732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.387299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.396652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0321fd06-0285-4eb8-9b85-f5d474c5ac01 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.205552 Aug 03 04:49:21.398030 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2039/4065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:21 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:21.510996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:21.511689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.518858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.519589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.520954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.521395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.523189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.536684 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a9b3d48-4014-4b8e-be1b-03158aaa4cdb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1672 microversion: 2.1 time: 0.199914 Aug 03 04:49:21.554841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2027/4066] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:21 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:21.681281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.691585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.694631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:21.696262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-559a321b-f820-4ba6-8ee9-70fc487f7e70 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.189348 Aug 03 04:49:21.697541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2040/4067] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:21 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:21.784983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:21.794003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.805994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.806443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.807416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.807859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.877162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:21.878100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:21.884948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.885418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:21.886349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:21.886688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.064033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.074663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc98726b-102a-49e1-a2de-fea66adcfa0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1321 microversion: 2.1 time: 0.201623 Aug 03 04:49:22.088320 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2041/4068] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:21 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:22.088320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.088320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.088708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.091817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.091817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.091817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.134265 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f01481e2-c0e5-4e3f-9d2c-327e2eba238d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.354844 Aug 03 04:49:22.134987 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2028/4069] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:21 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:49:22.149061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.150883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.160559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.161294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.162387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.163025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.305817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.315172 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a675aeb-2c21-4951-ae5b-3e6089f0e869 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.237411 Aug 03 04:49:22.336085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2042/4070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:22.356814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a5d5c96-4603-42b8-83c9-7877fc83846c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47df4af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.367703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.376652 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b8edc2f-b887-41e6-a768-9a4017da8603 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1671 microversion: 2.1 time: 0.236307 Aug 03 04:49:22.378704 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2029/4071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:22.395565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.396213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.416349 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a5d5c96-4603-42b8-83c9-7877fc83846c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1454 microversion: 2.1 time: 0.085908 Aug 03 04:49:22.416821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.417313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.418092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.418533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.423969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2043/4072] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:22.428704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.429325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.447908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.448385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.449168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.449606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.673311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.684517 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e0c49c0-9b06-4939-8c2d-c44a951972bb tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.304495 Aug 03 04:49:22.696286 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2030/4073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:22.718904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.719528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.728846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.729298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.730079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.730517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.764725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.777666 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd99cbaa-241f-4abf-a12e-a896521ab609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.352228 Aug 03 04:49:22.791839 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2044/4074] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:22.814947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:22.819223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:22.839515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.849915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.849915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:22.849915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:22.956937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:22.980657 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e10c7c4-3539-4681-ac0f-382135111afe tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1672 microversion: 2.1 time: 0.260377 Aug 03 04:49:22.980657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2031/4075] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:23.018849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-95f6d5d6-12d8-479e-b51d-64e36f22088f req-ea977d1a-7db9-49db-9a01-4dce2f24bb64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-plugged", "status": "completed", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:23.032322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-95f6d5d6-12d8-479e-b51d-64e36f22088f req-ea977d1a-7db9-49db-9a01-4dce2f24bb64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.032896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-95f6d5d6-12d8-479e-b51d-64e36f22088f req-ea977d1a-7db9-49db-9a01-4dce2f24bb64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.051789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-95f6d5d6-12d8-479e-b51d-64e36f22088f req-ea977d1a-7db9-49db-9a01-4dce2f24bb64 service nova] Creating event network-vif-plugged:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:49:23.057427 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-95f6d5d6-12d8-479e-b51d-64e36f22088f req-ea977d1a-7db9-49db-9a01-4dce2f24bb64 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043427 Aug 03 04:49:23.058074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2032/4076] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:23.105776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:23.106597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:23.110970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.119302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.121506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.121702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.122859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-013f2092-25f4-4f0e-9177-4ebc4a6d52a7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.338706 Aug 03 04:49:23.123547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.123752 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2045/4077] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:22 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:23.133413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.133850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.294695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.307613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1cf553e-7e31-4558-9522-8363eb02a40a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1515 microversion: 2.1 time: 0.209547 Aug 03 04:49:23.308407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2033/4078] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:23 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:23.336306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:23.341466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:23.342301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:23.345337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:23.358169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.360727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.361640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.362161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.365348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.365832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.366955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.367403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.426781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'flavor' on Instance uuid 0fb71887-715d-4774-a22b-d690ca968fc1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:23.541795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.551662 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7859cdc-1b4d-4d73-9930-396eb3c915b7 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.214110 Aug 03 04:49:23.552846 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2034/4079] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:23 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:23.586874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:23.587417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:23.613713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.617080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.617892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:23.618331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:23.863224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:23.872936 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84d2f692-66dd-47b1-afe8-f07501f32925 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1671 microversion: 2.1 time: 0.318394 Aug 03 04:49:23.887448 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2035/4080] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:23 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1671 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:23.887448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-026d83f9-b437-4c06-8db5-5a650fc1e1e0 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59e52700>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:24.027710 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fdcf61fe-d84b-4ebc-8288-aa4905415bd8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action" status: 200 len: 32 microversion: 2.1 time: 0.696522 Aug 03 04:49:24.043517 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2046/4081] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:23 2022] POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action => generated 32 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 04:49:24.043517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:24.043517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:24.049559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.050292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.051259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.052348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c38a5883-b221-403e-8bcd-c73dc59e2cfd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.223926 Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2047/4082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:24 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.301733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.435560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:24.446802 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-452ab215-41c4-4d65-9d3a-f5d53a7286f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1507 microversion: 2.1 time: 0.191525 Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2048/4083] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:24 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.462221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.643671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:24.652080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16a25dae-5b54-44d9-bb67-3a912b47f00c tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1672 microversion: 2.1 time: 0.203373 Aug 03 04:49:24.652697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2049/4084] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:24 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:24.657988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:24.658610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:24.665846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.665846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:24.666402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:24.666846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:25.023095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:25.036835 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a3f9f72-1306-4c2c-9f5a-fa8f2b619001 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.383029 Aug 03 04:49:25.044507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2050/4085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:24 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:25.058238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:25.058926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:25.083906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:25.087134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:25.088086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:25.088610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:25.676513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:25.683282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:25.720787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:25.727360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:25.728648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2ebea94-3014-424d-9906-02b29de43d2b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.680151 Aug 03 04:49:25.741110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2051/4086] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:25 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:25.746614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:25.747232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:25.773482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:25.776548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:25.799804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:25.800702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:26.408537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:26.418878 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9d1252d-067e-4522-a242-2afdfb135037 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.688612 Aug 03 04:49:26.434070 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2052/4087] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:25 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:26.434070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:26.434070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:26.444995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:26.450009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:26.450009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:26.450009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:26.761165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:26.776082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b65feb1-2032-4daf-82ff-14cf5cd6ab8d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1671 microversion: 2.1 time: 0.354715 Aug 03 04:49:26.777358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2053/4088] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:26.784999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7c54942f-2cba-44a2-b7a6-6b4f011526e4 req-8de3cf40-d7d2-4a32-94cf-0b8686ee149e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa850f20-ff78-4986-b56a-f27f324c1955", "name": "network-vif-plugged", "status": "completed", "tag": "52f77edc-0b3c-4dce-b437-073b2f8d8961"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:26.799894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7c54942f-2cba-44a2-b7a6-6b4f011526e4 req-8de3cf40-d7d2-4a32-94cf-0b8686ee149e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:26.801009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7c54942f-2cba-44a2-b7a6-6b4f011526e4 req-8de3cf40-d7d2-4a32-94cf-0b8686ee149e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:26.822544 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7c54942f-2cba-44a2-b7a6-6b4f011526e4 req-8de3cf40-d7d2-4a32-94cf-0b8686ee149e service nova] Creating event network-vif-plugged:52f77edc-0b3c-4dce-b437-073b2f8d8961 for instance fa850f20-ff78-4986-b56a-f27f324c1955 on n-h1-826756-5 Aug 03 04:49:26.831256 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7c54942f-2cba-44a2-b7a6-6b4f011526e4 req-8de3cf40-d7d2-4a32-94cf-0b8686ee149e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052449 Aug 03 04:49:26.833197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2054/4089] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:26.842916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:26.844466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:26.857200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:26.857200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:26.857200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:26.857200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:27.448639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:27.468145 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0132fe78-5ede-4564-a72a-900ff7f2ccdf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1328 microversion: 2.1 time: 0.632897 Aug 03 04:49:27.480306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2055/4090] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:26 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1328 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:27.480306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:27.480306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:27.489400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:27.489971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:27.491527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:27.492047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:27.822610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:27.839345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c1674a4-2fa2-4c02-84f1-553c4c04fef5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1528 microversion: 2.1 time: 0.367739 Aug 03 04:49:27.840347 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2056/4091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:27 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1528 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:27.868654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:27.870777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:27.886338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:27.892958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:27.894044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:27.894614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.003519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:28.013262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94d75c3d-6b9c-43e8-8119-e8454e1d933d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1604 microversion: 2.1 time: 0.164096 Aug 03 04:49:28.014163 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2057/4092] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:27 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:28.019574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:28.020422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:28.027918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.028529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.029603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.030713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.372246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:28.381881 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f1169ce-e61f-4e12-ab7c-12dd322424b4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.366415 Aug 03 04:49:28.413400 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2058/4093] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:28 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:28.420102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:28.433845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:28.453889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:28.453889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.453889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.454605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.455147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.821681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:28.830205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:28.831963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:28.841425 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-527c73c9-63a3-4378-9c50-9b9fc6785383 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.426699 Aug 03 04:49:28.842341 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2059/4094] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:28 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:28.853591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e7d31868-defa-4438-ad06-ad4e6a195719 req-f656178c-aa87-46ea-8759-b22c423eb4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779d1f9e-2351-4630-83f4-9a80cfcc5a8d", "name": "network-vif-deleted", "tag": "935aefd9-11dd-4cea-a681-d52158672852"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:28.875175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e7d31868-defa-4438-ad06-ad4e6a195719 req-f656178c-aa87-46ea-8759-b22c423eb4fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.875653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e7d31868-defa-4438-ad06-ad4e6a195719 req-f656178c-aa87-46ea-8759-b22c423eb4fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.898711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e7d31868-defa-4438-ad06-ad4e6a195719 req-f656178c-aa87-46ea-8759-b22c423eb4fe service nova] Creating event network-vif-deleted:935aefd9-11dd-4cea-a681-d52158672852 for instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d on n-h2-826756-5 Aug 03 04:49:28.909223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e7d31868-defa-4438-ad06-ad4e6a195719 req-f656178c-aa87-46ea-8759-b22c423eb4fe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063922 Aug 03 04:49:28.915726 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2060/4095] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:28.924242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:28.925540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:28.944104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.945580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:28.946340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:28.951640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:29.192125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:29.208813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d19da04-8faa-4c7a-a5dc-140a9f79bb4a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.291086 Aug 03 04:49:29.209585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2061/4096] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:28 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:29.213912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:29.214532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:29.220672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:29.221110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:29.221805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:29.222243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:29.416366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:29.777636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:29.786970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42239e88-bbc2-4af3-a532-91a413cc881e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.576495 Aug 03 04:49:29.787698 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2062/4097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:29 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:29.793209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:29.793932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:29.802879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:29.805429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:29.805429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:29.805429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:29.964107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:30.043689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:30.053421 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c527fc3-30f9-44a6-b4b2-d6c59db9c79b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1510 microversion: 2.1 time: 0.263220 Aug 03 04:49:30.069336 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2063/4098] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:29 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:30.079178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-685084b8-b7fd-495d-9fe5-917f4100b579 req-aff1f5b9-7945-4733-8699-c6ef97701c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb81dbc-92a7-4589-b911-665d67b1a77e", "name": "network-vif-plugged", "status": "completed", "tag": "dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:30.090990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-685084b8-b7fd-495d-9fe5-917f4100b579 req-aff1f5b9-7945-4733-8699-c6ef97701c20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.092306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-685084b8-b7fd-495d-9fe5-917f4100b579 req-aff1f5b9-7945-4733-8699-c6ef97701c20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.104939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-685084b8-b7fd-495d-9fe5-917f4100b579 req-aff1f5b9-7945-4733-8699-c6ef97701c20 service nova] Creating event network-vif-plugged:dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc for instance 0eb81dbc-92a7-4589-b911-665d67b1a77e on n-h2-826756-5 Aug 03 04:49:30.113644 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-685084b8-b7fd-495d-9fe5-917f4100b579 req-aff1f5b9-7945-4733-8699-c6ef97701c20 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040890 Aug 03 04:49:30.118430 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2064/4099] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:30.125024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:30.125816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:30.153577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.155381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.155875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.156522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.172692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:30.373056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:30.394990 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ce2c4e7-34d6-4039-b925-74ddd50685cb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.275163 Aug 03 04:49:30.398004 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2065/4100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:30 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:30.411518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:30.412805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:30.426925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.441018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.444688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.446387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.530491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:30.532317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.532873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.537653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:30.648954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:30.657259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a244ae2-5d44-4d57-8ab0-1aa69c80dce7 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.257889 Aug 03 04:49:30.657843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2066/4101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:30 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:30.669813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:30.670430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:30.688132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.688632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.689411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:30.689845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:30.948947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:30.950417 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a05e9c9f-5ff1-466f-a221-ab1ecaf0e2ca tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.291281 Aug 03 04:49:30.955432 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2067/4102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:30 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:30.961065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:30.969474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:31.063716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.064177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.064994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.065574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.316038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:31.332177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:31.333720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:31.335012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb134f17-4715-49de-b450-19c56eebbcaf tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.377786 Aug 03 04:49:31.335636 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2068/4103] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:30 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:31.340363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:31.340982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:31.348255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.348739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.349600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.350029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.568959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2dc8956d-b09e-4a5b-9b81-40d4f5a6d3bf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1510 microversion: 2.1 time: 0.251017 Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2069/4104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:31 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.604253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.609447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.609903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.615932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:31.832755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:31.841291 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-923e4ffb-d959-4f88-91c6-169ecbca68fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.251676 Aug 03 04:49:31.856542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2070/4105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:31 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:31.863878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:31.863878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:31.870583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.871299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:31.872366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:31.873084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.095751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:32.104683 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-224edaf8-a5b8-4143-87e7-9c6317895a6b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.246619 Aug 03 04:49:32.105273 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2071/4106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:31 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:32.122535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:32.123077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:32.130015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.130471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.131255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.131704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.179760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:49:32.722079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-753016d4-dad8-4f80-ac33-668cdeb56879 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 204 len: 0 microversion: 2.1 time: 0.613147 Aug 03 04:49:32.724038 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2072/4107] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:49:32 2022] DELETE /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:32.729754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:32.730565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:32.743032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.744428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.746248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.746709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.800014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.800878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.801623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:32.875601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:32.881916 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19053b69-3dc0-42f4-b224-55469016c94a tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.156394 Aug 03 04:49:32.883651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2073/4108] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:32 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:32.889302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:32.890254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:32.897456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.897918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:32.898931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:32.899376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.060646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.079213 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9ff5ca1-b12e-47f9-a4d3-975f6f06db77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.193824 Aug 03 04:49:33.081124 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2074/4109] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:32 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:33.086818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:33.096830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:33.096830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.096830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.096830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.096830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.248956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.257408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.265179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.273931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-549736ba-1458-494c-ba11-cb41574fb14a tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.183721 Aug 03 04:49:33.276637 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2075/4110] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:33 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:33.282506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:33.283248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:33.289599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.290054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.290828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.291268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.447006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.457529 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c67b112f-abd3-4783-a3ca-1676b9da345f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1516 microversion: 2.1 time: 0.179512 Aug 03 04:49:33.458998 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2076/4111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:33 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:33.471380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:33.472143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:33.478913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.481325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.481325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.481325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.608840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:33.618706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.626526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8db5fbd4-5b59-4743-acc2-fd6c47ed2dec tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.165040 Aug 03 04:49:33.627106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2077/4112] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:33 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:33.631758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:33.635242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:33.638573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.639586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.640752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.641182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.779557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:33.787525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37e32afe-b9c1-4f10-bc13-000cfd3d1be0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.159396 Aug 03 04:49:33.788126 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2078/4113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:33 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:33.868338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:33.908016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:33.908701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:33.914852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.915414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.916189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.916658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.949375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:33.950015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:33.950520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:34.002168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.009905 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ecb6aee1-b373-4774-aead-eb3afe2f3066 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.107135 Aug 03 04:49:34.010608 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2079/4114] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:33 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:34.093213 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-026d83f9-b437-4c06-8db5-5a650fc1e1e0 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1463 microversion: 2.1 time: 10.214171 Aug 03 04:49:34.093892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2036/4115] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:23 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1463 bytes in 10220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:34.106847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.107452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.119435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.124539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.124539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.124539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.125710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77829d08-c94b-4e84-b9b0-0c8a69a9fcd4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d36310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.176549 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77829d08-c94b-4e84-b9b0-0c8a69a9fcd4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 200 len: 1463 microversion: 2.1 time: 0.062501 Aug 03 04:49:34.177223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2037/4116] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 1463 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:34.190799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.191873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.199781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.200395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.201439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.202457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.315650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.324591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eae8b8ee-2571-452b-96c3-dfb24c742a79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.221650 Aug 03 04:49:34.336568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2080/4117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:34.336568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.336568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.344385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.344851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.345641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.346084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.371110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.380453 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fcbb86b-8f6b-4e02-9831-b1a78f430a14 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1481 microversion: 2.1 time: 0.193965 Aug 03 04:49:34.381340 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2038/4118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1481 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:34.484793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.485342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.492224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.492956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.493944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.494551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.508944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.519764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.524095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.524095 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45b9b61b-4278-4581-82a6-ef1098170017 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.196813 Aug 03 04:49:34.524095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2081/4119] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:34.647822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.648623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.654680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.655132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.655904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.656362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.779130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:34.790783 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-367ad69d-c40a-4da4-a326-71c9e7b3a88f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1516 microversion: 2.1 time: 0.310467 Aug 03 04:49:34.793095 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2039/4120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:34.808463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:34.810088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:34.821570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.822556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:34.823583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:34.824223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.061893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.070842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-591f2b8b-49c5-4038-bdad-656b045b2436 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.426788 Aug 03 04:49:35.072889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2082/4121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:35.087324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.090651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:35.093731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.095063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.095702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.096503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.097029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.103835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e03f528-7a92-4823-a9f8-f5a0c42574b8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.299863 Aug 03 04:49:35.117943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2040/4122] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:34 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:35.146324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.146901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.147215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:35.202008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.211267 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c6d9ee7-d76e-4804-85a0-185d332268c5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.127660 Aug 03 04:49:35.215518 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2083/4123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:35.347445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.348138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:35.354698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.355476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.356880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.357456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.403381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.404449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:35.417329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.419038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.420088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.420807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.428171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:35.638448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.649900 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fca5558-2cc2-4747-9c68-cb772e2b9b11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.306524 Aug 03 04:49:35.653090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2041/4124] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:35.659108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-56229058-8c79-47bf-95af-2e4d2d3b0be6 req-e86e8f9d-3797-4017-ada9-9999fa485f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa850f20-ff78-4986-b56a-f27f324c1955", "name": "network-vif-deleted", "tag": "52f77edc-0b3c-4dce-b437-073b2f8d8961"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:35.669714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.676631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-56229058-8c79-47bf-95af-2e4d2d3b0be6 req-e86e8f9d-3797-4017-ada9-9999fa485f20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.677422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-56229058-8c79-47bf-95af-2e4d2d3b0be6 req-e86e8f9d-3797-4017-ada9-9999fa485f20 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.698410 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-56229058-8c79-47bf-95af-2e4d2d3b0be6 req-e86e8f9d-3797-4017-ada9-9999fa485f20 service nova] Creating event network-vif-deleted:52f77edc-0b3c-4dce-b437-073b2f8d8961 for instance fa850f20-ff78-4986-b56a-f27f324c1955 on n-h1-826756-5 Aug 03 04:49:35.698575 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f35cff0e-3fcd-4099-9380-4727cc216889 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1468 microversion: 2.1 time: 0.293731 Aug 03 04:49:35.698575 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2084/4125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1468 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:35.700074 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-56229058-8c79-47bf-95af-2e4d2d3b0be6 req-e86e8f9d-3797-4017-ada9-9999fa485f20 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044032 Aug 03 04:49:35.703291 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2042/4126] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:35.707410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.708228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:35.722610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e8132a6-35c4-4531-84b2-cd2655a0ee66 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540ceaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.733586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.734280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.735092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.735960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.839736 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e8132a6-35c4-4531-84b2-cd2655a0ee66 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?changes-since=2022-08-03T04%3A47%3A57Z" status: 200 len: 1900 microversion: 2.1 time: 0.118688 Aug 03 04:49:35.839736 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2043/4127] 10.222.0.72 () {58 vars in 1199 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/images?changes-since=2022-08-03T04%3A47%3A57Z => generated 1900 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:35.843783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.844782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:35.852292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.852997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.853960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.854460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.896164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:35.896647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:35.897111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid fa850f20-ff78-4986-b56a-f27f324c1955 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:35.910341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.919420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.924834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.926266 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c456b9e-8b52-4e2b-8288-3b51ca5fa9a4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.232019 Aug 03 04:49:35.927425 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2085/4128] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:35.932196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b71e4c67-5854-40f6-8b3f-1d257d50a600 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59cd8b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:35.943993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:35.952504 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84c9ab08-f5cb-4e8c-a044-ba269c6f66ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 200 len: 1318 microversion: 2.1 time: 0.112102 Aug 03 04:49:35.953307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2044/4129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:36.024479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b71e4c67-5854-40f6-8b3f-1d257d50a600 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-637004736" status: 200 len: 484 microversion: 2.1 time: 0.095957 Aug 03 04:49:36.025179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2086/4130] 10.222.0.72 () {58 vars in 1229 bytes} [Wed Aug 3 04:49:35 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-637004736 => generated 484 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:36.037801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-713967cf-e6a1-4cef-93ab-553c8735042b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540e2790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.092786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.093339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:36.100292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.100752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.101528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.101971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.146615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-713967cf-e6a1-4cef-93ab-553c8735042b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?server=91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 956 microversion: 2.1 time: 0.112628 Aug 03 04:49:36.154822 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2045/4131] 10.222.0.72 () {58 vars in 1209 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?server=91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 956 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:36.160342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.160970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:36.168403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.168936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.169802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.170375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.300355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:36.306818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93f249af-59d2-4063-9637-25d0dede48b1 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.218100 Aug 03 04:49:36.307814 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2087/4132] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:36.313399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6fd43610-6bdb-466e-860b-fbac1c91838b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47d5fc10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.337093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:36.345666 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd779b3a-fadc-41bd-905e-a4ee320dd7d4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.189206 Aug 03 04:49:36.346262 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2046/4133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:36.352151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.352996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:36.360888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.361400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.362176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.362621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.367155 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6fd43610-6bdb-466e-860b-fbac1c91838b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fv2.1%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 484 microversion: 2.1 time: 0.057569 Aug 03 04:49:36.367735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2088/4134] 10.222.0.72 () {58 vars in 1317 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fv2.1%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d => generated 484 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:36.379456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e11ac20b-5f42-4c93-913c-874bc03d4f8d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e6b8b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.395284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.395745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.396215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:36.439749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e11ac20b-5f42-4c93-913c-874bc03d4f8d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 484 microversion: 2.1 time: 0.064046 Aug 03 04:49:36.440755 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2089/4135] 10.222.0.72 () {58 vars in 1303 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:36.457458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:36.466538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab985c9e-d0f0-45e7-afde-7762d0fb93da tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.119130 Aug 03 04:49:36.467971 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2047/4136] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:36.529117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fd31a1d-81db-42d4-9e3a-3fccd2fb9e9c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e6b550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.647234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fd31a1d-81db-42d4-9e3a-3fccd2fb9e9c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.121853 Aug 03 04:49:36.647817 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2090/4137] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:36.665593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d9e5019-0b93-4aa5-a4ba-93ecd3cf89de tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540e5b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.675062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.675791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:36.682116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.682579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.683353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.683802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.741186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d9e5019-0b93-4aa5-a4ba-93ecd3cf89de tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.081592 Aug 03 04:49:36.742180 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2048/4138] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:36.756077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afcd5d37-11a8-460c-8006-937f42a508d5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d389d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.836665 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-afcd5d37-11a8-460c-8006-937f42a508d5 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.084488 Aug 03 04:49:36.837243 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2049/4139] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:36.844655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:36.852254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f2dfb0a-231d-4fcd-9f2e-9c1463f0c369 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd54609a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.859943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf4c98a4-7a1f-49f0-b07c-3dbd3ad33d28 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.189394 Aug 03 04:49:36.875024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2091/4140] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:36.938382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f2dfb0a-231d-4fcd-9f2e-9c1463f0c369 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?changes-since=2022-08-03T04%3A47%3A50Z" status: 200 len: 6330 microversion: 2.1 time: 0.090544 Aug 03 04:49:36.938977 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2050/4141] 10.222.0.72 () {58 vars in 1220 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-03T04%3A47%3A50Z => generated 6330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:36.950180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.951022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:36.956951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19b15aab-6f0e-4478-a2ba-5ce8f77e3385 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540e2040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:36.958593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.958909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:36.959691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:36.960138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.016355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19b15aab-6f0e-4478-a2ba-5ce8f77e3385 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-637004736" status: 200 len: 664 microversion: 2.1 time: 0.063186 Aug 03 04:49:37.016943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2051/4142] 10.222.0.72 () {58 vars in 1250 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-637004736 => generated 664 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:37.021993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.022809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:37.030781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.031642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.034095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.034714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.049700 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 HTTP/1.1 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fa850f20-ff78-4986-b56a-f27f324c1955'} Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:37.051796 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e38b8243-ea75-4343-b25e-8f85771d1a90 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 404 len: 111 microversion: 2.1 time: 0.035176 Aug 03 04:49:37.057452 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2052/4143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:37.058342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ade2fa8-b5e6-4176-9541-e023a0eee16b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540e55e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.114174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ade2fa8-b5e6-4176-9541-e023a0eee16b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fv2.1%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1466 microversion: 2.1 time: 0.059149 Aug 03 04:49:37.114852 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2053/4144] 10.222.0.72 () {58 vars in 1338 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fv2.1%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d => generated 1466 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:37.127856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e91ef0a6-f79e-4e88-a432-f508445f34ff tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '.version_select at 0x7fdd54809dc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.128033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:37.129975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:37.131527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:37.132743 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1f9b42b1-d7d3-4de2-ba6e-c3113990f6c8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.186629 Aug 03 04:49:37.148763 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2092/4145] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:36 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:37.153930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb346042-0352-44ec-afb5-4b15f6201f4d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd545d78b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.205141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb346042-0352-44ec-afb5-4b15f6201f4d tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1466 microversion: 2.1 time: 0.055204 Aug 03 04:49:37.205712 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2093/4146] 10.222.0.72 () {58 vars in 1324 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.72%2Fcompute%2Fservers%2F47c4b733-ed81-4164-8448-5bc667788e1d => generated 1466 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:37.218455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e91ef0a6-f79e-4e88-a432-f508445f34ff tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-key-1714771515" status: 202 len: 0 microversion: 2.1 time: 0.102383 Aug 03 04:49:37.219135 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2054/4147] 10.222.0.72 () {58 vars in 1209 bytes} [Wed Aug 3 04:49:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1714771515 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:49:37.221465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28e657a6-7bc0-4259-b649-7c406e3163f9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59dfcb80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.273883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1615744435", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:37.309217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28e657a6-7bc0-4259-b649-7c406e3163f9 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.092049 Aug 03 04:49:37.317891 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2094/4148] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:37.329804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc7617ae-979e-4fe2-8420-296db8ae380b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e6b820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.341179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:49:37.405628 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc7617ae-979e-4fe2-8420-296db8ae380b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.079510 Aug 03 04:49:37.406461 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2095/4149] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:37.411019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.411478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:37.417619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.418067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.418835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.429832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.644221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:37.652065 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5327ac7a-c0db-4216-8f0c-f1aba3b48daf tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.244798 Aug 03 04:49:37.652690 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2096/4150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:37.657538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.658189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:37.664903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.665366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.666170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.666635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.897036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:37.904670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e943ce0-2673-4497-afc4-1874d06ca4f9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.250834 Aug 03 04:49:37.905765 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2097/4151] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:37.910222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a89c31b-684c-40c8-bb21-cda688cecf7b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47eacca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.923783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:49:37.924307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:49:37.924724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:49:37.925143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:49:37.925589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:49:37.943099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.944737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.946360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.947161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.970095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:49:37.973840 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a89c31b-684c-40c8-bb21-cda688cecf7b tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464" status: 200 len: 784 microversion: 2.1 time: 0.066999 Aug 03 04:49:37.974740 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2098/4152] 10.222.0.72 () {58 vars in 1233 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/images/f43e106e-5d11-4960-8ca7-6f17956e0464 => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:37.975980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:49:37.983847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:37.984812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:37.990696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:49:37.992081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.992562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:37.993365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:49:37.993526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:37.993865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.026019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.026498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.026980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:38.076203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.084920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8754902-4b77-4db3-adbe-82e4221e1b2e tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.107637 Aug 03 04:49:38.085503 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2099/4153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:37 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:38.089912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.090527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:38.097447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.098029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.098799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.099255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.149729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e43dc2c-72ff-4b13-8b44-753bcf4d2132 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880182 Aug 03 04:49:38.156749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2055/4154] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:49:38.156749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d024fe0d-9a8b-4933-a4c6-7c9426ba9a76 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59d36280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.230832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d024fe0d-9a8b-4933-a4c6-7c9426ba9a76 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.078890 Aug 03 04:49:38.237427 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2056/4155] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:38.238394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.239668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:38.249276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.250545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.251609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.253082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.273854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.284990 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e43a659-035d-4da6-99f4-a7fd54692fcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.198426 Aug 03 04:49:38.289776 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2100/4156] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:38.294715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-241628f9-6713-4257-94ba-b8337830f83d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.295353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-241628f9-6713-4257-94ba-b8337830f83d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:38.389514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-241628f9-6713-4257-94ba-b8337830f83d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.390594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-241628f9-6713-4257-94ba-b8337830f83d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1209 microversion: 2.1 time: 0.102083 Aug 03 04:49:38.398121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2101/4157] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:38.411330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b3f1495-e853-484b-9bfe-2b8f37b8f22c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e6b160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.510952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.521530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.523122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.524349 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa3e0db8-4d46-453d-9ee7-521457c3f887 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.291015 Aug 03 04:49:38.538355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2057/4158] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:38.632133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-561d5845-a3dc-4bc4-b94e-090b2e0966f3 req-cf9e864f-fe7a-453d-9f27-8d248eff6071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-unplugged", "status": "completed", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:38.643403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-561d5845-a3dc-4bc4-b94e-090b2e0966f3 req-cf9e864f-fe7a-453d-9f27-8d248eff6071 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.644142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-561d5845-a3dc-4bc4-b94e-090b2e0966f3 req-cf9e864f-fe7a-453d-9f27-8d248eff6071 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.659449 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-561d5845-a3dc-4bc4-b94e-090b2e0966f3 req-cf9e864f-fe7a-453d-9f27-8d248eff6071 service nova] Creating event network-vif-unplugged:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:49:38.665203 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-561d5845-a3dc-4bc4-b94e-090b2e0966f3 req-cf9e864f-fe7a-453d-9f27-8d248eff6071 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037340 Aug 03 04:49:38.666211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2058/4159] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:38.675240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.675937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:38.682307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.682761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.683526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.683992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.828821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:38.844395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae1e0ba8-eeb2-4377-8372-e356df68bbab tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.169856 Aug 03 04:49:38.846761 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2059/4160] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:38.927533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:38.930924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:38.934196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.934647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:38.935404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:38.936629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.088507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.097237 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-106cf1a1-d87d-4558-96f9-5f2cab2e6ce3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.173005 Aug 03 04:49:39.108733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2060/4161] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:38 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:39.116296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:39.117128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:39.123820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.124351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.125303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.125896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.160880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.166075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.166075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:39.207044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.214714 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7778db0-cfc9-43dc-8560-73c7deedddc0 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.104912 Aug 03 04:49:39.215284 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2061/4162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:39 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:39.309345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:39.309968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:39.317351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.317803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.318577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.319015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.465367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.475653 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6536c489-9675-4050-b9f8-73c62250248d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.170094 Aug 03 04:49:39.476652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2062/4163] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:39 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:39.481512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:39.482216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:39.489809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.490393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.491308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.491845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.557646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.566327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26b6bdf2-4a8c-40c4-b61b-0da1c79fae0a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1213 microversion: 2.1 time: 0.088573 Aug 03 04:49:39.567018 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2063/4164] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:39 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:39.572052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:39.572792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:39.579801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.580322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.581097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.581797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.715796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.724786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.726368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:39.727661 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b7564e6-9338-4d6a-bf9d-280f26f24780 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.159559 Aug 03 04:49:39.728296 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2064/4165] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:39 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:39.868394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:39.868929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:39.875506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.875966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.876769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:39.877212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:39.881801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:40.025686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.033678 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81b2ac1f-4902-4395-9d4b-726c50ffab06 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.169868 Aug 03 04:49:40.034256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2065/4166] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:39 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:40.124519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:40.125412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:40.132604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.137536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.137536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.137536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.314037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.330832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28667bf4-86be-45bf-a345-c947bb25af7c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.212064 Aug 03 04:49:40.331817 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2066/4167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:40 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:40.336737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:40.337338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:40.343496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.343942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.344733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.345167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.378091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.378535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.378974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:40.422626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.430245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea56db7b-394d-4f4e-8d57-e8214109ccc2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.097066 Aug 03 04:49:40.430812 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2067/4168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:40 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.515801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.683813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.692003 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30367e09-4492-4023-8c73-32bf0d7c11a7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.197517 Aug 03 04:49:40.692784 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2068/4169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:40 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:40.698536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:40.698536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:40.705817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.706635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.706995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.707453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.777841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.785370 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba54610f-49c8-4982-91c0-5de354d25c9d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1213 microversion: 2.1 time: 0.091529 Aug 03 04:49:40.785950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2069/4170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:40 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:40.790934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:40.791549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:40.797499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.797944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.798702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:40.799134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:40.942444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.951038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.953629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:40.954946 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7897892-c08d-418d-88a1-7202778dca2c tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.168057 Aug 03 04:49:40.955584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2070/4171] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:40 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:41.058425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.059117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.066601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.067095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.068113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.068719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.215242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:41.223085 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-57ee7c9f-f0d2-452f-9fe3-9164c9093e1c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.169165 Aug 03 04:49:41.223666 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2071/4172] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:41.358422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b3f1495-e853-484b-9bfe-2b8f37b8f22c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c" status: 204 len: 0 microversion: 2.1 time: 2.965786 Aug 03 04:49:41.358893 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2102/4173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:38 2022] DELETE /compute/v2.1/images/3656e38a-8c55-45cb-809b-cd10a8ab1e4c => generated 0 bytes in 2968 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:41.360128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.361146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.369330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfe34179-c0c5-407a-bff3-3105d297d311 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd47e00e50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.369571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.370079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.370898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.371332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.524874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:41.532538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c836f145-92b7-4672-a022-03f4ba7eb2ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.182203 Aug 03 04:49:41.533110 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2072/4174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:41.538694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.539303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.545474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.545907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.546701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.547168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.587511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.587960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.588444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 779d1f9e-2351-4630-83f4-9a80cfcc5a8d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:41.655730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:41.666492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89a6ce3d-13e5-47f0-a63f-e6662227e777 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 200 len: 1327 microversion: 2.1 time: 0.131197 Aug 03 04:49:41.672308 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2073/4175] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:41.716412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.717249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.723378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.723829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.724624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.725061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.878708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:41.886460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce05a4be-e37c-4fda-9b45-6e2675f6be69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.173899 Aug 03 04:49:41.886988 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2074/4176] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:41.892597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.893207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.899051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.903590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.903590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.903590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.971475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:41.979275 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e1a034a-2897-4232-a599-f1dc460216e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1205 microversion: 2.1 time: 0.091321 Aug 03 04:49:41.983952 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2075/4177] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:41.984626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:41.985042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:41.991266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.991725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:41.992519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:41.992959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.136733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:42.145521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:42.152062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:42.152062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4fe8e218-29f5-415a-a80e-052127a8bda6 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.167365 Aug 03 04:49:42.152062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2076/4178] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:41 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:42.244946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.253916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:42.253916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.253916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.253916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.253916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.397452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:42.401907 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a88a53d-6e6e-4cdc-9bd9-6f85cd551e32 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.160931 Aug 03 04:49:42.402584 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2077/4179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:42 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:42.553259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.553873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:42.560079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.560616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.561368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.561804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.681675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfe34179-c0c5-407a-bff3-3105d297d311 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0" status: 204 len: 0 microversion: 2.1 time: 1.317610 Aug 03 04:49:42.682340 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2103/4180] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:41 2022] DELETE /compute/v2.1/images/4cd9ead6-16be-4737-a6e8-3a12f85384b0 => generated 0 bytes in 1319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:42.692681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e04f24a-3bc0-46b7-a5e4-15ce4c1aed54 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd5459adc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.693633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:42.707428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d0e105e6-75f0-4c71-a0a1-175d2887b609 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.157970 Aug 03 04:49:42.708032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2078/4181] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:42 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:42.712744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.715352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:42.720638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.721100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.721875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.722343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.736882 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d HTTP/1.1 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '779d1f9e-2351-4630-83f4-9a80cfcc5a8d'} Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:42.738543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c991b8a6-75bf-4363-927b-1c2f00bb44e9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 404 len: 111 microversion: 2.1 time: 0.030827 Aug 03 04:49:42.748807 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2079/4182] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:42 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:42.753193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0eb0cef4-4a14-4d7b-a7ee-eecdda30ab50 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '.version_select at 0x7fdd540e50d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.854548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0eb0cef4-4a14-4d7b-a7ee-eecdda30ab50 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371553202" status: 202 len: 0 microversion: 2.1 time: 0.109431 Aug 03 04:49:42.855139 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2080/4183] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371553202 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:49:42.907150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:42.907792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:42.910848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:42.915111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.915562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:42.916343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:42.916782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.049356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.057065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6751105-f382-4686-9d42-c98805fb14ec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.153948 Aug 03 04:49:43.057676 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2081/4184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:42 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:43.070670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:43.071317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:43.078154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.078607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.079371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.079807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.145513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.149005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:43.153570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72254b05-7a5b-4f7e-a070-4bd4deddc63e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1205 microversion: 2.1 time: 0.086637 Aug 03 04:49:43.154163 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2082/4185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:43 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:43.173218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:43.173911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:43.180088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.180600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.181413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.181887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.322712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.331205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.333014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.334207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d2228df-5337-4c74-b1b9-419d0e3781d8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.165564 Aug 03 04:49:43.334771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2083/4186] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:43 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:43.423714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:43.424364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:43.430563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.430914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.431693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.432132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.598885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.606598 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5bbfce2e-9d92-4269-b31b-77dbdea39151 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.187282 Aug 03 04:49:43.607162 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2084/4187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:43 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:43.729746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:43.730333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:43.737147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.737549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.738377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:43.738731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:43.897705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:43.908584 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2aab1be3-df67-43f7-8a89-58a6041d1cfe tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.182562 Aug 03 04:49:43.909440 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2085/4188] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:43 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:43.916933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ea4c452-b0f1-4b03-95d8-75d61264fcd2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: .version_select at 0x7fdd47f015e0>, body: {"keypair": {"name": "tempest-keypair-1408423200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfAIzxJKbBISm646bvwJ+wXIvo4BPejDIi0DB6k0Ma2VdFAlB8SdHhHHLZ7bJIY5b90whTwSC7eWYN/4vgYQcYgrS3P+9wJKL9xFQVeMJbmdsQuE8ndK/Rjla3jmM2fOA=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:43.933511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0ea4c452-b0f1-4b03-95d8-75d61264fcd2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for project eb38f33edc704bb39daf9765439257d5. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:49:43.939628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-0ea4c452-b0f1-4b03-95d8-75d61264fcd2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for user 2ebe6f390e2741058f63638d0b22eac9 and project eb38f33edc704bb39daf9765439257d5. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:49:44.091145 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ea4c452-b0f1-4b03-95d8-75d61264fcd2 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180630 Aug 03 04:49:44.100132 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2086/4189] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:49:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:44.100132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.109200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.123808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.127057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.128581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.129366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.311802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.326616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d0230cb-054b-4d60-9dac-a27f24a6aedc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.230318 Aug 03 04:49:44.327235 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2087/4190] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:44 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:44.347376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.348893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.358440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.361172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.362317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.385646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.440838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.449760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edd944e8-0afa-4343-b742-877cd625887c tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1261 microversion: 2.1 time: 0.120654 Aug 03 04:49:44.450717 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2088/4191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:44 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1261 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:44.456669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.457538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.465700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.470100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.470100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.470100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.689297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.715194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.716878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.718436 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8604a919-2cea-453d-9a79-3aa5508e8b47 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.266305 Aug 03 04:49:44.733283 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2089/4192] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:44 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:44.733283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.733283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.736946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.737329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.738237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.738678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.832743 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e04f24a-3bc0-46b7-a5e4-15ce4c1aed54 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679" status: 204 len: 0 microversion: 2.1 time: 2.144472 Aug 03 04:49:44.833918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2104/4193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:42 2022] DELETE /compute/v2.1/images/fc4aa3c6-bd98-4899-a769-956907467679 => generated 0 bytes in 2146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:49:44.844315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.849625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.858710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.861459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.862298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.865844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.911039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:49:44.955604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:44.969644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-695a0895-1d7f-4f51-ad24-86aaf8f326b2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.248685 Aug 03 04:49:44.970334 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2090/4194] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:44 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:44.975113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:44.982658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:44.990500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.990957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:44.991749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:44.992190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.244143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.253030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35300601-a3a3-43e3-a520-e25aeeefca18 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.281424 Aug 03 04:49:45.254578 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2091/4195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:44 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:45.290328 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f7a9587-feff-48ba-b2bb-4644cf7fc330 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 204 len: 0 microversion: 2.1 time: 0.451654 Aug 03 04:49:45.291880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2105/4196] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:49:44 2022] DELETE /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:49:45.300594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:45.301334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:45.309796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.310912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.312069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.313249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.349987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:45.350866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:45.359915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.361921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.362997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.363863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.555129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.569950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4257b73-24ac-4c4b-aef8-fc2ded96d5ad tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1473 microversion: 2.1 time: 0.272851 Aug 03 04:49:45.571383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2092/4197] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:45 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:45.606010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:45.608352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:45.624558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.634275 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b03e00e2-7e8e-477c-9093-77415cbb62c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.287620 Aug 03 04:49:45.635655 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2106/4198] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:45 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:45.640513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.641400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.642780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.643440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.733430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.743790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56fa8044-f7f6-402b-8ed6-48f4f781c6cc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1267 microversion: 2.1 time: 0.171054 Aug 03 04:49:45.747026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:45.747890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:45.755699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2093/4199] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:45 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:45.757742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.758455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.759534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:45.760304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:45.960522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.970396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.971906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:45.973333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54984c8a-fcee-4880-83ee-b727ad50ff67 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.230557 Aug 03 04:49:45.974100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2107/4200] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:45 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:45.994050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:45.995391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:46.004888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.006043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.007139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.007768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.194111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:46.204131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9ca7a66a-e81d-450d-9bfe-d422060ed64d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.214651 Aug 03 04:49:46.219251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2094/4201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:45 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:46.274693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:46.275604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:46.285857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.286625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.287609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.288225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.475885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:46.493054 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dcaf8a7d-6515-457c-8f14-7f166a326c6f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.222405 Aug 03 04:49:46.494235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2108/4202] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:46 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:46.595630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:46.596404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:46.614346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.614906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.615797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.616339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.662846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:46.663651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:46.675208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.684921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:46.693418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:46.694051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.075278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:47.088579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db779ab6-4573-491f-981c-499cd57fc9f7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1473 microversion: 2.1 time: 0.496840 Aug 03 04:49:47.089895 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2095/4203] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:46 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1473 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:47.096152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:47.097052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:47.104702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:47.114280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.115047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.116638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.117285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.121300 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73f1287d-6672-4b17-ad40-a9c11f7a2bc0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.464718 Aug 03 04:49:47.132499 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2109/4204] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:46 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:47.145721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:47.146350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:47.163933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.168565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.170260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.170882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.578896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:47.589315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b825c75c-970a-49ae-81eb-5a92001bf81d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.497883 Aug 03 04:49:47.596720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2096/4205] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:47 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:47.609553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:47.625228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:47.640437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.641136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.642121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:47.648281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:47.958793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:48.130811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.135238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:48.143200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.145996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.147811 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f77473c-5f0f-4ff6-84b5-93c059266fed tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 1.014166 Aug 03 04:49:48.148870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2110/4206] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:47 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:48.156396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-981b048e-a25b-45df-b486-b35d47656b0f req-cf2263ca-f025-4f90-9467-c845ed76b4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-plugged", "status": "completed", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:48.171745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-981b048e-a25b-45df-b486-b35d47656b0f req-cf2263ca-f025-4f90-9467-c845ed76b4bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.173204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-981b048e-a25b-45df-b486-b35d47656b0f req-cf2263ca-f025-4f90-9467-c845ed76b4bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-981b048e-a25b-45df-b486-b35d47656b0f req-cf2263ca-f025-4f90-9467-c845ed76b4bb service nova] Creating event network-vif-plugged:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h2-826756-5 Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-981b048e-a25b-45df-b486-b35d47656b0f req-cf2263ca-f025-4f90-9467-c845ed76b4bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054846 Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2111/4207] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.253395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.345426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.353735 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-552abd26-8cf1-4880-95aa-ad6386b8c075 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.748221 Aug 03 04:49:48.354415 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2097/4208] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:47 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:48.368335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:48.368335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:48.373424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.373880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.374655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.375090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.386195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:48.492204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.501759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26d13ba0-2d32-40f4-99aa-2a412f762489 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.294163 Aug 03 04:49:48.519595 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2112/4209] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:48 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:48.521998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-343fd1e6-bc03-48c8-9d89-b3f719c60613 req-ed931b69-1d6f-463d-aaff-152fb4ba063b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9874c3-d796-48db-a176-5fd8b97341a1", "tag": "8f67b126-9b16-4611-8ed9-8cfddee8f7f3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:48.537593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-343fd1e6-bc03-48c8-9d89-b3f719c60613 req-ed931b69-1d6f-463d-aaff-152fb4ba063b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.551993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-343fd1e6-bc03-48c8-9d89-b3f719c60613 req-ed931b69-1d6f-463d-aaff-152fb4ba063b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.551993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-343fd1e6-bc03-48c8-9d89-b3f719c60613 req-ed931b69-1d6f-463d-aaff-152fb4ba063b service nova] Creating event network-changed:8f67b126-9b16-4611-8ed9-8cfddee8f7f3 for instance 1d9874c3-d796-48db-a176-5fd8b97341a1 on n-h2-826756-5 Aug 03 04:49:48.556145 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-343fd1e6-bc03-48c8-9d89-b3f719c60613 req-ed931b69-1d6f-463d-aaff-152fb4ba063b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040549 Aug 03 04:49:48.556796 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2113/4210] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:48.562948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:48.563663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:48.570925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.579571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.580575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.581247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.640723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:48.653621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1bede46a-b810-4630-88fa-754c24bca9d7 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1473 microversion: 2.1 time: 0.298096 Aug 03 04:49:48.669995 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2098/4211] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:48 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:48.669995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:48.669995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:48.684537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.685156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:48.686738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:48.687184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.042475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.052591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-abbb6861-722d-45e5-b83b-35e4f2c6985c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.492384 Aug 03 04:49:49.054966 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2114/4212] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:48 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:49.062745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1cf87c4b-7284-4419-80c0-e60846bb3f36 req-c6ce2b49-b46d-49f0-ba10-07048c1a897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c4b733-ed81-4164-8448-5bc667788e1d", "name": "network-vif-deleted", "tag": "48db9db0-6b04-4c02-b8c3-06fcac1fd327"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:49.089562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1cf87c4b-7284-4419-80c0-e60846bb3f36 req-c6ce2b49-b46d-49f0-ba10-07048c1a897a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.090423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1cf87c4b-7284-4419-80c0-e60846bb3f36 req-c6ce2b49-b46d-49f0-ba10-07048c1a897a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.106450 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1cf87c4b-7284-4419-80c0-e60846bb3f36 req-c6ce2b49-b46d-49f0-ba10-07048c1a897a service nova] Creating event network-vif-deleted:48db9db0-6b04-4c02-b8c3-06fcac1fd327 for instance 47c4b733-ed81-4164-8448-5bc667788e1d on n-h1-826756-5 Aug 03 04:49:49.117834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1cf87c4b-7284-4419-80c0-e60846bb3f36 req-c6ce2b49-b46d-49f0-ba10-07048c1a897a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061288 Aug 03 04:49:49.119401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2115/4213] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:49.120750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.130282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-36f4d264-667d-497e-83e2-e3484e3b9963 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.472373 Aug 03 04:49:49.134167 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2099/4214] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:48 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:49.184724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:49.189939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:49.192801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:49.200675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.201119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.202055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.203750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.375930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:49.376977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:49.394472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.395514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.397821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.398616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.452480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:49.640027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.651028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.652911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.654666 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d384e46a-ad00-4484-944f-54cc2cd93bc3 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.474937 Aug 03 04:49:49.655504 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2116/4215] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:49 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:49.661729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:49.662595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:49.679125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.680670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.681824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.682479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.715454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.737358 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55d9d54e-9b35-4179-83a3-ea4b868aaff4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.366091 Aug 03 04:49:49.742491 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2100/4216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:49 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:49.753317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:49.754347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:49.763622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.765630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.766478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.766963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.803471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:49.804031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:49.804560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lazy-loading 'fault' on Instance uuid 47c4b733-ed81-4164-8448-5bc667788e1d {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:49.874887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.892576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8024ab31-5651-43c0-adce-4f8bb470e9ab tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 200 len: 1307 microversion: 2.1 time: 0.146055 Aug 03 04:49:49.893744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2101/4217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:49 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:49.936279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:49.944900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b726b897-ce6b-4ab5-9aa7-f24536758f54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.288181 Aug 03 04:49:49.945589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2117/4218] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:49 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:50.027175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1317949299", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e074a4b-f902-4eed-bcc3-75f5a8703622"}], "security_groups": [{"name": "tempest-securitygroup--1208753619"}], "key_name": "tempest-keypair-1408423200", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:50.075162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:50.076684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:50.087220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.087760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.088645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.089148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.198174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] validate_networks() for [('7e074a4b-f902-4eed-bcc3-75f5a8703622', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:49:50.326018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:50.337398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-954bd1bf-8d28-4f1d-a308-adfad23a3dba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.263803 Aug 03 04:49:50.337398 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2118/4219] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:50 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:50.351092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:50.352684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:50.363290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.363832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.364791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.365315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.627362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:50.649732 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-809a3973-ba56-4f0a-86f7-241a18ddcf9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.308568 Aug 03 04:49:50.651063 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2119/4220] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:50 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:50.689901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:50.690878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:50.704835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.705805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.707107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.709079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.832707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:49:50.833366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:49:50.833632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:49:50.834036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:49:50.834443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:49:50.851336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.857588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.857588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.857588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.875548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for project eb38f33edc704bb39daf9765439257d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:49:50.883058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Getting quotas for user 2ebe6f390e2741058f63638d0b22eac9 and project eb38f33edc704bb39daf9765439257d5. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:49:50.899725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:49:50.901993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:49:50.929160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:50.939143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:50.940995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:50.942194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef4cfe9a-b37c-4ba4-935e-0077ef29f94d tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.265074 Aug 03 04:49:50.942776 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2120/4221] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:50 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:50.947878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:50.948676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:50.956522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.957078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:50.957887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:50.958355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.030968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-866d3196-8d3c-4ecc-b180-2914dd6586cb tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.008641 Aug 03 04:49:51.038623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2102/4222] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:49:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:49:51.045100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.045534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 47c4b733-ed81-4164-8448-5bc667788e1d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.054496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.054496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.055270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.055552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.073441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] HTTP exception thrown: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Request method failure captured: Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d HTTP/1.1 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f31elnyBUFluEqqeiCm_wBUAXGLmQNRv9beTZyxrrg7pMkCgkmIlZTULtyfykIg5P_SZ4KgrVYSNSxZfMtIirwDQAH8Co1gadPEnnkSCFwtrxnpAjQhbV8l1mtWUY-VlXYLCbtgrlEsE7NNgCaXa31St5hz10QMJIlHG_OMEFBK3G8 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 95202d0336b14e40bca85fca08129f99 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95202d0336b14e40bca85fca08129f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95202d0336b14e40bca85fca08129f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95202d0336b14e40bca85fca08129f99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95202d0336b14e40bca85fca08129f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 95202d0336b14e40bca85fca08129f99 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListImageFiltersTestJSON-2070352012-project Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ef386a1ba5d64e77bd0107ddafbf5d0f Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListImageFiltersTestJSON-2070352012-project Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '47c4b733-ed81-4164-8448-5bc667788e1d'} Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:51.075205 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Returning 404 to user: Instance 47c4b733-ed81-4164-8448-5bc667788e1d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6dbedad9-f669-450a-b74f-4c72bb020638 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d" status: 404 len: 111 microversion: 2.1 time: 0.036636 Aug 03 04:49:51.080127 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2103/4223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/47c4b733-ed81-4164-8448-5bc667788e1d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:51.083562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.085298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.103650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.104120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.105026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.105472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.151672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:51.162712 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8615562-d45f-4641-9d5c-3cbbf925514f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.217798 Aug 03 04:49:51.165323 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2121/4224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:50 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:51.177414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-125f8f45-6203-4b16-b53c-7329756459d8 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.178202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-125f8f45-6203-4b16-b53c-7329756459d8 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.310718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-125f8f45-6203-4b16-b53c-7329756459d8 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:51.318326 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-125f8f45-6203-4b16-b53c-7329756459d8 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1238 microversion: 2.1 time: 0.148142 Aug 03 04:49:51.319291 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2122/4225] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1238 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:51.324246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.325068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.348484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.348484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.348484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.349271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:51.349398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.356190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e4ce243e-da75-4c8d-87e2-7f70eb072c32 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.277529 Aug 03 04:49:51.357324 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2104/4226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:51.362113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.362981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.369396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.370116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.371139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.371824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.394308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:49:51.534588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:51.543359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6a48742-9296-4284-af52-088986dc838e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.184749 Aug 03 04:49:51.544934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2105/4227] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:51.674632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.675308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.688517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.689342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.690369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.697815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.847668 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f0557fb-db7b-4614-b1da-829c579a55d3 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 204 len: 0 microversion: 2.1 time: 0.526781 Aug 03 04:49:51.848453 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2123/4228] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:49:51 2022] DELETE /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:51.860691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.860691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.866684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.867444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.868494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.869177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.885515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:51.893870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d47a226-c511-41a1-a711-99a421e53a0d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.224446 Aug 03 04:49:51.894646 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2106/4229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:51.969498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:51.970052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:51.977783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.978241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:51.979042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:51.979478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.092440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.100922 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c4a4be6-83ad-42bb-a1e2-1341c1b5cfbb tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1474 microversion: 2.1 time: 0.247785 Aug 03 04:49:52.102011 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2124/4230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1474 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:52.164491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.174350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.176041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.177308 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f70821d-0220-441c-98ae-fee3b376cfa7 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.213110 Aug 03 04:49:52.177957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2107/4231] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:51 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:52.188051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:52.188697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:52.196099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.196569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.197373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.197808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.347235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ca9f135-6955-4544-8710-78ab5a7c5720 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:52.347235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ca9f135-6955-4544-8710-78ab5a7c5720 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:52.347734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.350856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d16de19-06ad-41e7-a97c-2371bcb73e84 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1523 microversion: 2.1 time: 0.167762 Aug 03 04:49:52.364624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2125/4232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:52 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:52.384445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:52.386652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:52.392246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.392726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.393564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.394044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.401932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ca9f135-6955-4544-8710-78ab5a7c5720 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.413362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ca9f135-6955-4544-8710-78ab5a7c5720 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1238 microversion: 2.1 time: 0.078301 Aug 03 04:49:52.414285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2108/4233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:52 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:52.538031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.546343 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-070b45bf-36df-4d3d-825d-439127f1ebf9 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.171319 Aug 03 04:49:52.546915 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2126/4234] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:52 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:52.566471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:52.575730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:52.575730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.575730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.577073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.577073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.796396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:52.807914 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4285d18f-043f-4770-ae4b-150a26b95a69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.246099 Aug 03 04:49:52.818585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2109/4235] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:52 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:52.917612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:52.922815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:52.941923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.941923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:52.941923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:52.941923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.118748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.124488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.125306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.132998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.134039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.135067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.135726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.136742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4901fbc9-6e05-4c3b-88b8-fad9d44a9d94 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.224832 Aug 03 04:49:53.152422 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2127/4236] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:52 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:53.207556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.208549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.237397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.238921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.240469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.240914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.313607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.322142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edc8ac7c-dfc0-43af-abef-beca6f1a43e4 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1474 microversion: 2.1 time: 0.202616 Aug 03 04:49:53.324005 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2110/4237] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:53.376750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.377624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.388588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.392586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.393748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.395646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.447823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.455471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:53.462654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.464166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.465395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c0a4b1b-5c70-4718-845d-6b9391cf9835 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.263296 Aug 03 04:49:53.466016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2128/4238] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:49:53.471555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.472178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.483094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.484637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.486470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.487551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.590954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.600330 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2906a71c-120d-4a11-933c-e41cb1efbea6 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1242 microversion: 2.1 time: 0.132518 Aug 03 04:49:53.604236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2129/4239] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:53.614688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.618376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.619510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.627798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.628257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.629044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-670915d3-56d8-4221-aec3-166853089363 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1500 microversion: 2.1 time: 0.258258 Aug 03 04:49:53.629229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.629679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.632348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2111/4240] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1500 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:53.651039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.663571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.664466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:53.671718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.672444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.673655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.674283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.744304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:49:53.782960 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-afc3170a-b235-448c-aef5-7dfabe261385 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.135626 Aug 03 04:49:53.783889 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2112/4241] 10.222.0.72 () {58 vars in 1154 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:53.798736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7b98ae3-34d8-473c-b427-a7b7317de3fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:53.807211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b98ae3-34d8-473c-b427-a7b7317de3fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.811244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:53.817439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b98ae3-34d8-473c-b427-a7b7317de3fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.821214 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e40816b-f072-4e13-83d8-8fbe4ff106bb tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.218418 Aug 03 04:49:53.822217 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2130/4242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:53.840665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:53.842064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:53.851301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.855325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.856395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:53.857588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:53.867433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7b98ae3-34d8-473c-b427-a7b7317de3fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Going to try to start instance {{(pid=120831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 04:49:54.105238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7b98ae3-34d8-473c-b427-a7b7317de3fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "POST /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7/action" status: 202 len: 0 microversion: 2.1 time: 0.313022 Aug 03 04:49:54.106444 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2113/4243] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:53 2022] POST /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:49:54.130303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:54.133766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:54.156757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:54.161019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.161409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.163781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.164151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.167745 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee3f11a0-8598-4c15-a1ff-92166841fac6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.339453 Aug 03 04:49:54.168359 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2131/4244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:53 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:54.186763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:54.187397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:54.202105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.209704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.209704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.209704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.506947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:54.524497 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29d22731-01be-4cc6-8d1b-7e3e4a962eb2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1509 microversion: 2.1 time: 0.406729 Aug 03 04:49:54.538246 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2114/4245] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:54 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1509 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:49:54.543512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:54.544698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:54.559102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.559828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.561436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.572140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.636049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:54.645441 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b99d6112-3322-4ca0-ba28-5b5e7a4bd7a6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.462916 Aug 03 04:49:54.650300 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2132/4246] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:54 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:54.666245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:54.667185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:54.675380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.676015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.677014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.677559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.871718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:54.880672 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b4d158d-5e44-4591-9932-8951d23abf2f tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1474 microversion: 2.1 time: 0.341045 Aug 03 04:49:54.881262 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2115/4247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:54 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:54.895688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:54.896998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:54.900113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:54.916742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.922150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:54.922150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:54.922150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.003865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.017708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.020989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.022728 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e308179-9a77-445b-883e-e9ab4a338a6b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1729 microversion: 2.20 time: 0.372457 Aug 03 04:49:55.024078 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2133/4248] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:54 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1729 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:55.032545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:55.033470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:55.045844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.068322 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aad24713-72e3-49a1-ba32-dd97cbedc120 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1290 microversion: 2.1 time: 0.177438 Aug 03 04:49:55.084894 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2116/4249] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:54 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1290 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:55.087864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.088444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.089283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.090174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.174139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1f5cc876-870e-4f2f-a968-f4a899bb63c0 req-cdaa66bb-3ea8-4868-84b0-0d3d3559d18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ed85ee-fba4-47b0-90bf-773eb56e8edd", "name": "network-vif-deleted", "tag": "c2aac6da-ff88-443a-950e-aac0d5aeb973"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:55.195041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1f5cc876-870e-4f2f-a968-f4a899bb63c0 req-cdaa66bb-3ea8-4868-84b0-0d3d3559d18a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.196113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1f5cc876-870e-4f2f-a968-f4a899bb63c0 req-cdaa66bb-3ea8-4868-84b0-0d3d3559d18a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.223001 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1f5cc876-870e-4f2f-a968-f4a899bb63c0 req-cdaa66bb-3ea8-4868-84b0-0d3d3559d18a service nova] Creating event network-vif-deleted:c2aac6da-ff88-443a-950e-aac0d5aeb973 for instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd on n-h1-826756-5 Aug 03 04:49:55.232774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1f5cc876-870e-4f2f-a968-f4a899bb63c0 req-cdaa66bb-3ea8-4868-84b0-0d3d3559d18a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063998 Aug 03 04:49:55.234126 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2117/4250] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:49:55.240944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:55.242021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:55.250464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.253545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.253545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.253545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.289554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:49:55.352130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.368492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae03a878-73cf-46d2-96f9-8470975911c5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.342489 Aug 03 04:49:55.381221 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2134/4251] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:55 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:55.465166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:55.478935 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de1ebd6d-b6fe-497d-b8a6-296af9c9e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.243315 Aug 03 04:49:55.482234 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2118/4252] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:55 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:55.549627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:55.550585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:55.565908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.566865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.572872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.575225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.672680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:55.673782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:55.690209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.690722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:55.706099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:55.707127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.112620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.121125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16c6344c-daae-4bc9-9f2e-ec1390a2c8ee tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.454841 Aug 03 04:49:56.125592 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2119/4253] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:55 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:56.143641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:56.144374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:56.151064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.153168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.153168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.153168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.170109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.184831 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9e38dda7-a89e-4657-9f09-3572a3c0a9fa tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1509 microversion: 2.1 time: 0.638265 Aug 03 04:49:56.184831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2135/4254] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:55 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:56.189529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.190054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.190412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lazy-loading 'fault' on Instance uuid 91ed85ee-fba4-47b0-90bf-773eb56e8edd {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:49:56.190728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:56.191994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:56.201871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.202758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.204821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.207030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.265405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef386a1ba5d64e77bd0107ddafbf5d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95202d0336b14e40bca85fca08129f99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.275681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e369e98d-2c1d-4aa8-a781-a16e514938cd tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 200 len: 1308 microversion: 2.1 time: 0.138088 Aug 03 04:49:56.278155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2120/4255] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:56 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:56.285496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:56.286236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:56.295122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.295661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.296697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.297273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.415118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.430244 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c55ed3b-d137-41e4-b703-720428e06cd1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1296 microversion: 2.1 time: 0.146651 Aug 03 04:49:56.441929 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2121/4256] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:56 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1296 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:56.448907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:56.449840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:56.462359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.463214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.464041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.464684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.580555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.580555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.580555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.580555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31c436f7-9a66-4702-8469-e734744b8d37 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1716 microversion: 2.20 time: 0.392346 Aug 03 04:49:56.597477 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2136/4257] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:49:56 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1716 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:49:56.603625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:56.605484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:56.673393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.673393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.673393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:56.673393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:56.674025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.674025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dbc16945-b2a5-4d82-8d46-af32aae9c05a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.219307 Aug 03 04:49:56.674025 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2122/4258] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:56 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:56.772232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:56.779738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed2b2680-2800-4f96-8688-b9483bca5b1e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1521 microversion: 2.1 time: 0.180528 Aug 03 04:49:56.780346 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2137/4259] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:56 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:57.147578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.148489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:57.155997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.156593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.157459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.157982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.203854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.205659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:57.218666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.223175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.224756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.225575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.522254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:57.532155 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ca1d489-ba82-4421-8df0-c171eac94c1e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1513 microversion: 2.1 time: 0.333075 Aug 03 04:49:57.533308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2138/4260] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1513 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:57.542744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.543550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] [instance: 91ed85ee-fba4-47b0-90bf-773eb56e8edd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:57.571550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.572458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.573526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.576503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.607624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] HTTP exception thrown: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Request method failure captured: Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd HTTP/1.1 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f31elnyBUFluEqqeiCm_wBUAXGLmQNRv9beTZyxrrg7pMkCgkmIlZTULtyfykIg5P_SZ4KgrVYSNSxZfMtIirwDQAH8Co1gadPEnnkSCFwtrxnpAjQhbV8l1mtWUY-VlXYLCbtgrlEsE7NNgCaXa31St5hz10QMJIlHG_OMEFBK3G8 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 95202d0336b14e40bca85fca08129f99 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95202d0336b14e40bca85fca08129f99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95202d0336b14e40bca85fca08129f99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95202d0336b14e40bca85fca08129f99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95202d0336b14e40bca85fca08129f99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 95202d0336b14e40bca85fca08129f99 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2070352012 Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ListImageFiltersTestJSON-2070352012-project Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ef386a1ba5d64e77bd0107ddafbf5d0f Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ListImageFiltersTestJSON-2070352012-project Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '91ed85ee-fba4-47b0-90bf-773eb56e8edd'} Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:57.611641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Returning 404 to user: Instance 91ed85ee-fba4-47b0-90bf-773eb56e8edd could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9837d840-0d01-472d-8691-4c2555ede199 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd" status: 404 len: 111 microversion: 2.1 time: 0.078388 Aug 03 04:49:57.620764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2139/4261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers/91ed85ee-fba4-47b0-90bf-773eb56e8edd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:57.621781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.621872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:57.632884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.637352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.637352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.637352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.800592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:57.810166 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5aae58b5-195f-4f37-a730-ca0d57a15db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.666596 Aug 03 04:49:57.834228 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2123/4262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:57.850476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.859913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:57.860630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.servers [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Removing options 'limit' from query {{(pid=120831) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 03 04:49:57.861450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:49:57.864969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.865440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.867022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.867466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.869598 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a49913be-a289-400f-b261-3c17ccfaabae tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.033768 Aug 03 04:49:57.877066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2124/4263] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:49:57.877066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb9e4f87-fc30-43c1-bb8b-844e1fc78b99 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540e00d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.898534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:57.910260 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a729356-8c52-4568-9a6c-a771b7dbc3bd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.294741 Aug 03 04:49:57.911063 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2140/4264] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:57.929458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:57.930094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:57.936870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.937324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:57.938302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:57.938743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.163391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:58.171637 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f88b84f-6c6b-450a-878d-b3dea6ccb726 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1523 microversion: 2.1 time: 0.250922 Aug 03 04:49:58.172331 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2141/4265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:58.177096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-21df9379-cdc4-4db6-9e91-e1b306031ddc req-deec6a3f-f319-4ced-9e15-1cdf7f28e061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9874c3-d796-48db-a176-5fd8b97341a1", "name": "network-vif-plugged", "status": "completed", "tag": "8f67b126-9b16-4611-8ed9-8cfddee8f7f3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:58.188042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21df9379-cdc4-4db6-9e91-e1b306031ddc req-deec6a3f-f319-4ced-9e15-1cdf7f28e061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.188620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21df9379-cdc4-4db6-9e91-e1b306031ddc req-deec6a3f-f319-4ced-9e15-1cdf7f28e061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.202255 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-21df9379-cdc4-4db6-9e91-e1b306031ddc req-deec6a3f-f319-4ced-9e15-1cdf7f28e061 service nova] Creating event network-vif-plugged:8f67b126-9b16-4611-8ed9-8cfddee8f7f3 for instance 1d9874c3-d796-48db-a176-5fd8b97341a1 on n-h2-826756-5 Aug 03 04:49:58.207980 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-21df9379-cdc4-4db6-9e91-e1b306031ddc req-deec6a3f-f319-4ced-9e15-1cdf7f28e061 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 Aug 03 04:49:58.209827 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2142/4266] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:58.215617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:58.216943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:58.223464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.223905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.224692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.225244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.687969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb9e4f87-fc30-43c1-bb8b-844e1fc78b99 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd" status: 204 len: 0 microversion: 2.1 time: 0.816128 Aug 03 04:49:58.688565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2125/4267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:57 2022] DELETE /compute/v2.1/images/3d03fd65-841a-4680-a3e0-77219896d2bd => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:58.694220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:58.694848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:58.703515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.704222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.705080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.705523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.795756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:58.803841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b64b05de-4330-44b3-b104-7ebaca977d51 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1501 microversion: 2.1 time: 0.592806 Aug 03 04:49:58.804568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2143/4268] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:58 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1501 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:58.810147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d844d490-7f42-45b7-8961-245b6add121c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd59cefc10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:58.925425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:58.936177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1f1df75-3bf4-41ae-b5f3-cbae7f1808bd tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1513 microversion: 2.1 time: 0.246301 Aug 03 04:49:58.936776 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2126/4269] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:58 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:58.941491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:58.942243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:58.949140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.949537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:58.950459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:58.950922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.184316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:59.192807 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30f0c2dc-f64a-4666-ac6c-86459e9a12a2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1515 microversion: 2.1 time: 0.254673 Aug 03 04:49:59.193625 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2127/4270] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:58 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:59.200002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.201487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.210207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.210207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.212159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.212702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.354650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d844d490-7f42-45b7-8961-245b6add121c tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead" status: 204 len: 0 microversion: 2.1 time: 0.548681 Aug 03 04:49:59.355234 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2144/4271] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:58 2022] DELETE /compute/v2.1/images/751e36ca-3a78-4f54-9e78-bd9de37bfead => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:49:59.361246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.361867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.367970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.368486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.369253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.369877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.373078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:59.380744 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f9f6d81-0fe8-49bf-825e-7d72fa79f086 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.184348 Aug 03 04:49:59.381322 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2128/4272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:59.386048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.386848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.393092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.393561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.394366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.394847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.664291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:59.672302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf0c1e07-6e53-4477-a863-8a32b8c0e5e1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.315850 Aug 03 04:49:59.673534 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2145/4273] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:59.677420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.678038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.689599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:59.691361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.691892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.692915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.693361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.697902 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-543c2212-e5ac-4f9f-86b4-6e9ecbb9c62c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1511 microversion: 2.1 time: 0.315508 Aug 03 04:49:59.698711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2129/4274] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1511 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:59.704321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:59.707207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.719305 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9/action HTTP/1.1 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 14 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: {"rescue": {}} Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9', 'body': {'rescue': {}}} Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:59.725906 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 404 to user: Instance 9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47572fe3-5c35-4e04-8fdb-bc3bfc184349 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9/action" status: 404 len: 111 microversion: 2.1 time: 0.027772 Aug 03 04:49:59.732155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2130/4275] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:49:59 2022] POST /compute/v2.1/servers/9c3a8fca-9f1f-4f66-bdf6-e0b08cae07d9/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:49:59.735407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f72a614f-bb48-472b-8c04-067fe575f9e2 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] Calling method '.version_select at 0x7fdd540a65e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.888545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:49:59.896160 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78fccfc6-a60c-4d63-8551-890d8d9042e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1505 microversion: 2.1 time: 0.222260 Aug 03 04:49:59.897505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2146/4276] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:49:59.902336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1be27c14-8124-470a-b4f7-32b0d12ab49e req-277383fb-0b14-462d-b737-57a72dd98af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650b5236-9353-4479-b9a6-cf30ffffc916", "tag": "4b85bf78-bb3a-4622-91f0-122d17f859c8"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:49:59.913073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1be27c14-8124-470a-b4f7-32b0d12ab49e req-277383fb-0b14-462d-b737-57a72dd98af3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.913523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1be27c14-8124-470a-b4f7-32b0d12ab49e req-277383fb-0b14-462d-b737-57a72dd98af3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.927788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1be27c14-8124-470a-b4f7-32b0d12ab49e req-277383fb-0b14-462d-b737-57a72dd98af3 service nova] Creating event network-changed:4b85bf78-bb3a-4622-91f0-122d17f859c8 for instance 650b5236-9353-4479-b9a6-cf30ffffc916 on n-h1-826756-5 Aug 03 04:49:59.932633 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1be27c14-8124-470a-b4f7-32b0d12ab49e req-277383fb-0b14-462d-b737-57a72dd98af3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033743 Aug 03 04:49:59.933228 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2147/4277] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:49:59.938360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:49:59.939053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:49:59.945261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.945711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.946473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:49:59.946908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:49:59.966595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:00.178048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:00.186921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e111d4ea-ed45-43ac-a7c0-8c5d7ee7f290 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1511 microversion: 2.1 time: 0.252337 Aug 03 04:50:00.202093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2148/4278] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:00.207904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:00.208260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.215017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.216392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.217423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.217911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.377773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f72a614f-bb48-472b-8c04-067fe575f9e2 tempest-ListImageFiltersTestJSON-2070352012 tempest-ListImageFiltersTestJSON-2070352012-project] 10.222.0.72 "DELETE /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189" status: 204 len: 0 microversion: 2.1 time: 0.642608 Aug 03 04:50:00.377773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2131/4279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:49:59 2022] DELETE /compute/v2.1/images/9c05a206-91a5-4614-a697-3ed75debd189 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:00.377773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.382356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:00.383080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:00.488657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.489079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.489884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.490348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.522011 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed2c967f-7211-4254-a94a-8c72adbea8dc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action" status: 202 len: 0 microversion: 2.1 time: 0.318285 Aug 03 04:50:00.523239 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2149/4280] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:00 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:50:00.529250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.529955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.536226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.536701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.537499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.537931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.581630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:00.643080 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a63250d2-9844-4c60-a66f-59bae047637f tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 0.269331 Aug 03 04:50:00.643676 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2132/4281] 10.222.0.72 () {58 vars in 1154 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:00.652597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.653811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.660787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.661244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.662032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.662474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.717907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:00.735098 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e2805e8-e311-4246-9eac-3ec09be83090 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1309 microversion: 2.1 time: 0.210277 Aug 03 04:50:00.735887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2150/4282] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:00.741417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.742083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.748938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.749557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.750519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.751208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.891887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:00.902082 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17a5f847-370a-4069-a449-a87ddf37e692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1520 microversion: 2.1 time: 0.257123 Aug 03 04:50:00.903652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2133/4283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:00.911430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.912513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.920855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.921720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.922761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.923365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.943059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:00.953597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02a2862d-3f7d-4833-92a6-49996663a60b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1513 microversion: 2.1 time: 0.214812 Aug 03 04:50:00.954405 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2151/4284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:00.972557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:00.973190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:00.987970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.987970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:00.987970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:00.987970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.161984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.177096 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc55b40e-f2f9-4e0c-930e-7465303ad126 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.271588 Aug 03 04:50:01.178229 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2134/4285] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:01.187409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:01.188741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:01.202495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.203001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.203893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.204347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.207620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.227023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d5b4178-0de7-4edc-9423-9fc2a5ef9777 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1505 microversion: 2.1 time: 0.258859 Aug 03 04:50:01.228937 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2152/4286] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:00 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:01.451382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.459515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94b68567-5686-438e-bbd9-1271c2aab153 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1511 microversion: 2.1 time: 0.279796 Aug 03 04:50:01.460199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2135/4287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:01 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:01.480529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:01.481644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:01.483925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:01.489387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.489837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.490609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.491043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.735832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.744019 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1fd0fd5-b738-431d-acab-95195d72e3ef tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1511 microversion: 2.1 time: 0.267429 Aug 03 04:50:01.744643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2153/4288] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:01 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:01.763358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:01.764019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:01.771489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.771954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:01.772362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.773343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.773977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.779623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.780859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:01.789796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.790247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.791436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.792223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:01.834038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:01.873080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:01.880492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:01.880951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.121541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.129874 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7801b594-9af9-4e0f-b527-07917a13a494 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1491 microversion: 2.1 time: 0.372357 Aug 03 04:50:02.140120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2136/4289] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:01 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1491 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:02.140120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:02.140120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:02.143430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.143910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.144664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.145101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.148927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68420660-9313-4a8f-adf1-baf7055e4b12 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.382544 Aug 03 04:50:02.150185 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2154/4290] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:50:01 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:02.175157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:02.180021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.180716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:02.333078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.333585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.334392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.334834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.364577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.373397 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-791c9195-42d0-4f62-9daa-d7a62935ea1f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1500 microversion: 2.1 time: 0.241294 Aug 03 04:50:02.375083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2137/4291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:02 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1500 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:02.380025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:02.380769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:02.388228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.388895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.389858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.390296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.409320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:02.409998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:02.429035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:02.500406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0394c9cd-8fb1-49a4-bb7b-8a88b5a4380a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.328873 Aug 03 04:50:02.501002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2155/4292] 10.222.0.72 () {58 vars in 1150 bytes} [Wed Aug 3 04:50:02 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:02.505841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:02.506456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:02.520020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.520020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.520020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.520020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.549622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.558445 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d0b4abc-1830-4f1b-8319-c712c838ecc5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.181895 Aug 03 04:50:02.559767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2138/4293] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:02 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:02.568426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1615744435", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:02.625790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:02.728630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.737901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b713f55e-91a9-412e-8c39-15fd0309b69c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1505 microversion: 2.1 time: 0.235518 Aug 03 04:50:02.747634 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2156/4294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:02 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:02.755161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:02.758072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:02.765617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.766079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.766983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.767434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.793458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'flavor' on Instance uuid c4786d26-74a5-4327-90aa-9d70b19e447c {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:02.807747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Cannot 'rescue' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state paused Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action HTTP/1.1 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 14 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: {"rescue": {}} Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'rescue' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state paused Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c4786d26-74a5-4327-90aa-9d70b19e447c', 'body': {'rescue': {}}} Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c4786d26-74a5-4327-90aa-9d70b19e447c in vm_state paused. Cannot rescue while the instance is in this state. Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state paused Aug 03 04:50:02.810642 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state paused Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 409 to user: Cannot 'rescue' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state paused {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12eb0068-c7c9-4ed7-96c2-b5dcb6526bfe tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action" status: 409 len: 144 microversion: 2.1 time: 0.061343 Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2157/4295] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:02 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action => generated 144 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:50:02.819367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:02.823511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:02.824212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:02.829651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.830104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.830896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.831592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.926014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:02.985807 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4d7dfc2-014b-4965-8cfc-eed30877eef9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.171555 Aug 03 04:50:02.986404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2158/4296] 10.222.0.72 () {58 vars in 1212 bytes} [Wed Aug 3 04:50:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:02.991161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:02.991694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:02.998662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:02.999120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:02.999893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.000363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.051862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:03.052321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:03.052815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:03.053240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:03.053659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:03.064049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.064561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.065369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.065816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.083564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:03.089085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:03.102549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:03.104869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:03.223186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-568ff8e3-573f-495c-8f42-8e1dcf6c5418 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action" status: 202 len: 0 microversion: 2.1 time: 0.235510 Aug 03 04:50:03.223750 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2159/4297] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:02 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:50:03.255503 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-20c70ace-7338-4492-a15c-0793ee2b14f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694567 Aug 03 04:50:03.256165 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2139/4298] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:03.260944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.266315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.267105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:03.273146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.273583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.274435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.274877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.368254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:03.431916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72458b01-9610-4da7-8151-ad10402d332d tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd59cef700>, body: {"keypair": {"name": "tempest-keypair-150713995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4CvTDNS8EzjhtvF0xx0XNlEAKzPWFcU6jaRGgbFqqILKOhh9V0/w77mt6/lrYTRNT7lYTiTdQyPiuGa+QIiDLYkb1ILtryN1W1hSr1AG6cxlYz2tPLit0Y592VnqEqHQ=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:03.434408 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da7db34c-be27-4c14-9ef6-0a083bd214d8 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.176855 Aug 03 04:50:03.442238 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2140/4299] 10.222.0.72 () {58 vars in 1196 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:03.448174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.448836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:03.456997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.457542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.458700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.458700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.463211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-72458b01-9610-4da7-8151-ad10402d332d tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:03.470492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-72458b01-9610-4da7-8151-ad10402d332d tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:03.472544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:03.610065 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72458b01-9610-4da7-8151-ad10402d332d tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.384940 Aug 03 04:50:03.610915 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2160/4300] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 387 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:50:03.619080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.620285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5f0ada6-e49d-4276-b037-8ae81814e23a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.621202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5f0ada6-e49d-4276-b037-8ae81814e23a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:03.628119 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0a776f2-32ff-4cdd-9282-be56691dd37d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1507 microversion: 2.1 time: 0.184729 Aug 03 04:50:03.628738 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2141/4301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:03.633906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.640171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.640905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': '1527706857', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:03.646391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.646844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.647628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.648251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.694392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5f0ada6-e49d-4276-b037-8ae81814e23a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.702482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5f0ada6-e49d-4276-b037-8ae81814e23a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1209 microversion: 2.1 time: 0.090311 Aug 03 04:50:03.710999 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2161/4302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:03.710999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.710999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:03.717151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.717675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.718973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.719425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.755060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:03.832630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2d326d7-2b72-4f5d-b349-772f731a07be tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=1527706857" status: 200 len: 346 microversion: 2.1 time: 0.202769 Aug 03 04:50:03.833348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2142/4303] 10.222.0.72 () {58 vars in 1156 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers?name=1527706857 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:03.838253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50b643b4-fa1d-459e-8454-dd6a7cf2805b tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd540951f0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.848114 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50b643b4-fa1d-459e-8454-dd6a7cf2805b tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs/tempest-keypair-150713995" status: 200 len: 512 microversion: 2.2 time: 0.013398 Aug 03 04:50:03.848730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2143/4304] 10.222.0.72 () {60 vars in 1255 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-150713995 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:03.853494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c7e61901-e3bc-4ed2-84e9-3d7913de32c7 req-c2135c71-68df-45c5-aa17-70210fa31438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb81dbc-92a7-4589-b911-665d67b1a77e", "name": "network-vif-unplugged", "status": "completed", "tag": "dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:03.863893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7e61901-e3bc-4ed2-84e9-3d7913de32c7 req-c2135c71-68df-45c5-aa17-70210fa31438 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.864370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c7e61901-e3bc-4ed2-84e9-3d7913de32c7 req-c2135c71-68df-45c5-aa17-70210fa31438 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.877019 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c7e61901-e3bc-4ed2-84e9-3d7913de32c7 req-c2135c71-68df-45c5-aa17-70210fa31438 service nova] Creating event network-vif-unplugged:dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc for instance 0eb81dbc-92a7-4589-b911-665d67b1a77e on n-h2-826756-5 Aug 03 04:50:03.882700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.883507 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c7e61901-e3bc-4ed2-84e9-3d7913de32c7 req-c2135c71-68df-45c5-aa17-70210fa31438 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033362 Aug 03 04:50:03.884334 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2144/4305] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:03.889770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.890476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:03.894406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c275bece-7a5f-4643-88b0-ba827094bc77 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.189756 Aug 03 04:50:03.894992 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2162/4306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:03.897210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.897940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.898945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.899522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:03.899851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.905408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:03.906191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:03.911467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.911922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:03.912758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:03.913199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.003676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:04.033226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:04.061466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:04.071036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dcc2c0c0-11cb-4512-bd0b-8b49d00683ca tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1505 microversion: 2.1 time: 0.185522 Aug 03 04:50:04.071828 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2145/4307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:04.076526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c1ad20a8-bb6d-4f8e-b0c6-e20d9e87b568 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd548a0940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.082202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1880dd76-ae11-4324-9a7f-c7a5a2e8a639 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.186158 Aug 03 04:50:04.082952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2163/4308] 10.222.0.72 () {58 vars in 1154 bytes} [Wed Aug 3 04:50:03 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:04.095178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.100055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:04.100759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-152770685', 'deleted': False, 'project_id': 'cdfed9e0c2c14644a125d453e5666756'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 04:50:04.106151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.107296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.108312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.108853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.196800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 04:50:04.204062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c1ad20a8-bb6d-4f8e-b0c6-e20d9e87b568 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-150713995" status: 204 len: 0 microversion: 2.2 time: 0.131311 Aug 03 04:50:04.204963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2146/4309] 10.222.0.72 () {60 vars in 1258 bytes} [Wed Aug 3 04:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-150713995 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:04.223774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ca9673c-61a1-4991-b1f8-c14a84b1bf91 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd54089ee0>, body: {"keypair": {"name": "tempest-keypair-1981842569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzAAg9iZR4El8/+6QGMaCYc8bmd1E+/eGaBBCcdqbIiJf1XNFG0MqClzek+q7OV/jJh8DkCfxkXx99OQChlET+gv7Kw9tOrZMTfikZI7X73MCIkVm40qeKSuowPxlY54w=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:04.243150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4ca9673c-61a1-4991-b1f8-c14a84b1bf91 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:04.248852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4ca9673c-61a1-4991-b1f8-c14a84b1bf91 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:04.274938 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95a8b5ee-34ca-405e-9a6f-09007d83389d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-152770685" status: 200 len: 346 microversion: 2.1 time: 0.177118 Aug 03 04:50:04.274938 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2164/4310] 10.222.0.72 () {58 vars in 1228 bytes} [Wed Aug 3 04:50:04 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-152770685 => generated 346 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:04.281781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.282294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:04.288252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.288743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.289520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.289961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.314883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:04.425832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ca9673c-61a1-4991-b1f8-c14a84b1bf91 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.206522 Aug 03 04:50:04.426459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2147/4311] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 03 04:50:04.436991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e30a307-2d48-432f-8543-1be5dc86e5a7 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd59d62430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.529324 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e30a307-2d48-432f-8543-1be5dc86e5a7 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981842569" status: 204 len: 0 microversion: 2.2 time: 0.096236 Aug 03 04:50:04.529845 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2148/4312] 10.222.0.72 () {60 vars in 1261 bytes} [Wed Aug 3 04:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981842569 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:50:04.538818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-115e21a3-03fc-4ee3-8c97-a1a734afe159 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd540893a0>, body: {"keypair": {"name": "tempest-keypair-66225399", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:04.554107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-115e21a3-03fc-4ee3-8c97-a1a734afe159 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:04.559703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-115e21a3-03fc-4ee3-8c97-a1a734afe159 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:04.661745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-115e21a3-03fc-4ee3-8c97-a1a734afe159 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 587 microversion: 2.2 time: 0.126577 Aug 03 04:50:04.662461 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2149/4313] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:04 2022] POST /compute/v2.1/os-keypairs => generated 587 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 03 04:50:04.669936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.670557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:04.673649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:04.677286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.677740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.678516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.678983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.722717 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-871bd9cb-8c72-41f9-9641-ef3f7e6a059b tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "DELETE /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 204 len: 0 microversion: 2.1 time: 0.445529 Aug 03 04:50:04.723415 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2165/4314] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:04 2022] DELETE /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:50:04.732196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42f0e6dd-d82d-416e-b1ae-8ec9d6809636 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd545d28b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.827186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:04.839392 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42f0e6dd-d82d-416e-b1ae-8ec9d6809636 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66225399" status: 204 len: 0 microversion: 2.2 time: 0.111490 Aug 03 04:50:04.840625 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2166/4315] 10.222.0.72 () {60 vars in 1255 bytes} [Wed Aug 3 04:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66225399 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:04.842880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b777efa1-cf66-47d2-bda4-390c0d9d2410 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1515 microversion: 2.1 time: 0.177292 Aug 03 04:50:04.853312 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2150/4316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:04 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:04.853312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.853312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:04.856378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:04.857635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:04.859483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.859949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.860881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.861354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.866197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.866972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.867823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:04.868518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:04.970961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:04.980099 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6dc2130-5ef0-4b4f-9cd1-5a2088369617 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1205 microversion: 2.1 time: 0.128983 Aug 03 04:50:04.995033 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2167/4317] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:04 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1205 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:04.995033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53eb4174-f4a6-4512-baad-5b18c5fdaf05 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd545a6670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-275523106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvUud7bklPpoKL4Zy+af/dw6pePylVbfhdYoxZ3Bic5pFnGcFcMz00RMYx2FM2sZRr7UTtTwf0YJe3JzIIzRNJGxwKreHUgufFDdHltxNVRd+nwbQFde8uwaQGOBH3a0w=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:05.004160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-53eb4174-f4a6-4512-baad-5b18c5fdaf05 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:05.009548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-53eb4174-f4a6-4512-baad-5b18c5fdaf05 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:05.059128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:05.068192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec09fe0d-65b0-4620-a2c6-4fb5307b605d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1517 microversion: 2.1 time: 0.222946 Aug 03 04:50:05.068936 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2151/4318] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:04 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:05.073358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.074102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:05.080759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.081594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.082474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.082996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.129842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53eb4174-f4a6-4512-baad-5b18c5fdaf05 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.146930 Aug 03 04:50:05.130461 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2168/4319] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:50:05.137423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.138140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:05.151378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.151972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.152959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.153472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.278376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:05.291157 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97139a55-7a41-4afd-8a46-1cea0e25f3a3 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.221181 Aug 03 04:50:05.291735 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2152/4320] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:05 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:05.310844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af4a766e-e1b4-4521-8c74-50e4aba93bc5 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd47c32b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1961005993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0H7yT25pdZ4AFTlih4Vjg+gDPeJjoN6RN3TOlZb4OwDdhPMa/ojp0rILFd/WRHa8LnVzQGEcrObapsJFGRgiDMF1wn3II8caJvfK8oFc21nn8UwMliMeAblEheIYA3uQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:05.326800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-af4a766e-e1b4-4521-8c74-50e4aba93bc5 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:05.327289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:05.334245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-af4a766e-e1b4-4521-8c74-50e4aba93bc5 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:05.335644 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c2ad2eb-8109-47fa-8b2e-d03b5a836897 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 200 len: 1508 microversion: 2.1 time: 0.202433 Aug 03 04:50:05.336575 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2169/4321] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:05 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:05.357702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.358208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:05.364471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.364925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.366641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:05.366641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:05.391635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:05.397373 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Working on deleting snapshot 701fdd9e-a933-4476-b6ef-e6dbfadd4a04 from shelved instance... Aug 03 04:50:05.478567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af4a766e-e1b4-4521-8c74-50e4aba93bc5 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.185784 Aug 03 04:50:05.479585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2153/4322] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:50:05.493085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94b79190-9a07-459b-804d-2c98917f934a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd59d62940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1675015474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4X/ChfPLStynbbw52ysE257SkPQ5E9kaZyMqw+x+q8LceNxCypfPFddi3FQolTcBuQYJjdm+V4QgC0VcmlTRIALVeFe1N1X1LZCuvhCgHepo7aL+IQ+sQBKro/j0bnZg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:05.508620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-94b79190-9a07-459b-804d-2c98917f934a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:05.514767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-94b79190-9a07-459b-804d-2c98917f934a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:05.642361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94b79190-9a07-459b-804d-2c98917f934a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.152751 Aug 03 04:50:05.643334 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2154/4323] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 03 04:50:05.655525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59bcea66-c815-410b-af7e-fa220b6a7d24 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd54609e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.661127 n-d-826756-5 devstack@n-api.service[120831]: WARNING oslo_db.sqlalchemy.utils [None req-59bcea66-c815-410b-af7e-fa220b6a7d24 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:50:05.674385 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59bcea66-c815-410b-af7e-fa220b6a7d24 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.024758 Aug 03 04:50:05.679540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2155/4324] 10.222.0.72 () {60 vars in 1177 bytes} [Wed Aug 3 04:50:05 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:05.689490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a2d38c3-7a03-44f7-9c0d-e366856a019b tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd540893a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.827036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a2d38c3-7a03-44f7-9c0d-e366856a019b tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1675015474" status: 204 len: 0 microversion: 2.2 time: 0.141262 Aug 03 04:50:05.827614 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2156/4325] 10.222.0.72 () {60 vars in 1321 bytes} [Wed Aug 3 04:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1675015474 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:50:05.836555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f78e2b09-59b7-4351-a2d7-5cbe88a413e2 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd54a80b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:05.971466 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f78e2b09-59b7-4351-a2d7-5cbe88a413e2 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1961005993" status: 204 len: 0 microversion: 2.2 time: 0.136858 Aug 03 04:50:05.971466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2157/4326] 10.222.0.72 () {60 vars in 1321 bytes} [Wed Aug 3 04:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1961005993 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:05.978896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73757f6d-91cc-4909-a01f-7605d24888b2 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd59d439d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:06.146360 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73757f6d-91cc-4909-a01f-7605d24888b2 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-275523106" status: 204 len: 0 microversion: 2.2 time: 0.171272 Aug 03 04:50:06.147363 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2158/4327] 10.222.0.72 () {60 vars in 1318 bytes} [Wed Aug 3 04:50:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-275523106 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:50:06.155955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:06.156727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:06.163668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.164228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:06.165428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.165891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:06.277642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:06.286392 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-48a30ed1-a04a-4da2-83ae-73f1c22a5965 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1261 microversion: 2.1 time: 0.137690 Aug 03 04:50:06.287270 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2159/4328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:06 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:06.301706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:06.303925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:06.314372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.314837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:06.315628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.316064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:06.558277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:06.569552 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a2fcbdc-ea15-4192-94d6-329cd06e40b4 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1517 microversion: 2.1 time: 0.272901 Aug 03 04:50:06.570582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2160/4329] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:06 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:06.577775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-feb904d6-3742-4308-811d-1cbff7779585 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd47c32dc0>, body: {"keypair": {"name": "tempest-keypair-386959957", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZVRoV6E5NCD0S4kefQIZE+a5EDeXa7fZxy58pi6PaidkZryGPbkHV5acKkzLg6DTsklZx3q73X7Nnvr36CfgDlAKhIYztTbXaNPvLjSo8AimVLTpFtEpSsNsr8qg6vjQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:06.599517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-feb904d6-3742-4308-811d-1cbff7779585 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:06.606152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-feb904d6-3742-4308-811d-1cbff7779585 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:06.798407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-feb904d6-3742-4308-811d-1cbff7779585 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.226436 Aug 03 04:50:06.799092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2161/4330] 10.222.0.72 () {62 vars in 1199 bytes} [Wed Aug 3 04:50:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 03 04:50:06.803814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:06.804480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:06.818143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.818143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:06.818143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:06.818143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.163951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:07.176532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89a2fe87-ad24-4546-9506-5edeee193779 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1364 microversion: 2.1 time: 0.374617 Aug 03 04:50:07.191728 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2162/4331] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:06 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:07.196676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e1057df-b7ea-495c-9983-ed6468cb904a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd54609e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:07.207191 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e1057df-b7ea-495c-9983-ed6468cb904a tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs/tempest-keypair-386959957" status: 200 len: 512 microversion: 2.2 time: 0.026814 Aug 03 04:50:07.208322 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2163/4332] 10.222.0.72 () {60 vars in 1255 bytes} [Wed Aug 3 04:50:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-386959957 => generated 512 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:07.219687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f90a0b09-06ca-4693-af1e-38e5a36a4559 req-f30d7905-5c15-44e4-b4d6-bfeb42164ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650b5236-9353-4479-b9a6-cf30ffffc916", "name": "network-vif-plugged", "status": "completed", "tag": "4b85bf78-bb3a-4622-91f0-122d17f859c8"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:07.234991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f90a0b09-06ca-4693-af1e-38e5a36a4559 req-f30d7905-5c15-44e4-b4d6-bfeb42164ad9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.235797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f90a0b09-06ca-4693-af1e-38e5a36a4559 req-f30d7905-5c15-44e4-b4d6-bfeb42164ad9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.249348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f90a0b09-06ca-4693-af1e-38e5a36a4559 req-f30d7905-5c15-44e4-b4d6-bfeb42164ad9 service nova] Creating event network-vif-plugged:4b85bf78-bb3a-4622-91f0-122d17f859c8 for instance 650b5236-9353-4479-b9a6-cf30ffffc916 on n-h1-826756-5 Aug 03 04:50:07.256059 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f90a0b09-06ca-4693-af1e-38e5a36a4559 req-f30d7905-5c15-44e4-b4d6-bfeb42164ad9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046556 Aug 03 04:50:07.256792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2164/4333] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:07.262994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f4abda55-adda-4d9a-8c52-60fb3ed7ce3f req-1b574235-d2e7-45aa-a58d-5659f44e5d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a76f51-ee4a-4741-a0e3-1eb82fcc5815", "name": "network-vif-deleted", "tag": "0df6a0bd-e77f-4de2-89c0-848cfde435aa"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:07.275756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f4abda55-adda-4d9a-8c52-60fb3ed7ce3f req-1b574235-d2e7-45aa-a58d-5659f44e5d37 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.276739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f4abda55-adda-4d9a-8c52-60fb3ed7ce3f req-1b574235-d2e7-45aa-a58d-5659f44e5d37 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.292374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f4abda55-adda-4d9a-8c52-60fb3ed7ce3f req-1b574235-d2e7-45aa-a58d-5659f44e5d37 service nova] Creating event network-vif-deleted:0df6a0bd-e77f-4de2-89c0-848cfde435aa for instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 on n-h1-826756-5 Aug 03 04:50:07.305306 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f4abda55-adda-4d9a-8c52-60fb3ed7ce3f req-1b574235-d2e7-45aa-a58d-5659f44e5d37 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046753 Aug 03 04:50:07.305950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2165/4334] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:07.314109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Doing local delete in cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120832) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 03 04:50:07.314947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.319684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-479327d4-7bfc-4690-a56a-2a2bb372e9ea tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd59d43af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:07.320351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.321579 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 03 04:50:07.329068 n-d-826756-5 devstack@n-api.service[120831]: WARNING oslo_db.sqlalchemy.utils [None req-479327d4-7bfc-4690-a56a-2a2bb372e9ea tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:50:07.330184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] deallocate_for_instance() {{(pid=120832) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 03 04:50:07.335811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-479327d4-7bfc-4690-a56a-2a2bb372e9ea tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.024439 Aug 03 04:50:07.336708 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2166/4335] 10.222.0.72 () {60 vars in 1177 bytes} [Wed Aug 3 04:50:07 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:07.343056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:07.344295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:07.352119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.352853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.353974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.354644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.484750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:07.493144 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e899336-946b-46f2-94fd-9f9e6340a72e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1279 microversion: 2.1 time: 0.154608 Aug 03 04:50:07.493744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2167/4336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:07 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:07.513020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21465d91-7412-4883-b193-cd2b7b2bbfe6 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd47c32e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:07.661282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21465d91-7412-4883-b193-cd2b7b2bbfe6 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-386959957" status: 204 len: 0 microversion: 2.2 time: 0.166494 Aug 03 04:50:07.661888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2168/4337] 10.222.0.72 () {60 vars in 1258 bytes} [Wed Aug 3 04:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-386959957 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:07.667433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:07.668043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:07.675276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.675728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:07.679625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:07.679625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:08.056219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:08.064174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d8f9862-8f12-4c4d-ae84-f2add7ec0744 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 200 len: 1305 microversion: 2.1 time: 0.401204 Aug 03 04:50:08.064795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2169/4338] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:07 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 1305 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:08.069611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Action: 'create', calling method: .version_select at 0x7fdd540a6af0>, body: {"keypair": {"name": "tempest-keypair-577256218", "type": "x509"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:08.086800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:08.093252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:08.109275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.processutils [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpkddael3b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpkddael3b/temp.key -subj /CN=641860ac33d14f96a7c79616becb2124 -extensions v3_req_client {{(pid=120831) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 03 04:50:08.235697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.processutils [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpkddael3b/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpkddael3b/temp.key -subj /CN=641860ac33d14f96a7c79616becb2124 -extensions v3_req_client" returned: 0 in 0.126s {{(pid=120831) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 03 04:50:08.237350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.processutils [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpkddael3b/temp.key -password pass: {{(pid=120831) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 03 04:50:08.261979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.processutils [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpkddael3b/temp.key -password pass:" returned: 0 in 0.024s {{(pid=120831) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 03 04:50:08.430443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:08.436872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Getting quotas for user 641860ac33d14f96a7c79616becb2124 and project 457d06f15eb54d0b99b99faff3047152. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:08.454447 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-841d8fd7-31df-4303-aa8a-9f83aeb731d9 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.388363 Aug 03 04:50:08.461395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2170/4339] 10.222.0.72 () {62 vars in 1198 bytes} [Wed Aug 3 04:50:08 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 390 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:08.464438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:08.467790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:08.470957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:08.475076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:08.480612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:08.480612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:08.480612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:08.506640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'flavor' on Instance uuid c4786d26-74a5-4327-90aa-9d70b19e447c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:08.670491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Updating instance_info_cache with network_info: [] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:50:08.710500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:08.942109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b390cf4-a77c-4916-96b9-2dd1993827d5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action" status: 200 len: 32 microversion: 2.1 time: 0.484594 Aug 03 04:50:08.944084 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2171/4340] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:08 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:50:08.972106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:08.973168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:08.992948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:08.993736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:08.994784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:08.995601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.334806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:09.353820 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47ab9247-60a2-48e8-8fad-a2b64f802339 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1549 microversion: 2.1 time: 0.405054 Aug 03 04:50:09.371047 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2172/4341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:08 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1549 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:09.371047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ea33a4a-ee46-4b69-8f60-237cca3a7665 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd54a80d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.378128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ea33a4a-ee46-4b69-8f60-237cca3a7665 tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs/tempest-keypair-577256218" status: 200 len: 1533 microversion: 2.2 time: 0.020728 Aug 03 04:50:09.378764 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2173/4342] 10.222.0.72 () {60 vars in 1255 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-577256218 => generated 1533 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:09.392133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.392887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.410054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.410601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.411466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.411977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.519347 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e6e3c72-adde-4064-a080-5f015d44e63d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 204 len: 0 microversion: 2.1 time: 4.165511 Aug 03 04:50:09.522238 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2170/4343] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:05 2022] DELETE /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 0 bytes in 4168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:50:09.528292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.529386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.540352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.541163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.542744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.543680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.665659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:09.673868 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-391e76d3-e73b-4444-a03e-ab9a1d3c8684 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.287732 Aug 03 04:50:09.674663 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2174/4344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:09.679737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.680411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 39a76f51-ee4a-4741-a0e3-1eb82fcc5815] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.687052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.687562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.690340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.690340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.725251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] HTTP exception thrown: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Request method failure captured: Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 HTTP/1.1 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4oATPNIFyd3CfCmXo1J_pw54PuPoemA414Dm3UoD4bc1SJT0pFFOs2WN4OGoOBl74vO5feeMziMlP2-wbaRrPOAUB0S22LWyw50A2FgQAwduNbpawOGWS0CanBZq7VIJEuDvWb0emvDv3aop41EtdQs3WMc6_M62uU1jVwGk3rYTM Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07bf1b2f15da4f8b88961d0a089cb1fa Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '39a76f51-ee4a-4741-a0e3-1eb82fcc5815'} Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:09.727460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Returning 404 to user: Instance 39a76f51-ee4a-4741-a0e3-1eb82fcc5815 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e8fab953-2413-44ce-8d73-a7cdf81ebce6 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815" status: 404 len: 111 microversion: 2.1 time: 0.053454 Aug 03 04:50:09.733577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2175/4345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/servers/39a76f51-ee4a-4741-a0e3-1eb82fcc5815 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:50:09.738155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-64357853-53b3-457a-ba7b-cc42a10a2dc3 req-b49857df-e29e-417e-88a8-974adb24b3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb81dbc-92a7-4589-b911-665d67b1a77e", "name": "network-vif-deleted", "tag": "dcd2ac9e-2d8d-470e-b578-2586c7e2a2cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:09.749347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-64357853-53b3-457a-ba7b-cc42a10a2dc3 req-b49857df-e29e-417e-88a8-974adb24b3ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.750945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-64357853-53b3-457a-ba7b-cc42a10a2dc3 req-b49857df-e29e-417e-88a8-974adb24b3ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.758900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:09.763109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.server_external_events [req-64357853-53b3-457a-ba7b-cc42a10a2dc3 req-b49857df-e29e-417e-88a8-974adb24b3ed service nova] Unable to find a host for instance 0eb81dbc-92a7-4589-b911-665d67b1a77e. Dropping event network-vif-deleted {{(pid=120831) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 04:50:09.764016 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-64357853-53b3-457a-ba7b-cc42a10a2dc3 req-b49857df-e29e-417e-88a8-974adb24b3ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029567 Aug 03 04:50:09.765311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2176/4346] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 04:50:09.767258 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9e9878f-787a-4ac4-b49a-68622fd6c8c9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.245454 Aug 03 04:50:09.768308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2171/4347] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:09.770333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.770694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.777234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.778259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.779047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.779511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.784522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ccbb6054-35de-4c0a-95bc-59d97722ec6f tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd550350d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.788937 n-d-826756-5 devstack@n-api.service[120832]: WARNING oslo_db.sqlalchemy.utils [None req-ccbb6054-35de-4c0a-95bc-59d97722ec6f tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 03 04:50:09.799130 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ccbb6054-35de-4c0a-95bc-59d97722ec6f tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.029264 Aug 03 04:50:09.801824 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2172/4348] 10.222.0.72 () {60 vars in 1177 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:09.809878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.810979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.838969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.845601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.846367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.847005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.876397 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e HTTP/1.1 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0eb81dbc-92a7-4589-b911-665d67b1a77e'} Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:09.879111 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67362e38-f0ea-479c-b5d4-ca422a1e8e29 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 404 len: 111 microversion: 2.1 time: 0.077404 Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2173/4349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.888401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:09.894559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.895252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.897278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:09.898379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:09.932871 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4dbeacec-d3bb-482d-adfe-42a04fb1ec51 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165094 Aug 03 04:50:09.941793 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2177/4350] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:50:09 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:09.944260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2674d0aa-5445-455b-a7df-d497bf8c2e8c tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] Calling method '.version_select at 0x7fdd547913a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:09.955498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:10.006256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:10.099727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2674d0aa-5445-455b-a7df-d497bf8c2e8c tempest-KeyPairsV22TestJSON-1369101709 tempest-KeyPairsV22TestJSON-1369101709-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-577256218" status: 204 len: 0 microversion: 2.2 time: 0.162791 Aug 03 04:50:10.100595 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2178/4351] 10.222.0.72 () {60 vars in 1258 bytes} [Wed Aug 3 04:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-577256218 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:10.109930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1384113234", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:10.183506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:10.322637 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78cf35c2-1dbf-45e4-b085-22ce201a9137 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 204 len: 0 microversion: 2.1 time: 0.439751 Aug 03 04:50:10.323134 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2174/4352] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:09 2022] DELETE /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:10.332562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:10.333341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:10.339459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:10.339811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:10.340960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:10.341399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:10.781644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:10.794583 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ecb3e4d-f9db-4253-b30c-996a1802ad6c tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1517 microversion: 2.1 time: 0.465747 Aug 03 04:50:10.795166 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2175/4353] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:10 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1517 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:10.803172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:10.803986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:10.819028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:10.819609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:10.821039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:10.821662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.093167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:11.094342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:11.094831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:11.095254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:11.095677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:11.099279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:11.109363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.110036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.116669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.116669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.117066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f53ee603-3750-43c1-a8f3-b4ef77fc1db8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.312652 Aug 03 04:50:11.117066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2176/4354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:10 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:11.119258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:11.120098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:11.128552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.129352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.130535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.131522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.138138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:11.144490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:11.182893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:11.185817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:11.390409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:11.392152 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b925cf3-eb2c-448d-9a91-47c744884555 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290480 Aug 03 04:50:11.393546 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2179/4355] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:11.405510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eea926ff-915a-4f0c-87ed-2a47d267c9e7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.290564 Aug 03 04:50:11.406288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2177/4356] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:11 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:11.407268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d3800f1-f3b7-4157-aaa2-910d7a565672 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:11.408069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d3800f1-f3b7-4157-aaa2-910d7a565672 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:11.494483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d3800f1-f3b7-4157-aaa2-910d7a565672 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:11.502045 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d3800f1-f3b7-4157-aaa2-910d7a565672 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1215 microversion: 2.1 time: 0.101953 Aug 03 04:50:11.502884 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2180/4357] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:11 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:11.805836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77619f99-e8eb-4127-a739-1a3495d63094", "tag": "52033026-b2e0-4b0e-b116-f741fa7b0f72"}, {"name": "network-changed", "server_uuid": "650b5236-9353-4479-b9a6-cf30ffffc916", "tag": "4b85bf78-bb3a-4622-91f0-122d17f859c8"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:11.820748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.821460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.824323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:11.825131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:11.838629 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] Creating event network-changed:52033026-b2e0-4b0e-b116-f741fa7b0f72 for instance 77619f99-e8eb-4127-a739-1a3495d63094 on n-h1-826756-5 Aug 03 04:50:11.839452 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] Creating event network-changed:4b85bf78-bb3a-4622-91f0-122d17f859c8 for instance 650b5236-9353-4479-b9a6-cf30ffffc916 on n-h1-826756-5 Aug 03 04:50:11.847418 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ec1c6ab1-a739-48c8-bd8c-ccae1ff857f6 req-6db3abfa-0f7a-4d54-bd51-e4ce268a2df4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045140 Aug 03 04:50:11.851474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.851474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:11.851911 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2178/4358] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:50:11.853376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:11.864992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.141008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:12.141755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:12.153598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.153598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.155393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.156299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.636623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:12.646937 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5200839b-3d57-46f7-b72f-5cf00180b43d tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1517 microversion: 2.1 time: 0.827453 Aug 03 04:50:12.648105 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2181/4359] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:11 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1517 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:12.654961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:12.655671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:12.661857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.662541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.663325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.663765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.704176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:12.717690 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad1983f6-ce1a-4825-9e70-ab8d8fe3266f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.586885 Aug 03 04:50:12.723736 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2179/4360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:12 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:12.741975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:12.741975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:12.749272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.750334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.751499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:12.751941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:12.894620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:12.912764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b34c189-1c5e-4a89-a658-81732f79efa5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1219 microversion: 2.1 time: 0.187617 Aug 03 04:50:12.913361 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2180/4361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:12 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1219 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:13.060754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:13.070945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c841642d-63f1-4d10-92be-7a3b52425b05 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.421298 Aug 03 04:50:13.072525 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2182/4362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:12 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:13.669460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:13.672091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:13.677318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.677757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.683320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.684786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.744199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:13.744866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:13.759730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.765922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.769595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.770335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.810350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:13.846086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c312a5f2-5ed4-4042-9540-5859bf543fcc tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1475 microversion: 2.1 time: 0.180338 Aug 03 04:50:13.846847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2181/4363] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:13 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1475 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:13.917745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5e178048-5119-4acf-9028-d60d54623f9a req-1faae4ab-27a5-441f-9f26-e243481a638c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0115c2a-45de-4fbd-8ccb-31ca1ecbb589", "name": "network-vif-deleted", "tag": "42a55e06-c04f-4f02-9f07-2dfb6708f955"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:13.930486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5e178048-5119-4acf-9028-d60d54623f9a req-1faae4ab-27a5-441f-9f26-e243481a638c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.931503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5e178048-5119-4acf-9028-d60d54623f9a req-1faae4ab-27a5-441f-9f26-e243481a638c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.948335 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5e178048-5119-4acf-9028-d60d54623f9a req-1faae4ab-27a5-441f-9f26-e243481a638c service nova] Creating event network-vif-deleted:42a55e06-c04f-4f02-9f07-2dfb6708f955 for instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 on n-h1-826756-5 Aug 03 04:50:13.959887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5e178048-5119-4acf-9028-d60d54623f9a req-1faae4ab-27a5-441f-9f26-e243481a638c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046563 Aug 03 04:50:13.961100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2182/4364] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:50:13.968863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:13.970203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:13.973944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:13.977674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.978137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.979489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:13.979941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:13.985388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6aeec999-dd78-4c14-b3e7-0c09e26b3c63 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.245192 Aug 03 04:50:13.987050 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2183/4365] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:13 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:14.052533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:14.060675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b980237-3534-4392-a859-00055e50a217 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1211 microversion: 2.1 time: 0.098196 Aug 03 04:50:14.061530 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2183/4366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:13 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:14.093956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:14.094567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:14.101115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:14.101565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:14.102460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:14.102899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:14.356285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:14.373519 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a503f06-6f89-43e0-a427-2bc919f25043 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.283842 Aug 03 04:50:14.374130 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2184/4367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:14 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:14.868966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:14.869116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:14.871191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:14.877877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:14.878338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:14.879352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:14.879795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:14.913099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:14.913681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:14.914054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lazy-loading 'fault' on Instance uuid e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:14.962274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:14.971827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00a12daa-5df5-49f7-94e6-c66d29ab401e tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 200 len: 1310 microversion: 2.1 time: 0.107285 Aug 03 04:50:14.972697 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2184/4368] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:14 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:15.011691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:15.013312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:15.021212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.022469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.023394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.024072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.084238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:15.085197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:15.087362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:15.093407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.093984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.094867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.095409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.278745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:15.288414 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5e1d17d-a84d-4e13-a191-3b7e43e1f398 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1275 microversion: 2.1 time: 0.208110 Aug 03 04:50:15.289713 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2185/4369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:15 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:15.397280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:15.401572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:15.413590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.448379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.448379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:15.448379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:15.513358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:15.526433 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba2c6c76-37b7-4024-b948-9fa6b4995579 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.518391 Aug 03 04:50:15.527909 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2185/4370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:15 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:15.780281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:15.788596 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7ae406a-2f0e-4039-b1d9-5860da30aa21 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.396343 Aug 03 04:50:15.788908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2186/4371] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:15 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:15.993506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:15.994472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: e0115c2a-45de-4fbd-8ccb-31ca1ecbb589] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.001602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.002063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.003232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.003685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.021858 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] HTTP exception thrown: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Request method failure captured: Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 HTTP/1.1 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4oATPNIFyd3CfCmXo1J_pw54PuPoemA414Dm3UoD4bc1SJT0pFFOs2WN4OGoOBl74vO5feeMziMlP2-wbaRrPOAUB0S22LWyw50A2FgQAwduNbpawOGWS0CanBZq7VIJEuDvWb0emvDv3aop41EtdQs3WMc6_M62uU1jVwGk3rYTM Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 07bf1b2f15da4f8b88961d0a089cb1fa Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'e0115c2a-45de-4fbd-8ccb-31ca1ecbb589'} Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:16.026363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. Aug 03 04:50:16.033080 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:16.034709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Returning 404 to user: Instance e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:16.035780 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33936510-bd52-495a-8857-894b2882bb22 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589" status: 404 len: 111 microversion: 2.1 time: 0.046541 Aug 03 04:50:16.036940 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2186/4372] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:15 2022] GET /compute/v2.1/servers/e0115c2a-45de-4fbd-8ccb-31ca1ecbb589 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:50:16.045555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:16.046739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.056832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.057833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.059888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.060684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.093227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:16.314101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:16.314812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.321642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.322617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.323625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.324417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.401185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:16.411598 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-129a13f2-51a6-4bd2-877b-997d691e5b45 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1273 microversion: 2.1 time: 0.101603 Aug 03 04:50:16.426041 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2187/4373] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:16 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:16.440163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:16.550769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:16.551464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.558189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.558714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.559698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.560144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.569166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77f1dd7f-0ad1-4941-9f9e-410899ca4881 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 204 len: 0 microversion: 2.1 time: 0.527449 Aug 03 04:50:16.569813 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2187/4374] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:16 2022] DELETE /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:16.579375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:16.580201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.588207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.588811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.589616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.590639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.927677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:16.941569 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08440bc3-1192-4f79-9c4b-3a86caa6df66 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.395292 Aug 03 04:50:16.942535 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2188/4375] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:16 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:16.959216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:16.960658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:16.968895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.969355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.972227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:16.972718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:16.975309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:16.989052 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd574a22-c844-47ba-aa82-ffa46909f9f2 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1519 microversion: 2.1 time: 0.411230 Aug 03 04:50:16.989052 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2188/4376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:16 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1519 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:17.202819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:17.215758 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a294fa9-fe2b-43ab-9b49-f543a98cfa31 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.271848 Aug 03 04:50:17.216935 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2189/4377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:16 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:17.436951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:17.438221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:17.448395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:17.449299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:17.450399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:17.451006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:17.646383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:17.653876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:17.656234 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2fa61fab-4b76-493a-bdc0-8e72e0079dc1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.223794 Aug 03 04:50:17.658288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2189/4378] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:17 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:17.967540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:17.968634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:17.975343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:17.976293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:17.977595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:17.978372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.008544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:18.009565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:18.023820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.025538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.026527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.028521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.415558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:18.425304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-534543d6-0e41-4dcc-83a5-551e77236030 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.463188 Aug 03 04:50:18.426002 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2190/4379] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:17 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:18.436379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:18.441295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5cc3913d-3bba-4004-9871-2160188a17a4 req-621e32e1-3416-411a-a972-fe78c854c12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6ea3a7a-2074-4db3-aa1b-3faf477d22ed", "tag": "c41636dc-bb4d-4e65-a872-9310aafd78b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:18.452676 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c6745db-491a-4383-9af3-cde4e83197ed tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1519 microversion: 2.1 time: 0.449430 Aug 03 04:50:18.467598 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2190/4380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:18 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1519 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:18.472961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:18.473584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:18.480187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5cc3913d-3bba-4004-9871-2160188a17a4 req-621e32e1-3416-411a-a972-fe78c854c12f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.491742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5cc3913d-3bba-4004-9871-2160188a17a4 req-621e32e1-3416-411a-a972-fe78c854c12f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.492596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.493687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.494224 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5cc3913d-3bba-4004-9871-2160188a17a4 req-621e32e1-3416-411a-a972-fe78c854c12f service nova] Creating event network-changed:c41636dc-bb4d-4e65-a872-9310aafd78b6 for instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed on n-h1-826756-5 Aug 03 04:50:18.495207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.495734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.500208 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5cc3913d-3bba-4004-9871-2160188a17a4 req-621e32e1-3416-411a-a972-fe78c854c12f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072572 Aug 03 04:50:18.502585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2191/4381] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:18.695282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:18.698189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:18.719011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.722859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.726703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:18.727865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:18.761103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:18.770507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3fd0733e-18dc-4d24-8984-bf1fb58dc308 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.301283 Aug 03 04:50:18.775701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2191/4382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:18 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:18.926998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:18.935225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aebe479f-d745-4b5e-bcb1-f622b542caf6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.260813 Aug 03 04:50:18.949950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2192/4383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:18 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:19.103754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6e6eac7b-1968-4514-8ac6-220289f7d8db req-cc9e212a-2f45-4c43-8f2f-932b18c73987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77619f99-e8eb-4127-a739-1a3495d63094", "name": "network-vif-plugged", "status": "completed", "tag": "52033026-b2e0-4b0e-b116-f741fa7b0f72"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:19.115824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6e6eac7b-1968-4514-8ac6-220289f7d8db req-cc9e212a-2f45-4c43-8f2f-932b18c73987 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.116306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6e6eac7b-1968-4514-8ac6-220289f7d8db req-cc9e212a-2f45-4c43-8f2f-932b18c73987 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.130023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6e6eac7b-1968-4514-8ac6-220289f7d8db req-cc9e212a-2f45-4c43-8f2f-932b18c73987 service nova] Creating event network-vif-plugged:52033026-b2e0-4b0e-b116-f741fa7b0f72 for instance 77619f99-e8eb-4127-a739-1a3495d63094 on n-h1-826756-5 Aug 03 04:50:19.134859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6e6eac7b-1968-4514-8ac6-220289f7d8db req-cc9e212a-2f45-4c43-8f2f-932b18c73987 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035096 Aug 03 04:50:19.135457 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2192/4384] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:19.447984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:19.450165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:19.464426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.469252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.470342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.471005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.483163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:19.484555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:19.535847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.540801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.541777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.542328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.807309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:19.828444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9fb5dcf-dd04-4cf8-93d5-038fbd5d0477 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.372105 Aug 03 04:50:19.837407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2193/4385] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:19 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:19.840709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:19.844513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:19.845564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:19.853430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eab4af32-ee28-4df9-89dd-f440b3ba198a tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1519 microversion: 2.1 time: 0.375840 Aug 03 04:50:19.853719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.854364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.855902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.856877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.869295 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2193/4386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:19 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1519 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:19.888214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:19.959790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:19.962451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:19.973901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.975165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:19.976153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:19.976889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:20.754978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:20.765792 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-959486db-f135-4c32-9da8-6b10eaf4f00c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.927010 Aug 03 04:50:20.776472 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2194/4387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:19 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:20.842662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:20.843625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:20.852822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:20.859187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:20.859646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:20.865416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc1890a8-1c81-4931-807b-3f40b8825b21 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.911315 Aug 03 04:50:20.866593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2194/4388] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:19 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:20.869382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:20.870183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:20.883186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:20.883186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:20.889099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:20.889880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:20.891113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:20.892075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:21.025895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:21.038991 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96403a5b-ae4c-4e0b-a085-ed3a163a7064 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1477 microversion: 2.1 time: 0.167832 Aug 03 04:50:21.050970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2195/4389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:20 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:21.050970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cb291fa7-559b-467f-9578-856d98b9d648 req-15555036-227a-476b-89fc-4f7cf15124ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a15ff99-abc6-4711-a3a9-bf78fa3d8de7", "name": "network-vif-deleted", "tag": "2eb0d2c9-7698-477b-a6ba-cc066049ba48"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:21.058043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cb291fa7-559b-467f-9578-856d98b9d648 req-15555036-227a-476b-89fc-4f7cf15124ec service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:21.059523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cb291fa7-559b-467f-9578-856d98b9d648 req-15555036-227a-476b-89fc-4f7cf15124ec service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:21.072551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cb291fa7-559b-467f-9578-856d98b9d648 req-15555036-227a-476b-89fc-4f7cf15124ec service nova] Creating event network-vif-deleted:2eb0d2c9-7698-477b-a6ba-cc066049ba48 for instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 on n-h2-826756-5 Aug 03 04:50:21.082396 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cb291fa7-559b-467f-9578-856d98b9d648 req-15555036-227a-476b-89fc-4f7cf15124ec service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041294 Aug 03 04:50:21.083422 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2196/4390] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:21.128915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:21.146320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:21.149260 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90f6c8bf-4e80-43a8-bde8-9a593e9ab831 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.312363 Aug 03 04:50:21.150443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2195/4391] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:20 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:21.788968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:21.789998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:21.797722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:21.798342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:21.799354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:21.799864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:21.887544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:21.888174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:21.891305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=42 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:21.898087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:21.898544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:21.899321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:21.899759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.143166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:22.156144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-968db116-2e79-4b0e-82d6-19434a0e3a3c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.372656 Aug 03 04:50:22.157168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2197/4392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:21 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:22.162284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:22.167199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:22.172470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:22.172925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.173747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:22.174191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.207980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:22.208471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.208973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lazy-loading 'fault' on Instance uuid 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:22.210215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:22.221902 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4f9477d-cda3-4be3-ada8-c602940521a1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.338698 Aug 03 04:50:22.240468 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2196/4393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:21 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:22.245754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:22.246709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:22.254284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:22.255561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.256789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:22.257453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:22.281289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07bf1b2f15da4f8b88961d0a089cb1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdfed9e0c2c14644a125d453e5666756', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:22.296815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10d51e0f-cb43-4785-8773-f746fdb6ba68 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 200 len: 1311 microversion: 2.1 time: 0.137921 Aug 03 04:50:22.305953 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2198/4394] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:22 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:22.453906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:22.464084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a7835f1-9910-40c3-bde5-54d57a61eb40 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1309 microversion: 2.1 time: 0.220742 Aug 03 04:50:22.464084 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2197/4395] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:22 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:23.177904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.179178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.186388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.186845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.187685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.188132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.248937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.250207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.258138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.258841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.259861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.260442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.380750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:23.391186 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-674433e6-db7f-41a4-9e35-f4c28d044988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.217055 Aug 03 04:50:23.391899 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2199/4396] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:23.396780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.397684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] [instance: 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.405125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.405915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.406941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.407588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.423190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] HTTP exception thrown: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Request method failure captured: Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 HTTP/1.1 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4oATPNIFyd3CfCmXo1J_pw54PuPoemA414Dm3UoD4bc1SJT0pFFOs2WN4OGoOBl74vO5feeMziMlP2-wbaRrPOAUB0S22LWyw50A2FgQAwduNbpawOGWS0CanBZq7VIJEuDvWb0emvDv3aop41EtdQs3WMc6_M62uU1jVwGk3rYTM Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cdfed9e0c2c14644a125d453e5666756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cdfed9e0c2c14644a125d453e5666756 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-634104170 Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 07bf1b2f15da4f8b88961d0a089cb1fa Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ListServerFiltersTestJSON-634104170-project Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8a15ff99-abc6-4711-a3a9-bf78fa3d8de7'} Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:23.425333 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. Aug 03 04:50:23.429971 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:23.431844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] Returning 404 to user: Instance 8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:23.433055 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-823b3b68-29c3-495f-8b8c-139f4a5a18c9 tempest-ListServerFiltersTestJSON-634104170 tempest-ListServerFiltersTestJSON-634104170-project] 10.222.0.72 "GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7" status: 404 len: 111 microversion: 2.1 time: 0.039867 Aug 03 04:50:23.433998 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2200/4397] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/8a15ff99-abc6-4711-a3a9-bf78fa3d8de7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:50:23.478183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:23.478183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edae5e0e-699b-4be4-b101-fe76c4b535f3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.222921 Aug 03 04:50:23.478183 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2198/4398] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:23.484251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.484896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.490900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.491352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.492409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.492911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.645901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:23.655524 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f921b576-8064-43e4-a5cb-71d40c85850a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1491 microversion: 2.1 time: 0.176274 Aug 03 04:50:23.657113 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2201/4399] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1491 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:23.679236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.680180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.689292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.690002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.691069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.691742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.856101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:23.869233 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a694a7b0-c902-4dbe-8c0f-7e877e8cc694 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1491 microversion: 2.1 time: 0.193837 Aug 03 04:50:23.890191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2199/4400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1491 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:23.890774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:23.892138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:23.900654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.901867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:23.903652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:23.904578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.092459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:24.106527 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d56a0ac7-2079-4993-a7ae-553396b0a1a8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1491 microversion: 2.1 time: 0.216908 Aug 03 04:50:24.122179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2202/4401] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:23 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1491 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:24.131243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:24.131751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:24.139545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.140243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.144138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.144138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.174810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:24.413690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:24.414988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:24.429948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.431432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.432712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.434329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.505326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4174e04b-04bd-429c-9dc4-f60cd774ad7e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 204 len: 0 microversion: 2.1 time: 0.377750 Aug 03 04:50:24.506272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2200/4402] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:24 2022] DELETE /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:24.513390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:24.514753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:24.523399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.526349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.528096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.529045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.782640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:24.793451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c584277-4286-4456-9c77-f84c77eb3497 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.382654 Aug 03 04:50:24.794651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2203/4403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:24 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:24.800077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:24.801163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:24.808159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.808998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.810028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:24.810781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:24.875604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:24.890841 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50279204-7b06-45da-97ec-137a59ef0b5a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.382371 Aug 03 04:50:24.892999 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2201/4404] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:24 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:25.079048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:25.088944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ea1d9dae-4f3b-4bfa-b76d-b98d590e59b7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1497 microversion: 2.1 time: 0.292895 Aug 03 04:50:25.106783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2204/4405] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:24 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:25.429625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-20848c68-96f9-4d9a-91c1-3e9a904ac626 req-010aa8d6-ffb5-4f9f-b422-a588cb5422fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ea3a7a-2074-4db3-aa1b-3faf477d22ed", "name": "network-vif-plugged", "status": "completed", "tag": "c41636dc-bb4d-4e65-a872-9310aafd78b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:25.452072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-20848c68-96f9-4d9a-91c1-3e9a904ac626 req-010aa8d6-ffb5-4f9f-b422-a588cb5422fb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:25.457105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-20848c68-96f9-4d9a-91c1-3e9a904ac626 req-010aa8d6-ffb5-4f9f-b422-a588cb5422fb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:25.478490 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-20848c68-96f9-4d9a-91c1-3e9a904ac626 req-010aa8d6-ffb5-4f9f-b422-a588cb5422fb service nova] Creating event network-vif-plugged:c41636dc-bb4d-4e65-a872-9310aafd78b6 for instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed on n-h1-826756-5 Aug 03 04:50:25.485291 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-20848c68-96f9-4d9a-91c1-3e9a904ac626 req-010aa8d6-ffb5-4f9f-b422-a588cb5422fb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060487 Aug 03 04:50:25.490067 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2202/4406] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:25.816071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:25.822972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:25.847228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:25.848704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:25.851661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:25.852144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:25.915703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:25.917213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:25.941336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:25.943409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:25.944323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:25.945429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:26.373631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:26.386399 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eac7d7f9-2f64-42cb-886b-ed5157d2ae54 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.475907 Aug 03 04:50:26.389197 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2203/4407] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:25 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:26.404947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:26.405575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:26.421680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:26.422872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:26.423844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:26.424645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:26.462272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:26.478582 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2696086-c435-482b-8759-d2be535f6b69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.666782 Aug 03 04:50:26.479825 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2205/4408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:25 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:26.658827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:26.678065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb8758b4-f1c9-43b5-be42-99e02ffbb669 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1497 microversion: 2.1 time: 0.284456 Aug 03 04:50:26.678065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2204/4409] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:26 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:27.412939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:27.413653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:27.425808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d2a40564-1f50-47ba-9e00-a94e9d88380e req-4a5889b1-eb40-4fa6-bc4d-69aed817d249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77619f99-e8eb-4127-a739-1a3495d63094", "name": "network-vif-deleted", "tag": "52033026-b2e0-4b0e-b116-f741fa7b0f72"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:27.439900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2a40564-1f50-47ba-9e00-a94e9d88380e req-4a5889b1-eb40-4fa6-bc4d-69aed817d249 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.440804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2a40564-1f50-47ba-9e00-a94e9d88380e req-4a5889b1-eb40-4fa6-bc4d-69aed817d249 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.451060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.451554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.459612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.460090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.463333 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d2a40564-1f50-47ba-9e00-a94e9d88380e req-4a5889b1-eb40-4fa6-bc4d-69aed817d249 service nova] Creating event network-vif-deleted:52033026-b2e0-4b0e-b116-f741fa7b0f72 for instance 77619f99-e8eb-4127-a739-1a3495d63094 on n-h1-826756-5 Aug 03 04:50:27.504259 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d2a40564-1f50-47ba-9e00-a94e9d88380e req-4a5889b1-eb40-4fa6-bc4d-69aed817d249 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082705 Aug 03 04:50:27.509780 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2205/4410] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:50:27.516233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:27.524152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:27.541409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.542483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.543741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.544520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.817727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:27.866688 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-986426df-88d3-4b66-9fad-42924260e89f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1315 microversion: 2.1 time: 0.463041 Aug 03 04:50:27.873447 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2206/4411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:27 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:27.884572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:27.896919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee0d6346-5073-4fcc-8430-5f4d741a481d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.385328 Aug 03 04:50:27.900426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2206/4412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:27 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:27.906550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:27.907180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:27.952008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.952008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:27.952008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:27.960476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:28.025450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:28.026257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:28.028514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid 77619f99-e8eb-4127-a739-1a3495d63094 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:28.076949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:28.081712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:28.087301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd403537-42fe-4725-b142-8a4bb3617493 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 200 len: 1299 microversion: 2.1 time: 0.212219 Aug 03 04:50:28.087897 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2207/4413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:27 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:28.893593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:28.895070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:28.913656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:28.916122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:28.923829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:28.925320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:28.930952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:28.938473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:28.948129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:28.952071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:28.954116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:28.954585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.253675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:29.264710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9e85330-e200-4e93-89e6-c4347055126d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1503 microversion: 2.1 time: 0.374902 Aug 03 04:50:29.274298 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2207/4414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:28 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:29.286924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:29.286924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:29.293037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.293818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.294827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.295462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.311039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:50:29.311184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 HTTP/1.1 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '77619f99-e8eb-4127-a739-1a3495d63094'} Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:29.313850 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:50:29.319528 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:29.321011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:29.326155 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de104329-beba-43a4-9cd0-8fb6a1cdeb93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.402023 Aug 03 04:50:29.326421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bca85b17-990e-411f-b581-be5eab6de04a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 404 len: 111 microversion: 2.1 time: 0.046268 Aug 03 04:50:29.326421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2208/4415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:29 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:50:29.326622 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2208/4416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:28 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:29.341754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dfa51cc-ae49-4a3f-944f-9926418425cc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:29.343578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:29.344203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:29.350001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:29.352589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dfa51cc-ae49-4a3f-944f-9926418425cc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.353359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dfa51cc-ae49-4a3f-944f-9926418425cc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.359018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.359018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.359018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.359018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.381288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3dfa51cc-ae49-4a3f-944f-9926418425cc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Going to try to stop instance {{(pid=120831) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:50:29.404016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:29.703217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3dfa51cc-ae49-4a3f-944f-9926418425cc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed/action" status: 202 len: 0 microversion: 2.1 time: 0.375626 Aug 03 04:50:29.709447 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2209/4417] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:29 2022] POST /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:50:29.717788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:29.718896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:29.726893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.727607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.728646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.729437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.758687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:29.914229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:29.925544 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6658f208-2a3d-42ce-a1d1-e231996fbf47 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.213006 Aug 03 04:50:29.942103 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-455b790a-630d-4fe7-a8ef-85f4284e01b8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 204 len: 0 microversion: 2.1 time: 0.612497 Aug 03 04:50:29.942893 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2210/4418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:29 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:29.944462 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2209/4419] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:29 2022] DELETE /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:29.956821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:29.957445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:29.963896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.964442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:29.965600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:29.966077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:30.115690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:30.127057 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce5973db-ba1b-4812-add0-66824d96b71a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1497 microversion: 2.1 time: 0.175798 Aug 03 04:50:30.127665 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2211/4420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:29 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:30.350582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:30.351215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:30.357856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:30.358313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:30.359137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:30.364627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:30.495516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:30.503968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b03ad5d8-d073-40a4-942d-025011be7610 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.157772 Aug 03 04:50:30.514927 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2210/4421] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:30 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:30.946927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:30.947659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:30.955351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:30.955806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:30.956878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:30.957316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:31.108446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:31.118315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-828d035a-6b62-4eff-a2b8-c20aa608f845 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.175287 Aug 03 04:50:31.119250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2212/4422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:30 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:31.153201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:31.154851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:31.164800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:31.165374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:31.176530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:31.176530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:31.355032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:31.364731 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb7967ba-c123-4227-be68-b746996799e8 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1497 microversion: 2.1 time: 0.216195 Aug 03 04:50:31.365298 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2211/4423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:31 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:31.526556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:31.527380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:31.535417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:31.536087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:31.536952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:31.537454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:31.741902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:31.754391 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b961d8e2-76d4-470f-9b69-98c52670a787 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.231638 Aug 03 04:50:31.770668 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2213/4424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:31 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:32.141182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:32.141850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:32.157441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.158908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:32.160172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.160816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:32.386941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:32.387653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:32.402780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.403232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:32.404017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.404513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:32.412575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:32.424022 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e7dd35e-dee4-4bb4-baf4-ef3b9eb8efbc tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.286713 Aug 03 04:50:32.440226 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2212/4425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:32 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:32.581539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:32.585822 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-20b9196b-4150-40af-b2b0-3a357e153dd4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1497 microversion: 2.1 time: 0.202961 Aug 03 04:50:32.587647 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2214/4426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:32 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:32.782830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:32.787155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:32.801947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.805904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:32.806981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:32.807699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.011944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:33.021338 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef99a2e7-4bc1-45d7-a1e9-12b556ff8de4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.242767 Aug 03 04:50:33.022732 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2213/4427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:32 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:33.230263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:33.230875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:33.249019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dc138cef-22b2-4a6e-b979-c2c9da94f23c req-81ca8f62-17b3-41e7-827f-f9577bc0bb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9874c3-d796-48db-a176-5fd8b97341a1", "name": "network-vif-deleted", "tag": "8f67b126-9b16-4611-8ed9-8cfddee8f7f3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:33.257111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.259385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.263129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.264491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.265478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc138cef-22b2-4a6e-b979-c2c9da94f23c req-81ca8f62-17b3-41e7-827f-f9577bc0bb1c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.266137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dc138cef-22b2-4a6e-b979-c2c9da94f23c req-81ca8f62-17b3-41e7-827f-f9577bc0bb1c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.292769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dc138cef-22b2-4a6e-b979-c2c9da94f23c req-81ca8f62-17b3-41e7-827f-f9577bc0bb1c service nova] Creating event network-vif-deleted:8f67b126-9b16-4611-8ed9-8cfddee8f7f3 for instance 1d9874c3-d796-48db-a176-5fd8b97341a1 on n-h2-826756-5 Aug 03 04:50:33.300986 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dc138cef-22b2-4a6e-b979-c2c9da94f23c req-81ca8f62-17b3-41e7-827f-f9577bc0bb1c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057987 Aug 03 04:50:33.304127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2214/4428] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:33.446311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:33.447255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:33.466622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.468002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.470539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.472851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.531285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:33.539615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f3f3877-3cf6-4459-80ad-98b521cdf44b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.317120 Aug 03 04:50:33.544556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2215/4429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:33 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:33.565876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:33.566777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:33.631467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.637406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.645433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.651263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.944282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:33.957340 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00398200-0953-4619-b21d-ef5873a08b22 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.515294 Aug 03 04:50:33.958079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2215/4430] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:33 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:33.963238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:33.970314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:33.980927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.991453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:33.993714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:33.996060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.040344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:34.057036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47882afa-ce3d-4809-9263-25c0d735b66b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.495341 Aug 03 04:50:34.060652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2216/4431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:33 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:34.069383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:34.073329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:34.087052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.092642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.092642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.092642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.095203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.099054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.099948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid 1d9874c3-d796-48db-a176-5fd8b97341a1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:34.242041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:34.264059 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b5a8ec7-6cc0-4107-867a-165360e3ee9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 200 len: 1299 microversion: 2.1 time: 0.304723 Aug 03 04:50:34.266012 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2216/4432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:33 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:34.270204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:34.272986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:34.294170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.299671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.300681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.301224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.539205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:34.550186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4fc58e01-20a0-4f60-a64a-53681bd549ce tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.487320 Aug 03 04:50:34.552630 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2217/4433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:34 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:34.671043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:34.680837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f0bb365a-5c80-417b-b6d6-274eb3d577cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.414261 Aug 03 04:50:34.681807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2217/4434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:34 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:34.704226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:34.710061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:34.725010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.728960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.728960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:34.728960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:34.985717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:34.986706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:35.008310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.009208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.010284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.011928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.047606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:35.064767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e733e461-f08f-46f2-af59-d7c7b1a72247 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.364335 Aug 03 04:50:35.069749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2218/4435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:34 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:35.286334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:35.286944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:35.298101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.298857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.301339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.303596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.339291 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 HTTP/1.1 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1d9874c3-d796-48db-a176-5fd8b97341a1'} Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:35.348184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ada1e6f-ba09-4735-b75e-72324e0f9d72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 404 len: 111 microversion: 2.1 time: 0.067681 Aug 03 04:50:35.355495 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2219/4436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:35 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:50:35.361215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1329575866", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "1f881aa8-baa3-4832-9e42-a4ace23e4798"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:35.365318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:35.407545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfd95c47-6b8e-4aaf-ac15-1871d1a10a84 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.430068 Aug 03 04:50:35.424951 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2218/4437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:34 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:35.491014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] validate_networks() for [('1f881aa8-baa3-4832-9e42-a4ace23e4798', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:35.577920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:35.578994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:35.599547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.602800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.605054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:35.612653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:35.925865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:35.938912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6beab3cc-4d44-4ed6-a003-7a73d3e94fee tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.367649 Aug 03 04:50:35.953258 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2219/4438] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:35 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:35.964808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-703028677", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:36.061284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:36.667957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:36.668454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:36.669191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:36.669804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:36.670617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:36.682994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.683736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:36.684766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.685400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:36.718731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:36.725034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:36.740245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:36.742942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:36.883741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:36.884248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:36.890532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:36.890532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:36.890532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:36.895515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.895963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:36.896799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.897238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:36.917172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:36.923017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:36.941488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:36.944126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:36.946516 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f9daf9e-3e77-4667-ad91-0d1fcdeea1b3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.591072 Aug 03 04:50:36.949086 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2220/4439] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:36.961600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:36.969027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:36.981671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.982771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:36.987587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:36.988895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:37.106499 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc824004-f64e-42c7-b5ed-7337addba0e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151026 Aug 03 04:50:37.119273 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2220/4440] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:37.127668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84d02230-23f7-4fc2-96bc-be6a05528888 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:37.128678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84d02230-23f7-4fc2-96bc-be6a05528888 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:37.215876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:37.227823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eca54deb-e1b0-43d6-a107-03df6fb60bcf tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.276675 Aug 03 04:50:37.228569 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2221/4441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:36 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:37.258442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:37.259209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:37.280509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:37.280509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:37.280509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:37.280509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:37.319043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84d02230-23f7-4fc2-96bc-be6a05528888 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:37.343008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84d02230-23f7-4fc2-96bc-be6a05528888 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1215 microversion: 2.1 time: 0.212784 Aug 03 04:50:37.357385 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2221/4442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:37 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:37.357385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-531fe954-3947-4bd2-9ab2-0d626f3164c3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:37.357385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-531fe954-3947-4bd2-9ab2-0d626f3164c3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:37.391141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:37.584760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-531fe954-3947-4bd2-9ab2-0d626f3164c3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:37.594795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-531fe954-3947-4bd2-9ab2-0d626f3164c3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1208 microversion: 2.1 time: 0.249904 Aug 03 04:50:37.610587 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2222/4443] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:37 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1208 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:37.664374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:37.674245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-515bebdf-d6ff-4bbc-9e16-1c294c673215 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.435468 Aug 03 04:50:37.674803 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2222/4444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:37 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:38.168680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1264297711", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "e2903c7d-6d21-4dba-a032-e0cd646e9166"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:38.235803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] validate_networks() for [('e2903c7d-6d21-4dba-a032-e0cd646e9166', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:38.249073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:38.249821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:38.258870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.259430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:38.260460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.260934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:38.485664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:38.505198 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77a4964a-c3bf-41ef-a7ed-1abfbda60d52 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.259900 Aug 03 04:50:38.507843 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2223/4445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:38 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:38.523748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:38.523748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:38.541296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.542803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:38.543671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.544118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:38.664875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:38.673562 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-413198c9-2bcc-4d43-a4f9-32daf45b2384 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1219 microversion: 2.1 time: 0.159599 Aug 03 04:50:38.674524 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2224/4446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:38 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:38.681933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:38.682791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:38.690163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.690873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:38.708840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:38.710408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.147466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:39.159177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b140c25a-8c0a-48d5-80b3-0ce0740ff4e0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1212 microversion: 2.1 time: 0.483458 Aug 03 04:50:39.159914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2225/4447] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:38 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1212 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:39.175535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:39.176247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:39.176972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:39.177423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:39.178008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:39.178797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:39.179646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:39.187772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.188494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.189774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.190089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.190393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.190544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.191600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.192051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.212113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Getting quotas for project 17be9f01e3df49c88b246fdcf6209358. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:39.219314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Getting quotas for user c47592043eeb4463a5cf93585007f037 and project 17be9f01e3df49c88b246fdcf6209358. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:39.235145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:39.238000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:39.352945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:39.362366 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef884e3f-78fc-4e19-8fcf-c8bfb5588286 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.188246 Aug 03 04:50:39.363189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2226/4448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:39 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:39.503797 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c87ddd2-ecd9-4146-8bd9-c10769d7f80a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481746 Aug 03 04:50:39.505022 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2223/4449] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:39.516198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d8ab87f-d0d4-4f92-804d-8553481ce43d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:39.517111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d8ab87f-d0d4-4f92-804d-8553481ce43d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:39.530220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:39.544688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:39.558794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.565992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.565992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.565992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.594867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d8ab87f-d0d4-4f92-804d-8553481ce43d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:39.603719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d8ab87f-d0d4-4f92-804d-8553481ce43d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1225 microversion: 2.1 time: 0.091294 Aug 03 04:50:39.624380 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2227/4450] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:39 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:39.717508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:39.718151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:39.736832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.742193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.743259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:39.743876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:39.769243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:39.780356 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-05609c35-c2db-4cf8-b75c-aa51a7fc8ddd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.257042 Aug 03 04:50:39.799564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2224/4451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:39 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:39.850561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:39.850561 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-151c1cd7-4f3c-4038-aadd-0ef48e482952 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1211 microversion: 2.1 time: 0.142168 Aug 03 04:50:39.864518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2228/4452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:39 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1211 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:40.184962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:40.186227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.194090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.194545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.195316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.195925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.290001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:40.297948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99d84fe9-ad03-416c-97c8-9c0814e1f1ab tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1260 microversion: 2.1 time: 0.117670 Aug 03 04:50:40.298531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2225/4453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:40 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1260 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:40.383858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:40.385007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.393927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.394810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.395864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.396584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.426094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:40.572045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:40.581756 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4086187-28fe-45c7-9103-412dbcac9dcc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1501 microversion: 2.1 time: 0.202045 Aug 03 04:50:40.582597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2229/4454] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:40 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:40.605017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c81cc5e5-ed63-45de-a2ab-c941552fd132"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:40.608615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.616046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.616535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.617573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.618015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.633748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb96e40b-eacc-4498-9d7b-87d0041d0106 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:40.634686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb96e40b-eacc-4498-9d7b-87d0041d0106 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.639919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:40.648921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Cannot 'attach_volume' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state rescued Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/os-volume_attachments HTTP/1.1 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 74 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: {"volumeAttachment": {"volumeId": "c81cc5e5-ed63-45de-a2ab-c941552fd132"}} Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'attach_volume' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state rescued Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': 'c4786d26-74a5-4327-90aa-9d70b19e447c', 'body': {'volumeAttachment': {'volumeId': 'c81cc5e5-ed63-45de-a2ab-c941552fd132'}}} Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c4786d26-74a5-4327-90aa-9d70b19e447c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 04:50:40.651643 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state rescued Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state rescued Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 409 to user: Cannot 'attach_volume' instance c4786d26-74a5-4327-90aa-9d70b19e447c while it is in vm_state rescued {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94dfcb72-3666-48a0-a118-f09a05b1d1e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053229 Aug 03 04:50:40.664968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2226/4455] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:50:40 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:50:40.680620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:40.681430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.699615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.699615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.699615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.699615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.700024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb96e40b-eacc-4498-9d7b-87d0041d0106 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:40.700329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb96e40b-eacc-4498-9d7b-87d0041d0106 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1225 microversion: 2.1 time: 0.070248 Aug 03 04:50:40.701499 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2230/4456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:40 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1225 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:40.806121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:40.808646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:40.815350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.815814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:40.822151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:40.822151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.021055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:41.029861 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c2ea2a09-bc7b-46b1-af2f-b203c9fd1ec2 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.227527 Aug 03 04:50:41.031092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2231/4457] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:40 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:41.040954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:41.040954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:41.044593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.045317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.046288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.046911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.114874 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c5e6b58-5685-4886-bc20-87084cc5ce11 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action" status: 202 len: 0 microversion: 2.1 time: 0.441137 Aug 03 04:50:41.116171 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2227/4458] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:50:40 2022] POST /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:50:41.129272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:41.130770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:41.144396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.144865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.145006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:41.145663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.147010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.162165 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e95337c-08cf-426d-94c1-423bf58feeac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1267 microversion: 2.1 time: 0.129763 Aug 03 04:50:41.172466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2232/4459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:41 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:41.321317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:41.322310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:41.334592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.335086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.335895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.336408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.346846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:41.359825 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f588613-a308-4da5-8608-84e984ca71d0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1509 microversion: 2.1 time: 0.233636 Aug 03 04:50:41.363692 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2228/4460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:41 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:41.452528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:41.463382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17dc3095-c59c-4920-aed0-3c4b43737bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1268 microversion: 2.1 time: 0.146753 Aug 03 04:50:41.470606 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2233/4461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:41 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:41.726539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:41.727291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:41.737552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.738294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.739556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:41.740186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:41.826514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:41.837976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-275a7e91-b278-4d4f-9ab2-f41d540d2eed tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1229 microversion: 2.1 time: 0.116212 Aug 03 04:50:41.839592 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2229/4462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:41 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:42.053435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:42.054212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:42.067545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.070037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.070855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.072251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.188169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:42.189421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:42.209576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.211137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.212150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.219740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.371945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:42.384817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a8da07a-dcec-444d-92bd-bff9135efd77 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1285 microversion: 2.1 time: 0.205005 Aug 03 04:50:42.386371 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2230/4463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:42 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:42.392186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:42.393181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:42.402315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.403039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.404360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.405060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.462405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:42.477449 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7345485f-6c8b-42d4-a7a3-c2284ee1d4f7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.427578 Aug 03 04:50:42.478067 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2234/4464] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:42 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:42.489092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:42.489724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:42.497339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.497801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.498610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.499067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.586742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:42.596933 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-79f2c3d7-a7fc-4099-a540-dd4c089e5fcd tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1509 microversion: 2.1 time: 0.208382 Aug 03 04:50:42.621435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:42.622217 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2231/4465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:42 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1509 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:42.642683 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-adb2ab19-3b3f-4197-9fbc-18f456d74815 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1266 microversion: 2.1 time: 0.160647 Aug 03 04:50:42.652319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2235/4466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:42 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:42.862566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:42.863465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:42.878096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.878096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:42.878096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:42.878096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.012533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:43.024255 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-70b710bf-0319-47e6-b170-0da26f106658 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1285 microversion: 2.1 time: 0.165264 Aug 03 04:50:43.025056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2232/4467] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:42 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:43.435038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:43.436362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:43.444124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.450427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.450427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.450427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.505263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:43.506536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:43.516339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.517690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.518677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.519573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.535392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:43.546753 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3960d4e4-3345-4fab-9d20-54b27957b823 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1273 microversion: 2.1 time: 0.115787 Aug 03 04:50:43.563771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2236/4468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:43 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:43.620089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:43.621655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:43.632639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.632639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:43.632639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:43.632639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.066807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:44.075239 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00735003-8348-40f5-90e3-6c2d78708b4c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.578451 Aug 03 04:50:44.085013 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2233/4469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:43 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:44.093591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:44.099884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:44.124860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:44.133013 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f982523b-907d-4901-b3d6-d3960e5b4c0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1509 microversion: 2.1 time: 0.517757 Aug 03 04:50:44.136964 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2237/4470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:43 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:44.144360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.149922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.153058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.153950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.154228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:44.156511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:44.177595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.180947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.181819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.185592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.316921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:44.327129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76f352a9-27d7-4518-b866-26d31b33cbbc tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1283 microversion: 2.1 time: 0.187991 Aug 03 04:50:44.328897 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2238/4471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:44 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:44.505367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:44.516178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f243c099-6c8e-4ee9-b06c-9caf9d7fa5f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.429754 Aug 03 04:50:44.516804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2234/4472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:44 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:44.569557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:44.570790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:44.578909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.579294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.580293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:44.580996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:44.725410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:44.735322 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc81a2cd-b3fe-47b7-a7c9-4b6120f4a5e3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.169373 Aug 03 04:50:44.736203 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2239/4473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:44 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:45.108444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:45.109211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:45.116154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.116667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.117441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.117901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.185946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:45.187323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:45.205575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.206222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.225542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.225542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.442074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:45.454671 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3cf5923-d3e0-4dd9-82b1-966103e936ad tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.350213 Aug 03 04:50:45.456940 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2235/4474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:45 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:45.479559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:45.480110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:45.488019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.489073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.497506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.497506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.586373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:45.599430 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be440188-92db-4334-a598-bcadbb6c855e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1509 microversion: 2.1 time: 0.423377 Aug 03 04:50:45.617099 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2240/4475] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:45 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:45.633086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:45.636217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:45.650340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.652009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.654171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.654171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.753837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:45.761847 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c834777e-75d8-465d-9d17-376ae6ea7512 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.302974 Aug 03 04:50:45.768570 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2236/4476] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:45 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:45.770931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:45.771549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:45.784182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.790189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:45.791169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:45.792119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.060011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:46.064586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:46.072972 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1b7a038-e94f-48f4-bf1e-5182afff96dd tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.450861 Aug 03 04:50:46.073928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2241/4477] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:45 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:46.076572 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d2eed7c-38ee-475f-9373-1317bfab07ef tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.308594 Aug 03 04:50:46.077509 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2237/4478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:45 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:46.478123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:46.478767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:46.485236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.486866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.486866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.486866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.592175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-efc4d4cf-965b-4782-beac-6878bf6a3c43 req-47c9d577-80c6-4b31-9016-d03a60aff4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e9def01-c5bc-431e-aad3-9282b96f5d69", "tag": "d800b83d-21fc-4ea5-857d-57776d8a4357"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:46.605772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-efc4d4cf-965b-4782-beac-6878bf6a3c43 req-47c9d577-80c6-4b31-9016-d03a60aff4b1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.606189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-efc4d4cf-965b-4782-beac-6878bf6a3c43 req-47c9d577-80c6-4b31-9016-d03a60aff4b1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.628923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-efc4d4cf-965b-4782-beac-6878bf6a3c43 req-47c9d577-80c6-4b31-9016-d03a60aff4b1 service nova] Creating event network-changed:d800b83d-21fc-4ea5-857d-57776d8a4357 for instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 on n-h2-826756-5 Aug 03 04:50:46.634984 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-efc4d4cf-965b-4782-beac-6878bf6a3c43 req-47c9d577-80c6-4b31-9016-d03a60aff4b1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048974 Aug 03 04:50:46.643503 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2238/4479] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:50:46.643503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:46.643503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:46.648177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.648666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.649442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.650078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.693722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:46.819350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:46.842762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea500f4e-6f68-4c3a-a50f-9ecc8a93ac3c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.356215 Aug 03 04:50:46.842762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2242/4480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:46 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:46.842762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b7c67c61-28d5-407a-8258-9f2a14d1caa8 req-8a5e7630-a94e-4069-8168-7da92e2d2028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030d1047-3675-47e8-a6f9-25699c346087", "tag": "0d9efd71-52f1-42ff-a236-f04cf6da9ea4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:46.848884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b7c67c61-28d5-407a-8258-9f2a14d1caa8 req-8a5e7630-a94e-4069-8168-7da92e2d2028 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.849088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b7c67c61-28d5-407a-8258-9f2a14d1caa8 req-8a5e7630-a94e-4069-8168-7da92e2d2028 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.861745 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b7c67c61-28d5-407a-8258-9f2a14d1caa8 req-8a5e7630-a94e-4069-8168-7da92e2d2028 service nova] Creating event network-changed:0d9efd71-52f1-42ff-a236-f04cf6da9ea4 for instance 030d1047-3675-47e8-a6f9-25699c346087 on n-h2-826756-5 Aug 03 04:50:46.874389 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b7c67c61-28d5-407a-8258-9f2a14d1caa8 req-8a5e7630-a94e-4069-8168-7da92e2d2028 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Aug 03 04:50:46.874389 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2243/4481] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:46.877261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:46.877887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:46.885397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.885981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.886787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:46.887230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:46.970586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:46.985767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f56a3d05-c483-4f1b-860c-dff97ea67db2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1515 microversion: 2.1 time: 0.348570 Aug 03 04:50:46.988939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2239/4482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:46 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1515 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:47.102145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:47.102145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:47.108622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.110066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.111449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.112735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.263155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:47.283753 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22618b55-f516-4be5-87ac-4b9e132f4a4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.414071 Aug 03 04:50:47.284970 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2244/4483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:46 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:47.298476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:47.299325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:47.310118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.311230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.312522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.313152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.479363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:47.493206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a20a131-04b5-42cc-a87f-27075f8d0c49 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.401368 Aug 03 04:50:47.493991 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2240/4484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:47 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:47.612150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:47.622369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-490e335d-5910-4d14-97fc-419aeecb96e6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.334280 Aug 03 04:50:47.624218 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2245/4485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:47 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:47.752230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:47.753185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:47.765386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.765900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.766690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.771552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.838377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5fa993d9-4f56-4014-b949-7b0169d3ed07 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/ips" status: 200 len: 145 microversion: 2.1 time: 0.089211 Aug 03 04:50:47.839002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2241/4486] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:50:47 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:47.857228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:47.857853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:47.866107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.872788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.872788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.872788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.962029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:47.964568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:47.973405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.977128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:47.977128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:47.977128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.062119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad035508-4d3f-4651-bf58-11692159dc23 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.101841 Aug 03 04:50:48.065163 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2242/4487] 10.222.0.72 () {60 vars in 1343 bytes} [Wed Aug 3 04:50:47 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:48.120155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.138040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5efadd51-064d-461d-aec1-a2338867f881 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.282537 Aug 03 04:50:48.140428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2246/4488] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:47 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:48.165302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:48.165817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:48.172308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.172763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.173543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.173989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.195268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:48.203241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:48.305440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:48.310170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:48.313975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.314663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.315690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.316332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.501806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.508492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:48.514184 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6194d366-0ac2-4066-9701-27523d1f2821 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.212724 Aug 03 04:50:48.528420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2247/4489] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:48 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:48.533294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:48.533925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:48.540744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.542027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.542979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.543429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.574075 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10900068-fa75-45fe-b6d1-176d5875cfcb tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 204 len: 0 microversion: 2.20 time: 0.410978 Aug 03 04:50:48.575077 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2243/4490] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:50:48 2022] DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:50:48.586978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:48.588491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:48.601264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.602089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.602881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.603318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.784959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.795719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-acfdfe05-0a64-43a2-a5a3-bbc70aa644df tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.266216 Aug 03 04:50:48.797946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2248/4491] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:48 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:48.807141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:48.809681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:48.824510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.826496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.827778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.828558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.856639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.866167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.867875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:48.869689 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be92fdef-b53f-4ee4-adc1-2730ddbd3189 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.290229 Aug 03 04:50:48.870501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2244/4492] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:48 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:48.899117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-06b83aa5-213c-48e0-a5d3-158c6135bdfc req-aa3bccce-8911-43e0-b2aa-f738d15769af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d426fd-2177-457b-bc63-837c5825fb08", "tag": "84846f8e-b415-4ca0-914d-a3f7254b6452"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:48.919205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-06b83aa5-213c-48e0-a5d3-158c6135bdfc req-aa3bccce-8911-43e0-b2aa-f738d15769af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:48.919895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-06b83aa5-213c-48e0-a5d3-158c6135bdfc req-aa3bccce-8911-43e0-b2aa-f738d15769af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:48.939904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-06b83aa5-213c-48e0-a5d3-158c6135bdfc req-aa3bccce-8911-43e0-b2aa-f738d15769af service nova] Creating event network-changed:84846f8e-b415-4ca0-914d-a3f7254b6452 for instance 20d426fd-2177-457b-bc63-837c5825fb08 on n-h2-826756-5 Aug 03 04:50:48.946019 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-06b83aa5-213c-48e0-a5d3-158c6135bdfc req-aa3bccce-8911-43e0-b2aa-f738d15769af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055751 Aug 03 04:50:48.946692 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2245/4493] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:49.005359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:49.014597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41ccf2aa-20f5-40ce-ba18-53f7e61bf0b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.215659 Aug 03 04:50:49.015235 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2249/4494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:48 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:49.161520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:49.162242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:49.173088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.173544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.174411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.174849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.203079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:49.229613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:49.318105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:49.328136 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed0888db-fb6b-48eb-8605-86485caf646a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.170948 Aug 03 04:50:49.328924 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2246/4495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:49 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:49.535130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:49.535747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:49.539264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:49.543620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.544104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.544908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.545428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.729673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:49.729673 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2caa82e-58ba-4237-ad4e-70e7623f2e05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.169514 Aug 03 04:50:49.729673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2250/4496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:49 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:49.822951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:49.823751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:49.831583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.832145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.833584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.834452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.893899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:49.902401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:49.904522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.906733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:49.907807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:49.908259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a4e0c8f-5507-42ad-b548-19c4a0866830 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.258152 Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2247/4497] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:49 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.107087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.108004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.108004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.114824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.116460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba637873-2ade-46a6-bfd6-78c7067b3419 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.226432 Aug 03 04:50:50.120308 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2251/4498] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:49 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:50:50.229021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.237203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a897b3bb-5e2b-4ffe-87a4-08c874e6e2a7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.158320 Aug 03 04:50:50.237803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2248/4499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:50 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:50.354868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:50.355785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:50.363039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.363610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.364280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.364975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.522998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.531750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca92e799-8c7a-496f-83f7-adbdbf3fb9f4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.184526 Aug 03 04:50:50.540173 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2252/4500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:50 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:50.742157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:50.742928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:50.749613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.750307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.751301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:50.752417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:50.940599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:50.950122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e9af6f7-3663-4f0d-a7a1-467b282017ff tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.214832 Aug 03 04:50:50.950617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2249/4501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:50 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:51.012742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7b920e8-4d4f-4671-afd3-e265de8046fa tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: .version_select at 0x7fdd5496b1f0>, body: {"keypair": {"name": "tempest-keypair-1837305109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN8zS4DDojxaBWuSoYY4wV/aq56EJ5oa4OnlrWEAqZdHWyl8asKs+oguflFHp9utUTKzmb+iev6Sica7vV6Y8g6WU8olQJLNjQiSMSPLMp4ho8040F3CP0ceKUe3OU6jg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:51.019183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:51.032434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d7b920e8-4d4f-4671-afd3-e265de8046fa tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:51.038796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d7b920e8-4d4f-4671-afd3-e265de8046fa tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for user 776b1938a6ea44a68923f368fd03fd8a and project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:51.126747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:51.127466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.134466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.135244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.142367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.142367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.208961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7b920e8-4d4f-4671-afd3-e265de8046fa tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200388 Aug 03 04:50:51.209999 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2253/4502] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:50:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:51.215508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:51.216390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.225304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.225962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.227054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.227490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.374848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.384535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffc61def-8c3c-464f-9553-48d87570e16b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.261563 Aug 03 04:50:51.386650 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2250/4503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:51 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:51.395216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:51.395216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.399098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.399814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.401540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.402231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.431204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.442322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.443835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.445043 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a04f542-bd7b-42e1-93a4-4455a36ba084 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.234027 Aug 03 04:50:51.446155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2254/4504] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:51 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:51.554063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:51.554678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.561505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.561953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.562923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.563560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.564827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.574745 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5d881cf-c7a6-45e3-ba3f-550c2f29ff3c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.186761 Aug 03 04:50:51.588685 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2251/4505] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:51 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:51.724888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:51.735292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3b8af7c-16b3-40b0-96e5-deb3fbdeda0b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.184532 Aug 03 04:50:51.737424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2255/4506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:51 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:51.971924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:51.972606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68398c9f-cf40-422a-aa77-d585cb991939"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:51.973042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.975095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:51.982559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.983016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.983450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.983902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.984357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.984510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:51.985436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:51.986048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.154269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.162202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72a5a780-5c85-4f73-8749-44b581393232 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.194140 Aug 03 04:50:52.162781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2252/4507] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:51 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:52.407132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:52.407776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:52.416772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.417264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.418430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.418880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.581814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.601648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a5f3c00-79de-4380-a2b6-662809fd6a9a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.198650 Aug 03 04:50:52.617683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2253/4508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:52 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:52.626233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:52.634987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:52.638956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.640595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.641876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.642324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.813147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.825728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.827781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.830058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2df5e689-c296-4506-83da-b8a1ee1a65bc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.211051 Aug 03 04:50:52.830902 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2254/4509] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:52 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:52.844836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:52.844836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:52.844836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.844836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.845612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:52.846054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:52.987498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:52.996815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b1de33b-2dc0-4593-a771-fac16934e365 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.164375 Aug 03 04:50:53.001009 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2255/4510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:52 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:53.005854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:53.006469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:53.016305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.016305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.016305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.016305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.121099 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15d7ae4f-f96a-4604-bf43-295652561947 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152327 Aug 03 04:50:53.140131 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2256/4511] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:50:51 2022] POST /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 194 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:53.149477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f1cad50b-027f-441b-8843-208551df75e1 req-a8c70f51-3508-4f0d-b2c4-358ba07bdd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9def01-c5bc-431e-aad3-9282b96f5d69", "name": "network-vif-plugged", "status": "completed", "tag": "d800b83d-21fc-4ea5-857d-57776d8a4357"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:53.169841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f1cad50b-027f-441b-8843-208551df75e1 req-a8c70f51-3508-4f0d-b2c4-358ba07bdd2c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.170948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f1cad50b-027f-441b-8843-208551df75e1 req-a8c70f51-3508-4f0d-b2c4-358ba07bdd2c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.188961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f1cad50b-027f-441b-8843-208551df75e1 req-a8c70f51-3508-4f0d-b2c4-358ba07bdd2c service nova] Creating event network-vif-plugged:d800b83d-21fc-4ea5-857d-57776d8a4357 for instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 on n-h2-826756-5 Aug 03 04:50:53.194300 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f1cad50b-027f-441b-8843-208551df75e1 req-a8c70f51-3508-4f0d-b2c4-358ba07bdd2c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051536 Aug 03 04:50:53.195661 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2257/4512] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:53.202624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:53.203992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:53.218093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:53.218221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.218221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.218221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.218221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.230845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f78855f-ad99-4bb9-bc00-20ef21726b8f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.221282 Aug 03 04:50:53.232814 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2256/4513] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:53 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:53.396352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:53.406487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a5c6515-f6de-4917-82b5-3768ff7af835 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.209229 Aug 03 04:50:53.407773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2258/4514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:53 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:53.623645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:53.624932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:53.631333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.631986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.633296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.633951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.798137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:53.826648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b855490c-eadb-4c38-9a4a-c258211bb5f2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.206165 Aug 03 04:50:53.843629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2257/4515] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:53 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:53.855089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:53.855961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:53.866591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.867055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:53.867848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:53.868300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.020994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:54.022272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:54.030245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.030700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.031486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.032030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.035300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:54.044762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:54.046885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:54.048209 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18bc6a86-3430-4abb-b6b7-b39da1b24fa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1722 microversion: 2.20 time: 0.197042 Aug 03 04:50:54.048899 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2259/4516] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:53 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:54.191969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:54.200591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-841c44b1-6b7f-45fd-b0c9-a77e7025f0a2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.185300 Aug 03 04:50:54.208318 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2258/4517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:54 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:54.255287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:54.255850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:54.262719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.263225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.271227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.271227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.427029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:54.428259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:54.453684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.459526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.460596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:54.461310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:54.494592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:54.965563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:54.982610 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f00e54a-bd08-41d5-9160-533c06d3136f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.724340 Aug 03 04:50:54.984074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2260/4518] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:54 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:54.995504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-52441690", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0888ee50-224e-4ac2-bb97-47c4f0527711"}], "security_groups": [{"name": "tempest-securitygroup--1464471706"}], "key_name": "tempest-keypair-1837305109", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:55.203747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:55.223954 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba0c1aa4-4adf-45f4-8876-6f63fd397c75 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.799152 Aug 03 04:50:55.223954 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2259/4519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:54 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:55.234131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:55.237158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:55.271993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:55.272148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:55.283579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:55.284084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:55.291982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] validate_networks() for [('0888ee50-224e-4ac2-bb97-47c4f0527711', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:50:55.955843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:55.966476 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a97b58d4-20b9-49c1-9ac8-ab76715acbe0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.741296 Aug 03 04:50:55.967064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2260/4520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:55 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:55.988599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:55.989432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:55.998215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:55.998668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.007522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.007988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.136219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:56.151251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:56.154691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:56.171269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdaf9d0b-32af-4972-a98c-d26bd24d6d25 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1655 microversion: 2.20 time: 0.189326 Aug 03 04:50:56.171929 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2261/4521] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:55 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1655 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:56.181686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:56.182530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:56.184511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:56.196473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:50:56.197353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.198757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:50:56.199457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:50:56.200006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:50:56.200664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:50:56.207276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.207276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.207276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.217148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.219354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.221121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.224220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.280042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:50:56.296519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Getting quotas for user 776b1938a6ea44a68923f368fd03fd8a and project d3ee5d435f6a4d6f9310915b86b709ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:50:56.349285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:50:56.352026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:50:56.454732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:56.468368 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2111be60-3aec-41e0-82d2-f119094f4be7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.295259 Aug 03 04:50:56.482795 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2262/4522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:56 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:56.482795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f9a33983-71d9-473d-b2c2-ec495a418c56 req-73558f80-330c-4940-81d3-792876817987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d426fd-2177-457b-bc63-837c5825fb08", "name": "network-vif-plugged", "status": "completed", "tag": "84846f8e-b415-4ca0-914d-a3f7254b6452"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:56.512690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f9a33983-71d9-473d-b2c2-ec495a418c56 req-73558f80-330c-4940-81d3-792876817987 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.513347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f9a33983-71d9-473d-b2c2-ec495a418c56 req-73558f80-330c-4940-81d3-792876817987 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.519716 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b94e5c44-0bed-41fe-9811-44ef52f9e52c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.533873 Aug 03 04:50:56.522369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2261/4523] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:50:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:50:56.530427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:56.540166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f9a33983-71d9-473d-b2c2-ec495a418c56 req-73558f80-330c-4940-81d3-792876817987 service nova] Creating event network-vif-plugged:84846f8e-b415-4ca0-914d-a3f7254b6452 for instance 20d426fd-2177-457b-bc63-837c5825fb08 on n-h2-826756-5 Aug 03 04:50:56.545252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:56.553813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.557141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.558489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f9a33983-71d9-473d-b2c2-ec495a418c56 req-73558f80-330c-4940-81d3-792876817987 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088279 Aug 03 04:50:56.559088 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2263/4524] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:56.560551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.560656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.578122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4d09ea42-1a8b-49f9-b369-a6a754b98ae6 req-23b77741-a377-479f-a06d-d94623ce0481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-deleted", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:56.607130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d09ea42-1a8b-49f9-b369-a6a754b98ae6 req-23b77741-a377-479f-a06d-d94623ce0481 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.611163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d09ea42-1a8b-49f9-b369-a6a754b98ae6 req-23b77741-a377-479f-a06d-d94623ce0481 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.647520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4d09ea42-1a8b-49f9-b369-a6a754b98ae6 req-23b77741-a377-479f-a06d-d94623ce0481 service nova] Creating event network-vif-deleted:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h2-826756-5 Aug 03 04:50:56.667230 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4d09ea42-1a8b-49f9-b369-a6a754b98ae6 req-23b77741-a377-479f-a06d-d94623ce0481 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102621 Aug 03 04:50:56.667833 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2264/4525] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:56.707133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:56.707872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:56.732834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.735227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:56.736161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:56.739232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.022781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.034905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-809417c4-e2b4-488e-a114-16d04686971c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.510381 Aug 03 04:50:57.053399 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2262/4526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:56 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:57.060153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8903187b-2580-48a1-b91c-e77fec794988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:57.060805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8903187b-2580-48a1-b91c-e77fec794988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:57.079211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.090253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd553bfb-5b79-46eb-9633-4275f00f5588 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1325 microversion: 2.1 time: 0.420036 Aug 03 04:50:57.092198 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2265/4527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:56 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:57.097738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:57.104832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:57.122883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.133401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.140120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.141394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.176315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8903187b-2580-48a1-b91c-e77fec794988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.189313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8903187b-2580-48a1-b91c-e77fec794988 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1244 microversion: 2.1 time: 0.134378 Aug 03 04:50:57.208052 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2263/4528] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:57 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:57.219581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:57.220568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:57.233895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.244338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.244338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.244338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.312069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.314133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.314908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'fault' on Instance uuid d032b7f3-b746-4288-8eb9-2ef11fa839f7 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:57.377958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.395968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.405604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.409350 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7e2708e-2522-4406-9678-27decbc87c73 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1371 microversion: 2.20 time: 0.197683 Aug 03 04:50:57.423933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2264/4529] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:57 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:50:57.425086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.436843 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ff1e4e6-f173-40d0-a03e-35dace8934ed tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.343207 Aug 03 04:50:57.438835 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2266/4530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:57 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:57.489898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:57.490533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:57.498883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.499351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.500145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:57.500632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:57.686922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:57.706036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fd24dd3-64da-41b1-8941-b66719b25e27 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.219967 Aug 03 04:50:57.722764 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2265/4531] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:57 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:58.060237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.060988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.068061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.068548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.069307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.069765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.115806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.116892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.125300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.126173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.127222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.128058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.133463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7ce92594-840a-4d0f-9a4a-87279754f38e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.237814 Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2267/4532] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.652018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-366b693f-8471-46a9-896f-49055d509f1a tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1522 microversion: 2.1 time: 0.225474 Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2266/4533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.655948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.657067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.657235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] HTTP exception thrown: Instance is not a member of specified network Aug 03 04:50:58.657310 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40edf2bb-bc39-44a5-bb19-b89548b34826 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1248 microversion: 2.1 time: 0.115960 Aug 03 04:50:58.657310 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2268/4534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1248 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Request method failure captured: Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69/ips/invalid HTTP/1.1 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f6dGYOZK2jIYJ2__xqMtlD7kn0bKh0YUci_CjFrM2M8mSJWx8GVMcVf3jjJ2uwEpdez5gf9zE5-bJl37Vbxg0cfS7mhd4ezWBzYRXE6YnjJ_RAQrX_bhtoF5wPNXLdt6BPnL0nm39MP_LWv9nyvfIDqvwAPj_SG1BNFJrl8R9XyyiQ Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c47592043eeb4463a5cf93585007f037 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance is not a member of specified network Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '4e9def01-c5bc-431e-aad3-9282b96f5d69', 'id': 'invalid'} Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-862a9087-4c06-4b9a-a514-72903d7def11 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.064803 Aug 03 04:50:58.657435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2267/4535] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69/ips/invalid => generated 91 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Failed to fetch instance by id 999 {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] HTTP exception thrown: Instance 999 could not be found. Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Request method failure captured: Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f6dGYOZK2jIYJ2__xqMtlD7kn0bKh0YUci_CjFrM2M8mSJWx8GVMcVf3jjJ2uwEpdez5gf9zE5-bJl37Vbxg0cfS7mhd4ezWBzYRXE6YnjJ_RAQrX_bhtoF5wPNXLdt6BPnL0nm39MP_LWv9nyvfIDqvwAPj_SG1BNFJrl8R9XyyiQ Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c47592043eeb4463a5cf93585007f037 Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 999 could not be found. Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': '999'} Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 03 04:50:58.662265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68ba9ca1-2724-453a-877e-9386f725f326 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009494 Aug 03 04:50:58.667631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2269/4536] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:50:58.669199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.669199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.669383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.669383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.669577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.669577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.669577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.669577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.669994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.669994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.669994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.669994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.669994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lazy-loading 'fault' on Instance uuid d032b7f3-b746-4288-8eb9-2ef11fa839f7 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '19c105bc7f2d4207bb168dfe3c19052f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a21344add4431685ff685ac8aa43a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e270eabb-35e7-4589-9e00-4ccb6778cc9e tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 200 len: 1371 microversion: 2.20 time: 0.111444 Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2268/4537] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.670382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.671385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.671385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.671385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.726424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.737254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d424f71b-8e4a-42fa-87df-6ebd8165432e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.185420 Aug 03 04:50:58.738097 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2269/4538] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:58.746502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-376793ff-b865-4a63-bc14-86cbbf25b182 req-76f58c6d-f824-4ca2-9311-b4b81fe0fc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d032b7f3-b746-4288-8eb9-2ef11fa839f7", "name": "network-vif-unplugged", "status": "completed", "tag": "de93a9f1-eba1-4f5e-94ce-d0081517cb59"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:50:58.757773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-376793ff-b865-4a63-bc14-86cbbf25b182 req-76f58c6d-f824-4ca2-9311-b4b81fe0fc2d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.758266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-376793ff-b865-4a63-bc14-86cbbf25b182 req-76f58c6d-f824-4ca2-9311-b4b81fe0fc2d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.770667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-376793ff-b865-4a63-bc14-86cbbf25b182 req-76f58c6d-f824-4ca2-9311-b4b81fe0fc2d service nova] Creating event network-vif-unplugged:de93a9f1-eba1-4f5e-94ce-d0081517cb59 for instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 on n-h2-826756-5 Aug 03 04:50:58.775846 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-376793ff-b865-4a63-bc14-86cbbf25b182 req-76f58c6d-f824-4ca2-9311-b4b81fe0fc2d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036501 Aug 03 04:50:58.776488 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2270/4539] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:50:58.781633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:58.782336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:58.803106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.803689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.804412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:58.804858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:58.968413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:58.979009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f104ce27-4542-47c1-95b7-81b820059e54 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1315 microversion: 2.1 time: 0.200375 Aug 03 04:50:58.980209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2271/4540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:58 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:59.316448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4697ae2-c28f-4339-a0a8-b16933e30873 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 204 len: 0 microversion: 2.1 time: 0.869329 Aug 03 04:50:59.316604 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2270/4541] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:50:58 2022] DELETE /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:50:59.327075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.327679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.328480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:59.329694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:59.343059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.343994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.345013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.345660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.347001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.347535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.348641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.349091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.652658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:59.655857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:59.662980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ee3e70f-4e70-40be-8704-ca841cdd687a tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1513 microversion: 2.1 time: 0.350284 Aug 03 04:50:59.663661 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2272/4542] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:59 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:59.669131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.669800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:59.672856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67f072f8-8d9b-4a8a-9231-4f800be55585 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1528 microversion: 2.1 time: 0.351136 Aug 03 04:50:59.673443 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2271/4543] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:59 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1528 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:50:59.677970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.678561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.678927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:59.679057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.679805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.680249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.689506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.690061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.691486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.692147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.711221 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 HTTP/1.1 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd032b7f3-b746-4288-8eb9-2ef11fa839f7'} Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:59.713987 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cb29fca-5ec1-4e3e-9588-87e192604ca8 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 404 len: 111 microversion: 2.20 time: 0.041070 Aug 03 04:50:59.717107 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2272/4544] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:50:59 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:50:59.724443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3ebe5ee-39b0-4c15-9a98-b22b0fd1a45b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '.version_select at 0x7fdd54615940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.754853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:59.765933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2074d4ad-0144-41d8-baee-b89b9c26ecec tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1240 microversion: 2.1 time: 0.101120 Aug 03 04:50:59.766559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2273/4545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:59 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:50:59.771849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:50:59.772498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:50:59.785617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.786001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.786943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:50:59.787381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:50:59.927201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3ebe5ee-39b0-4c15-9a98-b22b0fd1a45b tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162757894" status: 204 len: 0 microversion: 2.20 time: 0.206544 Aug 03 04:50:59.929959 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2273/4546] 10.222.0.72 () {60 vars in 1262 bytes} [Wed Aug 3 04:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162757894 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 04:50:59.945422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:50:59.955982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4b5f87a-d046-448e-a40c-bd24706a9eb9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.187751 Aug 03 04:50:59.956705 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2274/4547] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:50:59 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:00.011824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:00.012486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:00.024606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.025617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.029820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.030741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.186443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:00.204987 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61f5c827-de16-4eba-b4e2-3b50011e2d28 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1501 microversion: 2.1 time: 0.198241 Aug 03 04:51:00.205846 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2274/4548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:00 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:00.228508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:00.229160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:00.236572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.237070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.237939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.238504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.379004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Removing security group d4f36f49-9ab2-4113-9240-c47744a59809 from port 84846f8e-b415-4ca0-914d-a3f7254b6452 Aug 03 04:51:00.685967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:00.686588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:00.715741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.716299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.717104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.717540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.941688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:00.950699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e300458b-059c-46bc-ad30-7f635b229bd4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1490 microversion: 2.1 time: 0.268852 Aug 03 04:51:00.951274 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2275/4549] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:00 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1490 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:00.956154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:00.956790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:00.965032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.966372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:00.966372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:00.966996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.045450 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c99e54b-9c8f-4b31-8db2-d7f2c35615fb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08/action" status: 202 len: 0 microversion: 2.1 time: 0.821954 Aug 03 04:51:01.051221 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2275/4550] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:00 2022] POST /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:01.060517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.060517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.066035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.067046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.069512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.070271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.216831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:01.234483 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc335c12-7ba5-44d6-9460-dc5d3f3baf53 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1304 microversion: 2.1 time: 0.187215 Aug 03 04:51:01.235112 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2276/4551] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:01 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:01.244400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d2f0fa58-12ca-4232-8575-af78eb57714d req-1a8820eb-be4d-4f73-9970-1ba6df3334b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030d1047-3675-47e8-a6f9-25699c346087", "name": "network-vif-plugged", "status": "completed", "tag": "0d9efd71-52f1-42ff-a236-f04cf6da9ea4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:01.287552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2f0fa58-12ca-4232-8575-af78eb57714d req-1a8820eb-be4d-4f73-9970-1ba6df3334b4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.288012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d2f0fa58-12ca-4232-8575-af78eb57714d req-1a8820eb-be4d-4f73-9970-1ba6df3334b4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.303005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d2f0fa58-12ca-4232-8575-af78eb57714d req-1a8820eb-be4d-4f73-9970-1ba6df3334b4 service nova] Creating event network-vif-plugged:0d9efd71-52f1-42ff-a236-f04cf6da9ea4 for instance 030d1047-3675-47e8-a6f9-25699c346087 on n-h2-826756-5 Aug 03 04:51:01.308153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d2f0fa58-12ca-4232-8575-af78eb57714d req-1a8820eb-be4d-4f73-9970-1ba6df3334b4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071860 Aug 03 04:51:01.309065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2277/4552] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:01.315978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.316683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.326704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.327414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.328435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.329024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.334454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:01.343335 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f88e19c4-ef63-4cbd-94b9-1e1bbce175e8 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1528 microversion: 2.1 time: 0.390851 Aug 03 04:51:01.353774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2276/4553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:00 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1528 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:01.363933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.371956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:51:01.372086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.372086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.372086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.373325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.373968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.716474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:01.729209 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db190af5-950c-4560-8224-631f4f798891 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.371687 Aug 03 04:51:01.730342 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2277/4554] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:01 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:01.748867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.761269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.778884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.779689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.780654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.781314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.786147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:01.904101 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8edc8c6c-799e-4ed8-a417-7a9986b4a2db tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 204 len: 0 microversion: 2.1 time: 0.593549 Aug 03 04:51:01.904930 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2278/4555] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:01 2022] DELETE /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:51:01.914095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c0f86613-2418-436c-b02b-7a7475fa91a3 req-ec19cda0-b62c-4d08-bde7-cf5379884299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d426fd-2177-457b-bc63-837c5825fb08", "tag": "84846f8e-b415-4ca0-914d-a3f7254b6452"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:01.922942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:01.937835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c0f86613-2418-436c-b02b-7a7475fa91a3 req-ec19cda0-b62c-4d08-bde7-cf5379884299 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.938297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c0f86613-2418-436c-b02b-7a7475fa91a3 req-ec19cda0-b62c-4d08-bde7-cf5379884299 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.938424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fa12ffb-8605-4642-8033-07bfc890e639 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1459 microversion: 2.1 time: 0.206625 Aug 03 04:51:01.939090 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2278/4556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:01 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1459 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:01.951783 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c0f86613-2418-436c-b02b-7a7475fa91a3 req-ec19cda0-b62c-4d08-bde7-cf5379884299 service nova] Creating event network-changed:84846f8e-b415-4ca0-914d-a3f7254b6452 for instance 20d426fd-2177-457b-bc63-837c5825fb08 on n-h2-826756-5 Aug 03 04:51:01.953755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.956960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.957245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c0f86613-2418-436c-b02b-7a7475fa91a3 req-ec19cda0-b62c-4d08-bde7-cf5379884299 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047422 Aug 03 04:51:01.957917 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2279/4557] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:01.963974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:01.964701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:01.971584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.972036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.972471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.972939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.973056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.973420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:01.973726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:01.974176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.322450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:02.331360 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b7e8703-2095-48a2-8db6-b23b8beb5809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.372272 Aug 03 04:51:02.334239 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2280/4558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:01 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:02.344328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-74d8674e-dce0-4efd-9c7e-e63c863def15 req-e28113d4-921e-48a1-ac35-fde7dbec55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e9def01-c5bc-431e-aad3-9282b96f5d69", "name": "network-vif-deleted", "tag": "d800b83d-21fc-4ea5-857d-57776d8a4357"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:02.365381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:02.374192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-74d8674e-dce0-4efd-9c7e-e63c863def15 req-e28113d4-921e-48a1-ac35-fde7dbec55d3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.374862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-74d8674e-dce0-4efd-9c7e-e63c863def15 req-e28113d4-921e-48a1-ac35-fde7dbec55d3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.382795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:02.389454 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-74d8674e-dce0-4efd-9c7e-e63c863def15 req-e28113d4-921e-48a1-ac35-fde7dbec55d3 service nova] Creating event network-vif-deleted:d800b83d-21fc-4ea5-857d-57776d8a4357 for instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 on n-h2-826756-5 Aug 03 04:51:02.395626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9935c4f1-2f13-4bb5-87f5-c972cfb8cd42 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1496 microversion: 2.1 time: 0.452235 Aug 03 04:51:02.396026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-74d8674e-dce0-4efd-9c7e-e63c863def15 req-e28113d4-921e-48a1-ac35-fde7dbec55d3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062595 Aug 03 04:51:02.403347 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2279/4559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:01 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1496 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:02.403347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:02.403347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:02.404575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2281/4560] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:02.413402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.413866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.414742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.417835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.419300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:02.420175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:02.427412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.428119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.429164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.429828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.574032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:02.595458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4af7a550-418f-48c3-bc37-c6ea2582ed5d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1486 microversion: 2.1 time: 0.189356 Aug 03 04:51:02.606659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2282/4561] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:02 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1486 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:02.606659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:02.606659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:02.627414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.627414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.627414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.627414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.711059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:02.720388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e10236b2-8c7b-4f7c-bcc3-67c0eef9a77a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.322397 Aug 03 04:51:02.721968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2280/4562] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:02 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:02.752590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:02.753483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:02.762338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.763077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.764178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.764930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.879587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:02.893973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f793e86-38a6-47f3-847c-ade4e1572eb1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.296339 Aug 03 04:51:02.894850 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2283/4563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:02 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:02.916464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:02.917333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:02.925835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.926641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.927489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:02.927957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:02.932737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:03.113813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:03.122917 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f83ab281-f982-4e91-8782-4ba3e87963e6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1308 microversion: 2.1 time: 0.375785 Aug 03 04:51:03.123703 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2281/4564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:02 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:03.230645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:03.238628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d2b72a0-7420-4f76-8dfe-c53aa35d4ee6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.326987 Aug 03 04:51:03.239394 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2284/4565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:02 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:03.261070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:03.261732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:03.267870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:03.268391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:03.269180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:03.269624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:03.427838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:03.429668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:03.440421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:03.440880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:03.441666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:03.442100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.114885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:04.125651 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a84bce1f-9334-4474-b923-0f9a350dd7db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.869258 Aug 03 04:51:04.126708 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2282/4566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:03 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:04.131841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:04.139229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:04.146718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.147502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.148459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.149034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.229812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.231499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.231499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lazy-loading 'fault' on Instance uuid 4e9def01-c5bc-431e-aad3-9282b96f5d69 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:04.485657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c47592043eeb4463a5cf93585007f037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17be9f01e3df49c88b246fdcf6209358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:04.499753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f3c710a-1087-4c7f-b460-6c1bafb64f4d tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 200 len: 1315 microversion: 2.1 time: 0.371738 Aug 03 04:51:04.501284 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2283/4567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:04 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:04.510782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:04.511588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:04.519846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.520649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.521588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.522224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.532006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:04.539655 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27a75741-b0f0-4585-8442-6bca12e76c85 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1496 microversion: 2.1 time: 1.117319 Aug 03 04:51:04.553263 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2285/4568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:03 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1496 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:04.562502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:04.566783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:04.581038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.581659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:04.582562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:04.583442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.085265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:05.085361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:05.099796 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1651a610-adbb-4cdf-8421-d5cd702eca3e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1490 microversion: 2.1 time: 0.545247 Aug 03 04:51:05.102158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2286/4569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:04 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1490 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:05.105103 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9451ec75-7301-4f66-8391-73b0e2aae854 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.602511 Aug 03 04:51:05.108479 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2284/4570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:04 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:05.113367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1813916773", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "1f881aa8-baa3-4832-9e42-a4ace23e4798"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:05.115935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:05.120413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.127831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.128510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.131088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.131975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.150804 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 HTTP/1.1 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd032b7f3-b746-4288-8eb9-2ef11fa839f7'} Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:05.153620 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc585f2c-6105-4be5-a63f-a2379e7602cc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 404 len: 111 microversion: 2.20 time: 0.044878 Aug 03 04:51:05.156574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2285/4571] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:51:05 2022] DELETE /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:51:05.165661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:05.169621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.178319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.179169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.179744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.180190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.205083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] validate_networks() for [('1f881aa8-baa3-4832-9e42-a4ace23e4798', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:51:05.377218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d07c37ac-2945-416c-b8fc-0de1cc1a507b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "PUT /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1085 microversion: 2.1 time: 0.217397 Aug 03 04:51:05.388715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2286/4572] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:51:05 2022] PUT /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1085 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:05.388715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:05.388715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: d032b7f3-b746-4288-8eb9-2ef11fa839f7] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.397396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.398504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.402148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.402623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.432041 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 HTTP/1.1 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd032b7f3-b746-4288-8eb9-2ef11fa839f7'} Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.438690 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance d032b7f3-b746-4288-8eb9-2ef11fa839f7 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-354b5151-0d14-43f7-aa9d-4d3e1002dcfc tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7" status: 404 len: 111 microversion: 2.20 time: 0.059830 Aug 03 04:51:05.442384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2287/4573] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:05 2022] GET /compute/v2.1/servers/d032b7f3-b746-4288-8eb9-2ef11fa839f7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:51:05.448734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:05.449005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.455362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.456352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.457233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.457901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.874285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:05.885380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fa7e7a4-1d3a-41a9-b723-5c018e847d3f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1511 microversion: 2.1 time: 0.440795 Aug 03 04:51:05.890040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2288/4574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:05 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:05.899852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:05.900795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] [instance: 4e9def01-c5bc-431e-aad3-9282b96f5d69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.909829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.910470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.911317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.914349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.928546 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] HTTP exception thrown: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Request method failure captured: Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 HTTP/1.1 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f6dGYOZK2jIYJ2__xqMtlD7kn0bKh0YUci_CjFrM2M8mSJWx8GVMcVf3jjJ2uwEpdez5gf9zE5-bJl37Vbxg0cfS7mhd4ezWBzYRXE6YnjJ_RAQrX_bhtoF5wPNXLdt6BPnL0nm39MP_LWv9nyvfIDqvwAPj_SG1BNFJrl8R9XyyiQ Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/17be9f01e3df49c88b246fdcf6209358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 17be9f01e3df49c88b246fdcf6209358 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-170811544 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c47592043eeb4463a5cf93585007f037 Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-170811544-project Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '4e9def01-c5bc-431e-aad3-9282b96f5d69'} Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.930345 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] Returning 404 to user: Instance 4e9def01-c5bc-431e-aad3-9282b96f5d69 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc712987-3fe9-4699-ba99-6fe81922fc05 tempest-ServerAddressesNegativeTestJSON-170811544 tempest-ServerAddressesNegativeTestJSON-170811544-project] 10.222.0.72 "GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69" status: 404 len: 111 microversion: 2.1 time: 0.041023 Aug 03 04:51:05.933943 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2289/4575] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:05 2022] GET /compute/v2.1/servers/4e9def01-c5bc-431e-aad3-9282b96f5d69 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:05.938544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:05.939263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:05.948743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.949547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:05.950542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:05.951326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.050767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:06.069096 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f42389b-cdd4-46d4-85aa-64340f2e3d7b tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 200 len: 1454 microversion: 2.1 time: 0.135034 Aug 03 04:51:06.069747 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2290/4576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:05 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:06.074705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2af8d925-27f7-443b-92d6-cd790654abb3 req-f3ffeb97-0de9-44d9-8783-827e2bd400e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6ea3a7a-2074-4db3-aa1b-3faf477d22ed", "name": "network-vif-deleted", "tag": "c41636dc-bb4d-4e65-a872-9310aafd78b6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:06.098806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2af8d925-27f7-443b-92d6-cd790654abb3 req-f3ffeb97-0de9-44d9-8783-827e2bd400e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.099163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2af8d925-27f7-443b-92d6-cd790654abb3 req-f3ffeb97-0de9-44d9-8783-827e2bd400e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.134354 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2af8d925-27f7-443b-92d6-cd790654abb3 req-f3ffeb97-0de9-44d9-8783-827e2bd400e0 service nova] Creating event network-vif-deleted:c41636dc-bb4d-4e65-a872-9310aafd78b6 for instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed on n-h1-826756-5 Aug 03 04:51:06.146326 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2af8d925-27f7-443b-92d6-cd790654abb3 req-f3ffeb97-0de9-44d9-8783-827e2bd400e0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075241 Aug 03 04:51:06.147672 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2291/4577] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:06.186478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:06.187508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:06.206388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.209931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.212469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.213276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.247979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:06.319561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:51:06.320209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:51:06.320790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:51:06.321348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:51:06.321867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:51:06.343411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.343867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.344925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.345374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.371856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:06.387545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Getting quotas for user d8afdfb3dc9b4e56b38fd2be3768a94a and project 2b6c60add37f4e209c73c69ccd898527. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:06.408605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:51:06.412899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:51:06.584958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:06.596451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-998ba23f-2c87-4569-a87f-fd4458e15453 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1511 microversion: 2.1 time: 0.447041 Aug 03 04:51:06.609580 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2292/4578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:06 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:06.612537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba7ef805-fa9a-4cd7-9e94-c570900ad42d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507613 Aug 03 04:51:06.623331 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2287/4579] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:51:06.624829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:06.628053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4d685c-479a-4906-9b8d-87770eae9778 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:06.628870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b4d685c-479a-4906-9b8d-87770eae9778 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:06.645249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:06.663587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.666564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.667982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.668627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.849897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b4d685c-479a-4906-9b8d-87770eae9778 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:06.863897 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b4d685c-479a-4906-9b8d-87770eae9778 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1215 microversion: 2.1 time: 0.238286 Aug 03 04:51:06.878388 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2288/4580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:06 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:06.884802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:06.891909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:06.904402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.906537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.912895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:06.915157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:06.978331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:51:07.224157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:07.234638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d187da4-d95b-4339-9368-02ba99c717a9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.613542 Aug 03 04:51:07.235409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2293/4581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:06 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:07.273394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:07.275928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:07.285753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.292892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.293888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.294489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.347487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-360b68d6-69b6-46ad-bcf2-59fa5979c58f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078286 Aug 03 04:51:07.355461 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2294/4582] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:51:07 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:07.367110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:07.367900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:07.387151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.387965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.388999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.389592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.420858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed HTTP/1.1 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a6ea3a7a-2074-4db3-aa1b-3faf477d22ed'} Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:07.422678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40dc66cd-8e9d-4b89-9f97-bcdf74ffacc4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 404 len: 111 microversion: 2.1 time: 0.067509 Aug 03 04:51:07.427017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2295/4583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:07 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:07.457546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:07.458056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:07.468495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c877db1c-62e2-468d-aeff-2469f2798078 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 204 len: 0 microversion: 2.1 time: 0.590316 Aug 03 04:51:07.472237 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2289/4584] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:06 2022] DELETE /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:51:07.473732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.478472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.478472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.478472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.478800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:07.479245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:07.498685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.499148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.499945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:07.504991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:07.570248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2be4776d-81a5-4ce7-a10d-208a8e470511 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939" status: 200 len: 194 microversion: 2.1 time: 0.142688 Aug 03 04:51:07.571123 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2296/4585] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 3 04:51:07 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:07.739710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-201263788", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "509771cb-84bd-4c75-be12-3d1527b8ee96"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:07.849806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] validate_networks() for [('509771cb-84bd-4c75-be12-3d1527b8ee96', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:51:08.224539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:08.244668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d51721bb-c2ea-41e3-ad78-b84852f1ff88 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1517 microversion: 2.1 time: 0.761459 Aug 03 04:51:08.245589 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2290/4586] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:07 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1517 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:08.253889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:08.254702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:08.275428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.282174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.283155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.283608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.364046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:08.376645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb140a5b-16f1-48da-b9e0-1f21d0292544 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1219 microversion: 2.1 time: 0.128982 Aug 03 04:51:08.377256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2291/4587] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:08 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:08.396863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9d467951-a65a-43c9-9b76-18bb78c85f75 req-7b02dc82-4942-4fa8-9166-c60963736710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:08.433513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9d467951-a65a-43c9-9b76-18bb78c85f75 req-7b02dc82-4942-4fa8-9166-c60963736710 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.433822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9d467951-a65a-43c9-9b76-18bb78c85f75 req-7b02dc82-4942-4fa8-9166-c60963736710 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.484206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9d467951-a65a-43c9-9b76-18bb78c85f75 req-7b02dc82-4942-4fa8-9166-c60963736710 service nova] Creating event network-changed:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:51:08.498230 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9d467951-a65a-43c9-9b76-18bb78c85f75 req-7b02dc82-4942-4fa8-9166-c60963736710 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119067 Aug 03 04:51:08.499225 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2292/4588] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:08.506261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:08.507175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:08.564184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.566120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.568174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.572855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.813035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:51:08.814581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:51:08.815230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:51:08.816338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:51:08.816907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:51:08.843007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.845037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.845862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:08.846952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:08.847400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:08.855912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0bcccffe-6cbc-41ad-b492-363f28a94d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.353761 Aug 03 04:51:08.857107 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2293/4589] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:08 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:08.875746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:08.898100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:08.913530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Getting quotas for user e427de1035e541b59256dd0adfdfee2e and project 2c26b3b9a2e94f5f8568efdc21c4c5a1. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:08.949316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:51:08.954124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:51:09.157884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-984652e0-e933-4204-ab3e-5d0b5ae27995 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563650 Aug 03 04:51:09.159115 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2297/4590] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:51:09.174843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c16d5076-9d64-4ab4-aee6-633eb79d9f1d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:09.181886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c16d5076-9d64-4ab4-aee6-633eb79d9f1d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:09.269758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:09.273211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:09.299695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.300470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.304149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.304867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.460261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c16d5076-9d64-4ab4-aee6-633eb79d9f1d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:09.481944 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c16d5076-9d64-4ab4-aee6-633eb79d9f1d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1214 microversion: 2.1 time: 0.313320 Aug 03 04:51:09.492907 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2294/4591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:09 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:09.510869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:09.511493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:09.533519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.533978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.534774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.535215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.747885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:09.761021 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b917220a-fb76-4537-8817-6eddb4bb7dc2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1211 microversion: 2.1 time: 0.265095 Aug 03 04:51:09.766326 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2295/4592] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:09 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:09.878332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:09.879280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:09.889792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.890636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.891746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:09.892434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:09.997803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:10.009240 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e30f1aa-ff94-46f2-95a8-ed0b9b516bb7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1517 microversion: 2.1 time: 0.745193 Aug 03 04:51:10.023645 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2298/4593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:09 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1517 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:10.510333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5dde9df4-cd61-48b3-9877-4bd78c68f66d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:10.511614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5dde9df4-cd61-48b3-9877-4bd78c68f66d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:10.770618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5dde9df4-cd61-48b3-9877-4bd78c68f66d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:10.794867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5dde9df4-cd61-48b3-9877-4bd78c68f66d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1214 microversion: 2.1 time: 0.293907 Aug 03 04:51:10.816756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2299/4594] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:10 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1214 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:10.831639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:10.833859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:10.842065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:10.845424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:10.846687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:10.848383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:10.849496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.163678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:11.178126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ebec781-ba98-4bc4-927c-59a00441c6de tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 1.303133 Aug 03 04:51:11.186987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:11.191624 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2296/4595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:09 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:11.199510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7dfc4bc-e26a-417a-a090-a817ec6beec7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1275 microversion: 2.1 time: 0.381195 Aug 03 04:51:11.202424 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2300/4596] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:10 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1275 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:11.203997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:11.204647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:11.216910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ec5a6dfc-450f-4a5f-8de3-930921499693 req-cd883856-a214-4c53-ae3e-68a7d5a43096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030d1047-3675-47e8-a6f9-25699c346087", "name": "network-vif-deleted", "tag": "0d9efd71-52f1-42ff-a236-f04cf6da9ea4"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:11.222157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.222615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.231921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.231921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.238604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ec5a6dfc-450f-4a5f-8de3-930921499693 req-cd883856-a214-4c53-ae3e-68a7d5a43096 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.240943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ec5a6dfc-450f-4a5f-8de3-930921499693 req-cd883856-a214-4c53-ae3e-68a7d5a43096 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.270586 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ec5a6dfc-450f-4a5f-8de3-930921499693 req-cd883856-a214-4c53-ae3e-68a7d5a43096 service nova] Creating event network-vif-deleted:0d9efd71-52f1-42ff-a236-f04cf6da9ea4 for instance 030d1047-3675-47e8-a6f9-25699c346087 on n-h2-826756-5 Aug 03 04:51:11.284716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ec5a6dfc-450f-4a5f-8de3-930921499693 req-cd883856-a214-4c53-ae3e-68a7d5a43096 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080357 Aug 03 04:51:11.287804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2301/4597] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:11.392386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:11.393385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:11.416839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.417562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.419723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.421098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.451519 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 HTTP/1.1 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '72531f91-6fd2-475e-bbe2-c4a450af9ee0'} Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:11.455890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.459112 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.464397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:11.465550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99db3bc8-c6d3-423e-add3-478e36b7ffa4 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 404 len: 111 microversion: 2.20 time: 0.080073 Aug 03 04:51:11.467811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2302/4598] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:51:11 2022] DELETE /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:51:11.479135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:11.480203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] [instance: 72531f91-6fd2-475e-bbe2-c4a450af9ee0] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:11.488825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.489288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.490261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.491985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.511202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] HTTP exception thrown: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Request method failure captured: Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 HTTP/1.1 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzlonbW_mK2tBzf18z50slJV6tJjaLt_Ydc1JMUeUaC5mna2MoFPfS6n2LR8dwYOR1oAye7n2BqosGVShuE4N1vmzyVx0BTf9waF3EwzUhxU28IG2rzQoGReQKgu6iiBHoNn2ECw63hwrmEkWryXW1aOV1J3Mw4Lyza3HNUTBITl-I Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_93a21344add4431685ff685ac8aa43a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/93a21344add4431685ff685ac8aa43a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 93a21344add4431685ff685ac8aa43a4 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1847295585 Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 19c105bc7f2d4207bb168dfe3c19052f Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1847295585-project Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '72531f91-6fd2-475e-bbe2-c4a450af9ee0'} Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.513042 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] Returning 404 to user: Instance 72531f91-6fd2-475e-bbe2-c4a450af9ee0 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:11.516203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26163f01-54bb-4018-ad0e-46d42c1943b0 tempest-AttachVolumeShelveTestJSON-1847295585 tempest-AttachVolumeShelveTestJSON-1847295585-project] 10.222.0.72 "GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0" status: 404 len: 111 microversion: 2.20 time: 0.042316 Aug 03 04:51:11.519600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2303/4599] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:11 2022] GET /compute/v2.1/servers/72531f91-6fd2-475e-bbe2-c4a450af9ee0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:51:11.547398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:11.560558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7b6e7f6-6b86-4822-92d5-63606b3e34e1 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 200 len: 1475 microversion: 2.1 time: 0.367573 Aug 03 04:51:11.562027 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2297/4600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:11 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:11.609105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4042db5-62e1-4b74-a461-7d11ee25b5c6"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:11.612185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:11.627956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.629859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.637224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.639408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.824626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:11.825336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:11.838751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.840589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.841995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:11.845462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:11.928379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:11.943775 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-383f1abf-050d-4bc0-9896-9a70bc7f49c0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1210 microversion: 2.1 time: 0.124638 Aug 03 04:51:11.957482 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2298/4601] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:11 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:12.199181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:12.200591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:12.225077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:12.228885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:12.235474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:12.235975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:12.780791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:12.794868 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae065bbd-ce79-4abc-8a00-c2798130a994 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.599610 Aug 03 04:51:12.796213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2299/4602] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:12 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:12.823860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:12.824922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:12.841148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:12.843179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:12.849870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:12.851018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.012442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1890f658-4398-4d08-bbda-4ab259902af9 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "POST /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.407336 Aug 03 04:51:13.022322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2304/4603] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:51:11 2022] POST /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 194 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:13.030747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:13.032490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:13.047556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.048441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.050409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.050409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.070391 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 HTTP/1.1 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '030d1047-3675-47e8-a6f9-25699c346087'} Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:13.093050 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:51:13.097609 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:13.099211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:13.100921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:13.105503 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-51ab3e32-494c-41d7-82ed-8bf1b514755d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 404 len: 111 microversion: 2.1 time: 0.080026 Aug 03 04:51:13.106613 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2305/4604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:13 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:13.128707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:13.132826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:13.141083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8b9a4ca-2adc-43fc-a670-acd7c9b12dc6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1273 microversion: 2.1 time: 0.339432 Aug 03 04:51:13.141083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2300/4605] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:12 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:13.173465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.175350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.175671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.176543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.232944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-732768864", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "33ebec44-b14e-43df-843f-571b61140489"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:13.339615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] validate_networks() for [('33ebec44-b14e-43df-843f-571b61140489', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:51:13.465314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:13.479557 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fbe35bb-a5a5-4e17-9886-929a7e55c927 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1274 microversion: 2.1 time: 0.368803 Aug 03 04:51:13.499382 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2306/4606] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:13 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:13.514564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-22c13cad-42ac-43a8-97f1-6472871c157e req-963d408b-0944-487f-94d8-f845becc6377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "name": "network-vif-plugged", "status": "completed", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:13.532685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-22c13cad-42ac-43a8-97f1-6472871c157e req-963d408b-0944-487f-94d8-f845becc6377 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.541042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-22c13cad-42ac-43a8-97f1-6472871c157e req-963d408b-0944-487f-94d8-f845becc6377 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.571320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-22c13cad-42ac-43a8-97f1-6472871c157e req-963d408b-0944-487f-94d8-f845becc6377 service nova] Creating event network-vif-plugged:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:51:13.585449 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-22c13cad-42ac-43a8-97f1-6472871c157e req-963d408b-0944-487f-94d8-f845becc6377 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074504 Aug 03 04:51:13.591889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2307/4607] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:13.818910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:13.819867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:13.840692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.841149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:13.841935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:13.842385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:14.340416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:14.358485 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54502643-6089-4d53-967c-3ac3f9f3d69e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 0.537237 Aug 03 04:51:14.372617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2308/4608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:13 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:14.372617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:14.372617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:14.391786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:14.394613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:14.395524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:14.395981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.569392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:51:15.570368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:51:15.571599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:51:15.572016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:51:15.572628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:51:15.582931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.583538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.584530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.585131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.607439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:15.613525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Getting quotas for user ae62dff3158946428069bdc58127d804 and project 826fee0a42d143898d4607bad49b02bc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:15.628082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:51:15.630747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:51:15.694680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:15.720143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e4a19130-0e02-472e-bb86-ea29f3e07661 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 1.358660 Aug 03 04:51:15.720760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2309/4609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:14 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:15.734178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:15.734997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:15.756712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.757164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.757956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.758432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.868755 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2725b108-8809-45bd-9670-07e38bfa480d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.641252 Aug 03 04:51:15.872846 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2301/4610] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:51:15.896068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:15.898263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:15.911647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.916340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:15.918862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:15.920782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:16.159914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:16.169912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f6b2a2d-fe48-40a5-b4ae-1981fe9a10a3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1272 microversion: 2.1 time: 0.439316 Aug 03 04:51:16.172780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2310/4611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:15 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1272 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:16.199016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86ee5523-f169-4766-9b7a-b54919137f19 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:16.199016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86ee5523-f169-4766-9b7a-b54919137f19 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:16.392679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86ee5523-f169-4766-9b7a-b54919137f19 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:16.417389 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86ee5523-f169-4766-9b7a-b54919137f19 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1208 microversion: 2.1 time: 0.243217 Aug 03 04:51:16.422153 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2311/4612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:16 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1208 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:16.751071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:16.754998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:16.783116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:16.783953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:16.787403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:16.788849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:17.051380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:17.069087 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-929d29d4-0685-4bab-9c9f-be9228b263db tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1370 microversion: 2.1 time: 1.193816 Aug 03 04:51:17.084481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2302/4613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:15 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1370 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:17.194158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:17.195145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:17.205793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:17.206592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:17.207787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:17.208702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:17.215411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:17.475065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:17.485736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82fac3e0-19bf-4a73-9118-c0bd0e3f90a3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.747441 Aug 03 04:51:17.489014 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2312/4614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:16 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:17.499439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:17.506209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:17.519164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:17.519862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:17.520831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:17.521418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:17.801528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:17.814097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c568873-9f4d-4fe2-b575-365c387f0e9f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1212 microversion: 2.1 time: 0.318606 Aug 03 04:51:17.816052 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2313/4615] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:17 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1212 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:17.971027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:17.980199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4211e68-04a8-4554-8f22-9100937334c7 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.790002 Aug 03 04:51:17.983968 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2303/4616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:17 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:18.093088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:18.093879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:18.105428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.111556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.114499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.115188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.350619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c07bcbd8-e7fd-498c-a06f-2f6f474f94a6 req-2fb2477b-0d06-4889-b97c-ea3bd2a30ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3408908f-2b74-4693-a606-fd33b8b5c029", "tag": "086aec99-839d-41e8-b1c0-793ede1f75dc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:18.379297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c07bcbd8-e7fd-498c-a06f-2f6f474f94a6 req-2fb2477b-0d06-4889-b97c-ea3bd2a30ab7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.381830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c07bcbd8-e7fd-498c-a06f-2f6f474f94a6 req-2fb2477b-0d06-4889-b97c-ea3bd2a30ab7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.410913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c07bcbd8-e7fd-498c-a06f-2f6f474f94a6 req-2fb2477b-0d06-4889-b97c-ea3bd2a30ab7 service nova] Creating event network-changed:086aec99-839d-41e8-b1c0-793ede1f75dc for instance 3408908f-2b74-4693-a606-fd33b8b5c029 on n-h1-826756-5 Aug 03 04:51:18.421110 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c07bcbd8-e7fd-498c-a06f-2f6f474f94a6 req-2fb2477b-0d06-4889-b97c-ea3bd2a30ab7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073890 Aug 03 04:51:18.428104 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2304/4617] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:51:18.511989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:18.512912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:18.528717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.529222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.540172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.540172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.840684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:18.858246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68449426-3a25-4a64-8c07-984c421a80a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1564 microversion: 2.1 time: 0.769317 Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2314/4618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:18 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1564 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.874430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.902292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:18.957568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:18.969185 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6547a8e7-98c1-4107-98c3-d2f40d0789b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1260 microversion: 2.1 time: 0.106049 Aug 03 04:51:18.971543 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2315/4619] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:18 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1260 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:18.987031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:18.987951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:18.994879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.995757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:18.999432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:18.999432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:19.213253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:19.224321 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-316b98c1-7332-4761-af5d-0eaa93c8adf6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.716087 Aug 03 04:51:19.225930 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2305/4620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:18 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:19.238061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:19.241278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:19.254990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:19.256364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:19.259280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:19.260384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:19.278811 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c43cf924-9ad1-4b6e-800b-cda9a5649e67 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.306120 Aug 03 04:51:19.286943 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2316/4621] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:51:18 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:19.994136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:19.995611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:20.015940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:20.018285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:20.019520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:20.020218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:20.172588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:20.180665 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21531b13-1dd7-4455-a67a-740dad616ae3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.951230 Aug 03 04:51:20.181268 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2306/4622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:19 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:20.199976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:20.208884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3ab2601-d2f5-41d7-a9d3-62dcf0fdc9ae tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1266 microversion: 2.1 time: 0.221768 Aug 03 04:51:20.213079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2317/4623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:19 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:20.247819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:20.248497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:20.264219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:20.265339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:20.269157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:20.270285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:21.207169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:21.207888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:21.230737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:21.238191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:21.239835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:21.240553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:21.660933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:21.674485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e28b9c4c-fd69-44c5-8233-7b74f034022c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 1.431895 Aug 03 04:51:21.676579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2307/4624] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:20 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:21.687440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:21.690604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:21.737180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:21.738644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:21.740022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:21.741441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:21.946273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:21.962156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:21.972049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-520768d1-b907-4211-b8c9-b5f80c041f9f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.770125 Aug 03 04:51:21.976051 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2318/4625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:21 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:22.230307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:22.239358 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5386fab-b15f-4129-9a2b-d269717566f5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.561342 Aug 03 04:51:22.240543 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2308/4626] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:21 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:22.460222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-168a8fe3-a9b7-4078-a42b-681a2d58cc34 req-c8d3157c-05ea-4cda-8319-780d661a545c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f5c36b-8a89-4a08-9b56-fe0b02ce4895", "tag": "338f624c-91a8-41ef-8270-e21128ea0f4f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:22.490632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-168a8fe3-a9b7-4078-a42b-681a2d58cc34 req-c8d3157c-05ea-4cda-8319-780d661a545c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:22.491830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-168a8fe3-a9b7-4078-a42b-681a2d58cc34 req-c8d3157c-05ea-4cda-8319-780d661a545c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:22.510184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-168a8fe3-a9b7-4078-a42b-681a2d58cc34 req-c8d3157c-05ea-4cda-8319-780d661a545c service nova] Creating event network-changed:338f624c-91a8-41ef-8270-e21128ea0f4f for instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 on n-h1-826756-5 Aug 03 04:51:22.516023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-168a8fe3-a9b7-4078-a42b-681a2d58cc34 req-c8d3157c-05ea-4cda-8319-780d661a545c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062602 Aug 03 04:51:22.520531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2319/4627] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:22.707731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:22.714050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:22.728854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:22.729651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:22.734791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:22.735359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:23.001852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:23.003249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:23.014437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:23.019184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:23.020420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:23.021983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:23.288740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:23.297918 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ecb87f17-c77d-43ca-9917-356fe8ad6edb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.601495 Aug 03 04:51:23.305216 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2309/4628] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:22 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:23.310670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:23.311228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:23.326641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:23.329927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:23.331836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:23.337382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:23.999326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:24.009939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb313458-c0c7-4946-85de-53bca9657316 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 1.012248 Aug 03 04:51:24.022856 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2320/4629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:22 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:24.034115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7ae7234b-ad2a-4055-bded-4c0d0f08dc55 req-02e2651d-d14e-4f16-b7ef-4d66eb45f0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98634787-1da2-4d7c-b2d5-d715bed3d5c5", "tag": "e37470b1-9ca9-44b2-abd5-d62edc401df0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:24.063401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7ae7234b-ad2a-4055-bded-4c0d0f08dc55 req-02e2651d-d14e-4f16-b7ef-4d66eb45f0b1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:24.064079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7ae7234b-ad2a-4055-bded-4c0d0f08dc55 req-02e2651d-d14e-4f16-b7ef-4d66eb45f0b1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:24.086442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7ae7234b-ad2a-4055-bded-4c0d0f08dc55 req-02e2651d-d14e-4f16-b7ef-4d66eb45f0b1 service nova] Creating event network-changed:e37470b1-9ca9-44b2-abd5-d62edc401df0 for instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 on n-h2-826756-5 Aug 03 04:51:24.108323 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7ae7234b-ad2a-4055-bded-4c0d0f08dc55 req-02e2651d-d14e-4f16-b7ef-4d66eb45f0b1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078107 Aug 03 04:51:24.112909 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2321/4630] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:24.322778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:24.323827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:24.340557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:24.341243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:24.344493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:24.347088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:24.728007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:24.752909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-505ab02b-5ac4-4219-ba88-d4034100a951 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 1.431826 Aug 03 04:51:24.752909 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2310/4631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:23 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:24.760656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bfe6fabd-34b9-4b5f-b972-f489bd6afd4b req-f92723a6-bdfd-4d0e-84e5-1d2cd1bf45d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:24.781245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bfe6fabd-34b9-4b5f-b972-f489bd6afd4b req-f92723a6-bdfd-4d0e-84e5-1d2cd1bf45d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:24.781688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bfe6fabd-34b9-4b5f-b972-f489bd6afd4b req-f92723a6-bdfd-4d0e-84e5-1d2cd1bf45d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:24.830887 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bfe6fabd-34b9-4b5f-b972-f489bd6afd4b req-f92723a6-bdfd-4d0e-84e5-1d2cd1bf45d5 service nova] Creating event network-changed:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:51:24.844793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bfe6fabd-34b9-4b5f-b972-f489bd6afd4b req-f92723a6-bdfd-4d0e-84e5-1d2cd1bf45d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102442 Aug 03 04:51:24.851209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2311/4632] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:25.050343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:25.051678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:25.060258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:25.076815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:25.079285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:25.084898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:25.084898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:25.349220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:25.359901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57dd4b19-1e74-453a-b1d3-0bffecdff026 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 1.044086 Aug 03 04:51:25.363201 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2322/4633] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:24 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:25.596004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:25.621949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=28 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:25.675354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:25.684803 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4cbda9c-8a35-4028-8e3d-150ab100f356 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.649880 Aug 03 04:51:25.687093 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2312/4634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:25 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:25.771023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:25.771650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:25.779536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:25.780242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:25.781212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:25.781804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:26.286744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:26.300163 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd362f4e-a777-4ef8-bc86-d343f210d3a7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.531924 Aug 03 04:51:26.302059 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2323/4635] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:25 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:26.387863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:26.389043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:26.399256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:26.401274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:26.402313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:26.402923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:26.634373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:26.649297 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2bc9354c-0395-449d-860c-eb51d063cc50 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.263395 Aug 03 04:51:26.649297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2313/4636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:26 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:26.711415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:26.712893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:26.714947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:26.719905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:26.720414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:26.721194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:26.721636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:26.979733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:26.987746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7b9780b2-dedf-4283-be13-46d8657159a4 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.281060 Aug 03 04:51:27.001829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2324/4637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:26 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:27.158632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-349f0718-3959-491d-af30-59a1363bd97c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Action: 'create', calling method: .version_select at 0x7fdd54cd5940>, body: {"keypair": {"name": "tempest-keypair-660885828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+Eju7ghvWUWqqBs3HAEM9tIYhsKR6GYn6EKqaUZ1UEavnpbBY5OAjXHAQuJVJPq7mDZKKmrgC10NWNVdi+EzKgI2ibmYSoh2l4WjdIoM82xjdXJ3FCGbzq8WfECnf85g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:27.177299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-349f0718-3959-491d-af30-59a1363bd97c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Getting quotas for project 90277125790c4575a67d25fff89029ae. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:27.183002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-349f0718-3959-491d-af30-59a1363bd97c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Getting quotas for user c278da47fdac47af94ed8d402bc76faf and project 90277125790c4575a67d25fff89029ae. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:27.323257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:27.323873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:27.330611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:27.331065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:27.331831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:27.332288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:27.349407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-349f0718-3959-491d-af30-59a1363bd97c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.194714 Aug 03 04:51:27.350371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2314/4638] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:51:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 199 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:51:27.597207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-de0353e1-3cf4-4dea-af94-a6ffdb951d31 req-f83b39de-0759-4e58-b54f-95fe9485e45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408908f-2b74-4693-a606-fd33b8b5c029", "name": "network-vif-plugged", "status": "completed", "tag": "086aec99-839d-41e8-b1c0-793ede1f75dc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:27.621431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:27.628254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-de0353e1-3cf4-4dea-af94-a6ffdb951d31 req-f83b39de-0759-4e58-b54f-95fe9485e45a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:27.630834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-358c66b5-9ed7-4f3e-b353-1cde6d2123f4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.311585 Aug 03 04:51:27.631611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2325/4639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:27 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:27.632244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-de0353e1-3cf4-4dea-af94-a6ffdb951d31 req-f83b39de-0759-4e58-b54f-95fe9485e45a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:27.653078 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-de0353e1-3cf4-4dea-af94-a6ffdb951d31 req-f83b39de-0759-4e58-b54f-95fe9485e45a service nova] Creating event network-vif-plugged:086aec99-839d-41e8-b1c0-793ede1f75dc for instance 3408908f-2b74-4693-a606-fd33b8b5c029 on n-h1-826756-5 Aug 03 04:51:27.659294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-de0353e1-3cf4-4dea-af94-a6ffdb951d31 req-f83b39de-0759-4e58-b54f-95fe9485e45a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069585 Aug 03 04:51:27.659986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2315/4640] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:51:27.669996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:27.670618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:27.677320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:27.677697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:27.678475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:27.678911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:27.964444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:27.978355 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78a6f576-75dd-4f4f-8a51-576d7ea0def4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.312690 Aug 03 04:51:27.981059 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2326/4641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:27 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:28.012916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:28.014251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:28.024090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.025054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.026401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.027338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.183878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:28.191671 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09b81a1f-1e37-4679-ad35-6ca7ec14ef4f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.185569 Aug 03 04:51:28.192256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2316/4642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:28 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:28.655085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:28.656669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:28.665429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.666467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.667257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.667880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.849004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:28.858476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:28.874513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.874978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.875776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:28.885241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:28.929021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:28.941663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da37ce1c-f642-40f6-aa1e-af24893a14c9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.291420 Aug 03 04:51:28.943727 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2327/4643] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:28 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:28.946304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a53b30b9-798f-4fc2-94fa-ec14f6debab5 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.101606 Aug 03 04:51:28.953771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2317/4644] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:51:28 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:29.003309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:29.004640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:29.026664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.029671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.031988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.032466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.117099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:29.117839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:29.124599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.125488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.126281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.126722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.162569 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-282b37b2-cdeb-49fb-8ab0-d6914c657d82 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939" status: 200 len: 194 microversion: 2.1 time: 0.050464 Aug 03 04:51:29.171982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2318/4645] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 3 04:51:29 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:29.187845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:29.188499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:29.215507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.216078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.216962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.217409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.384753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:29.394261 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e3cee3a-44f5-448c-9d91-fd44a9f22d2b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1315 microversion: 2.1 time: 0.395854 Aug 03 04:51:29.402064 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2328/4646] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:28 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:29.427995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:29.432724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:29.449301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.450390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.450840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'services' on Instance uuid 650b5236-9353-4479-b9a6-cf30ffffc916 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:29.453009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.453524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.726327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:29.738392 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-87b32c92-644f-4bc6-b5d1-155263f17d06 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.326632 Aug 03 04:51:29.738392 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2329/4647] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:29 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:29.744147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7987dd2c-ed60-42bb-a040-6022c08187cf req-aa8944d8-25e2-42f6-a359-a27a4051962d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98634787-1da2-4d7c-b2d5-d715bed3d5c5", "name": "network-vif-plugged", "status": "completed", "tag": "e37470b1-9ca9-44b2-abd5-d62edc401df0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:29.754093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7987dd2c-ed60-42bb-a040-6022c08187cf req-aa8944d8-25e2-42f6-a359-a27a4051962d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.754539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7987dd2c-ed60-42bb-a040-6022c08187cf req-aa8944d8-25e2-42f6-a359-a27a4051962d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.767116 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7987dd2c-ed60-42bb-a040-6022c08187cf req-aa8944d8-25e2-42f6-a359-a27a4051962d service nova] Creating event network-vif-plugged:e37470b1-9ca9-44b2-abd5-d62edc401df0 for instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 on n-h2-826756-5 Aug 03 04:51:29.773074 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7987dd2c-ed60-42bb-a040-6022c08187cf req-aa8944d8-25e2-42f6-a359-a27a4051962d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034533 Aug 03 04:51:29.773703 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2330/4648] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:29.925325 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8aa8f761-0606-402e-af73-261362662ab1 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939" status: 202 len: 0 microversion: 2.1 time: 0.750713 Aug 03 04:51:29.930129 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2319/4649] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:51:29 2022] DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/68398c9f-cf40-422a-aa77-d585cb991939 => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:29.968349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:29.969412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:29.988325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.988749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:29.989545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:29.989997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.188037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:30.202273 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8aecd48-97cb-4b2c-af3e-86c27b9f3ec4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.238142 Aug 03 04:51:30.203952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2331/4650] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:29 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:30.431296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:30.432001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:30.438974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.439427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.440307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.440748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.652842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:30.673832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52f51b2f-6970-4510-8130-f26826a23425 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1501 microversion: 2.1 time: 0.244390 Aug 03 04:51:30.680789 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2320/4651] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:30 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:30.714865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:30.715411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:30.722149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.722793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.723737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.724352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.769567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:30.770649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:30.793550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.794486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.795908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:30.796469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:30.973116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:30.986376 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a1a2476-f13f-404c-8b2f-7fb31771eff5 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.231079 Aug 03 04:51:31.003410 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2321/4652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:30 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:31.033522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5002aeb0-1702-42fd-9ac9-a7845a4acedd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029/action" status: 202 len: 0 microversion: 2.1 time: 0.341360 Aug 03 04:51:31.034949 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2332/4653] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:30 2022] POST /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:31.060539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:31.061608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:31.074955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:31.075413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:31.077693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:31.078194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:31.092755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:31.227848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:31.229274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:31.241310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:31.243212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:31.244767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:31.247710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:31.463222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:31.481752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27247b88-a61e-4aed-8bca-41372c8f6d4f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1506 microversion: 2.1 time: 0.441835 Aug 03 04:51:31.484979 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2322/4654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:31 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:31.579736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:31.589205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac136986-7a77-4d46-b121-8506fa2262a2 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1308 microversion: 2.1 time: 0.366222 Aug 03 04:51:31.590453 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2333/4655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:31 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:31.788441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-11aaeb47-d221-48be-ae3c-f238887b2780 req-32cdee3d-1acb-45c7-9d1c-4e4d6e838ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f5c36b-8a89-4a08-9b56-fe0b02ce4895", "name": "network-vif-plugged", "status": "completed", "tag": "338f624c-91a8-41ef-8270-e21128ea0f4f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:31.799506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-11aaeb47-d221-48be-ae3c-f238887b2780 req-32cdee3d-1acb-45c7-9d1c-4e4d6e838ada service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:31.804639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-11aaeb47-d221-48be-ae3c-f238887b2780 req-32cdee3d-1acb-45c7-9d1c-4e4d6e838ada service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:31.813860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-11aaeb47-d221-48be-ae3c-f238887b2780 req-32cdee3d-1acb-45c7-9d1c-4e4d6e838ada service nova] Creating event network-vif-plugged:338f624c-91a8-41ef-8270-e21128ea0f4f for instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 on n-h1-826756-5 Aug 03 04:51:31.819348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-11aaeb47-d221-48be-ae3c-f238887b2780 req-32cdee3d-1acb-45c7-9d1c-4e4d6e838ada service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Aug 03 04:51:31.821215 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2323/4656] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:32.011279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:32.012322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:32.033680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:32.034364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:32.035337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:32.035927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:32.274165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:32.286814 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab811f1f-6abb-4bbf-aa38-31bad1c6de50 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1314 microversion: 2.1 time: 0.279254 Aug 03 04:51:32.287717 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2334/4657] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:32 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:32.421442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-677138149", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "23e95ebe-0ca5-42dd-b9d2-bf3713e8b1d9"}, {"port": "c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70", "tag": "port-1"}, {"port": "437a55e5-d30f-4c6f-9001-dae1fc7f60f5", "tag": "port-2"}, {"uuid": "f80ee5b3-92bc-45f6-8a2f-9fdf64210401", "tag": "net-1"}, {"uuid": "f80ee5b3-92bc-45f6-8a2f-9fdf64210401"}, {"uuid": "681eee5c-a670-4462-b92d-c2d996a16616", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "681eee5c-a670-4462-b92d-c2d996a16616", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6d043914-587a-4caa-9985-372d407d9871", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4f5539c8-ee94-4fbe-8bf1-a0f83bf46cca", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "bdee47c8-959f-479b-afe6-9904386c9006", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1152190809"}], "key_name": "tempest-keypair-660885828", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:32.595736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1469024547", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:32.603697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] validate_networks() for [('23e95ebe-0ca5-42dd-b9d2-bf3713e8b1d9', None, None, None, None, None), (None, None, 'c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70', None, None, None), (None, None, '437a55e5-d30f-4c6f-9001-dae1fc7f60f5', None, None, None), ('f80ee5b3-92bc-45f6-8a2f-9fdf64210401', None, None, None, None, None), ('f80ee5b3-92bc-45f6-8a2f-9fdf64210401', None, None, None, None, None), ('681eee5c-a670-4462-b92d-c2d996a16616', '10.2.2.100', None, None, None, None), ('681eee5c-a670-4462-b92d-c2d996a16616', '10.2.2.200', None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:51:32.671016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] validate_networks() for [('e846b1ee-021c-4040-9e1d-a2601a896f4d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:51:33.516901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:51:33.518287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:51:33.525886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:51:33.526568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:51:33.527165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:51:33.545963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:33.546757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:33.547721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:33.548347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:33.581523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Getting quotas for project 22b4107a8b4e48189d60d8d32552402f. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:33.589205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Getting quotas for user d82f57fce2de44ca8ee2eb18f0b3e436 and project 22b4107a8b4e48189d60d8d32552402f. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:33.607031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:51:33.610816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:51:33.841995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e6de891-d3c9-4a22-be9d-4dc0c4cccb73 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.440714 Aug 03 04:51:33.850272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2324/4658] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:51:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:51:33.859384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:33.861892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:33.870349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:33.872718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:33.873751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:33.875267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:34.199078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:34.207589 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a1bc029-ab5a-458b-b864-7255cbeb76ce tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1486 microversion: 2.1 time: 0.355485 Aug 03 04:51:34.228315 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2325/4659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:33 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1486 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:34.237455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:34.238076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:34.259369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:34.259827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:34.260741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:34.261187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:34.600300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:34.612949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7aba6b6-b293-4440-bc74-b8514af1da55 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1489 microversion: 2.1 time: 0.383146 Aug 03 04:51:34.614435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2326/4660] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:34 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1489 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:34.638216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:34.639094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:34.645800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:34.647290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:34.648902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:34.649496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:34.995676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:35.003941 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-549e2479-8d15-4271-af1e-9635d32bbeb1 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1501 microversion: 2.1 time: 0.377183 Aug 03 04:51:35.007540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2327/4661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:34 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1501 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:35.024570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e847ee5-822a-4686-be9d-a56f40183b99 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:35.025278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e847ee5-822a-4686-be9d-a56f40183b99 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:35.172374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e847ee5-822a-4686-be9d-a56f40183b99 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:35.188790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e847ee5-822a-4686-be9d-a56f40183b99 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1223 microversion: 2.1 time: 0.175042 Aug 03 04:51:35.188790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2328/4662] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:35 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:35.209807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:35.215519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:35.228900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:35.234711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:35.234711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:35.234711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:35.290211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'flavor' on Instance uuid 3408908f-2b74-4693-a606-fd33b8b5c029 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:35.997490 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c80da02-45dc-4f8e-b2d9-60c575878f1a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029/action" status: 202 len: 0 microversion: 2.1 time: 0.788510 Aug 03 04:51:35.997490 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2329/4663] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:35 2022] POST /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:36.017423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1761660077"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:36.021956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:36.032483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.033258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.034211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.034809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.234731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9efdfbe5-55a0-4a65-bc2c-9bb7f9e3072e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "PUT /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1075 microversion: 2.1 time: 0.238017 Aug 03 04:51:36.235700 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2330/4664] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:51:35 2022] PUT /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1075 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:36.250145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:36.250927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:36.267838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.268562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.269538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.270146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.308489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lazy-loading 'flavor' on Instance uuid f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:36.430139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:51:36.430661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:51:36.433692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:51:36.435030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:51:36.435616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:51:36.449280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.450186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.451212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.451654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.471517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Getting quotas for project 90277125790c4575a67d25fff89029ae. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:51:36.477379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Getting quotas for user c278da47fdac47af94ed8d402bc76faf and project 90277125790c4575a67d25fff89029ae. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:51:36.715552 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea1fc49e-4cbe-403f-8abe-565b9aab65ec tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "POST /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895/action" status: 202 len: 0 microversion: 2.1 time: 0.477043 Aug 03 04:51:36.719786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2331/4665] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:36 2022] POST /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:36.739253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:36.740161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:51:36.747697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6d043914-587a-4caa-9985-372d407d9871',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4f5539c8-ee94-4fbe-8bf1-a0f83bf46cca',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdee47c8-959f-479b-afe6-9904386c9006',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:51:36.748321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:36.766611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.766611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.766611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.766611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.910137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:36.918705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff7a064f-a8aa-4420-8edb-9336af3a02d9 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1513 microversion: 2.1 time: 0.197243 Aug 03 04:51:36.919285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2332/4666] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:36 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:36.923683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:36.924413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:36.930251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.930698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.931454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:36.931887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:36.998018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:37.004808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70ab9608-5f32-44bc-ae8a-a4cb1190f8ab tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1219 microversion: 2.1 time: 0.084542 Aug 03 04:51:37.005393 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2333/4667] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:36 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:37.009918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:37.010519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:37.016399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.016852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.017607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.018040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.153434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:37.158750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a29f9d3-b4e8-4fb2-b400-48493e94c9b9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1501 microversion: 2.1 time: 0.152400 Aug 03 04:51:37.159326 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2334/4668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:37 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:37.171733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:37.172507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:37.179162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.179743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.180549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.180987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.316057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:37.322799 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22c624f6-6da2-4692-8265-d46d2c6c62d3 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1509 microversion: 2.1 time: 0.154906 Aug 03 04:51:37.323388 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2335/4669] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:37 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:37.328194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:37.328718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:37.334850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.335493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.336542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.336990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.362747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:37.367670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33758fab-f9cc-4b2e-8dcc-7b786cbf9a0b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/a4042db5-62e1-4b74-a461-7d11ee25b5c6" status: 200 len: 194 microversion: 2.1 time: 0.042443 Aug 03 04:51:37.368288 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2336/4670] 10.222.0.72 () {58 vars in 1413 bytes} [Wed Aug 3 04:51:37 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/a4042db5-62e1-4b74-a461-7d11ee25b5c6 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:37.372760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:37.373402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:37.379336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.379799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.380602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.381073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.552384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:37.559849 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-061d3c49-06e9-4e91-b299-90a70ccf5b23 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1501 microversion: 2.1 time: 0.190544 Aug 03 04:51:37.560443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2337/4671] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:37 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:37.565033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:37.565514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:37.571255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.571700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.572501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.572938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:37.666694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'services' on Instance uuid 650b5236-9353-4479-b9a6-cf30ffffc916 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:37.962193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-216b4e2e-eca6-430a-a99e-1dc7d9dcfcb4 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/a4042db5-62e1-4b74-a461-7d11ee25b5c6" status: 202 len: 0 microversion: 2.1 time: 0.398457 Aug 03 04:51:37.962827 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2338/4672] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:51:37 2022] DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments/a4042db5-62e1-4b74-a461-7d11ee25b5c6 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:37.982004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8187730a-da80-464a-abc0-d91a7ffaee6d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:37.998051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8187730a-da80-464a-abc0-d91a7ffaee6d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:37.998591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8187730a-da80-464a-abc0-d91a7ffaee6d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.028710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8187730a-da80-464a-abc0-d91a7ffaee6d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Going to try to stop instance {{(pid=120831) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:51:38.312431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8187730a-da80-464a-abc0-d91a7ffaee6d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "POST /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5/action" status: 202 len: 0 microversion: 2.1 time: 0.348191 Aug 03 04:51:38.313332 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2339/4673] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:37 2022] POST /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:38.318653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.319418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.326158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.326618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.327392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.328134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.479798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.499799 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c668b23-0214-44ce-916c-44ad6f78412b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1513 microversion: 2.1 time: 0.185415 Aug 03 04:51:38.500574 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2340/4674] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:38 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:38.501004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6fbfd3da-8d18-4e7a-b5c9-53901c969e6e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.083538 Aug 03 04:51:38.501924 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2335/4675] 10.222.0.72 () {62 vars in 1189 bytes} [Wed Aug 3 04:51:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 6085 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 04:51:38.506347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.506775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.507953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.508259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.516604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.517951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.518914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.519627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.536005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.536738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.538789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.539419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.598836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.610203 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-391750d7-3999-4274-857e-77fcdd053cd0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1281 microversion: 2.1 time: 0.107840 Aug 03 04:51:38.610804 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2341/4676] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:38 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:38.615911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.618154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.626973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.627428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.628238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.628715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.772062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.780828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26571711-c51d-4c1f-bb25-e99286a692f6 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.277508 Aug 03 04:51:38.781242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2336/4677] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:38 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:38.786000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.786856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.909871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.924056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.925442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.927304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:38.934889 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b12e0286-a5bc-4422-b7e3-3d7e7248c7d2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1284 microversion: 2.32 time: 0.151201 Aug 03 04:51:38.934889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2337/4678] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:38 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:38.939283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1f9f865-f498-4caf-9ef2-e0dc5b809825 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1492 microversion: 2.1 time: 0.327102 Aug 03 04:51:38.944972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2342/4679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:38 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1492 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:38.971351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:38.972300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:38.980032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.980859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.981847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:38.982970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:38.991045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:39.029681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:51:39.343095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:39.462701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f98b39a-ca6b-441b-9509-0f368882a31f tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 204 len: 0 microversion: 2.1 time: 0.496062 Aug 03 04:51:39.463298 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2338/4680] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:38 2022] DELETE /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:51:39.472375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:39.473284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:39.481026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.481794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.482638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.483182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.536892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:39.551067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:39.567532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.568299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.569455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.570734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.936682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:39.937030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:39.947976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85042201-8f4a-4697-b644-42c8ce8d7066 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1498 microversion: 2.1 time: 0.480371 Aug 03 04:51:39.948612 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2343/4681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:39 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1498 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:39.952692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd01a621-26e5-42ca-b6c0-e20087ad83c3 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.421549 Aug 03 04:51:39.953559 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2339/4682] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:39 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:39.954450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:39.955468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:39.962053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.962691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.965333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.965791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.977051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:39.978144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:39.986653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.987307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:39.988614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:39.989177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:40.304357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:40.312473 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1e83a25-43fe-4453-8fc8-d74e055a6c8c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 0.362647 Aug 03 04:51:40.313112 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2344/4683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:39 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:40.322539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:40.332760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:40.333394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:40.350385 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2aa0023f-a347-438d-97c0-b30f0dfa9d1e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.378380 Aug 03 04:51:40.365830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2340/4684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:39 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:40.428116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-89b7b8dc-3b11-4d5b-90a3-538ff0d3818d req-9a2ee9a5-2ea7-4391-a813-6252f36de3ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:40.434981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:40.444841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:40.446773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-89b7b8dc-3b11-4d5b-90a3-538ff0d3818d req-9a2ee9a5-2ea7-4391-a813-6252f36de3ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:40.447407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-89b7b8dc-3b11-4d5b-90a3-538ff0d3818d req-9a2ee9a5-2ea7-4391-a813-6252f36de3ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:40.452192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:40.453523 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec603f65-43c8-4e29-a8e0-d57b1d8d31ff tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1284 microversion: 2.32 time: 0.139488 Aug 03 04:51:40.456735 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2345/4685] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:40 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:40.473325 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-89b7b8dc-3b11-4d5b-90a3-538ff0d3818d req-9a2ee9a5-2ea7-4391-a813-6252f36de3ac service nova] Creating event network-changed:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:51:40.479638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-89b7b8dc-3b11-4d5b-90a3-538ff0d3818d req-9a2ee9a5-2ea7-4391-a813-6252f36de3ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056350 Aug 03 04:51:40.480596 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2341/4686] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:51:40.984176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:40.985892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:40.989630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:40.990663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:41.009785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.011853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.013718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.015116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.016514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.021426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.023536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.025481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.689726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:41.701611 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4aa4c916-7903-4c5f-95d1-8d006fa662ef tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1498 microversion: 2.1 time: 0.735443 Aug 03 04:51:41.706133 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2346/4687] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:40 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1498 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:41.720968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2c24a551-863a-41c8-8a13-0b1b8ffd7211 req-c234712a-0730-4a9e-9be3-cbdcae42698a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408908f-2b74-4693-a606-fd33b8b5c029", "name": "network-vif-plugged", "status": "completed", "tag": "086aec99-839d-41e8-b1c0-793ede1f75dc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:41.755064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2c24a551-863a-41c8-8a13-0b1b8ffd7211 req-c234712a-0730-4a9e-9be3-cbdcae42698a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.755515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2c24a551-863a-41c8-8a13-0b1b8ffd7211 req-c234712a-0730-4a9e-9be3-cbdcae42698a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.780253 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2c24a551-863a-41c8-8a13-0b1b8ffd7211 req-c234712a-0730-4a9e-9be3-cbdcae42698a service nova] Creating event network-vif-plugged:086aec99-839d-41e8-b1c0-793ede1f75dc for instance 3408908f-2b74-4693-a606-fd33b8b5c029 on n-h1-826756-5 Aug 03 04:51:41.785752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2c24a551-863a-41c8-8a13-0b1b8ffd7211 req-c234712a-0730-4a9e-9be3-cbdcae42698a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078305 Aug 03 04:51:41.787349 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2347/4688] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:41.797442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:41.797442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:41.798239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:41.805019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.805649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.807250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.807843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.875645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:41.885509 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5f3ac69-ef43-4671-98d2-0852e05a4db5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.912104 Aug 03 04:51:41.912015 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2342/4689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:40 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:41.912015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:41.912015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:41.916990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.917932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:41.926088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:41.926868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.419395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.429207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1897af2e-9b7a-450d-9055-b5d09acb3e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 0.639477 Aug 03 04:51:42.430051 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2348/4690] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:41 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:42.447719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:42.449907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:42.466710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.467202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.470183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.470663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.578026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.589005 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a793e852-89e4-42ac-a2b4-01d158829242 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.685833 Aug 03 04:51:42.591413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2343/4691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:41 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:42.707489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.731743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:42.732635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:42.744910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.745672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.751600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.752350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.757145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.763705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.765177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d1cb0a9-58b7-4920-8b5f-99ac6bac8bcf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1574 microversion: 2.32 time: 0.329874 Aug 03 04:51:42.773996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2349/4692] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:42 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1574 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:42.812024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9ba3e843-7189-40c5-9842-5a235954a0a7 req-b28a7b9e-5ee5-444c-bc32-b0536c36943a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f5c36b-8a89-4a08-9b56-fe0b02ce4895", "name": "network-vif-deleted", "tag": "338f624c-91a8-41ef-8270-e21128ea0f4f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:42.828117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9ba3e843-7189-40c5-9842-5a235954a0a7 req-b28a7b9e-5ee5-444c-bc32-b0536c36943a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.829409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9ba3e843-7189-40c5-9842-5a235954a0a7 req-b28a7b9e-5ee5-444c-bc32-b0536c36943a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.865380 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9ba3e843-7189-40c5-9842-5a235954a0a7 req-b28a7b9e-5ee5-444c-bc32-b0536c36943a service nova] Creating event network-vif-deleted:338f624c-91a8-41ef-8270-e21128ea0f4f for instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 on n-h1-826756-5 Aug 03 04:51:42.872042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9ba3e843-7189-40c5-9842-5a235954a0a7 req-b28a7b9e-5ee5-444c-bc32-b0536c36943a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064495 Aug 03 04:51:42.874857 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2350/4693] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:51:42.909285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:42.911096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:42.926888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:42.934014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.934712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.935226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ac5d9ae-fb0f-4ea3-b1cb-48c48e08dc2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1456 microversion: 2.1 time: 0.207640 Aug 03 04:51:42.935830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:42.936461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:42.948326 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2344/4694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:42 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1456 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:43.242810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:43.252786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-554a1d48-01f5-4b0f-a8bb-fd12f347e110 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.349159 Aug 03 04:51:43.257160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2351/4695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:42 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:43.453583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:43.454286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:43.465971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.466711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:43.467668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.468282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:43.617783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:43.618686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:43.621406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:43.633741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.635017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:43.636104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.637000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:43.820193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:43.831382 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1bbc0a75-1fad-4d2c-9275-23d02deda13f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 0.382132 Aug 03 04:51:43.832286 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2345/4696] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:43 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:43.840226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:43.841403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:43.852142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.853252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:43.854318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:43.855111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.035579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:44.047865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:44.055326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:44.058567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54b183e7-c12b-4585-9cbf-e55071c500dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1592 microversion: 2.32 time: 0.225071 Aug 03 04:51:44.061057 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2346/4697] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:43 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1592 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:44.097745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:44.098773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:44.125410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.134627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.134627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.134627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.144151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:44.172566 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1b0bbec4-1343-418c-933c-329fefad1e67 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.559348 Aug 03 04:51:44.174403 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2352/4698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:43 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:44.232068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.233993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.235367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lazy-loading 'fault' on Instance uuid f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:44.297679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:44.301820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:44.331347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.331968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.336116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.338962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.347268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e427de1035e541b59256dd0adfdfee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c26b3b9a2e94f5f8568efdc21c4c5a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:44.358212 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-095f2e53-f500-464c-8a74-d0645925e14e tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 200 len: 1304 microversion: 2.1 time: 0.294355 Aug 03 04:51:44.363877 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2347/4699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:44 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:44.853563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:44.854294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:44.862367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.865005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:44.866117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:44.866799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:45.016931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:45.025891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a30d879e-71f2-43c9-ab86-00e75cc8d47d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.745559 Aug 03 04:51:45.031100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2353/4700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:44 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:45.086389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:45.087314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:45.097625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:45.098976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:45.100202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:45.100901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:45.106935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:45.921777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:45.937615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:45.941552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:45.944945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7eeb46e-c2cf-43b6-a328-0401080e86ef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1592 microversion: 2.32 time: 0.863014 Aug 03 04:51:45.945560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2354/4701] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:45 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1592 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:51:45.954875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:45.955929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:45.966431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:45.967169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:45.968143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:45.968771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:45.992931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:46.002817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f535e8b0-2c93-4d50-88f4-3324b72ab894 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 1.153563 Aug 03 04:51:46.011145 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2348/4702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:44 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:46.013459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.014311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.023890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.024589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.025610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.028835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.047383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 HTTP/1.1 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f0f5c36b-8a89-4a08-9b56-fe0b02ce4895'} Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.049187 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dafc4825-c380-4008-b7c5-1ae062de32d0 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 404 len: 111 microversion: 2.1 time: 0.046028 Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2349/4703] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.061039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.067828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.068312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.069699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.070131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.155069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc77a2ad-4585-4900-b4ba-5d2ff66d6b4f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102015 Aug 03 04:51:46.155774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2350/4704] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:51:46.163269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.164251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.174052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.174607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.175790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.176446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.409558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:46.415653 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94062730-2a79-41b7-ab0c-79e175bb9864 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.468175 Aug 03 04:51:46.421671 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2355/4705] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:45 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:46.451365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.452225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.461760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:46.461914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.469166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.470071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.470538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.491356 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 HTTP/1.1 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f0f5c36b-8a89-4a08-9b56-fe0b02ce4895'} Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.502318 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.507292 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.511729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.519290 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eae31d06-ed61-447c-a821-8ffc65e6add8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 404 len: 111 microversion: 2.1 time: 0.083887 Aug 03 04:51:46.531180 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2356/4706] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:46 2022] DELETE /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:46.531340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:46.531440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.534727 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d71a09f2-5714-4d10-b54a-2d511278b06e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.377604 Aug 03 04:51:46.537028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.539690 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2351/4707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:46.549392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.557030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.557662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: f0f5c36b-8a89-4a08-9b56-fe0b02ce4895] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.558269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.559353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.560015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.577801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.578272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.579348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.579801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.620885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84af729d-6acc-4bf0-b2b3-aa65886d990d tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098874 Aug 03 04:51:46.622309 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2357/4708] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:51:46.625430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 HTTP/1.1 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f0f5c36b-8a89-4a08-9b56-fe0b02ce4895'} Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.633464 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.637644 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-afa751f7-850e-44dd-9405-ca0bf99f90fa tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895" status: 404 len: 111 microversion: 2.1 time: 0.089615 Aug 03 04:51:46.639339 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2352/4709] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/f0f5c36b-8a89-4a08-9b56-fe0b02ce4895 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:46.653351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.654553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.680119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.686812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.689049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.692058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.744970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed HTTP/1.1 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a6ea3a7a-2074-4db3-aa1b-3faf477d22ed'} Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.749135 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.752641 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.754653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.755746 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d2f6b61-23b2-4d28-86a2-d7d7ced9b508 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 404 len: 111 microversion: 2.1 time: 0.114741 Aug 03 04:51:46.757289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2358/4710] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:46 2022] DELETE /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:46.765356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.765982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a6ea3a7a-2074-4db3-aa1b-3faf477d22ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.778128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.778878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.779812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.780432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.783723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.784415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.799845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.800637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.807641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.808948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.809712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed HTTP/1.1 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a6ea3a7a-2074-4db3-aa1b-3faf477d22ed'} Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.824545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. Aug 03 04:51:46.828061 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.829759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a6ea3a7a-2074-4db3-aa1b-3faf477d22ed could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.831124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db5be382-2725-4e8e-8a99-3144ad1f79bd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed" status: 404 len: 111 microversion: 2.1 time: 0.069694 Aug 03 04:51:46.837600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2353/4711] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/a6ea3a7a-2074-4db3-aa1b-3faf477d22ed => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:46.847313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.848132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.857923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.866434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:51:46.868151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.869299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.869946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.890871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e HTTP/1.1 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0eb81dbc-92a7-4589-b911-665d67b1a77e'} Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.892924 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.896159 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.898402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.899557 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53138b7f-0d5f-4bdb-a2ac-b66749dad4ff tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 404 len: 111 microversion: 2.1 time: 0.057722 Aug 03 04:51:46.900390 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2354/4712] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:46 2022] DELETE /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:51:46.909154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.910157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 0eb81dbc-92a7-4589-b911-665d67b1a77e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.919186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.920025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.921283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.922112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.946284 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e HTTP/1.1 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0eb81dbc-92a7-4589-b911-665d67b1a77e'} Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:46.948375 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. Aug 03 04:51:46.951781 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:46.953613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 0eb81dbc-92a7-4589-b911-665d67b1a77e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:46.954654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30105f2e-77fb-46da-ad7e-3703153a0f96 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e" status: 404 len: 111 microversion: 2.1 time: 0.050109 Aug 03 04:51:46.955971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2355/4713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:46 2022] GET /compute/v2.1/servers/0eb81dbc-92a7-4589-b911-665d67b1a77e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:51:46.969029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:46.969541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:46.986153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.986632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:46.987480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:46.987983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.015789 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 HTTP/1.1 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '795e0524-9b2c-4ec3-acf8-648505e27711'} Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:47.024940 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d00b96f4-151a-4ae1-8b2c-3f252c8819f6 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 404 len: 111 microversion: 2.1 time: 0.058767 Aug 03 04:51:47.029621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2356/4714] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:46 2022] DELETE /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:47.033052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.033735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.041741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.042203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.042997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.043431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.067483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:47.339517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:47.358000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:47.359580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:47.361430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dde25712-fbd1-42e3-a9ef-ac540becfcc8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1660 microversion: 2.32 time: 0.335547 Aug 03 04:51:47.382525 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90cda0f1-854c-4fac-ac09-bee1d3924454 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 204 len: 0 microversion: 2.1 time: 0.609206 Aug 03 04:51:47.383156 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2359/4715] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:46 2022] DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:51:47.388550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.389255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.393648 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2357/4716] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1660 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:47.401465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.401925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.402712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.403152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.404088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.404756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 795e0524-9b2c-4ec3-acf8-648505e27711] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.425590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.426103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.426947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.427876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.451464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 HTTP/1.1 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '795e0524-9b2c-4ec3-acf8-648505e27711'} Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.453641 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 795e0524-9b2c-4ec3-acf8-648505e27711 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:47.457498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0bfb9137-6c10-4694-8ef6-e7899c266c2c tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711" status: 404 len: 111 microversion: 2.1 time: 0.061194 Aug 03 04:51:47.461388 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2358/4717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/795e0524-9b2c-4ec3-acf8-648505e27711 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:47.473825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.474470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.483597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.484069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.485079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.485533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.853246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:47.862044 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d82b191-0b8c-4c11-9eb3-d9362f36e7ba tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1674 microversion: 2.1 time: 0.399541 Aug 03 04:51:47.876221 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2359/4718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1674 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:47.916396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.918516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.922827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:47.935509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.935997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.939149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:47.939577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:47.939694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6238649-f440-4888-9d83-67434f523821 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 0.555203 Aug 03 04:51:47.940225 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2360/4719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:47.946361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:47.951600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:47.958931 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 HTTP/1.1 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ddff9eeb-e236-44a8-904a-d96a4275e1c0'} Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.962136 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:47.968816 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:47.971513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:47.973973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b9bdda6-a281-4808-a8bf-784f4ff24cbd tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0" status: 404 len: 111 microversion: 2.1 time: 0.031002 Aug 03 04:51:47.978312 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2361/4720] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:47 2022] DELETE /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:47.997367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:48.002413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:48.015310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.033212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.039984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.042304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.544972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:48.549103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:48.567665 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c00226c5-0747-48dc-a659-3e2df343b131 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.581028 Aug 03 04:51:48.567665 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2362/4721] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:48.569809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:48.570010 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab100c56-9035-43cf-9fe8-89fb83043e21 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.691641 Aug 03 04:51:48.570835 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2360/4722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:47 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:48.571145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: ddff9eeb-e236-44a8-904a-d96a4275e1c0] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:48.590707 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:48.594072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-163c962e-0d7f-494e-bc41-fead2bd0a26c req-2c933577-ef0e-4dd8-b071-015fca68c288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "name": "network-vif-plugged", "status": "completed", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 HTTP/1.1 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ddff9eeb-e236-44a8-904a-d96a4275e1c0'} Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:48.595522 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:48.599375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance ddff9eeb-e236-44a8-904a-d96a4275e1c0 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:48.600355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fe82f79-01df-4f46-abb2-7d6d3780fb70 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0" status: 404 len: 111 microversion: 2.1 time: 0.035297 Aug 03 04:51:48.609567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2363/4723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:48 2022] GET /compute/v2.1/servers/ddff9eeb-e236-44a8-904a-d96a4275e1c0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:48.610176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-163c962e-0d7f-494e-bc41-fead2bd0a26c req-2c933577-ef0e-4dd8-b071-015fca68c288 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.610176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-163c962e-0d7f-494e-bc41-fead2bd0a26c req-2c933577-ef0e-4dd8-b071-015fca68c288 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.617143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:48.617694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:48.633558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.634028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.635823 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-163c962e-0d7f-494e-bc41-fead2bd0a26c req-2c933577-ef0e-4dd8-b071-015fca68c288 service nova] Creating event network-vif-plugged:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:51:48.641702 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-163c962e-0d7f-494e-bc41-fead2bd0a26c req-2c933577-ef0e-4dd8-b071-015fca68c288 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057691 Aug 03 04:51:48.642513 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2361/4724] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:48.649134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.649607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.890251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:48.902169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:48.902886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:48.903353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:48.905332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:48.906825 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e3a9b20c-167c-48bc-b464-ee7d3c29ca03 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1707 microversion: 2.32 time: 0.294339 Aug 03 04:51:48.908164 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2364/4725] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:48 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1707 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:48.919907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:48.922200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.922929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.923896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.928936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.963131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:48.964932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:48.977598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.982233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:48.985207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:48.987047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:49.462447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:49.470061 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e91d6b51-5106-4da4-8be6-ff5d8a0a25dd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1674 microversion: 2.1 time: 0.573597 Aug 03 04:51:49.477451 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2362/4726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:48 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1674 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:49.509130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:49.533585 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70344b1f-51c5-4dfb-84a3-2942ea4e0658 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1323 microversion: 2.1 time: 0.575756 Aug 03 04:51:49.534796 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2365/4727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:48 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:49.592027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:49.593566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:49.597083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:49.597706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:49.604627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:49.605069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:49.606254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:49.606845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:49.612669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:49.613141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:49.613933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:49.614387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.072297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:50.080586 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a20ecdc1-00c2-4ec0-ac9c-6898aa248a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.493796 Aug 03 04:51:50.086146 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2363/4728] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:49 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:50.106359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:50.107478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:50.124019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.124811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.125827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.126465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.392816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:50.401592 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b184157-75ab-48dc-ab49-843b4c24e989 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.811277 Aug 03 04:51:50.402155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2366/4729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:49 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:50.499166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:50.500010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:50.502183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:50.534986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.540872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.545906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.546376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.761166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:50.786119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:50.787749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:50.789002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d94942cb-2c1a-4707-bd92-44605189fb90 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1707 microversion: 2.32 time: 0.701676 Aug 03 04:51:50.795888 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2364/4730] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:50 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1707 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:50.827045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:50.828177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:50.836872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.837781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:50.838894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:50.839597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.028569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:51.040891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2b6ed52d-2941-4ff7-bf55-ec6e4517e968 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1674 microversion: 2.1 time: 0.547167 Aug 03 04:51:51.041864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2367/4731] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:50 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1674 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:51.106794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:51.107650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:51.128040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.128784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.129714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.130298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.191677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:51.204823 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c6d7f9b-5974-4649-8497-acd73b437ab0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1518 microversion: 2.1 time: 0.389661 Aug 03 04:51:51.205886 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2365/4732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:50 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1518 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:51.230842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:51.233452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:51.246877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.249664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.250651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.252845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.308015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lazy-loading 'flavor' on Instance uuid fafd9a96-b3f1-4ae1-ac39-604a0b4f569a {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:51.741771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:51.760069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f38becb5-9ae1-46a3-b256-81e2d38feff6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.656979 Aug 03 04:51:51.768430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9b61dd8-830a-48b5-b94f-53ce10deda12 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action" status: 200 len: 32 microversion: 2.1 time: 0.542595 Aug 03 04:51:51.774811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2366/4733] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:51:51 2022] POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action => generated 32 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:51:51.778034 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2368/4734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:51 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:51.805635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:51.807928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:51.808081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:51.809048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:51.816659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.817235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.818128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.820969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.827131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.829940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:51.829940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:51.829940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.158199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:53.170351 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41490772-11eb-4a6a-aab6-fb5c7efe6609 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 1.398686 Aug 03 04:51:53.173520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2367/4735] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:51 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:53.188748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:53.192147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:53.199760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.200480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.201553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.202141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.227819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:53.259120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55542d16-ef20-497a-8307-919cdf39595d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 1.440424 Aug 03 04:51:53.259120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2369/4736] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:51 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:53.259120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:53.259120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:53.275014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.278986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.279938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.282629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.834485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:53.845192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80f9fba8-cf93-48e2-bf5c-10f96be5cf83 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1606 microversion: 2.1 time: 0.604558 Aug 03 04:51:53.859100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2370/4737] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:53 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1606 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:53.859100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:53.859100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:53.904239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.905236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.906486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:53.907143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:53.985365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:54.013393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:54.024768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:54.026537 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47ce8ab9-07dd-4212-8fd9-e57c589b3418 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1754 microversion: 2.32 time: 0.851774 Aug 03 04:51:54.029270 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2368/4738] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:53 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1754 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:54.040465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e6505180-5ed6-4d8e-b490-bd496a9a1ce2 req-a097190e-040b-4b69-9458-ff324a3f8782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650b5236-9353-4479-b9a6-cf30ffffc916", "name": "network-vif-deleted", "tag": "4b85bf78-bb3a-4622-91f0-122d17f859c8"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:54.087644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e6505180-5ed6-4d8e-b490-bd496a9a1ce2 req-a097190e-040b-4b69-9458-ff324a3f8782 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.090979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e6505180-5ed6-4d8e-b490-bd496a9a1ce2 req-a097190e-040b-4b69-9458-ff324a3f8782 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.123001 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e6505180-5ed6-4d8e-b490-bd496a9a1ce2 req-a097190e-040b-4b69-9458-ff324a3f8782 service nova] Creating event network-vif-deleted:4b85bf78-bb3a-4622-91f0-122d17f859c8 for instance 650b5236-9353-4479-b9a6-cf30ffffc916 on n-h1-826756-5 Aug 03 04:51:54.142900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e6505180-5ed6-4d8e-b490-bd496a9a1ce2 req-a097190e-040b-4b69-9458-ff324a3f8782 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112096 Aug 03 04:51:54.147914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2369/4739] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:54.207658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:54.210989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:54.218364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.219267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.220878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.221547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.797445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:54.817201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a009d437-3005-4c88-ae34-ef558457e5c7 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.966265 Aug 03 04:51:54.832884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:54.836383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2371/4740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:53 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:54.838031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41384c85-5f67-4fab-869a-4375bad629ec tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.641717 Aug 03 04:51:54.840171 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2370/4741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:54 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:54.844485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:54.845284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:54.857573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.857573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.858128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.858734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.876908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:54.877537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:54.884910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:54.893018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.893018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.893018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.893018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.942015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:54.942683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:54.943115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lazy-loading 'fault' on Instance uuid 650b5236-9353-4479-b9a6-cf30ffffc916 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:51:55.056822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ebe6f390e2741058f63638d0b22eac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb38f33edc704bb39daf9765439257d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:55.076048 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c87244ec-9d9c-405f-a9d9-72305d35fd9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 200 len: 1328 microversion: 2.1 time: 0.206836 Aug 03 04:51:55.080870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2371/4742] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:54 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 1328 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:51:55.104173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:55.105103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:55.146486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.146971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:55.147805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.148255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:55.399473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:55.413321 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29ea22bf-ec2f-4131-9623-91cd260f6e50 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.574702 Aug 03 04:51:55.419649 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2372/4743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:54 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:55.801432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:55.833125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:55.833125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:55.833125 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1dfb674f-7700-4048-8096-9779391bef20 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1801 microversion: 2.32 time: 0.739725 Aug 03 04:51:55.834812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2372/4744] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:55 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1801 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:55.856871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:55.859206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:55.878624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.879533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:55.880651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.882055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:55.906451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:55.907073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:55.917954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.922332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:55.925223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:55.925682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.579033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:56.605130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:51:56.612573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad554edb-85ae-4943-8a09-9f5b5a5b65cf tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.710584 Aug 03 04:51:56.613492 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2373/4745] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:55 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:56.624965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:56.625857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:56.648983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.649845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.650924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.651594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.688391 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 HTTP/1.1 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '052aabd9-41dd-49ad-a810-45f88f53dc96'} Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:56.713365 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.717992 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.721939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:56.723929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8b2d990-666d-41ac-9aea-e6b63d332780 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 404 len: 111 microversion: 2.1 time: 0.108622 Aug 03 04:51:56.728788 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2374/4746] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:56 2022] DELETE /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:56.736966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:56.738013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:56.755355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.757429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.758742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.759524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.782706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:56.795442 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93461941-1df1-4bcd-b65c-d526c1d6e913 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.955708 Aug 03 04:51:56.796370 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2373/4747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:55 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:56.807028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:56.828177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:51:56.828931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 HTTP/1.1 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '650b5236-9353-4479-b9a6-cf30ffffc916'} Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.842018 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.845539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:56.847624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffd6e407-9e3d-4016-9596-fc0626c5691f tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 404 len: 111 microversion: 2.1 time: 0.116248 Aug 03 04:51:56.853862 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2375/4748] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:56 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:56.854671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.855238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.856141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.857443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.877389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:56.878477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: 052aabd9-41dd-49ad-a810-45f88f53dc96] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:56.889018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.890754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.891757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.892631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.917859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 HTTP/1.1 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '052aabd9-41dd-49ad-a810-45f88f53dc96'} Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:56.921501 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance 052aabd9-41dd-49ad-a810-45f88f53dc96 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcf7b1ba-c16f-47cc-a683-8245f0e56014 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96" status: 404 len: 111 microversion: 2.1 time: 0.052256 Aug 03 04:51:56.934263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2376/4749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:56 2022] GET /compute/v2.1/servers/052aabd9-41dd-49ad-a810-45f88f53dc96 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:56.950454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:56.951578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:56.962286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.963079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:56.964373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:56.967450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.311783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:57.327495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab06d56a-4178-44eb-979e-0922049c5c1b tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.529758 Aug 03 04:51:57.332066 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2374/4750] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:56 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:57.346905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11aef503-fb44-4c9a-9a2d-8253395f1ecf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '.version_select at 0x7fdd548a6670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:57.452189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:57.456950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11aef503-fb44-4c9a-9a2d-8253395f1ecf tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408423200" status: 202 len: 0 microversion: 2.1 time: 0.123589 Aug 03 04:51:57.458682 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2375/4751] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:51:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408423200 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:51:57.466943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:57.467713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:57.476996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.479423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.480518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.482542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.487550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:57.487550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:57.494122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27503af2-29ee-49c3-b42c-b8086535939d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1801 microversion: 2.32 time: 0.555524 Aug 03 04:51:57.494735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2377/4752] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:56 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1801 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:51:57.515500 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 HTTP/1.1 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a337e213-31f3-4906-bfcb-aaf764643609'} Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:57.517316 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:57.524228 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e35feae-27e1-4c32-af5c-bc1db106549d tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 404 len: 111 microversion: 2.1 time: 0.058838 Aug 03 04:51:57.532960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:57.532960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] [instance: a337e213-31f3-4906-bfcb-aaf764643609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:57.533188 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2376/4753] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:51:57 2022] DELETE /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:57.534643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.535156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.535937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.536406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.567772 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] HTTP exception thrown: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Request method failure captured: Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 HTTP/1.1 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f2PZQzngaxvMv0RDqTBNZNNCLK8iDuaSzhrl0PBRLaMJytJZwN1eA41ULp3AE2fvA87y_h7ndv_SWwH8nQ-64rYmtCanOEJlHS38lvY8sZRF1Ef6idUoko6KYtEt-jflzggQFPovpABsHVecvynwOjlHRNV0HFgzhz-8_KN8nRkNGA Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c26b3b9a2e94f5f8568efdc21c4c5a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c26b3b9a2e94f5f8568efdc21c4c5a1 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-1912605688 Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e427de1035e541b59256dd0adfdfee2e Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-1912605688-project Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a337e213-31f3-4906-bfcb-aaf764643609'} Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:51:57.570025 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] Returning 404 to user: Instance a337e213-31f3-4906-bfcb-aaf764643609 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:51:57.576943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30720f6f-0ffb-4e8d-9861-c376b36745e8 tempest-DeleteServersTestJSON-1912605688 tempest-DeleteServersTestJSON-1912605688-project] 10.222.0.72 "GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609" status: 404 len: 111 microversion: 2.1 time: 0.049756 Aug 03 04:51:57.595173 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2378/4754] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:57 2022] GET /compute/v2.1/servers/a337e213-31f3-4906-bfcb-aaf764643609 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:51:57.629070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28080298-5de8-4294-945e-00d5a3150961"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:51:57.635274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:57.643165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:57.646060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:57.669885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.672099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.673133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.674666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.675503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.675700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:57.675947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:57.676600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:58.254365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:58.270196 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8fd5ae95-77b9-4b44-a6b0-87a6feb3c2ca tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.635167 Aug 03 04:51:58.271949 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2379/4755] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:57 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:58.293159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:58.297310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:58.324972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:58.327254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:58.337323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:58.338038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:58.791798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a43847d0-b37e-4206-a5a5-e875a23d34a6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.166852 Aug 03 04:51:58.797795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2377/4756] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:51:57 2022] POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:51:58.803987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:58.809454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:58.829208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:58.832549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:58.834589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:58.843681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:59.220394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:59.229239 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88d984ea-e37d-4ce8-b09c-831dd0883bdc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.955911 Aug 03 04:51:59.235114 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2380/4757] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:58 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:59.263231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:59.263859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:59.280706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:59.281157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:59.281951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:59.282383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:59.795380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:59.806401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-619b01f0-8273-4720-b5b4-970c0b826bf8 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 1.007086 Aug 03 04:51:59.819220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2378/4758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:58 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:51:59.830965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:51:59.835856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:51:59.849565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:59.852622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:59.853656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:51:59.854141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:51:59.863859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:59.875742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:59.878329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:51:59.879774 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f027f02f-824f-4e76-8d00-a0ad6779fb4c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1848 microversion: 2.32 time: 0.629973 Aug 03 04:51:59.881244 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2381/4759] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:51:59 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1848 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:00.261903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:00.262439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:00.281346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.281993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:00.282600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.283037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:00.646127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:00.654798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a7e6103-0e9c-482b-8047-a1d2159800f7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.833938 Aug 03 04:52:00.655467 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2379/4760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:51:59 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:00.831116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:00.831845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:00.839846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.840530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:00.841557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.842012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:00.883473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:00.894747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0052fb8b-647d-4058-81a1-21fbbd39cdeb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.636608 Aug 03 04:52:00.895501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2382/4761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:00 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:00.916088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:00.917061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:00.924007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.924675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:00.925865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:00.932374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.321991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:01.329820 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e731ac1-43f2-48a1-b222-6f893e712b01 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.503511 Aug 03 04:52:01.330700 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2380/4762] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:00 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:01.335829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0e27bd80-1744-426c-b6b8-15b3634e8f56 req-b9e69884-1292-47f5-b7a0-23bdafaee9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "e34306e5-c6ae-4036-861c-45f67d309de1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:01.345683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0e27bd80-1744-426c-b6b8-15b3634e8f56 req-b9e69884-1292-47f5-b7a0-23bdafaee9d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:01.346347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0e27bd80-1744-426c-b6b8-15b3634e8f56 req-b9e69884-1292-47f5-b7a0-23bdafaee9d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.359850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0e27bd80-1744-426c-b6b8-15b3634e8f56 req-b9e69884-1292-47f5-b7a0-23bdafaee9d0 service nova] Creating event network-changed:e34306e5-c6ae-4036-861c-45f67d309de1 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:01.364907 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0e27bd80-1744-426c-b6b8-15b3634e8f56 req-b9e69884-1292-47f5-b7a0-23bdafaee9d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 Aug 03 04:52:01.366231 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2381/4763] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:01.377458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:01.388983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:01.390808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:01.392214 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-643fe698-af3a-47c8-be1b-d52ec8fb5f39 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1848 microversion: 2.32 time: 0.485786 Aug 03 04:52:01.393304 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2383/4764] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:00 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1848 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:01.676839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:01.678456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:01.685096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:01.685816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.686702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:01.687230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.918100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:01.919092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:01.930949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:01.931768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.932890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:01.933339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:01.974653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:01.983989 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da20c894-d3c9-4998-aff4-8ce8d379203b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.311252 Aug 03 04:52:01.984851 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2382/4765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:01 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:02.353931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:02.355467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:02.365363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:02.366114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:02.367153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:02.367768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:02.375756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:02.385432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3d85a102-c45a-4dec-ba4c-22610176ecd1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.472654 Aug 03 04:52:02.387914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2384/4766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:01 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:02.420301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:02.421820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:02.424779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:02.433260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:02.433781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:02.434566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:02.435501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:03.054330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.063177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d950c34e-bd94-47ac-aaf9-28c036a56711 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.714523 Aug 03 04:52:03.073960 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2383/4767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:02 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:03.087251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:03.088390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:03.094886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:03.098247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:03.098247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:03.098247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:03.147227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.171234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.174048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.180761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e33e0b4b-af9a-47ed-a383-47e8f453a52d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1869 microversion: 2.32 time: 0.765059 Aug 03 04:52:03.203089 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2385/4768] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:02 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1869 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:03.409876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:03.411372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:03.420395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:03.423792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:03.423792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:03.423792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:03.894758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.904505 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1c3aa5cb-a786-41eb-83e8-7a11b07ebae7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.828787 Aug 03 04:52:03.919156 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2384/4769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:03 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:03.965051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:03.977124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d148b7ba-3dfc-46b3-813f-1633e462687e tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1505 microversion: 2.1 time: 0.571401 Aug 03 04:52:03.996761 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2386/4770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:03 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1505 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:04.085951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-16478713-13cc-4bad-bb9b-3efe1a7d7cd1 req-95efd878-80eb-4729-be34-81ace53ecf89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:04.088215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:04.089048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:04.097072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.097804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.098749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.099013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-16478713-13cc-4bad-bb9b-3efe1a7d7cd1 req-95efd878-80eb-4729-be34-81ace53ecf89 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.099611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.100107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-16478713-13cc-4bad-bb9b-3efe1a7d7cd1 req-95efd878-80eb-4729-be34-81ace53ecf89 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.118532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-16478713-13cc-4bad-bb9b-3efe1a7d7cd1 req-95efd878-80eb-4729-be34-81ace53ecf89 service nova] Creating event network-changed:c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:04.124616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-16478713-13cc-4bad-bb9b-3efe1a7d7cd1 req-95efd878-80eb-4729-be34-81ace53ecf89 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044573 Aug 03 04:52:04.125709 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2385/4771] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:04.213282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:04.214058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:04.222885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.228003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.228003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.228003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.728970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:04.748681 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-597ee389-16f7-4668-bc91-702c5b74e237 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.664620 Aug 03 04:52:04.755118 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2387/4772] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:04 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:04.763717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:04.773224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:04.774743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:04.775915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ca1f99b-208a-4222-8992-c756afe2b7c6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1869 microversion: 2.32 time: 0.568215 Aug 03 04:52:04.776515 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2386/4773] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:04 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1869 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:52:04.926719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:04.928083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:04.938593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.940624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:04.941619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:04.942279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.004644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:05.006349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:05.014451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.015040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.016009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.016648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.372647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:05.384680 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2c3a251-310f-4c77-9f0f-32fc5a1edf09 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.461584 Aug 03 04:52:05.399262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:05.399921 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2388/4774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:04 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:05.405838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28005071-9db9-4c25-9884-5c2196533ae2 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1505 microversion: 2.1 time: 0.401161 Aug 03 04:52:05.408599 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2387/4775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:04 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:05.608479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a6d253b6-d4ba-4b28-8cfc-3b754c8cce73 req-9113e261-a58f-4d60-85fe-ef038ea057d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408908f-2b74-4693-a606-fd33b8b5c029", "name": "network-vif-unplugged", "status": "completed", "tag": "086aec99-839d-41e8-b1c0-793ede1f75dc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:05.636236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6d253b6-d4ba-4b28-8cfc-3b754c8cce73 req-9113e261-a58f-4d60-85fe-ef038ea057d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.636236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a6d253b6-d4ba-4b28-8cfc-3b754c8cce73 req-9113e261-a58f-4d60-85fe-ef038ea057d2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.639026 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a6d253b6-d4ba-4b28-8cfc-3b754c8cce73 req-9113e261-a58f-4d60-85fe-ef038ea057d2 service nova] Creating event network-vif-unplugged:086aec99-839d-41e8-b1c0-793ede1f75dc for instance 3408908f-2b74-4693-a606-fd33b8b5c029 on n-h1-826756-5 Aug 03 04:52:05.644952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a6d253b6-d4ba-4b28-8cfc-3b754c8cce73 req-9113e261-a58f-4d60-85fe-ef038ea057d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.243253 Aug 03 04:52:05.646074 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2389/4776] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:05.781435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:05.782213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:05.791135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.801309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:05.803155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:05.806868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.810091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.813767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.825213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.825742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:05.830499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:05.831213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:06.564871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:06.584130 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-510b7e86-631e-438c-8e11-5f98968f5d57 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.808218 Aug 03 04:52:06.588316 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2388/4777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:05 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:06.596117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:06.605635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c56eb95c-d220-4d25-b4c5-866a55333a0f req-c8240064-c1ac-42ea-9d6d-a1009810d3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "437a55e5-d30f-4c6f-9001-dae1fc7f60f5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:06.608492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:06.620505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:06.620505 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0d2fb6f0-5761-47ea-b7d3-b04dee247cb7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 0.816026 Aug 03 04:52:06.620873 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2390/4778] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:05 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:06.630686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c56eb95c-d220-4d25-b4c5-866a55333a0f req-c8240064-c1ac-42ea-9d6d-a1009810d3d4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:06.633866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c56eb95c-d220-4d25-b4c5-866a55333a0f req-c8240064-c1ac-42ea-9d6d-a1009810d3d4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:06.635280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:06.635924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:06.647311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:06.648006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:06.657606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:06.658052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:06.713930 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c56eb95c-d220-4d25-b4c5-866a55333a0f req-c8240064-c1ac-42ea-9d6d-a1009810d3d4 service nova] Creating event network-changed:437a55e5-d30f-4c6f-9001-dae1fc7f60f5 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:06.748622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c56eb95c-d220-4d25-b4c5-866a55333a0f req-c8240064-c1ac-42ea-9d6d-a1009810d3d4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154386 Aug 03 04:52:06.751617 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2389/4779] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:06.780125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:06.783139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:06.806017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:06.806987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:06.809294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:06.819178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:07.066231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:07.077418 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68b4c3ec-9614-4635-9e82-ec9f1ade210b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.455577 Aug 03 04:52:07.080125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2391/4780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:06 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:07.586405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:07.594403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc0c0f51-38f3-4c6a-87ae-c477205c5749 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 200 len: 1508 microversion: 2.1 time: 0.841031 Aug 03 04:52:07.595328 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2390/4781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:06 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 1508 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:07.607517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:07.608397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:07.618781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:07.619013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:07.620406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:07.625452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:07.627962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:07.632454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:07.633229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:07.636047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:07.638658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:07.639398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:07.695952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:08.258530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:08.272609 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61d83038-dee7-478f-9574-16e4ddeeb361 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.663498 Aug 03 04:52:08.284493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:08.285787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2392/4782] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:07 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:08.293352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:08.293974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:08.296961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-58fa9ca0-2b05-488a-bef0-064d2a22e499 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.682746 Aug 03 04:52:08.297577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2391/4783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:07 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:08.306012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:08.306862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:08.318051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:08.319038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:08.320003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:08.320766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:08.322587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:08.323173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:08.325955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:08.325955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.109299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.122886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a40c2550-929c-438e-81ec-7ccc848bed95 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1511 microversion: 2.1 time: 0.824158 Aug 03 04:52:09.123703 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2392/4784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:08 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1511 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:09.147020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.147999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:09.150661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:09.160587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.162384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.163437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.164557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.167306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:09.177312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.180584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.182482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9be5e2c2-a122-492c-b1e0-444ee4af231a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 0.892748 Aug 03 04:52:09.183484 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2393/4785] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:08 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:09.299672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:09.300985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:09.309141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.309899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.311085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.311394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.489741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.498252 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c247e55-ac6d-4053-ae41-c0a0f5cf2658 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.356971 Aug 03 04:52:09.509063 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2393/4786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:09 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:09.532566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:09.533195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:09.543141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:09.550353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:09.558947 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cee806a9-2c12-4a38-98bd-691727168767 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.264958 Aug 03 04:52:09.561704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2394/4787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:09 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:09.569580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.573374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.581955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.583080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.627442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-99825110-e790-4064-b544-3f5003eeab2b req-86df28d8-0d47-4105-b3b0-a3ebd7304a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "dbf790c9-1b50-46b1-aee1-8e6be6b98806"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:09.643195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-99825110-e790-4064-b544-3f5003eeab2b req-86df28d8-0d47-4105-b3b0-a3ebd7304a87 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:09.644568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-99825110-e790-4064-b544-3f5003eeab2b req-86df28d8-0d47-4105-b3b0-a3ebd7304a87 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:09.661301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-99825110-e790-4064-b544-3f5003eeab2b req-86df28d8-0d47-4105-b3b0-a3ebd7304a87 service nova] Creating event network-changed:dbf790c9-1b50-46b1-aee1-8e6be6b98806 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:09.670009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-99825110-e790-4064-b544-3f5003eeab2b req-86df28d8-0d47-4105-b3b0-a3ebd7304a87 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048260 Aug 03 04:52:09.672159 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2395/4788] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:10.145415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:10.146291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:10.157918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:10.159091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:10.160205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:10.160927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:10.310801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:10.347243 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a4a8c60-7d97-4373-a4c7-1fd64f1f4c17 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.819758 Aug 03 04:52:10.351731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2394/4789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:09 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:10.373674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:10.375947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:10.404250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:10.405269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:10.406484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:10.408251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:10.964834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:10.981243 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a29056c7-6dbc-4813-adf7-faa047d2eba4 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1488 microversion: 2.1 time: 0.840286 Aug 03 04:52:10.982122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2396/4790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:10 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1488 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:10.992729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:10.993617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:11.023830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.024582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.026977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.030052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.471300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:11.483824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6aaa566f-6b82-4dc5-acc5-bb2eabd1f395 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.498200 Aug 03 04:52:11.485247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2397/4791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:10 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:11.491345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:11.513113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:11.513592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:11.514897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:11.516972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:11.520941 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fd415fb-7460-4cb8-8183-c06a0b7957d0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 1.167295 Aug 03 04:52:11.523384 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2395/4792] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:10 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:11.533597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.534362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.535601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.535988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2086555194"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:11.537379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.546722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:11.565217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.566466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.567529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.568344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.785566 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c8497b8-412e-4cff-8b6c-18a7e2445bfc tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "PUT /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1061 microversion: 2.1 time: 0.259051 Aug 03 04:52:11.794929 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2396/4793] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:52:11 2022] PUT /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1061 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:11.866131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:11.879587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c87d4d1b-b61e-448d-bacf-4d37ba4c5de2 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.393015 Aug 03 04:52:11.889013 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2398/4794] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:11 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:11.896968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fcdc480-0f1b-4b5e-9b43-09923f13f851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:11.922942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fcdc480-0f1b-4b5e-9b43-09923f13f851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:11.923659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fcdc480-0f1b-4b5e-9b43-09923f13f851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:11.982178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1466142520", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:12.000133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fcdc480-0f1b-4b5e-9b43-09923f13f851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 04:52:12.102240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:52:12.102676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:52:12.103157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:52:12.103593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:52:12.103987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:52:12.121863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.122318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.123124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.123563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.157563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Getting quotas for project f333a1d95d9b49f693f48791f75bb8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:52:12.196926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Getting quotas for user 86e88737d8b74ffc8386b610ec9f4159 and project f333a1d95d9b49f693f48791f75bb8f0. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:52:12.211905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:52:12.214941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:52:12.292889 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fcdc480-0f1b-4b5e-9b43-09923f13f851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.409879 Aug 03 04:52:12.294021 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2399/4795] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:11 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:12.303089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:12.304126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:12.313600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.314346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.317110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.318820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.366163 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11901c67-393f-4842-919e-64dc6a1a91ad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.578223 Aug 03 04:52:12.370167 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2397/4796] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:52:12.374906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ab91f7ba-755f-4fcb-b1b9-0bec235d55e4 req-95b6205c-b379-40c7-b0a6-d9762fec0dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "97b16f2c-c92b-4982-841b-793440779ba3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:12.407454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab91f7ba-755f-4fcb-b1b9-0bec235d55e4 req-95b6205c-b379-40c7-b0a6-d9762fec0dc1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.407940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab91f7ba-755f-4fcb-b1b9-0bec235d55e4 req-95b6205c-b379-40c7-b0a6-d9762fec0dc1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.436711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ab91f7ba-755f-4fcb-b1b9-0bec235d55e4 req-95b6205c-b379-40c7-b0a6-d9762fec0dc1 service nova] Creating event network-changed:97b16f2c-c92b-4982-841b-793440779ba3 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:12.447196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ab91f7ba-755f-4fcb-b1b9-0bec235d55e4 req-95b6205c-b379-40c7-b0a6-d9762fec0dc1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075741 Aug 03 04:52:12.452324 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2398/4797] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:12.467322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:12.468205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:12.491114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.491114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:12.491114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:12.491114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:13.053264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.073034 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22cda063-401e-4280-acce-92a661fbc556 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1488 microversion: 2.1 time: 0.777366 Aug 03 04:52:13.074146 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2400/4798] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:12 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1488 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:13.079290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:13.080431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:13.130723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.154768 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85b6e029-6c0d-4217-a947-4d5b3d7dfe82 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.698735 Aug 03 04:52:13.160088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2399/4799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:12 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:13.174131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:13.174765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:13.179005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.187675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.194795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.196086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb0a7633-67e1-44d0-9276-bd04d9d49fad tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1281 microversion: 2.47 time: 0.120637 Aug 03 04:52:13.196679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:13.197599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:13.200132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:13.201909 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2401/4800] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:13 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:13.202999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:13.211779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:13.212839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:13.226126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:13.227779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:13.228153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:13.228935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:13.986388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:13.999286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.005590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.006810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-14d48201-729d-43c0-bd9d-8adae77bda09 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 0.844557 Aug 03 04:52:14.007373 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2400/4801] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:13 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:14.026755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:14.026755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:14.031783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.032555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.033531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.034771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.045120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.056245 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-462d66bf-2124-4b02-9f9b-30d291f23c80 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.852736 Aug 03 04:52:14.057854 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2402/4802] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:13 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:14.184689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:14.185590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:14.195232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.196490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.197782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.198697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.454720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.464008 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5f073494-be44-47ac-b0b7-81fb9d845a9b tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1488 microversion: 2.1 time: 0.455340 Aug 03 04:52:14.468372 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2401/4803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:14 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1488 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:14.503627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:14.504640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:14.519660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.521077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.537085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.538009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.733363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.746965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.758131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.758534 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f7acb55-2ddc-431e-a117-cbaf3f642b47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.579513 Aug 03 04:52:14.760081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:14.761656 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11056c3c-ac4a-4244-acd4-5a0c7e6cdea8 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1285 microversion: 2.47 time: 0.290476 Aug 03 04:52:14.763799 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2403/4804] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:14 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:14.769598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:14.770310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:14.778358 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2402/4805] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:14 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1285 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:14.785161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-58b3ed09-47c4-4d44-b726-318abab6bb02 req-56665bb5-1aaa-460b-98f0-18a2c4e88c1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "cf3e5ac9-04a7-4f43-a57e-a03909ef5526"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:14.789655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.790131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.796786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.798453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.808595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-58b3ed09-47c4-4d44-b726-318abab6bb02 req-56665bb5-1aaa-460b-98f0-18a2c4e88c1f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.810639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-58b3ed09-47c4-4d44-b726-318abab6bb02 req-56665bb5-1aaa-460b-98f0-18a2c4e88c1f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.840973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-58b3ed09-47c4-4d44-b726-318abab6bb02 req-56665bb5-1aaa-460b-98f0-18a2c4e88c1f service nova] Creating event network-changed:cf3e5ac9-04a7-4f43-a57e-a03909ef5526 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:14.848355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-58b3ed09-47c4-4d44-b726-318abab6bb02 req-56665bb5-1aaa-460b-98f0-18a2c4e88c1f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068268 Aug 03 04:52:14.857252 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2403/4806] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:14.872057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:14.872477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:14.882965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:14.914392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.914869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:14.918846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:14.920375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:15.021829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'flavor' on Instance uuid 95d828b3-2ce2-4d35-b592-b2b98530f114 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:15.365551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96670194-382d-4574-bbca-1dad385684aa tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 204 len: 0 microversion: 2.1 time: 0.598409 Aug 03 04:52:15.365551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2404/4807] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:14 2022] DELETE /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:52:15.380872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:15.386828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:15.400193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:15.400860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:15.401523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:15.401963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:15.618669 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-87a32e8c-1624-4e17-900b-412e8e7a3ab4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/action" status: 200 len: 32 microversion: 2.1 time: 0.756766 Aug 03 04:52:15.624082 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2404/4808] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:14 2022] POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/action => generated 32 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:52:15.639827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:15.641729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:15.661568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:15.662259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:15.665127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:15.665780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:15.984250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.014984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.016949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.021454 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc7cdb5a-e8d3-4f36-aeda-6d7e055c0ea5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 0.654184 Aug 03 04:52:16.030977 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2405/4809] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:15 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:16.061674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.066878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:16.067553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:16.074414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f3246a5-052e-4d5a-9cca-46a049295c3f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.446062 Aug 03 04:52:16.077520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.078893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.081034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.082153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.088205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2405/4810] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:15 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:16.099869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:16.100685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:16.108842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.114444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.114444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.114444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.803331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.809656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.822576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7fef74da-08c7-4c5f-9135-f582b52aa396 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.733054 Aug 03 04:52:16.823943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d3d2d236-64ae-44cd-b347-ef3d59df422e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1494 microversion: 2.1 time: 0.774710 Aug 03 04:52:16.824575 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2406/4811] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:16 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1494 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:16.825693 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2406/4812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:16 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:16.836389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:16.837193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:16.838042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:16.841461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:16.847441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.847896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.849006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.849448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.855644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.856166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.857024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:16.857643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:16.885206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:16.969437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.978555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.981361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:16.982860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00dc8fb0-8df8-4247-be8d-2d8c4f0e7980 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1339 microversion: 2.47 time: 0.156042 Aug 03 04:52:17.008120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2407/4813] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:16 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:17.058714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f9a7a0c7-50ab-49dc-a13a-7aecad2423cc req-a34234e5-b09e-47f6-b246-541d66353417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "e592c4e7-ebc7-4698-a174-874f118b41b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:17.069876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9a7a0c7-50ab-49dc-a13a-7aecad2423cc req-a34234e5-b09e-47f6-b246-541d66353417 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.070422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9a7a0c7-50ab-49dc-a13a-7aecad2423cc req-a34234e5-b09e-47f6-b246-541d66353417 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.090823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f9a7a0c7-50ab-49dc-a13a-7aecad2423cc req-a34234e5-b09e-47f6-b246-541d66353417 service nova] Creating event network-changed:e592c4e7-ebc7-4698-a174-874f118b41b6 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:17.098328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:17.106951 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f9a7a0c7-50ab-49dc-a13a-7aecad2423cc req-a34234e5-b09e-47f6-b246-541d66353417 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121179 Aug 03 04:52:17.107937 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2408/4814] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:17.108747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31c2a4dd-ec2e-4c9a-868e-b9e1c302b0f0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.280675 Aug 03 04:52:17.116189 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2407/4815] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:16 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:17.116738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:17.116738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:17.118925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:17.119542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:17.134912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.135379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.136163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.136664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.144291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.148575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.153270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.153942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.646732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:17.658907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:17.661634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:17.663506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cad9bdf9-9ab8-4624-97f3-ba268e765225 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1890 microversion: 2.32 time: 0.553945 Aug 03 04:52:17.664597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2409/4816] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:17 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1890 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:17.791185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:17.804526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b46183e7-d47e-441b-a4af-b590d1502760 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.690633 Aug 03 04:52:17.825379 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2408/4817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:17 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:17.858253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:17.859249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:17.860391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:17.861050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:17.866503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.867243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.868230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.868382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.868842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.869270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.869632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:17.870144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:17.894419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:18.222038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.236018 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58d41dae-2201-4d93-b59b-950f217888a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.376906 Aug 03 04:52:18.236706 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2409/4818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:17 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:18.252386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:18.253018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:18.256854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.262877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.263507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.264358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.264832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.269197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9c80c09-77a9-4b53-b675-822598e42413 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1494 microversion: 2.1 time: 0.415138 Aug 03 04:52:18.272082 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2410/4819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:17 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1494 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:18.293687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:18.294309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:18.306856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.307685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.308792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.309377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.539180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.552214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.554630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.556084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8be5f382-d7eb-4171-8b0b-ae2988ab5d03 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1339 microversion: 2.47 time: 0.307965 Aug 03 04:52:18.557348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2410/4820] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:18 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:18.723746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d3ca6238-ae0d-4d0f-a3af-53167edebbd8 req-dd1d218a-1ed7-450f-aecd-65906f0d5007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98634787-1da2-4d7c-b2d5-d715bed3d5c5", "name": "network-vif-deleted", "tag": "e37470b1-9ca9-44b2-abd5-d62edc401df0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:18.736641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d3ca6238-ae0d-4d0f-a3af-53167edebbd8 req-dd1d218a-1ed7-450f-aecd-65906f0d5007 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.737321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d3ca6238-ae0d-4d0f-a3af-53167edebbd8 req-dd1d218a-1ed7-450f-aecd-65906f0d5007 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.746989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:18.754764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d3ca6238-ae0d-4d0f-a3af-53167edebbd8 req-dd1d218a-1ed7-450f-aecd-65906f0d5007 service nova] Creating event network-vif-deleted:e37470b1-9ca9-44b2-abd5-d62edc401df0 for instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 on n-h2-826756-5 Aug 03 04:52:18.760260 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a18788a-8ae2-4512-8ea6-8fa9c57bc8ee tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.485247 Aug 03 04:52:18.776359 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d3ca6238-ae0d-4d0f-a3af-53167edebbd8 req-dd1d218a-1ed7-450f-aecd-65906f0d5007 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202713 Aug 03 04:52:18.776517 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2411/4821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:18 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:18.777772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2411/4822] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:18.782259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:18.782889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:18.795336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.796113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.797189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.797789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.834866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:18.836309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:18.844712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.845397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:18.846427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:18.847033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.391090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.440822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.447497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.451659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.455220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f40fd73-17a8-4bec-9c5a-259bd090d06d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.690642 Aug 03 04:52:19.456236 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2412/4823] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:18 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:19.471827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29346d1f-6cae-4bdf-a3c4-3d6df3ff790d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.636941 Aug 03 04:52:19.483220 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2412/4824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:18 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:19.501519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:19.502398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:19.502913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:19.503691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:19.514380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.515380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.517092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.518266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.527059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.527059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.527059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.527059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.598889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.599331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.613811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid 98634787-1da2-4d7c-b2d5-d715bed3d5c5 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:19.752576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.760241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8601426-dab5-4770-804b-9a834703e4da tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 200 len: 1310 microversion: 2.1 time: 0.274147 Aug 03 04:52:19.775964 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2413/4825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:19 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 1310 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:19.782927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:19.782927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:19.788682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.789131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.789892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:19.790327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:19.931024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.942623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.966987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.974227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:19.975559 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e02c4cac-4051-4890-9878-b76dfa3598c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1360 microversion: 2.47 time: 0.198380 Aug 03 04:52:19.988292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8b34485-cd61-4dba-8865-6b377462ba78 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.494025 Aug 03 04:52:19.988292 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2413/4826] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:19 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:19.988548 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2414/4827] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:19 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:19.989178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:19.994797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:20.013028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.013028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.013028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.013028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.023351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-718764928"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:20.025854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:20.031976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.032488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.033276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.033719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.390821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:20.399553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a6659534-da4f-46f8-b6b4-729d2710e032 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.415798 Aug 03 04:52:20.400300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2414/4828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:19 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:20.482618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:20.483234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:20.490928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.491405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.492182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.500532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.681440 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-042da6d9-e215-4270-884f-51a8d56fc4c0 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "POST /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71/action" status: 202 len: 52 microversion: 2.47 time: 0.658142 Aug 03 04:52:20.683572 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2415/4829] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 04:52:20 2022] POST /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71/action => generated 52 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Aug 03 04:52:20.690626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:20.692217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:20.699723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.700517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:20.701526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:20.702120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.306486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:21.314971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:21.327684 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30bd5303-c467-4bba-b740-41efbe246a8f tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.641856 Aug 03 04:52:21.333329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:21.334907 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2416/4830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:20 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:21.338072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:21.339726 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76f01b58-848a-4cf5-95a2-e638955541e0 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.861075 Aug 03 04:52:21.340314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2415/4831] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:20 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:52:21.344334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.344845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.354467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.355094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.358721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.359187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.360163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.360641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.372003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.372501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.373475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.373922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.388759 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 HTTP/1.1 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '98634787-1da2-4d7c-b2d5-d715bed3d5c5'} Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.390770 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.395761 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.397276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:21.398345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b744cee-f8ed-4c56-aa37-dea412491ed9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 404 len: 111 microversion: 2.1 time: 0.051243 Aug 03 04:52:21.399407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2416/4832] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:21 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:21.416938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:21.417134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.417134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.426139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.427814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.428908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.429680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.652782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:21.661296 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82530d66-57c9-4721-a033-6ca8950013d9 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.260671 Aug 03 04:52:21.662013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2417/4833] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:21 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:21.683028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.686562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.697701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.698455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.711548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.711548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.727995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 HTTP/1.1 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '98634787-1da2-4d7c-b2d5-d715bed3d5c5'} Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:21.729760 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd62ddc7-8ea4-4aec-ad39-a245aea428b3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 404 len: 111 microversion: 2.1 time: 0.056500 Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2418/4834] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:21 2022] DELETE /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.749314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.752771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.753237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.754051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.754727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.800003 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-90fd8d14-92fe-4b96-a4d5-dc5a0909f2b6 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "DELETE /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 204 len: 0 microversion: 2.47 time: 0.462787 Aug 03 04:52:21.803098 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2417/4835] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:52:21 2022] DELETE /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:52:21.809140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.811323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.838829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.839366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.840470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.840969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.859508 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 HTTP/1.1 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '650b5236-9353-4479-b9a6-cf30ffffc916'} Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:21.862697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4723d20c-6d3f-449b-86cd-3bdc0997c055 tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 404 len: 111 microversion: 2.1 time: 0.061488 Aug 03 04:52:21.867897 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2418/4836] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:21 2022] DELETE /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:21.875997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.876666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 98634787-1da2-4d7c-b2d5-d715bed3d5c5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.884547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.885010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.885818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.886390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.907914 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 HTTP/1.1 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '98634787-1da2-4d7c-b2d5-d715bed3d5c5'} Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.912332 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 98634787-1da2-4d7c-b2d5-d715bed3d5c5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73534430-0029-43d6-b67b-d68e75d1162d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5" status: 404 len: 111 microversion: 2.1 time: 0.042361 Aug 03 04:52:21.916038 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2419/4837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:21 2022] GET /compute/v2.1/servers/98634787-1da2-4d7c-b2d5-d715bed3d5c5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:21.920040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:21.920784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:21.929438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.929910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:21.930712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:21.931161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.124905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.140008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.143109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:22.144110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.147636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2aab91e-840b-42c5-bac5-40dfdef50591 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1366 microversion: 2.47 time: 0.231801 Aug 03 04:52:22.150023 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2420/4838] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:21 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:22.160742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.162031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 650b5236-9353-4479-b9a6-cf30ffffc916] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.171894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.173031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.174658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.175621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.201152 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 HTTP/1.1 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '650b5236-9353-4479-b9a6-cf30ffffc916'} Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.203284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. Aug 03 04:52:22.209475 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.209927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:22.210633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 650b5236-9353-4479-b9a6-cf30ffffc916 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.211753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed4f3ec5-44f1-4548-ae02-70086735ff9b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916" status: 404 len: 111 microversion: 2.1 time: 0.056246 Aug 03 04:52:22.213730 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2421/4839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/650b5236-9353-4479-b9a6-cf30ffffc916 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.222040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.222771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.235523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.236442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.237204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.237799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.258812 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 HTTP/1.1 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '030d1047-3675-47e8-a6f9-25699c346087'} Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.260880 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.264869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-720b585e-36ee-4267-841f-115983c8b733 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 404 len: 111 microversion: 2.1 time: 0.047740 Aug 03 04:52:22.266374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2422/4840] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:22 2022] DELETE /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.272032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.272693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 030d1047-3675-47e8-a6f9-25699c346087] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.279920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.280571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.281372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.281816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.297415 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 HTTP/1.1 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '030d1047-3675-47e8-a6f9-25699c346087'} Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.298973 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 030d1047-3675-47e8-a6f9-25699c346087 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ed5293a-b757-4b9f-8255-58d9b68979b5 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087" status: 404 len: 111 microversion: 2.1 time: 0.033160 Aug 03 04:52:22.303751 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2423/4841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/030d1047-3675-47e8-a6f9-25699c346087 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.310770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.311373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.319255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.319255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.319685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.320561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.335431 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 HTTP/1.1 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '77619f99-e8eb-4127-a739-1a3495d63094'} Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.337409 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.342866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.343493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.343599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.343599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ecdc2ad7-8985-4003-a49c-d26842e65325 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 404 len: 111 microversion: 2.1 time: 0.032668 Aug 03 04:52:22.344945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2424/4842] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:22 2022] DELETE /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.349937 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-332ccb62-02a1-4170-bcfc-3b5931a1103b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1679 microversion: 2.1 time: 0.608737 Aug 03 04:52:22.351743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.353712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 77619f99-e8eb-4127-a739-1a3495d63094] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.353819 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2419/4843] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:21 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1679 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:22.369323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.373917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.374488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.374752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.375617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.376464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.393249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.394532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.396127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.398568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.399290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 HTTP/1.1 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '77619f99-e8eb-4127-a739-1a3495d63094'} Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.399977 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 77619f99-e8eb-4127-a739-1a3495d63094 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72721544-8e36-4444-84a4-dcddd01fdc06 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094" status: 404 len: 111 microversion: 2.1 time: 0.056766 Aug 03 04:52:22.403573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2425/4844] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/77619f99-e8eb-4127-a739-1a3495d63094 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.413588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.414239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.424049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.424549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.425487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.425886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.811357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.825207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-31e1f02d-9563-4fb5-b0da-32d3b19622e0 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.471582 Aug 03 04:52:22.826503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2420/4845] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:22.833753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.834618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.842823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.843624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.844659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.845387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.855831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.867067 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.867741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 HTTP/1.1 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1d9874c3-d796-48db-a176-5fd8b97341a1'} Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.869439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.872979 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.875368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:22.875628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.876638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52db6146-c533-4440-b243-83ee1dc8a0ca tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.468695 Aug 03 04:52:22.885420 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2426/4846] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:22.885420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.885420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.885420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:22.893388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-142c8e0a-e0a1-4b4e-9ad2-bff43c39072f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 404 len: 111 microversion: 2.1 time: 0.064663 Aug 03 04:52:22.894564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2421/4847] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:22 2022] DELETE /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:22.902589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.903288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.904992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.908216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.908983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 1d9874c3-d796-48db-a176-5fd8b97341a1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.909121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.917999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.918740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.919735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.920454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.938229 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 HTTP/1.1 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1d9874c3-d796-48db-a176-5fd8b97341a1'} Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.940208 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 1d9874c3-d796-48db-a176-5fd8b97341a1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e76c421-9128-4072-b708-d5b3673f9d3d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1" status: 404 len: 111 microversion: 2.1 time: 0.041984 Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2422/4848] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/1d9874c3-d796-48db-a176-5fd8b97341a1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:22.959235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:22.966333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.967068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.968083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:22.971327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:22.994032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 HTTP/1.1 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fa850f20-ff78-4986-b56a-f27f324c1955'} Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:22.997059 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5021b924-c721-4fb5-992d-da541aab7db7 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 404 len: 111 microversion: 2.1 time: 0.050552 Aug 03 04:52:23.006460 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2423/4849] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:22 2022] DELETE /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:52:23.014672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.015364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: fa850f20-ff78-4986-b56a-f27f324c1955] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.022641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.023356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.024212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.025388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.043488 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 HTTP/1.1 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fa850f20-ff78-4986-b56a-f27f324c1955'} Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.045184 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance fa850f20-ff78-4986-b56a-f27f324c1955 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.048857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4088f81a-125e-4aef-8c07-e75e2b172948 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955" status: 404 len: 111 microversion: 2.1 time: 0.036659 Aug 03 04:52:23.050769 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2424/4850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/fa850f20-ff78-4986-b56a-f27f324c1955 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:23.055609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.056184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.062568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.063096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.063937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.064480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.080234 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb HTTP/1.1 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '37bff9a7-ab46-42fc-9ef5-c390179c05eb'} Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:23.082141 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.085698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6cc12a4-1568-49ec-932f-4102af122ebe tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 404 len: 111 microversion: 2.1 time: 0.031839 Aug 03 04:52:23.087776 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2425/4851] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:23 2022] DELETE /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:23.092746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.093430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 37bff9a7-ab46-42fc-9ef5-c390179c05eb] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.100721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.101323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.102109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.102783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.119381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb HTTP/1.1 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '37bff9a7-ab46-42fc-9ef5-c390179c05eb'} Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.121301 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 37bff9a7-ab46-42fc-9ef5-c390179c05eb could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b82a5999-dc60-47a1-98da-a3268871ab72 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb" status: 404 len: 111 microversion: 2.1 time: 0.033993 Aug 03 04:52:23.132199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2426/4852] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/37bff9a7-ab46-42fc-9ef5-c390179c05eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:23.136493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.137114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.145240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 HTTP/1.1 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '8e71b753-b10d-4a4b-92a6-645cb1f39298'} Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.147046 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.150639 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0880cfac-d7fc-47c3-baea-990b900dd97d tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298" status: 404 len: 111 microversion: 2.1 time: 0.019011 Aug 03 04:52:23.151633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:23.153176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2427/4853] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:23 2022] DELETE /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:23.158429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.159276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: 8e71b753-b10d-4a4b-92a6-645cb1f39298] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.162616 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e99423a-ab3b-4dc8-a0d0-ccc6b80cbc70 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.283864 Aug 03 04:52:23.168354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2427/4854] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:22 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:23.168661 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 HTTP/1.1 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '8e71b753-b10d-4a4b-92a6-645cb1f39298'} Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:23.170538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:23.174308 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:23.174308 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:23.174308 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. Aug 03 04:52:23.174308 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:23.175579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance 8e71b753-b10d-4a4b-92a6-645cb1f39298 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:23.177457 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c69289ab-1a95-4ef4-9462-768ae4f304f9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298" status: 404 len: 111 microversion: 2.1 time: 0.022355 Aug 03 04:52:23.178093 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2428/4855] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/8e71b753-b10d-4a4b-92a6-645cb1f39298 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:23.185219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.185833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.191290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:23.193664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.194127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.194916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.195393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.197442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.198006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.199910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:23.204217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.205037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.205892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.206561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.233814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:23.275014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:23.284151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:23.286657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:23.288024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7ae88893-c089-4647-904c-85002451edda tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1366 microversion: 2.47 time: 0.106642 Aug 03 04:52:23.288827 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2428/4856] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:23.374517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.375145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.382793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.383552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.384694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.385351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.576782 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cacb53c0-0ec3-4668-8435-1fb04f5dfae3 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 204 len: 0 microversion: 2.1 time: 0.382456 Aug 03 04:52:23.579161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2429/4857] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:23 2022] DELETE /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:52:23.599058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:23.599934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:23.607014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.607609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.608517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.609057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.630707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:23.763566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:23.772327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36947f88-c41a-4945-a205-0f5c8b5eb284 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1656 microversion: 2.1 time: 0.401889 Aug 03 04:52:23.772927 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2429/4858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1656 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:23.795006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a0713c0a-74de-4181-bd69-e0940600dbe5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:23.803342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0713c0a-74de-4181-bd69-e0940600dbe5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:23.803924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0713c0a-74de-4181-bd69-e0940600dbe5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:23.830731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0713c0a-74de-4181-bd69-e0940600dbe5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Going to try to start instance {{(pid=120832) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 04:52:24.004068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:24.011786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9d923ee-8c7a-4821-a475-1a6308db246a tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1479 microversion: 2.1 time: 0.419238 Aug 03 04:52:24.012402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2430/4859] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:23 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1479 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:24.021643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:24.022484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:24.031042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.031695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.032498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.032937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.069663 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a0713c0a-74de-4181-bd69-e0940600dbe5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.278715 Aug 03 04:52:24.070357 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2430/4860] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:23 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:52:24.075594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:24.076383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:24.083881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.084894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.085961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.086408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.514620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:24.526859 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c0fa076-5e3d-44d2-b7b1-89a6412fde23 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.512913 Aug 03 04:52:24.527805 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2431/4861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:24 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:24.534331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:24.545707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:24.546577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:24.553202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:24.555438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:24.558705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47ca5a97-3184-444b-88d8-a64c62295d9e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.487234 Aug 03 04:52:24.560510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.561263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2431/4862] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:24 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:24.562121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.565172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.565840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.576674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:24.577529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:24.600655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.600655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:24.601353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:24.601795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.049328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.057789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55fdff12-90d5-4a8d-b2c9-88b05846e26a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.528649 Aug 03 04:52:25.068303 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2432/4863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:24 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:25.068303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:25.068303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:25.070651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.071445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.072523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.073209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.084573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.092344 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07146bad-9541-4c65-b59a-53908698ea52 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.528427 Aug 03 04:52:25.107216 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2432/4864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:24 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:25.107216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:25.107216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:25.113649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.115880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.125680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.125680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.125970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:25.128303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.128956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.130114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lazy-loading 'fault' on Instance uuid 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:25.237810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.248569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.251996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e88737d8b74ffc8386b610ec9f4159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f333a1d95d9b49f693f48791f75bb8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.254950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c60082eb-4e20-4bd0-8597-02b69b1bf203 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 200 len: 1371 microversion: 2.47 time: 0.193666 Aug 03 04:52:25.275477 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2433/4865] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:25 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:25.549480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:25.550135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:25.571585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.572386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.573555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.574235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.801540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.809754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3bd650e-91a0-40bd-9bf6-c056c3611be0 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1479 microversion: 2.1 time: 0.715337 Aug 03 04:52:25.810343 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2433/4866] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:25 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1479 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:25.815022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:25.815765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:25.822923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.823382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.824162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:25.824812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:25.949813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:25.963414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e7d9e95-3629-4592-98f2-37edda7cdd7d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.417917 Aug 03 04:52:25.964127 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2434/4867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:25 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:26.083804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.084849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.090990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.091633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.093236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.093972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.394626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:26.412307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:26.414921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:26.416905 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-300b73d8-8d86-4c41-af3f-29a03e8e168a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.605466 Aug 03 04:52:26.418125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2434/4868] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:25 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:26.458434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:26.459567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.461133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.466751 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8576143a-340f-4573-a035-e4e8a4190685 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.388592 Aug 03 04:52:26.467344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2435/4869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:26.482778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.489017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.489552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.490872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.491459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.495116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] [instance: 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.507077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.516246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.517456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.517907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.550051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] HTTP exception thrown: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Request method failure captured: Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 HTTP/1.1 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f77YHqm81rRajfTUVPgC_HAYoMfQhA8VvazgRgmQRAZvi1j3MSp3D045i9kgyYAZ8OalphCS1ZR2T6tjy-2wOQxoq9rW32QuC5wxp_UBzd0BnF3hJX__9ke4XKo7l4jSVjAzQ5jMxwuxKJ3XfWunKjumz0lxxPIGrVmmU9uAye3N8Q Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: f333a1d95d9b49f693f48791f75bb8f0 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAaction247Test-1208461491 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f333a1d95d9b49f693f48791f75bb8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/f333a1d95d9b49f693f48791f75bb8f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_f333a1d95d9b49f693f48791f75bb8f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/f333a1d95d9b49f693f48791f75bb8f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAaction247Test-1208461491 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: f333a1d95d9b49f693f48791f75bb8f0 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAaction247Test-1208461491 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAaction247Test-1208461491-project Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 86e88737d8b74ffc8386b610ec9f4159 Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAaction247Test-1208461491-project Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5120e35c-c9a0-4a91-b2d8-c14dd72c4b71'} Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.552849 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] Returning 404 to user: Instance 5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73076182-c5b4-4ae6-b377-0c0e9af74c31 tempest-ServersAaction247Test-1208461491 tempest-ServersAaction247Test-1208461491-project] 10.222.0.72 "GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71" status: 404 len: 111 microversion: 2.47 time: 0.086012 Aug 03 04:52:26.558390 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2436/4870] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/5120e35c-c9a0-4a91-b2d8-c14dd72c4b71 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:52:26.798020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:26.805469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.806267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.811866 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02b2c1dc-a84f-4e63-be1d-32bc88b2e97a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.390237 Aug 03 04:52:26.813221 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2435/4871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:26.815257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.815725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.817529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.818018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.831430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.832438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.834426 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d HTTP/1.1 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '779d1f9e-2351-4630-83f4-9a80cfcc5a8d'} Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:26.836025 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:26.840227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0609b6d6-d52d-42f7-9950-e72b8297719b tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 404 len: 111 microversion: 2.1 time: 0.037916 Aug 03 04:52:26.841901 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2437/4872] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:26 2022] DELETE /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:52:26.845065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.845701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.846778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.847366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.850368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.851016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] [instance: 779d1f9e-2351-4630-83f4-9a80cfcc5a8d] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.857837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.858297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.861086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.861754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.881021 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] HTTP exception thrown: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Request method failure captured: Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d HTTP/1.1 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f09iHOFwGFu_OAiRS-sPK7cqZOLT-ZbUR7gwlso4j3moFi0onreMELCk91MUW5cnKTsevE2ZvDJuWAGICYM5OTW90ZEUAVDnovlx2j9ClU75oM4WtsoI4uypgqYtRAFwdYdkKa03z3rCLmXiQTl0rRWy60NGml9K_RQYIMOKGSM55w Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_eb38f33edc704bb39daf9765439257d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/eb38f33edc704bb39daf9765439257d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: eb38f33edc704bb39daf9765439257d5 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1354168892 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2ebe6f390e2741058f63638d0b22eac9 Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeTestJSON-1354168892-project Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '779d1f9e-2351-4630-83f4-9a80cfcc5a8d'} Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:26.882793 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] Returning 404 to user: Instance 779d1f9e-2351-4630-83f4-9a80cfcc5a8d could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:26.887062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-025aa5d0-3662-459a-bd50-f9ccc7972acd tempest-AttachVolumeTestJSON-1354168892 tempest-AttachVolumeTestJSON-1354168892-project] 10.222.0.72 "GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d" status: 404 len: 111 microversion: 2.1 time: 0.041337 Aug 03 04:52:26.889101 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2438/4873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/779d1f9e-2351-4630-83f4-9a80cfcc5a8d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:26.985314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:26.986057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:26.993717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:26.994177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:26.995001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.003520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.163325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.174838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0803dc7-f708-4139-944c-d9b1bd1780e9 tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1479 microversion: 2.1 time: 0.347444 Aug 03 04:52:27.175603 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2436/4874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1479 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:27.237929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.249128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b472158-c0d4-4f76-a942-ab9985e56ddb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1524 microversion: 2.1 time: 0.267148 Aug 03 04:52:27.258809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2439/4875] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:26 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:27.298633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-521e4a7f-6c5f-4b22-ae11-ba0bb911c6e7 req-be266e0c-a055-49b3-ad49-73374a9491a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48875e1-28b9-4057-86dc-3698445d0163", "name": "network-vif-deleted", "tag": "698e9060-e53c-40b6-9b7b-9b2f003db458"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:27.333415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-521e4a7f-6c5f-4b22-ae11-ba0bb911c6e7 req-be266e0c-a055-49b3-ad49-73374a9491a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.334141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-521e4a7f-6c5f-4b22-ae11-ba0bb911c6e7 req-be266e0c-a055-49b3-ad49-73374a9491a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.349680 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-521e4a7f-6c5f-4b22-ae11-ba0bb911c6e7 req-be266e0c-a055-49b3-ad49-73374a9491a7 service nova] Creating event network-vif-deleted:698e9060-e53c-40b6-9b7b-9b2f003db458 for instance c48875e1-28b9-4057-86dc-3698445d0163 on n-h2-826756-5 Aug 03 04:52:27.355329 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-521e4a7f-6c5f-4b22-ae11-ba0bb911c6e7 req-be266e0c-a055-49b3-ad49-73374a9491a7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060367 Aug 03 04:52:27.356199 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2437/4876] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:27.446488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:27.447102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:27.455805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.456259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.457114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.457555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.490301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:27.491239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:27.501455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.512214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.513327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.513951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.950276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.961892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd5eca8f-46fa-4e26-a2f3-07a5ab1d1fbc tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1665 microversion: 2.1 time: 0.476505 Aug 03 04:52:27.963148 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2438/4877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:27 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1665 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:27.967845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.968600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:27.969227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:27.977797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.979188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:27.980386 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53f0b610-2434-454f-ad9d-fdcc3fa3feef tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.537972 Aug 03 04:52:27.980948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2440/4878] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:27 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:27.982252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.983033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:27.984003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:27.984654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.144533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:28.153479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2484e16-4b40-47e6-9c85-341e6d0cd170 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.189160 Aug 03 04:52:28.154343 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2439/4879] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:27 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:28.197852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:28.198463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:28.205047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:28.205497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.206441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:28.206981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.240589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:28.241736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.242195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lazy-loading 'fault' on Instance uuid c48875e1-28b9-4057-86dc-3698445d0163 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:28.272651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:28.273530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:28.281487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:28.282358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.283387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:28.284000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:28.293714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae62dff3158946428069bdc58127d804', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826fee0a42d143898d4607bad49b02bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:28.304898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76021955-8807-497d-9222-7e3ca0b4e21f tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 200 len: 1282 microversion: 2.1 time: 0.109771 Aug 03 04:52:28.305511 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2441/4880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:28 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:28.466045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:28.473927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0565465d-08c9-410a-83ab-b1ca279fca85 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1504 microversion: 2.1 time: 0.207068 Aug 03 04:52:28.474514 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2440/4881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:28 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:28.496300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99f7fe56-20d7-4256-b044-e1ea5cf2143d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'create', calling method: .version_select at 0x7fdd47ea1670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2097562119", "description": "tempest-description-1692614502"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:28.987468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:28.988915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:29.004141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.006313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.008151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.010922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.188372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99f7fe56-20d7-4256-b044-e1ea5cf2143d tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.695971 Aug 03 04:52:29.188990 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2442/4882] 10.222.0.72 () {60 vars in 1180 bytes} [Wed Aug 3 04:52:28 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:29.197718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:29.197718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:29.203486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.203486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.203486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.203991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.248299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.261464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0aff9f9-8724-4a4c-9b64-24f2b0640333 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.280569 Aug 03 04:52:29.261687 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2441/4883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:28 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:29.266862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:29.267729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:29.274914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.275563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.276611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.277340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.480191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.493987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.497667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.497667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a631043f-c2b1-4ece-9c5a-d5980b35fa96 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.307267 Aug 03 04:52:29.498619 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2443/4884] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:29 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:29.505210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2097562119"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:29.506217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:29.513185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.513715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.514775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.515382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.548788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.559712 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f844f586-1163-469b-a21c-7075b087b7cf tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.296828 Aug 03 04:52:29.561883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2442/4885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:29 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:29.581091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:29.583301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:29.590509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.591190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.592161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:29.592805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:29.745950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Adding security group f71aa12c-4dc4-4582-b5b0-089b38601702 to port e9e8579f-30a0-46fe-b72c-d64e0d9596b7 Aug 03 04:52:29.942986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:29.969622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5fe0d67f-0cbc-4f78-8ef7-c8a2321e20d4 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.406566 Aug 03 04:52:29.972145 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2443/4886] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:29 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:29.989075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:29.990484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] [instance: c48875e1-28b9-4057-86dc-3698445d0163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:30.015034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.018728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.022552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.023665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.074756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] HTTP exception thrown: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Request method failure captured: Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 HTTP/1.1 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f4EXNxmPDaIrB_RG5-e9RVFaPHtv5t-h63iUoYEm8BqC2JNGFhzRqWZXcdxMMDWj3IoxcgG_FCVG2MRbnpr_hxfLz0hN-DfReKlPh1d9YhFUuPvmKKF1MDXHaS789u5UZ1aKV6aC3xRmVYc3HXbld5wJTdjxJiKrrpe6D6IFZuuWSA Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_826fee0a42d143898d4607bad49b02bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/826fee0a42d143898d4607bad49b02bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersTestJSON-265513988 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 826fee0a42d143898d4607bad49b02bc Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersTestJSON-265513988 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersTestJSON-265513988-project Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ae62dff3158946428069bdc58127d804 Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersTestJSON-265513988-project Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c48875e1-28b9-4057-86dc-3698445d0163'} Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:30.076819 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. Aug 03 04:52:30.080574 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:30.084614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] Returning 404 to user: Instance c48875e1-28b9-4057-86dc-3698445d0163 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:30.086658 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1627746b-d500-4800-b28c-591f9ab2f19e tempest-ServersTestJSON-265513988 tempest-ServersTestJSON-265513988-project] 10.222.0.72 "GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163" status: 404 len: 111 microversion: 2.1 time: 0.112688 Aug 03 04:52:30.091193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2444/4887] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:29 2022] GET /compute/v2.1/servers/c48875e1-28b9-4057-86dc-3698445d0163 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:30.099803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:30.105259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:30.119023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.120995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.122042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.124345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.146411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:30.427906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:30.436289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fef08733-9374-42bc-b400-cf387186c0db tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.343066 Aug 03 04:52:30.436889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2445/4888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:30 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:30.463218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:30.464159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:30.471025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.471493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.473403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.474050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.642910 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dccb9d50-7428-4951-ab82-5e233242c6b7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action" status: 202 len: 0 microversion: 2.1 time: 1.141524 Aug 03 04:52:30.642910 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2444/4889] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:29 2022] POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action => generated 0 bytes in 1143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:30.654315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:30.654315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:30.674919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.675378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.680087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.680649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.754901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:30.764098 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4bd3498e-0c4c-4b2e-8fb0-664313d729e0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.310815 Aug 03 04:52:30.785495 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2446/4890] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:30 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:30.798021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:30.799974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:30.819074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.823169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:30.823169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:30.823169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.208311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:31.214316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:31.223186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:31.225206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:31.225631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a3bc413-893a-4188-9ba3-821cd1d114e6 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.438527 Aug 03 04:52:31.226961 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2447/4891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:30 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:31.232124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2097562119"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:31.233040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:31.240255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.240872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.241720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.242159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.244051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aad15950-be88-4749-a066-64ea47a01c95 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.583200 Aug 03 04:52:31.245551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2445/4892] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:30 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:31.255537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1fbcba1f-5edb-403c-9f54-0213b1c6512c req-ea164110-1fe8-4409-98cd-26bd69f8dd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:31.267341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1fbcba1f-5edb-403c-9f54-0213b1c6512c req-ea164110-1fe8-4409-98cd-26bd69f8dd09 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.268451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1fbcba1f-5edb-403c-9f54-0213b1c6512c req-ea164110-1fe8-4409-98cd-26bd69f8dd09 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.287438 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1fbcba1f-5edb-403c-9f54-0213b1c6512c req-ea164110-1fe8-4409-98cd-26bd69f8dd09 service nova] Creating event network-changed:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:52:31.293618 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1fbcba1f-5edb-403c-9f54-0213b1c6512c req-ea164110-1fe8-4409-98cd-26bd69f8dd09 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045272 Aug 03 04:52:31.298068 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2446/4893] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:31.300679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:31.301591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:31.308722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.309647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.310600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.311269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.547846 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.network.security_group_api [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Removing security group f71aa12c-4dc4-4582-b5b0-089b38601702 from port e9e8579f-30a0-46fe-b72c-d64e0d9596b7 Aug 03 04:52:31.784565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:31.797395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cf210d63-d2d0-4d19-b86d-cde3ecd8e88c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.501768 Aug 03 04:52:31.799426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2447/4894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:31 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:31.821769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:31.822542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:31.829295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.830183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.831125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:31.831708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:31.859638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'flavor' on Instance uuid 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:32.225249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:32.312991 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da856dfd-1e13-4168-a235-0cfc90c68a40 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.493828 Aug 03 04:52:32.315260 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2448/4895] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:31 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:52:32.345091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:32.345913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:32.359731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:32.368632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:32.370161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:32.370827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:32.937159 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-482db422-bb98-453b-89ed-096a6130c32c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action" status: 202 len: 0 microversion: 2.1 time: 1.708745 Aug 03 04:52:32.942740 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2448/4896] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:31 2022] POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action => generated 0 bytes in 1710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:32.946142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:32.946804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:32.960012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:32.960934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:32.961951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:32.962633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:33.280864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:33.290142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ac02e16-cab8-48f9-b59a-2380c907ef69 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.971685 Aug 03 04:52:33.320979 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2449/4897] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:32 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:33.320979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:33.320979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:33.322220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:33.322927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:33.323879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:33.324509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:33.398951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:33.411177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:33.414004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:33.414954 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5d105ea-141d-45ed-a3c6-376b1f4ac6d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.474965 Aug 03 04:52:33.415334 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2449/4898] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:32 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:33.421039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65f0ef5b-e85b-48e8-adaa-18ec09a4615c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'create', calling method: .version_select at 0x7fdd47e00040>, body: {"pool": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:33.645755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:33.658253 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f1bd862-c18f-4488-9555-c2cb7719d444 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1660 microversion: 2.1 time: 0.347739 Aug 03 04:52:33.659323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2450/4899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:33 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1660 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:33.666448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-34f2fea6-0082-4fe3-bd66-26cd49dd65a7 req-e57c8232-f45c-4678-ad33-3dfbaa78104f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:33.681843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-34f2fea6-0082-4fe3-bd66-26cd49dd65a7 req-e57c8232-f45c-4678-ad33-3dfbaa78104f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:33.682637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-34f2fea6-0082-4fe3-bd66-26cd49dd65a7 req-e57c8232-f45c-4678-ad33-3dfbaa78104f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:33.702118 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-34f2fea6-0082-4fe3-bd66-26cd49dd65a7 req-e57c8232-f45c-4678-ad33-3dfbaa78104f service nova] Creating event network-changed:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:52:33.715925 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-34f2fea6-0082-4fe3-bd66-26cd49dd65a7 req-e57c8232-f45c-4678-ad33-3dfbaa78104f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054416 Aug 03 04:52:33.716566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2451/4900] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:33.725776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:33.728671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:33.737698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:33.738722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:33.739889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:33.740575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:34.026091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e2c3f0f7-3804-4f74-bd1d-640c74fe6851 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action" status: 202 len: 0 microversion: 2.1 time: 0.306958 Aug 03 04:52:34.038189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2452/4901] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:33 2022] POST /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:34.064725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:34.071755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:34.097898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:34.098364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:34.099155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:34.099593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:34.600531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:34.610543 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28974952-0210-458d-bbf9-b68a8fb6889b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1666 microversion: 2.1 time: 0.570989 Aug 03 04:52:34.611283 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2453/4902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:34 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1666 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:34.615932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:34.616674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:34.623604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:34.624430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:34.625480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:34.626128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:35.019690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:35.053435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd9406c8-09e7-4230-ae09-ba76ce06d9e2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.437879 Aug 03 04:52:35.053435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2454/4903] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:34 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:35.060675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:35.061472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:35.071145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:35.072002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:35.077445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:35.078230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:35.543478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:35.554676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:35.556308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:35.557562 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cec3048a-95fa-43b0-a08f-fcd480220f11 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.503516 Aug 03 04:52:35.558272 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2455/4904] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:35 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:35.633696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:35.634386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:35.643218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:35.643683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:35.644571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:35.645228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:35.959345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:35.966701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d8c003d-7b13-4ee8-8dba-5566fad4ce9c tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1666 microversion: 2.1 time: 0.338162 Aug 03 04:52:35.980608 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2456/4905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:35 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1666 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:36.072475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:36.073094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:36.108374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:36.109084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:36.109952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:36.110407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:36.505974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:36.518806 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8bfcf422-100a-43cb-84ea-3f8f46d2bf2b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.449992 Aug 03 04:52:36.521167 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2457/4906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:36 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:36.583422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:36.589952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:36.590835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:36.591384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:36.592263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:36.592813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:36.995231 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65f0ef5b-e85b-48e8-adaa-18ec09a4615c tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.578628 Aug 03 04:52:36.996395 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2450/4907] 10.222.0.72 () {60 vars in 1170 bytes} [Wed Aug 3 04:52:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:37.002428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:37.003291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:37.017092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.020571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:37.023379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.028527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:37.133865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:37.146208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:37.148108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:37.150508 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4fa05f4-2b78-4168-8203-51bcfcd22eaf tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.571310 Aug 03 04:52:37.162711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2458/4908] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:36 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:52:37.184104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.49"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:37.189701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:37.199970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.201406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:37.202524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.203757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:37.248571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Acquired lock "refresh_cache-fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:52:37.390012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:37.405953 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5c6fb69a-8f4e-45b3-acf8-9b0448ad2a04 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.408264 Aug 03 04:52:37.410585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2451/4909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:36 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:37.434302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:37.435284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:37.443248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.454276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:37.455628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:37.456283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:38.298650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:38.313737 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0653e877-0d5e-4e39-a784-d7ba4b3fd84f tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1669 microversion: 2.1 time: 0.883401 Aug 03 04:52:38.318358 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2452/4910] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:37 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1669 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:38.333511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:38.334154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:38.356097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:38.356580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:38.361193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:38.361798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:38.912803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:38.926337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac7fa301-20ed-4691-be52-8551cc53b20c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.609120 Aug 03 04:52:38.932431 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2453/4911] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:38 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:38.939934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:38.940581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:38.952703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:38.953288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:38.954311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:38.962312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:39.426647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:39.444449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:39.452144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:39.463554 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-150211e6-a7b0-45b9-95d0-35c45a2c8841 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.529726 Aug 03 04:52:39.465594 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2454/4912] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:38 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:39.483722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:39.484556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:39.504119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:39.504874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:39.507800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:39.510977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:39.586415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:39.595398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Working on deleting snapshot f135a8d8-030a-4149-a79d-d8bdd228b3e6 from shelved instance... Aug 03 04:52:40.227072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:52:41.624360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Updating instance_info_cache with network_info: [{"id": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7", "address": "fa:16:3e:20:75:13", "network": {"id": "e846b1ee-021c-4040-9e1d-a2601a896f4d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1556937836-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "22b4107a8b4e48189d60d8d32552402f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape9e8579f-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:52:41.792054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Releasing lock "refresh_cache-fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:52:41.793047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d647fbd7-7925-4019-b704-dfb46b3e1ead tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action" status: 202 len: 0 microversion: 2.1 time: 4.628987 Aug 03 04:52:41.801940 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2459/4913] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:37 2022] POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action => generated 0 bytes in 4631 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:52:41.801940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:41.801940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:41.808129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:41.808661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:41.810899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:41.811358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:42.577088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:42.588211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75231ffe-cc23-49c2-915a-926e3853b4bc tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.792576 Aug 03 04:52:42.589086 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2460/4914] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:41 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:42.611778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0f09c75d-e171-41cc-b352-1706392498cb req-fc0cf8da-8c57-4cc1-9e4a-5db6e0a389d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:42.627894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0f09c75d-e171-41cc-b352-1706392498cb req-fc0cf8da-8c57-4cc1-9e4a-5db6e0a389d8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:42.629252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0f09c75d-e171-41cc-b352-1706392498cb req-fc0cf8da-8c57-4cc1-9e4a-5db6e0a389d8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:42.642270 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0f09c75d-e171-41cc-b352-1706392498cb req-fc0cf8da-8c57-4cc1-9e4a-5db6e0a389d8 service nova] Creating event network-changed:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:52:42.655468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0f09c75d-e171-41cc-b352-1706392498cb req-fc0cf8da-8c57-4cc1-9e4a-5db6e0a389d8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048465 Aug 03 04:52:42.656096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2461/4915] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:42.662006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:42.662713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:42.677447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Doing local delete in cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) {{(pid=120832) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 03 04:52:42.678003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:42.678401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:42.679182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:42.679623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:42.685479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:42.686086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:42.686692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 03 04:52:42.702140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] deallocate_for_instance() {{(pid=120832) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 03 04:52:43.297229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:43.314523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:43.318432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:43.318760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ac37396-d1c6-4ea4-98dd-508d05503f06 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.661489 Aug 03 04:52:43.319746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2462/4916] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:42 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:43.324709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.49"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:43.695944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:43.707111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:43.707910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:43.709105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:43.710590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:44.044939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Acquired lock "refresh_cache-fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 04:52:44.522702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Updating instance_info_cache with network_info: [] {{(pid=120832) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:52:45.403115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f49a3f2-61f3-4e7b-9c34-2ffc6d9257c1 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 204 len: 0 microversion: 2.1 time: 5.933727 Aug 03 04:52:45.404807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2455/4917] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:39 2022] DELETE /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 0 bytes in 5938 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:52:45.711337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Action: 'create', calling method: .version_select at 0x7fdd47d62c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:45.769375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Getting quotas for project 8ef244cabfa44e4084370a30416f747d. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:52:45.775395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Getting quotas for user 1bc8aaa86e614644b02e000bf8acb529 and project 8ef244cabfa44e4084370a30416f747d. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:52:45.977703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Getting quotas for project 8ef244cabfa44e4084370a30416f747d. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:52:45.986076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Getting quotas for user 1bc8aaa86e614644b02e000bf8acb529 and project 8ef244cabfa44e4084370a30416f747d. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:52:46.005089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16d6a6aa-a4c5-4ed9-b4cf-82fbe60a2121 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.598854 Aug 03 04:52:46.006715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2456/4918] 10.222.0.72 () {62 vars in 1214 bytes} [Wed Aug 3 04:52:45 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:52:46.014494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:46.015336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:46.022285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:46.029007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:46.029007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:46.029007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:46.539187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Building network info cache for instance {{(pid=120831) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 03 04:52:46.849833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:46.853784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:46.868138 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c87f38bb-d126-45f9-8433-62ad3eba1bba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.858035 Aug 03 04:52:46.869439 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2457/4919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:46 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:46.885197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:46.887170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:46.898092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:46.898990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:46.900163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:46.900786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.666346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:47.683536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:47.685230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:47.691267 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18e64cb8-7336-44f4-8946-e8250b0846a4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.815906 Aug 03 04:52:47.705500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2458/4920] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:46 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:47.717141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-55f00a56-8ef4-47e4-a751-148026d1ac6c req-483a8255-e9a0-47dd-a1d1-f801c9057c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3408908f-2b74-4693-a606-fd33b8b5c029", "name": "network-vif-deleted", "tag": "086aec99-839d-41e8-b1c0-793ede1f75dc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:47.728736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-55f00a56-8ef4-47e4-a751-148026d1ac6c req-483a8255-e9a0-47dd-a1d1-f801c9057c43 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:47.729442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-55f00a56-8ef4-47e4-a751-148026d1ac6c req-483a8255-e9a0-47dd-a1d1-f801c9057c43 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.747250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.server_external_events [req-55f00a56-8ef4-47e4-a751-148026d1ac6c req-483a8255-e9a0-47dd-a1d1-f801c9057c43 service nova] Unable to find a host for instance 3408908f-2b74-4693-a606-fd33b8b5c029. Dropping event network-vif-deleted {{(pid=120832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 04:52:47.748525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-55f00a56-8ef4-47e4-a751-148026d1ac6c req-483a8255-e9a0-47dd-a1d1-f801c9057c43 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035585 Aug 03 04:52:47.749302 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2459/4921] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 04:52:47.754193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:47.755063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3408908f-2b74-4693-a606-fd33b8b5c029] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:47.761921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:47.762606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.763546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:47.764261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.783285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 HTTP/1.1 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '3408908f-2b74-4693-a606-fd33b8b5c029'} Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:47.786382 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. Aug 03 04:52:47.791697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:47.793604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 404 to user: Instance 3408908f-2b74-4693-a606-fd33b8b5c029 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:47.794738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ff6fdc8-3afc-460c-89d5-edef6d60b997 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029" status: 404 len: 111 microversion: 2.1 time: 0.044354 Aug 03 04:52:47.795852 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2460/4922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:47 2022] GET /compute/v2.1/servers/3408908f-2b74-4693-a606-fd33b8b5c029 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:47.802035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-671b923c-9965-4c60-92a3-64b53eaa7569 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:47.818663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:47.822960 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-671b923c-9965-4c60-92a3-64b53eaa7569 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.025440 Aug 03 04:52:47.835527 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2461/4923] 10.222.0.72 () {60 vars in 1193 bytes} [Wed Aug 3 04:52:47 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:52:47.836612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:47.837387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:47.845073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:47.845938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.848130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:47.849504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:47.883386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:48.306970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f4a2b04-d448-46bb-954a-6bdf3a88a743 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 204 len: 0 microversion: 2.1 time: 0.480301 Aug 03 04:52:48.312169 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2462/4924] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:47 2022] DELETE /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:52:48.324836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6883520-824d-4410-9f2f-55ec2f7832f1 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:48.336818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Updating instance_info_cache with network_info: [{"id": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7", "address": "fa:16:3e:20:75:13", "network": {"id": "e846b1ee-021c-4040-9e1d-a2601a896f4d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1556937836-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "22b4107a8b4e48189d60d8d32552402f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape9e8579f-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120831) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 03 04:52:48.347582 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6883520-824d-4410-9f2f-55ec2f7832f1 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798" status: 200 len: 235 microversion: 2.64 time: 0.032814 Aug 03 04:52:48.351500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2463/4925] 10.222.0.72 () {60 vars in 1304 bytes} [Wed Aug 3 04:52:48 2022] GET /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798 => generated 235 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:52:48.354480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:48.355836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:48.364515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:48.365346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:48.367360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:48.368039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:48.526932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Releasing lock "refresh_cache-fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" {{(pid=120831) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 04:52:48.527813 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80474794-b0d0-40a3-88c6-d1bc14227e14 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action" status: 202 len: 0 microversion: 2.1 time: 5.206917 Aug 03 04:52:48.528638 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2463/4926] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:43 2022] POST /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a/action => generated 0 bytes in 5208 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 03 04:52:48.536327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:48.537338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:48.545250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:48.545922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:48.551591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:48.552255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:48.594924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:48.801471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:48.817444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:48.823538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc1d15e2-4efa-4d36-8c31-e27e373f2dc0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1465 microversion: 2.1 time: 0.292057 Aug 03 04:52:48.824504 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2464/4927] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:48 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1465 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:48.834823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76f71753-bf29-411f-b87e-1b502ccb2c4c tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:48.845734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb2b6523-4616-462d-bf07-230335a7e44c tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.495521 Aug 03 04:52:48.853560 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2464/4928] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:48 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:48.862944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5293c0ef-568a-49d7-8ea3-7ffda90125e5 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '.version_select at 0x7fdd47c8b8b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:49.030893 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76f71753-bf29-411f-b87e-1b502ccb2c4c tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798" status: 204 len: 0 microversion: 2.64 time: 0.205012 Aug 03 04:52:49.039049 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2465/4929] 10.222.0.72 () {60 vars in 1307 bytes} [Wed Aug 3 04:52:48 2022] DELETE /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:52:49.041167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:49.046910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:49.055306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:49.055852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:49.056745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:49.057382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:49.768777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:49.788987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:49.790507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:49.791684 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7005afdf-27e0-4524-9de0-0fd2289177b3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.759001 Aug 03 04:52:49.793885 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2466/4930] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:49 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:49.798958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03804af8-cd55-4360-84ad-3bc85a5e1244 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:49.805984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-03804af8-cd55-4360-84ad-3bc85a5e1244 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] HTTP exception thrown: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03804af8-cd55-4360-84ad-3bc85a5e1244 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Request method failure captured: Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798 HTTP/1.1 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f8buZT5OcZE5uXsCj1YCYFJZflhuqBO5IWX8EGTbvCM6cqNomwr8Ua6Q86dnS0jXpiSCqXL4Sqy2JFL4e5dpulCbgv55rPa9Jsn7vfk5mDNoI_AFMZT7FKm2qof-9qGk4tcDbNHE76AEt2ifSHmoCWUphnOxlY_vhH42Np-JWDkerE Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.64 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 8ef244cabfa44e4084370a30416f747d Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerGroup264TestJSON-441209798 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8ef244cabfa44e4084370a30416f747d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8ef244cabfa44e4084370a30416f747d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8ef244cabfa44e4084370a30416f747d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8ef244cabfa44e4084370a30416f747d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerGroup264TestJSON-441209798 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 8ef244cabfa44e4084370a30416f747d Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerGroup264TestJSON-441209798 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerGroup264TestJSON-441209798-project Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1bc8aaa86e614644b02e000bf8acb529 Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerGroup264TestJSON-441209798-project Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ce35c062-e254-4ec3-abed-df4d019b9798'} Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:49.816392 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03804af8-cd55-4360-84ad-3bc85a5e1244 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] Returning 404 to user: Instance group ce35c062-e254-4ec3-abed-df4d019b9798 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03804af8-cd55-4360-84ad-3bc85a5e1244 tempest-ServerGroup264TestJSON-441209798 tempest-ServerGroup264TestJSON-441209798-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798" status: 404 len: 117 microversion: 2.64 time: 0.019864 Aug 03 04:52:49.820081 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2467/4931] 10.222.0.72 () {60 vars in 1307 bytes} [Wed Aug 3 04:52:49 2022] DELETE /compute/v2.1/os-server-groups/ce35c062-e254-4ec3-abed-df4d019b9798 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:52:49.825765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0cda2c9e-88ff-4d98-8d2d-a559450169a0 req-b839592d-57e6-4c43-9d26-3e73ee8d2377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:49.863836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0cda2c9e-88ff-4d98-8d2d-a559450169a0 req-b839592d-57e6-4c43-9d26-3e73ee8d2377 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:49.864620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0cda2c9e-88ff-4d98-8d2d-a559450169a0 req-b839592d-57e6-4c43-9d26-3e73ee8d2377 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:49.884444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0cda2c9e-88ff-4d98-8d2d-a559450169a0 req-b839592d-57e6-4c43-9d26-3e73ee8d2377 service nova] Creating event network-changed:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:52:49.892606 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0cda2c9e-88ff-4d98-8d2d-a559450169a0 req-b839592d-57e6-4c43-9d26-3e73ee8d2377 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071450 Aug 03 04:52:49.901571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2468/4932] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:49.908044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:49.913110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:49.951485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:49.958186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:49.959908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:49.960415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:50.547166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:50.555965 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc806577-56f9-452b-a232-e0ad320e8872 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1465 microversion: 2.1 time: 0.652089 Aug 03 04:52:50.561579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2469/4933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:49 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1465 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:50.577205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:50.599316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:50.615169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:50.615918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:50.619507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:50.620171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:51.387471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5293c0ef-568a-49d7-8ea3-7ffda90125e5 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "DELETE /compute/v2.1/os-floating-ips/722b2dac-771c-4b12-a6e8-661b3f615623" status: 202 len: 0 microversion: 2.1 time: 2.532698 Aug 03 04:52:51.388082 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2465/4934] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:52:48 2022] DELETE /compute/v2.1/os-floating-ips/722b2dac-771c-4b12-a6e8-661b3f615623 => generated 0 bytes in 2534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:51.398048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:51.398680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:51.418144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:51.419609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:51.420495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:51.425889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:51.430813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:51.445600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5acd63e1-2769-4e85-88dc-f6e84ca2931a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.877019 Aug 03 04:52:51.446560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2470/4935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:50 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:51.463860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-090c06b8-ff58-4ef8-947d-8549ff5ff945 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '.version_select at 0x7fdd546238b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:51.942343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:51.969672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:51.975924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:51.989971 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-891888fd-1ec4-4a05-9782-7c679eca46f7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.587524 Aug 03 04:52:51.989971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2466/4936] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:51 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:52.023361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:52.029811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:52.052680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.053498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.055215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.059892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.297142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-090c06b8-ff58-4ef8-947d-8549ff5ff945 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "DELETE /compute/v2.1/os-security-groups/f71aa12c-4dc4-4582-b5b0-089b38601702" status: 202 len: 0 microversion: 2.1 time: 0.847425 Aug 03 04:52:52.297746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2471/4937] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 04:52:51 2022] DELETE /compute/v2.1/os-security-groups/f71aa12c-4dc4-4582-b5b0-089b38601702 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:52:52.306849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:52.307844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:52.315555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:52.318046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.318515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.326135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de00e214-720d-4fbb-9a60-858b49987c57 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1465 microversion: 2.1 time: 0.319616 Aug 03 04:52:52.354059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.354059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.354299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2467/4938] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:51 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1465 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:52.425444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:52.469349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:52.470626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:52.482748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.493047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.496469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.499045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.889428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:52.899899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-023adc7c-155b-45c9-9fa6-916acd18f82a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1734 microversion: 2.1 time: 0.434999 Aug 03 04:52:52.905040 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2468/4939] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:52 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:52:52.916977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8b6611cb-7be8-41c2-b0d0-294eefb2a9ee req-9deb7555-f174-46ff-8f0f-d88fc08d8d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d426fd-2177-457b-bc63-837c5825fb08", "name": "network-vif-deleted", "tag": "84846f8e-b415-4ca0-914d-a3f7254b6452"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:52.943262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8b6611cb-7be8-41c2-b0d0-294eefb2a9ee req-9deb7555-f174-46ff-8f0f-d88fc08d8d3a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.945227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8b6611cb-7be8-41c2-b0d0-294eefb2a9ee req-9deb7555-f174-46ff-8f0f-d88fc08d8d3a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.950540 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6276fa62-7940-4877-8014-bcb41e075d31 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 204 len: 0 microversion: 2.1 time: 0.647655 Aug 03 04:52:52.954287 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2472/4940] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:52 2022] DELETE /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:52:52.962395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:52.964058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8b6611cb-7be8-41c2-b0d0-294eefb2a9ee req-9deb7555-f174-46ff-8f0f-d88fc08d8d3a service nova] Creating event network-vif-deleted:84846f8e-b415-4ca0-914d-a3f7254b6452 for instance 20d426fd-2177-457b-bc63-837c5825fb08 on n-h2-826756-5 Aug 03 04:52:52.969787 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8b6611cb-7be8-41c2-b0d0-294eefb2a9ee req-9deb7555-f174-46ff-8f0f-d88fc08d8d3a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063288 Aug 03 04:52:52.970659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2469/4941] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:52.972345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:52.979403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.980145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:52.988058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:52.988058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.015901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:53.019375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:53.031782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.032641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.034392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.035316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.364412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:53.369317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:53.379682 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54be7904-6e00-4f62-8c5c-0eaecf3109d7 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1510 microversion: 2.1 time: 0.423797 Aug 03 04:52:53.381040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2473/4942] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:52 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:53.385042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:53.386473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:53.387550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:53.387702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:53.393139 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f8a4aca-be9f-4cf2-af62-1a6944939144 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.382025 Aug 03 04:52:53.394127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2470/4943] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:53 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:53.394887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.395834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.396857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.398549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.447824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.449553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.453197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'fault' on Instance uuid 20d426fd-2177-457b-bc63-837c5825fb08 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:53.532814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:53.544730 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27e46633-23d4-4f8f-a74c-ee23ce5992b6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1305 microversion: 2.1 time: 0.160303 Aug 03 04:52:53.554112 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2474/4944] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:53 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:53.930744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:53.931658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:53.941614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.944161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:53.946518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:53.947218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:54.258686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:54.272704 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-120861fa-7852-4b70-b2ae-23f822450600 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1714 microversion: 2.1 time: 0.342937 Aug 03 04:52:54.284382 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2471/4945] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:53 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1714 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:54.403178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:54.404626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:54.423281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:54.425184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:54.435161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:54.441369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:54.444785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:54.448133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:54.454644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:54.456802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:54.459138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:54.463442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:54.968958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:54.982774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4549f29-c278-4026-b9d7-ad6b9a0bb0c6 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1510 microversion: 2.1 time: 0.583172 Aug 03 04:52:54.996371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2475/4946] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:54 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1510 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:54.996371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:54.996371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:55.004967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.005068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:55.005490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.005490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.005490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.015078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:55.020605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:55.022218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78dd1908-5f0c-4815-a6d9-c88ba5c699de tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.603064 Aug 03 04:52:55.035865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2472/4947] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:54 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:55.044088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:55.053210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:55.053470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:55.053470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.053470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.053470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'fault' on Instance uuid 20d426fd-2177-457b-bc63-837c5825fb08 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:55.057569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.059313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.061048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.062055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.113657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:55.124089 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c70a337-c662-4de7-9217-2e7ea5b13160 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 200 len: 1305 microversion: 2.1 time: 0.134405 Aug 03 04:52:55.125287 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2476/4948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:54 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:55.171987 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Cannot 'detach_volume' instance 95d828b3-2ce2-4d35-b592-b2b98530f114 while it is in vm_state rescued Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments/28080298-5de8-4294-945e-00d5a3150961 HTTP/1.1 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'detach_volume' instance 95d828b3-2ce2-4d35-b592-b2b98530f114 while it is in vm_state rescued Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': '95d828b3-2ce2-4d35-b592-b2b98530f114', 'id': '28080298-5de8-4294-945e-00d5a3150961'} Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 95d828b3-2ce2-4d35-b592-b2b98530f114 while it is in vm_state rescued Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:55.173792 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 95d828b3-2ce2-4d35-b592-b2b98530f114 while it is in vm_state rescued Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 409 to user: Cannot 'detach_volume' instance 95d828b3-2ce2-4d35-b592-b2b98530f114 while it is in vm_state rescued {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c39511b-c530-4e92-a119-d86f4f4edde7 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments/28080298-5de8-4294-945e-00d5a3150961" status: 409 len: 152 microversion: 2.1 time: 0.140114 Aug 03 04:52:55.178678 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2473/4949] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:52:55 2022] DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments/28080298-5de8-4294-945e-00d5a3150961 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:52:55.185385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:55.186024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:55.192819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.193390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.194332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.194904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.509326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c7af7ff-6f21-4daf-9477-165c5775760d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/action" status: 202 len: 0 microversion: 2.1 time: 0.327866 Aug 03 04:52:55.510019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2477/4950] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:52:55 2022] POST /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 04:52:55.520193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:55.521175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:55.528431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.529115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.530121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:55.530625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:55.727645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:55.738044 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-103e50da-23af-4fc8-9972-277541398e3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1722 microversion: 2.1 time: 0.221067 Aug 03 04:52:55.748305 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2474/4951] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:55 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:56.011905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:56.013941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:56.026173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:56.026916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:56.027898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:56.028601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:56.058167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:56.059684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:56.062693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:56.069820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:56.076186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:56.076186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:56.076186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.012392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.022645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ccf25cf4-63f0-45c4-afac-55605b49cbdf tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1510 microversion: 2.1 time: 1.016315 Aug 03 04:52:57.038399 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2478/4952] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:56 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1510 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:57.043995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:57.044914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 20d426fd-2177-457b-bc63-837c5825fb08] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:57.055666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.056803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.058352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.059609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.083016 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 HTTP/1.1 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '20d426fd-2177-457b-bc63-837c5825fb08'} Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:52:57.084983 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. Aug 03 04:52:57.089228 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:52:57.090409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 404 to user: Instance 20d426fd-2177-457b-bc63-837c5825fb08 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:52:57.093326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ffd6d5a2-4d8f-455f-b7b8-c3fd534e5bd6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08" status: 404 len: 111 microversion: 2.1 time: 0.053444 Aug 03 04:52:57.094521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.094995 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2479/4953] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:57 2022] GET /compute/v2.1/servers/20d426fd-2177-457b-bc63-837c5825fb08 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:52:57.100900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:57.101531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:57.106192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.107974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.108802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.109310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.109733 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0a5ff1a-4323-4f06-a74c-0137b4e2aaf3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 1.067433 Aug 03 04:52:57.110083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.110944 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2475/4954] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:56 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:57.111270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.124422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:57.124934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:57.135009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.135478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.136284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.136903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.168999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:52:57.209150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:57.446970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.460128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1722 microversion: 2.1 time: 0.361021 Aug 03 04:52:57.462148 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2480/4955] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:57 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:57.464953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:57.466172 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94a4bb7f-34e4-41b1-9d99-644a8b676d4e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001558 Aug 03 04:52:57.473576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2481/4956] 10.222.0.72 () {56 vars in 886 bytes} [Wed Aug 3 04:52:57 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 04:52:57.533252 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fed698b7-3e3c-4203-b7ff-301eb69315d6 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 204 len: 0 microversion: 2.1 time: 0.419797 Aug 03 04:52:57.535067 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2476/4957] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:52:57 2022] DELETE /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:52:57.543127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:57.543837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:57.555006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.555651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.556638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.557327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.866191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:57.868543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a9d1485e-a5fc-45ff-a103-41794088c41e req-48aef238-f732-460f-997c-b68fd0bb9d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafd9a96-b3f1-4ae1-ac39-604a0b4f569a", "name": "network-vif-deleted", "tag": "e9e8579f-30a0-46fe-b72c-d64e0d9596b7"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:57.870031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:52:57.878313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b95b26d3-094e-4552-8f82-e47c8a8e1e33 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1506 microversion: 2.1 time: 0.338863 Aug 03 04:52:57.880965 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2482/4958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:57 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:57.901622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a9d1485e-a5fc-45ff-a103-41794088c41e req-48aef238-f732-460f-997c-b68fd0bb9d29 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:57.902084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a9d1485e-a5fc-45ff-a103-41794088c41e req-48aef238-f732-460f-997c-b68fd0bb9d29 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:57.934336 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a9d1485e-a5fc-45ff-a103-41794088c41e req-48aef238-f732-460f-997c-b68fd0bb9d29 service nova] Creating event network-vif-deleted:e9e8579f-30a0-46fe-b72c-d64e0d9596b7 for instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a on n-h2-826756-5 Aug 03 04:52:57.944024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a9d1485e-a5fc-45ff-a103-41794088c41e req-48aef238-f732-460f-997c-b68fd0bb9d29 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080753 Aug 03 04:52:57.948936 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2477/4959] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:58.045821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:58.049061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:58.071907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.072719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.082154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.082970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.136710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:58.138123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:58.150715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.158041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.161748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.161748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.271633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:58.280179 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dfc7d935-0a6e-4607-b833-8d762f7c46fb tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1468 microversion: 2.1 time: 0.239430 Aug 03 04:52:58.299788 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2483/4960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:58 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1468 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:58.305322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b71a7dce-5065-444a-ba99-29b5a8679805 req-2b6693fe-8f59-45d0-8431-b0f3d9beea3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "97b16f2c-c92b-4982-841b-793440779ba3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:52:58.331546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b71a7dce-5065-444a-ba99-29b5a8679805 req-2b6693fe-8f59-45d0-8431-b0f3d9beea3f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.332015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b71a7dce-5065-444a-ba99-29b5a8679805 req-2b6693fe-8f59-45d0-8431-b0f3d9beea3f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.364401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b71a7dce-5065-444a-ba99-29b5a8679805 req-2b6693fe-8f59-45d0-8431-b0f3d9beea3f service nova] Creating event network-vif-plugged:97b16f2c-c92b-4982-841b-793440779ba3 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:52:58.373328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b71a7dce-5065-444a-ba99-29b5a8679805 req-2b6693fe-8f59-45d0-8431-b0f3d9beea3f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071918 Aug 03 04:52:58.374176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2484/4961] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:52:58.483960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:58.484697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:58.498918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.499730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.500801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.502613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.816753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:58.829686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:58.836261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:58.837774 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43340adc-971f-4e58-b94d-d92e91f48e42 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.706769 Aug 03 04:52:58.840941 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2478/4962] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:58 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:52:58.907702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:58.910509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:58.922032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.923710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.925268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:58.928563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:58.928859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:58.940860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d223d0a0-0728-4529-b6a9-be80e874dd63 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1722 microversion: 2.1 time: 0.462064 Aug 03 04:52:58.941596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2485/4963] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:58 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1722 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:59.252568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:59.263019 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a57d690b-4c88-4b21-baff-cfd9dcee201a tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1506 microversion: 2.1 time: 0.360464 Aug 03 04:52:59.266179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2479/4964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:58 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:59.304079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:59.304804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:59.315694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.316150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.324293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.325009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.401572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.402159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.402695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lazy-loading 'fault' on Instance uuid fafd9a96-b3f1-4ae1-ac39-604a0b4f569a {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:52:59.774233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f57fce2de44ca8ee2eb18f0b3e436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b4107a8b4e48189d60d8d32552402f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:52:59.782140 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-725cd523-4532-426d-acc0-5af3d5e401aa tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 200 len: 1313 microversion: 2.1 time: 0.483099 Aug 03 04:52:59.785014 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2486/4965] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:59 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:52:59.864971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:59.865614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:59.881423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.881913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.882721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.883180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.963445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:52:59.964111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:52:59.971975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.972463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:52:59.981190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:52:59.982084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.778941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:00.797397 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-197bc85d-27e4-4b12-8f3a-c1f1ec07cdcb tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1728 microversion: 2.1 time: 0.837601 Aug 03 04:53:00.799564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2487/4966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:52:59 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1728 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:00.819950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:00.833457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3bdffd07-2aa8-483c-bae7-c67240731121 req-8f7eec8e-d95a-49d9-8408-8d9d79e0fca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1", "name": "network-vif-deleted", "tag": "05afef8c-d78a-4971-b296-05e6a67fd88b"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:00.834285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:00.836023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:00.837393 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1facc29-50f8-463f-b431-624ee52b826e tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.977220 Aug 03 04:53:00.838487 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2480/4967] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:52:59 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:00.845318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:00.847204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:00.867592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bdffd07-2aa8-483c-bae7-c67240731121 req-8f7eec8e-d95a-49d9-8408-8d9d79e0fca4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.868384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bdffd07-2aa8-483c-bae7-c67240731121 req-8f7eec8e-d95a-49d9-8408-8d9d79e0fca4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.878768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.879240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.887816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3bdffd07-2aa8-483c-bae7-c67240731121 req-8f7eec8e-d95a-49d9-8408-8d9d79e0fca4 service nova] Creating event network-vif-deleted:05afef8c-d78a-4971-b296-05e6a67fd88b for instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 on n-h2-826756-5 Aug 03 04:53:00.895444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3bdffd07-2aa8-483c-bae7-c67240731121 req-8f7eec8e-d95a-49d9-8408-8d9d79e0fca4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069060 Aug 03 04:53:00.897023 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2488/4968] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:00.902539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "437a55e5-d30f-4c6f-9001-dae1fc7f60f5"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "e592c4e7-ebc7-4698-a174-874f118b41b6"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:00.910736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.911445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.916785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.917778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.931664 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Creating event network-vif-plugged:437a55e5-d30f-4c6f-9001-dae1fc7f60f5 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:00.932495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Creating event network-vif-plugged:e592c4e7-ebc7-4698-a174-874f118b41b6 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:00.937015 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] Creating event network-vif-plugged:c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:00.944100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a8c9503f-ffa1-4446-be6e-f02a430e5f9d req-2274c2df-8db3-47aa-9467-f8587b7a0487 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045391 Aug 03 04:53:00.953224 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2489/4969] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:00.962630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:00.963686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] [instance: fafd9a96-b3f1-4ae1-ac39-604a0b4f569a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:00.981431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.982101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:00.983406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:00.984020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:01.002532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] HTTP exception thrown: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Request method failure captured: Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a HTTP/1.1 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f7USK18j6MaSl6peyoLdh1SpPBvaf1VN_lxKXe_Dv3tEGT2U8jVjP2nbBQttMd8DF2waheNG6ZSuaghrJuJBM6lv_Apd-3AkyYjPVVBfkiagBqPDIbQI7_td8XtBt1ywsbAggeLtAIPxymVfmuEvAD6SvAFmvxA1FLRMAYDdtLTpEw Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 22b4107a8b4e48189d60d8d32552402f Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-395438037 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/22b4107a8b4e48189d60d8d32552402f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/22b4107a8b4e48189d60d8d32552402f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_22b4107a8b4e48189d60d8d32552402f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/22b4107a8b4e48189d60d8d32552402f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-395438037 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 22b4107a8b4e48189d60d8d32552402f Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-395438037 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueTestJSONUnderV235-395438037-project Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d82f57fce2de44ca8ee2eb18f0b3e436 Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-395438037-project Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'fafd9a96-b3f1-4ae1-ac39-604a0b4f569a'} Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:01.005110 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] Returning 404 to user: Instance fafd9a96-b3f1-4ae1-ac39-604a0b4f569a could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:01.018944 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf1f6c5f-d530-411b-b1f9-b1bf27036435 tempest-ServerRescueTestJSONUnderV235-395438037 tempest-ServerRescueTestJSONUnderV235-395438037-project] 10.222.0.72 "GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a" status: 404 len: 111 microversion: 2.1 time: 0.055541 Aug 03 04:53:01.020041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:01.020677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2490/4970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:00 2022] GET /compute/v2.1/servers/fafd9a96-b3f1-4ae1-ac39-604a0b4f569a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:53:01.021874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:01.023551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'fault' on Instance uuid 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:01.029979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:01.038118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:01.059694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:01.059925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:01.060745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:01.061186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:01.233935 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c6e9838-d128-40bb-911b-bd715a723104 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211672 Aug 03 04:53:01.234576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2491/4971] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:53:01 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:01.380882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:01.392987 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d46d69c-7b16-46b7-9c96-b1e4b4e900cb tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 200 len: 1304 microversion: 2.1 time: 0.552922 Aug 03 04:53:01.394249 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2481/4972] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:00 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 1304 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:01.865603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:01.866785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:01.879323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:01.880028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:01.880987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:01.886481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:02.417565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:02.419024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:02.429483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:02.431004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:02.432736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:02.433656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:02.458264 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 HTTP/1.1 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1'} Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:02.462196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:02.466059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 404 to user: Instance 3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:02.466514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d77d1f9-e655-4a63-911f-6386e0e0d2ae tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1" status: 404 len: 111 microversion: 2.1 time: 0.054937 Aug 03 04:53:02.468645 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2482/4973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:02 2022] GET /compute/v2.1/servers/3bc0dd33-f3ec-4bab-aca0-8a78c3224bc1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:53:02.481964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:02.482799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:02.491075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:02.494843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:02.500016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:02.505013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:02.507568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:02.511169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:02.516654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:02.520152 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-885cc83b-6f33-456f-b3ee-1ac3ee69ba88 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.658638 Aug 03 04:53:02.521544 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2492/4974] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:01 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:02.573260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:53:02.985512 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b10e68bf-1e7a-4436-b02a-e864b14e29ec tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 204 len: 0 microversion: 2.1 time: 0.509787 Aug 03 04:53:02.989093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2483/4975] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:53:02 2022] DELETE /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:53:02.990501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "cf3e5ac9-04a7-4f43-a57e-a03909ef5526"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "dbf790c9-1b50-46b1-aee1-8e6be6b98806"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-plugged", "status": "completed", "tag": "e34306e5-c6ae-4036-861c-45f67d309de1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:03.011922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:03.014968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:03.041361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:03.043895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:03.044367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:03.049861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:03.051796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:03.051796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:03.064005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Creating event network-vif-plugged:cf3e5ac9-04a7-4f43-a57e-a03909ef5526 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:03.064634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Creating event network-vif-plugged:dbf790c9-1b50-46b1-aee1-8e6be6b98806 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:03.065302 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] Creating event network-vif-plugged:e34306e5-c6ae-4036-861c-45f67d309de1 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:03.090365 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f0b0a1c3-0ec7-4b40-85a5-443e44071c1f req-cb07d710-dac8-4c99-89d6-aa7f4c375b9f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.111395 Aug 03 04:53:03.091416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2493/4976] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:53:03.552302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:03.557697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:03.575826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:03.576454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:03.577800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:03.578251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:03.775924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:03.788492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43848c27-c6fd-4b47-bfae-81a2c4218553 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1494 microversion: 2.1 time: 0.793715 Aug 03 04:53:03.789820 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2484/4977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:02 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1494 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:04.038976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:04.056599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:04.056599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:04.069649 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ffb6819d-352c-4105-8e72-6a5e92011d51 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.523491 Aug 03 04:53:04.102134 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2494/4978] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:03 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:04.606421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-446a56d7-dc5b-40fa-8c9d-df9f3460d74e req-1a475e5e-6c9a-4fb1-b08f-4df1aebf8dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:04.620552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-446a56d7-dc5b-40fa-8c9d-df9f3460d74e req-1a475e5e-6c9a-4fb1-b08f-4df1aebf8dd5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:04.621390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-446a56d7-dc5b-40fa-8c9d-df9f3460d74e req-1a475e5e-6c9a-4fb1-b08f-4df1aebf8dd5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:04.639365 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-446a56d7-dc5b-40fa-8c9d-df9f3460d74e req-1a475e5e-6c9a-4fb1-b08f-4df1aebf8dd5 service nova] Creating event network-changed:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:53:04.646174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-446a56d7-dc5b-40fa-8c9d-df9f3460d74e req-1a475e5e-6c9a-4fb1-b08f-4df1aebf8dd5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055638 Aug 03 04:53:04.647510 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2485/4979] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:04.810668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:04.811546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:04.821022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:04.821665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:04.822847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:04.823445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:05.103348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:05.104133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:05.134949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:05.135514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:05.136406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:05.137018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:05.635123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:05.646247 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43470a9d-c3ed-4738-9ef5-61e9501d715d tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 200 len: 1452 microversion: 2.1 time: 0.839493 Aug 03 04:53:05.654928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2495/4980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:04 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 1452 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:05.961643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:05.972496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:05.981832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:05.981832 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76c2407e-f910-41ac-b782-0db56210cf64 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1878 microversion: 2.32 time: 0.882012 Aug 03 04:53:05.981832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2486/4981] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:05 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1878 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:06.668994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:06.669790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 310064db-388e-49e3-adb3-437a7dfe0567] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:06.677598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:06.678224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:06.679000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:06.679464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:06.680085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}, {"server_uuid": "310064db-388e-49e3-adb3-437a7dfe0567", "name": "network-vif-deleted", "tag": "df7f5560-d681-44e6-b63a-3cd5f48a9b5e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:06.694211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:06.695092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:06.716077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 HTTP/1.1 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '310064db-388e-49e3-adb3-437a7dfe0567'} Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:06.718827 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. Aug 03 04:53:06.725093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:06.727795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 404 to user: Instance 310064db-388e-49e3-adb3-437a7dfe0567 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:06.733826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-739886b4-ce47-42fb-97f0-b65679503ddd tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567" status: 404 len: 111 microversion: 2.1 time: 0.066376 Aug 03 04:53:06.737113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] Creating event network-changed:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:53:06.737113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] Creating event network-vif-deleted:df7f5560-d681-44e6-b63a-3cd5f48a9b5e for instance 310064db-388e-49e3-adb3-437a7dfe0567 on n-h2-826756-5 Aug 03 04:53:06.738365 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2496/4982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:06 2022] GET /compute/v2.1/servers/310064db-388e-49e3-adb3-437a7dfe0567 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:53:06.746818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:06.749894 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-cc4557fb-10f7-4518-ba28-aa98d57cb924 req-5a4b5c32-5b6f-48aa-9471-f5564dc06c62 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.073328 Aug 03 04:53:06.751036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2487/4983] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:53:06.751953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:06.771328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:06.772175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:06.773229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:06.773878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:06.808145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:53:07.014740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:07.018117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:07.030562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.031595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:07.032751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.034309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:07.321531 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c110e380-13e3-464c-9e86-de72226461ac tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 204 len: 0 microversion: 2.1 time: 0.578736 Aug 03 04:53:07.322310 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2497/4984] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:53:06 2022] DELETE /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:53:07.514845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-205177465", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:07.599505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:53:07.599937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:53:07.600462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:53:07.601088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:53:07.601751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:53:07.612961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.613923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:07.614913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.615558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:07.628386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:07.645709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:07.647394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:07.648759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e6fdc85-aa1a-4825-aab8-35209c7b2cb5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2828 microversion: 2.32 time: 0.653457 Aug 03 04:53:07.660298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Getting quotas for project 169f8169523e4e819b25e384c3404c41. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:53:07.666161 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2488/4985] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:06 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2828 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:07.666279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Getting quotas for user e8b3ace78fa847228b46beb3765761ee and project 169f8169523e4e819b25e384c3404c41. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:53:07.666388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:07.666388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:07.686548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:53:07.689662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.690196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:53:07.691440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:07.692498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:07.693100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:08.105909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73539034-4515-479f-936f-15926b9c2228 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.781621 Aug 03 04:53:08.111127 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2498/4986] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:53:08.148887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:08.151559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:08.156852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:08.169969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf9c6b6e-c573-4bc1-b370-13febd110a47 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1675 microversion: 2.1 time: 0.514341 Aug 03 04:53:08.170584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2489/4987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:07 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1675 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:08.184339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:08.185573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:08.191220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:08.193592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:08.195425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:08.196826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:08.328186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:08.328186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:08.335759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:08.337123 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b065e95-1f25-44fa-aab3-0dfafa0828cf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1277 microversion: 2.54 time: 0.161600 Aug 03 04:53:08.338174 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2490/4988] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:08 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:08.500369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98b377c3-e55e-4b80-8354-c76ff45f67dd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.387695 Aug 03 04:53:08.501347 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2499/4989] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:53:08 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72/os-interface => generated 1829 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:09.192346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:09.193151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:09.200993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:09.201448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:09.202233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:09.202674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:09.365047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:09.372605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:09.486524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:09.496124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:09.498087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:09.498682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:09.500009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52ebd9e1-655d-4d68-9c16-2079f34c9b12 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1277 microversion: 2.54 time: 0.142222 Aug 03 04:53:09.510408 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3814308-dba0-4c97-9fd0-dbcb5b1678d5 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1675 microversion: 2.1 time: 0.321673 Aug 03 04:53:09.511950 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2491/4990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:09 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1675 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:09.513411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2500/4991] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:09 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:09.810337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-68c961bf-c779-4910-9978-f43e7f31c254 req-a090a81f-15b6-4531-9cbd-e5a1a1810262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "tag": "e34306e5-c6ae-4036-861c-45f67d309de1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:09.822109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-68c961bf-c779-4910-9978-f43e7f31c254 req-a090a81f-15b6-4531-9cbd-e5a1a1810262 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:09.822544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-68c961bf-c779-4910-9978-f43e7f31c254 req-a090a81f-15b6-4531-9cbd-e5a1a1810262 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:09.835890 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-68c961bf-c779-4910-9978-f43e7f31c254 req-a090a81f-15b6-4531-9cbd-e5a1a1810262 service nova] Creating event network-changed:e34306e5-c6ae-4036-861c-45f67d309de1 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:53:09.841585 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-68c961bf-c779-4910-9978-f43e7f31c254 req-a090a81f-15b6-4531-9cbd-e5a1a1810262 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034970 Aug 03 04:53:09.842419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2492/4992] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:10.528494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:10.529276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:10.535576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:10.536322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:10.544948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:10.548942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:10.548942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:10.548942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:10.552031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:10.553080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:10.554096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:10.559479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:10.641509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:10.658688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:10.666358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:10.671837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-778dcc68-4676-4e62-a482-982371f0318c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1329 microversion: 2.54 time: 0.148110 Aug 03 04:53:10.695552 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2501/4993] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:10 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1329 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:10.879928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:10.901564 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2741a75e-8314-46df-b923-1cec834b310b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1675 microversion: 2.1 time: 0.372456 Aug 03 04:53:10.905561 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2493/4994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:10 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1675 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:11.703951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:11.713272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:11.718111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:11.718577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:11.719363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:11.719804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:11.862763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:11.865848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:11.868987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:11.872441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb31d799-6657-467f-85a8-629e8844af92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1347 microversion: 2.54 time: 0.170146 Aug 03 04:53:11.873887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2502/4995] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:11 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1347 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:11.935466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:11.936479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:11.954871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:11.956195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:11.960934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:11.961950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:12.123124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:12.133953 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a3e5d9a-d9fc-4a8b-a84b-2874e14483e8 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1607 microversion: 2.1 time: 0.208359 Aug 03 04:53:12.148410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2494/4996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:11 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1607 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:12.796309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8e9b063e-bad9-4473-82c9-5d60319b7049 req-07a694dd-9796-43cb-b3d3-fe8368daeaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba", "name": "network-vif-deleted", "tag": "81b17af5-aeb1-491a-93f2-5898b99c0847"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:12.833577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8e9b063e-bad9-4473-82c9-5d60319b7049 req-07a694dd-9796-43cb-b3d3-fe8368daeaa3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:12.836656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8e9b063e-bad9-4473-82c9-5d60319b7049 req-07a694dd-9796-43cb-b3d3-fe8368daeaa3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:12.863348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8e9b063e-bad9-4473-82c9-5d60319b7049 req-07a694dd-9796-43cb-b3d3-fe8368daeaa3 service nova] Creating event network-vif-deleted:81b17af5-aeb1-491a-93f2-5898b99c0847 for instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba on n-h2-826756-5 Aug 03 04:53:12.888581 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8e9b063e-bad9-4473-82c9-5d60319b7049 req-07a694dd-9796-43cb-b3d3-fe8368daeaa3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095911 Aug 03 04:53:12.889209 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2503/4997] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:12.902901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:12.903425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:12.922231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:12.922694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:12.924315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:12.929506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:12.940962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:13.049972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:13.062766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:13.069837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:13.080718 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-320f050a-6cef-401c-8d88-aa647e7474a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1335 microversion: 2.54 time: 0.178415 Aug 03 04:53:13.082254 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2495/4998] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:12 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1335 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:13.155645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:13.156385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:13.168701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:13.169170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:13.170004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:13.177458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:13.381097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b2f4985-e0ca-46e0-b2f1-7971060b3020 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] Calling method '.version_select at 0x7fdd47c08af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:13.450649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:13.464630 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8238fc9-7a27-4e76-8b5f-26a6ba60b52b tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1323 microversion: 2.1 time: 0.310536 Aug 03 04:53:13.480330 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2496/4999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:13 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:13.498865 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b2f4985-e0ca-46e0-b2f1-7971060b3020 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087/defaults" status: 200 len: 371 microversion: 2.1 time: 0.457687 Aug 03 04:53:13.508313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2504/5000] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:53:13 2022] GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087/defaults => generated 371 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:13.511810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1df4dbb-d92e-4a6f-a3af-26a83963496f tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] Calling method '.version_select at 0x7fdd47e00790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:13.659320 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1df4dbb-d92e-4a6f-a3af-26a83963496f tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087" status: 200 len: 371 microversion: 2.1 time: 0.151743 Aug 03 04:53:13.660725 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2497/5001] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:53:13 2022] GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087 => generated 371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:13.682338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5821299c-c73f-445f-9407-d069daec0765 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] Calling method '.version_select at 0x7fdd47e1a040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:13.811053 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5821299c-c73f-445f-9407-d069daec0765 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087/defaults" status: 200 len: 371 microversion: 2.1 time: 0.133527 Aug 03 04:53:13.818240 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2505/5002] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:53:13 2022] GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087/defaults => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:13.832050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf4157ef-32a1-4296-b8f8-7441b98affe8 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] Calling method '.version_select at 0x7fdd47df4d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:14.107920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:14.108822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:14.120641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:14.123688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:14.123688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:14.123688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:14.152932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:14.367731 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf4157ef-32a1-4296-b8f8-7441b98affe8 tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087" status: 200 len: 371 microversion: 2.1 time: 0.540308 Aug 03 04:53:14.368624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2498/5003] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 04:53:13 2022] GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087 => generated 371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:14.390146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be304172-59c0-4edd-af19-6778886c043b tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] Calling method '.version_select at 0x7fdd59e581f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:14.478644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:14.497353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:14.510281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:14.513067 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e3e2d389-fc10-4652-9711-51d0993188f0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1335 microversion: 2.54 time: 0.408405 Aug 03 04:53:14.514328 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2506/5004] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:14 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1335 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:14.542769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:14.547922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:14.566709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:14.628306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:14.633559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:14.634407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:14.634855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:14.672931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be304172-59c0-4edd-af19-6778886c043b tempest-QuotasTestJSON-562969502 tempest-QuotasTestJSON-562969502-project] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087?user_id=47336039592242eaa1d7bfa6d570b220" status: 200 len: 371 microversion: 2.1 time: 0.294396 Aug 03 04:53:14.696702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2499/5005] 10.222.0.72 () {58 vars in 1323 bytes} [Wed Aug 3 04:53:14 2022] GET /compute/v2.1/os-quota-sets/38df4465260045f2b3a5e7e369786087?user_id=47336039592242eaa1d7bfa6d570b220 => generated 371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:53:14.765454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:14.765843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:14.766305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lazy-loading 'fault' on Instance uuid 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:14.901865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8afdfb3dc9b4e56b38fd2be3768a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b6c60add37f4e209c73c69ccd898527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:14.906071 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a789ce02-a6ba-4a2f-bf56-8004302b4809 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 200 len: 1328 microversion: 2.1 time: 0.389105 Aug 03 04:53:14.906743 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2507/5006] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:14 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 1328 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:15.549637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:15.549637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:15.556946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.557771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.558551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.559091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.705673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:15.716027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:15.717698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:15.719075 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af933996-d184-42cb-bfc9-b683f8db548f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1356 microversion: 2.54 time: 0.179101 Aug 03 04:53:15.722055 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2500/5007] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:15 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:15.746621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fddf58e-d081-49dc-a701-ffd6d7f31d9b tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Action: 'create', calling method: .version_select at 0x7fdd47e1af70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1956805590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaSqZeklBUjhYDmQOOrbEVpmB4XqnEpfeicyalWNnZqnjrLfUP/+OgcdUStvbQk4AfLi2ipXi6byBU9B9MWjf8kg9pmTjjyU04AgM6Uh5W9rJhHtyMGgrw6sz5qmDDKtw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:15.769887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fddf58e-d081-49dc-a701-ffd6d7f31d9b tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Getting quotas for project 169f8169523e4e819b25e384c3404c41. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:53:15.777085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8fddf58e-d081-49dc-a701-ffd6d7f31d9b tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Getting quotas for user e8b3ace78fa847228b46beb3765761ee and project 169f8169523e4e819b25e384c3404c41. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:53:15.889621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fddf58e-d081-49dc-a701-ffd6d7f31d9b tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.147098 Aug 03 04:53:15.893966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2508/5008] 10.222.0.72 () {62 vars in 1200 bytes} [Wed Aug 3 04:53:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 04:53:15.901984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1956805590", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:15.914135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:15.929008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:15.929008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] [instance: 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:15.932104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:15.935725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.936182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.940784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.941295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.942064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.942521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.945985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:15.946447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:15.967323 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] HTTP exception thrown: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Request method failure captured: Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba HTTP/1.1 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6fzXljrLOIbvnM6OA96yFsKLXS5Zj3SoQxF5XDTKE0TjEt9HewTS4m1jJxFKoIPzR2k0-SwocLKCz4R-wmDGS7wIGzBvjbFKzAjmRwppX1GnFGNERXA4vaNEf-e56F4Xxua4BWUw-iEAIX-531ux718DdB5F9xtawSKtzYsQSQ7YBag Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2b6c60add37f4e209c73c69ccd898527"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2b6c60add37f4e209c73c69ccd898527 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-960525398 Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: d8afdfb3dc9b4e56b38fd2be3768a94a Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-960525398-project Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba'} Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:15.972782 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. Aug 03 04:53:15.977789 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:15.979466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Returning 404 to user: Instance 95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:15.981173 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b05507b-3516-4512-bca1-dff64396a818 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba" status: 404 len: 111 microversion: 2.1 time: 0.057233 Aug 03 04:53:15.982010 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2509/5009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:15 2022] GET /compute/v2.1/servers/95f8a9e5-6cc2-4682-a0b8-8a4e92bed1ba => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:53:16.000516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7cde43e5-11ae-4776-84a4-fe1f8d1dcee0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] Calling method '.version_select at 0x7fdd540e23a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:16.122793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:53:16.123490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:53:16.124577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:53:16.125402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:53:16.125878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:53:16.131189 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7cde43e5-11ae-4776-84a4-fe1f8d1dcee0 tempest-ServerActionsTestJSON-960525398 tempest-ServerActionsTestJSON-960525398-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824954441" status: 202 len: 0 microversion: 2.1 time: 0.141302 Aug 03 04:53:16.132859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2510/5010] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 04:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824954441 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:53:16.586697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:16.599559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:16.603862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:16.605079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:16.605716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:16.660385 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95591bc1-6c4a-455b-b50e-a50310582436 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "POST /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288/action" status: 202 len: 1139 microversion: 2.54 time: 0.762290 Aug 03 04:53:16.661726 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2501/5011] 10.222.0.72 () {62 vars in 1320 bytes} [Wed Aug 3 04:53:15 2022] POST /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288/action => generated 1139 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 04:53:16.685979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:16.686932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:16.722767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:16.723781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:16.725162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:16.725994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:16.895312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:16.911419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:16.919268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:16.922752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a8c6cdb8-75d0-4de3-8e71-1d83c4b31ab8 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.238922 Aug 03 04:53:16.924473 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2511/5012] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:16 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:17.950648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:17.952218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:17.973670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:17.974130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:17.979544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:17.980487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:18.308443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:18.327247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:18.333883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:18.337253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-958df620-bfc0-416e-9538-9c7e5d76fdc9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.391266 Aug 03 04:53:18.344505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2502/5013] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:17 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:19.365392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:19.366051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:19.370839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:19.378039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:19.378499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:19.379297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:19.379764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:19.508416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:19.523313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:19.531898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:19.534125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ffa7b8d-8cfc-4d78-9a69-4ad431e7862d tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.174695 Aug 03 04:53:19.537806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2512/5014] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:19 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:20.565045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:20.565045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:20.585243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:20.592816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:20.595615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:20.606322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:21.054748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:21.080747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:21.082417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:21.083813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-500f2b12-25e7-453e-ba9d-6519d9ddb944 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.526148 Aug 03 04:53:21.084527 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2503/5015] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:20 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:22.112246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:22.112246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:22.125213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:22.126114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:22.127065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:22.127829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:22.216976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:22.227359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:22.229924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:22.232462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3fa0d92-6f90-4f42-ad6f-2208b7d0a7d0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.127581 Aug 03 04:53:22.234018 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2513/5016] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:22 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:22.917470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Calling method '.version_select at 0x7fdd47ceab80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:22.918369 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:53:22.918369 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:53:22.919538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:22.919992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:22.949639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:22.950216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:22.963133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:22.964635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:22.977167 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9479812c-ec21-474a-ae91-05719de727e0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1468591696-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.294907 Aug 03 04:53:22.984037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2504/5017] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:53:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:23.262531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:23.263311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:23.277492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:23.278553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:23.279518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:23.282643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:23.386584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:23.408916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:23.408916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:23.410081 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-add354ed-193d-408c-8c73-c55c754fcd93 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.151319 Aug 03 04:53:23.412441 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2514/5018] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:23 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:24.435556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:24.436418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:24.455074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:24.456795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:24.457747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:24.460193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:24.625468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:24.639186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:24.642441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:24.644202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f9600d4d-250c-47c8-a706-215a8529523a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.213102 Aug 03 04:53:24.646160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2505/5019] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:24 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:25.678127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:25.678127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:25.690820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:25.693855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:25.696814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:25.697576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:25.804861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:25.940035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:25.952017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:25.957521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:25.959912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb7484fc-af44-4d3b-a74d-1eb88c6c0152 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.291559 Aug 03 04:53:25.964068 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2515/5020] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:25 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:26.994877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:26.995917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:27.009140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:27.017531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:27.021745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:27.022830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:27.026947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:27.149977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:27.172886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:27.175009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:27.176436 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89d3232f-0e1e-4d22-804c-9a4fc5b72a14 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.186078 Aug 03 04:53:27.177486 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2506/5021] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:26 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:28.202784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:28.205573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:28.219922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:28.220923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:28.222018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:28.223225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:28.315035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:28.332492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:28.334053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:28.335249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-25a3690d-fdb8-48ba-8c42-a7db554e39a1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.136600 Aug 03 04:53:28.337446 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2516/5022] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:28 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:28.999437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-237202923", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "4d43532c-1b8e-4731-a0bf-837c5827e285"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:29.116214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] validate_networks() for [('4d43532c-1b8e-4731-a0bf-837c5827e285', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:53:29.366121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:29.368932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:29.387478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:29.389379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:29.392150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:29.393040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:29.631034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:29.646618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:29.646618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:29.646618 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9e22025-757c-4824-a22a-f217958db54a tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.286981 Aug 03 04:53:29.646618 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2517/5023] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:29 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:30.371765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:53:30.374470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:53:30.374470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:53:30.374470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:53:30.374470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:53:30.403227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:30.416462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:30.417574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:30.420292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:30.477579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Getting quotas for project a25a614cae1641a0a9d4f166282d3e94. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:53:30.488568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Getting quotas for user a5b3399284834fca932d3eee63a08457 and project a25a614cae1641a0a9d4f166282d3e94. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:53:30.528406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:53:30.532482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:53:30.673074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:30.674665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:30.691420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:30.692413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:30.693455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:30.693921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:30.777535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-368f6a5d-8c24-4dd3-9877-a0eeb06f05e0 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.041940 Aug 03 04:53:30.784778 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2507/5024] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:53:30.790485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:30.791107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:30.934780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:30.949125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:30.950946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:30.952966 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6eb1252-04f6-4c5b-a675-87f15ac78502 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.287161 Aug 03 04:53:30.968614 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2518/5025] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:30 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:31.018094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:31.028327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:31.037073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:31.038361 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21fee9a2-b640-46c3-89c9-57071972e4ad tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1261 microversion: 2.26 time: 0.252122 Aug 03 04:53:31.038979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2508/5026] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:30 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1261 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:31.984633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:31.985916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:32.004428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:32.005261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:32.006225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:32.006745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:32.066857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:32.067455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:32.124166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.137097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.138841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.140319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ceb112b9-410f-489a-95fd-84ab2ddeb131 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.160367 Aug 03 04:53:32.141986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2519/5027] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:31 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:32.279842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.294422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.303198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:32.304551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd97b063-4e9d-4168-b36e-ddfd906a9abe tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1261 microversion: 2.26 time: 0.242805 Aug 03 04:53:32.305368 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2509/5028] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:32 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:33.167586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:33.168825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:33.176507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:33.177158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:33.178268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:33.178715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:33.246883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.256557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.258140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.259389 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ef7b2a3-3dbc-42d8-bf08-4aa7b58ed600 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.096578 Aug 03 04:53:33.260092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2520/5029] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:33 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:33.335361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:33.337464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:33.351640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:33.352499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:33.353716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:33.354383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:33.521613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.530885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.532581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:33.533768 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f96470a-6b5b-463d-8512-170ca19b508c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1265 microversion: 2.26 time: 0.205539 Aug 03 04:53:33.534843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2510/5030] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:33 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:33.996412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:33.997204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:34.009492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.009940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.010722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.011411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.190853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'services' on Instance uuid 95d828b3-2ce2-4d35-b592-b2b98530f114 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:34.288563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:34.293808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:34.303453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.304324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.305366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.306050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.407635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.417465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.422876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.424638 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-300d752b-3579-427e-8c28-a66860b52ac7 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.144258 Aug 03 04:53:34.425743 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2511/5031] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:34 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:34.559017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:34.559641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:34.569468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.570281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.572894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.572894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.676858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.683129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e84828d9-0602-4cbb-94b1-ebdf6bafdd59 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments/28080298-5de8-4294-945e-00d5a3150961" status: 202 len: 0 microversion: 2.1 time: 0.690130 Aug 03 04:53:34.686145 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2521/5032] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:53:33 2022] DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments/28080298-5de8-4294-945e-00d5a3150961 => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:53:34.692840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.695560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:34.698715 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-55479030-eb7d-45e9-a514-7710e7febfa6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1313 microversion: 2.26 time: 0.143613 Aug 03 04:53:34.701491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2512/5033] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:34 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:34.724653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:34.737886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:34.753666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.755531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.757833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:34.758587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:34.802897 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26c3362c-f35c-4f33-91bd-7613c3defc08 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112842 Aug 03 04:53:34.804169 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2522/5034] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:34 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:35.450334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:35.450968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:35.466364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.467157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.468231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.468901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.567362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.584472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.586057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.593693 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b74a460-1305-47dd-a21a-c1ceea19ada9 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.147090 Aug 03 04:53:35.594807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2513/5035] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:35 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:35.737936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:35.738548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:35.754415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.757865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.758939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.759552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.816565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:35.821164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:35.829818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.831296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.832377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:35.833048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:35.860678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.869173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.877246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:35.888192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f229ac8-96f8-4969-8949-513d8df4ddf7 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1319 microversion: 2.26 time: 0.145617 Aug 03 04:53:35.888192 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2523/5036] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:35 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:35.888433 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8c94791-2db2-4c1f-8bd1-1ac30c017154 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075859 Aug 03 04:53:35.893780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2514/5037] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:35 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:53:36.622637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:36.623536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:36.637460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.638042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:36.638833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.639278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:36.732176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:36.742874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:36.747728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:36.749834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:36.751683 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2e5cab4-0263-4534-863d-e6389903119f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.133548 Aug 03 04:53:36.763310 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2524/5038] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:36 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:36.912306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:36.913341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:36.915717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:36.927679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.928282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:36.935668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:36.940224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.940704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.941727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:36.943437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:36.945261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:36.948427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:37.002380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:37.043988 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f2c4eaa2-5255-4abd-b2e4-f9e3eb1406a5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147275 Aug 03 04:53:37.044623 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2515/5039] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:36 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:37.135951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:37.146716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:37.148915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:37.150372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b718a876-a651-4069-b1f2-a540bd2d0cdd tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1319 microversion: 2.26 time: 0.251061 Aug 03 04:53:37.151242 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2525/5040] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:36 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:37.777569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:37.778199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:37.790945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:37.791337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:37.795486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:37.799413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:38.058868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.064418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:38.068852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:38.078373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:38.079662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:38.080783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:38.081449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:38.088803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.091004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.093258 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c01e6a56-14ec-46e8-b4a2-431a8224317e tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.319269 Aug 03 04:53:38.096624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2516/5041] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:37 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:38.150889 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-480ff624-49cf-44df-be4e-2ef654b51be5 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093020 Aug 03 04:53:38.241160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2526/5042] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:38 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:38.241444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:38.582294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.600608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.619210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:38.630864 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80edbaa0-7591-4b4f-a935-5cb96cb4065e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.453677 Aug 03 04:53:38.633209 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2517/5043] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:38 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:39.070202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2b19eda3-d2e7-4842-909a-fc493c7b3ba7 req-f4a59379-1e42-4475-ae32-3d391899e3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5f7415-ddea-4142-bad4-9f32aed9d748", "tag": "a257c0f0-aa79-469e-b9f0-77185d76c4d5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:39.096691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2b19eda3-d2e7-4842-909a-fc493c7b3ba7 req-f4a59379-1e42-4475-ae32-3d391899e3ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.097465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2b19eda3-d2e7-4842-909a-fc493c7b3ba7 req-f4a59379-1e42-4475-ae32-3d391899e3ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.111264 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2b19eda3-d2e7-4842-909a-fc493c7b3ba7 req-f4a59379-1e42-4475-ae32-3d391899e3ce service nova] Creating event network-changed:a257c0f0-aa79-469e-b9f0-77185d76c4d5 for instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 on n-h2-826756-5 Aug 03 04:53:39.121860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2b19eda3-d2e7-4842-909a-fc493c7b3ba7 req-f4a59379-1e42-4475-ae32-3d391899e3ce service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057170 Aug 03 04:53:39.123881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2527/5044] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:53:39.124258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:39.125074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:39.147227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.147990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.148532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.148957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.255195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:39.257879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:39.278392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.279966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.282565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.284288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.322938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:39.338834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:39.340402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:39.341923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab8b9599-c3d4-4546-b2ad-59a1e24e53d1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.221594 Aug 03 04:53:39.342681 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2518/5045] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:39 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:39.363300 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7486a863-8232-40d5-803c-88b77dca07f8 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115161 Aug 03 04:53:39.365335 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2528/5046] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:39 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:39.666645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:39.667438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:39.676670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.677665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:39.679618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:39.680317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:40.370003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:40.373856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:40.390318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:40.391023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:40.391910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:40.392397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:40.456098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:40.556730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.587956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.597425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.605416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e590a84c-f817-4b5b-8485-9f38aff7ad80 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.937342 Aug 03 04:53:40.605416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2519/5047] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:39 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:40.649861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:40.653547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:40.691222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.713212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:40.714118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:40.715607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.720647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:40.722938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:40.723784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:40.738823 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f470a11-3002-432c-98fd-066b85501803 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.372782 Aug 03 04:53:40.750657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2529/5048] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:40 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:40.871624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e27629a0-13b7-4df9-aa5e-783bd4eb5c42 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.260698 Aug 03 04:53:40.896955 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2520/5049] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:40 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 197 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:41.649978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:41.650682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:41.676036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:41.683555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:41.683555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:41.683555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:41.789246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:41.789927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:41.807995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:41.808520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:41.813410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:41.813410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:41.978815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:41.990844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:41.994166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:41.996259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-005da4a6-0ff2-46a4-a1d3-631b5842270f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.212023 Aug 03 04:53:42.009644 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2521/5050] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:41 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:42.026388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:42.028333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:42.033054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:42.038479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:42.042633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:42.043536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.044521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8fb1aad9-48ac-49f8-a230-c5ad1361bcd5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.399015 Aug 03 04:53:42.044875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.045512 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2530/5051] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:41 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:42.049007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.050221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.135236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e7c62b7-d544-4782-9fb0-45fe0639a5c4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122527 Aug 03 04:53:42.137757 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2522/5052] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:53:42 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:53:42.295724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:42.298748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:42.311617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.319224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.321497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.323108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.371988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:42.430986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Cannot 'reboot' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action HTTP/1.1 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 28 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: {"reboot": {"type": "HARD"}} Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'reboot' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0fb71887-715d-4774-a22b-d690ca968fc1', 'body': {'reboot': {'type': 'HARD'}}} Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:53:42.433830 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 409 to user: Cannot 'reboot' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:42.438677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb092f98-4496-4ac3-9a0f-125742987b6a tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action" status: 409 len: 145 microversion: 2.1 time: 0.145039 Aug 03 04:53:42.445383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2531/5053] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:53:42 2022] POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action => generated 145 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:53:42.453699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:42.464325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:42.475615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.476902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.477723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.478203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.510278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Cannot 'rebuild' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action HTTP/1.1 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 65 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'rebuild' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '0fb71887-715d-4774-a22b-d690ca968fc1', 'body': {'rebuild': {'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464'}}} Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:53:42.512330 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued Aug 03 04:53:42.517147 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:53:42.519821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 409 to user: Cannot 'rebuild' instance 0fb71887-715d-4774-a22b-d690ca968fc1 while it is in vm_state rescued {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:42.521487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27c99063-19b4-4586-801f-18a177bfb368 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action" status: 409 len: 146 microversion: 2.1 time: 0.074587 Aug 03 04:53:42.522459 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2532/5054] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:53:42 2022] POST /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1/action => generated 146 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:53:42.534063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:42.534845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:42.542998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.543717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.544757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:42.545405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:42.555872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-502382270", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:42.579875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:53:42.622279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] validate_networks() for [('4e662d4b-a10e-4675-ab7d-cbb130da6c6d', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:53:43.121140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:53:43.122292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:53:43.123238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:53:43.123979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:53:43.124606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:53:43.137053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.137760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.138737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.139484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.167764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Getting quotas for project 1755d3827e404d31a9730e7ec4137c77. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:53:43.174559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Getting quotas for user 279aedd4ceab4f72a921f2ea248bc791 and project 1755d3827e404d31a9730e7ec4137c77. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:53:43.193191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:53:43.195423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:53:43.258497 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85c67715-b2d9-4464-8dd8-62ac62bdf1f2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 204 len: 0 microversion: 2.1 time: 0.728070 Aug 03 04:53:43.260577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2533/5055] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:53:42 2022] DELETE /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 04:53:43.269017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:43.270570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:43.279237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.281430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.282487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.283014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.356689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.367311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.369088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.370287 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d6e98ed-9023-440c-95f7-e945d822dab1 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.108168 Aug 03 04:53:43.371040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2534/5056] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:43 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:43.386686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:43.392082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88ff122a-dba2-4494-83b8-4d019804b08a tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026556 Aug 03 04:53:43.392785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2523/5057] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:53:43.397864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:43.398739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:43.406646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:43.411501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.411501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.412251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.412913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.419463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.422460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.423302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:43.423777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:43.748468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.764199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd7a263e-8821-449a-8790-6632c0afce6f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1688 microversion: 2.1 time: 0.370142 Aug 03 04:53:43.767818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2524/5058] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:43 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1688 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:43.784443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f195b212-fcab-45c7-9ec4-943916e67000 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:43.785079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f195b212-fcab-45c7-9ec4-943916e67000 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:43.812853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.829938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.832624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.834111 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76ce8ab4-62af-4d56-8d02-96243799a425 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.461984 Aug 03 04:53:43.834850 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2535/5059] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:43 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:43.894719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f195b212-fcab-45c7-9ec4-943916e67000 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:43.901842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f195b212-fcab-45c7-9ec4-943916e67000 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1223 microversion: 2.1 time: 0.132514 Aug 03 04:53:43.902427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2525/5060] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:43 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:44.399902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:44.406833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:44.410638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.411324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:44.412519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.413170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:44.489673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:44.503101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:44.506492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:44.507727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee698126-fb75-4ac6-969e-9c3a8a355ee0 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.114595 Aug 03 04:53:44.513062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2536/5061] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:44 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:44.792447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:44.793705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:44.800863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:44.808071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.809011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:44.810606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.811112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:44.860394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:44.861098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:44.868299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.868946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:44.869741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:44.870411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:45.067167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.081643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f00f0dd5-e00d-42b1-a102-f1b03ee899a4 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1688 microversion: 2.1 time: 0.293399 Aug 03 04:53:45.112742 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2526/5062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:44 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1688 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:45.116440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.120520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5d41264-03c1-4560-9de5-d42b1aeffd38 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:45.121476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5d41264-03c1-4560-9de5-d42b1aeffd38 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:45.128392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.142167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.143817 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d3fee49-8abc-4d48-bb05-9e9c4ef5f809 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.289122 Aug 03 04:53:45.157939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2537/5063] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:44 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:45.201380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c5d41264-03c1-4560-9de5-d42b1aeffd38 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.211201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5d41264-03c1-4560-9de5-d42b1aeffd38 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1223 microversion: 2.1 time: 0.096183 Aug 03 04:53:45.216423 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2527/5064] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:45 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:45.537237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:45.537852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:45.544131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:45.544606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:45.545379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:45.545815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:45.629385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.644123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.644123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:45.645210 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3c64ea3-e659-45fd-9409-2868e7135a92 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.112069 Aug 03 04:53:45.645766 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2538/5065] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:45 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:46.108328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:46.110353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:46.120374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.121086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.122427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.123343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.171870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:46.172605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:46.179477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.179941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.182744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.183203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.533268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.549107 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d17969b-bf03-4214-a85a-4c5eb2e174ba tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1688 microversion: 2.1 time: 0.447167 Aug 03 04:53:46.564366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2528/5066] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:46 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1688 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:46.571176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:46.572560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:46.581497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.582205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.584386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.585013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.599388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.610921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.615381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.617677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef5e1291-a991-4c71-b483-21577c3f4d73 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.450515 Aug 03 04:53:46.618842 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2539/5067] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:46 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:46.669760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:46.670339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:46.680034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.682448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.683264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:46.683961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:46.861453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.868412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.870560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.872439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:46.873733 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e293d0b3-c17a-4e19-a948-97f46beb54ba tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.208025 Aug 03 04:53:46.874809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2540/5068] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:46 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:46.888517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f22880bd-17f5-4ed3-9604-a9e17c0133c1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1275 microversion: 2.1 time: 0.322391 Aug 03 04:53:46.899708 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2529/5069] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:46 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1275 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:47.354061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0d9950e4-1d77-4c1a-b920-b5054f6b6959 req-3eda365c-63aa-4abc-98be-c34349c054c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f7415-ddea-4142-bad4-9f32aed9d748", "name": "network-vif-plugged", "status": "completed", "tag": "a257c0f0-aa79-469e-b9f0-77185d76c4d5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:47.372597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0d9950e4-1d77-4c1a-b920-b5054f6b6959 req-3eda365c-63aa-4abc-98be-c34349c054c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.373245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0d9950e4-1d77-4c1a-b920-b5054f6b6959 req-3eda365c-63aa-4abc-98be-c34349c054c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.378669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:47.388932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0d9950e4-1d77-4c1a-b920-b5054f6b6959 req-3eda365c-63aa-4abc-98be-c34349c054c1 service nova] Creating event network-vif-plugged:a257c0f0-aa79-469e-b9f0-77185d76c4d5 for instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 on n-h2-826756-5 Aug 03 04:53:47.403328 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0d9950e4-1d77-4c1a-b920-b5054f6b6959 req-3eda365c-63aa-4abc-98be-c34349c054c1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054102 Aug 03 04:53:47.405103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2541/5070] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:47.572132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:47.572789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:47.581160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.581860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.582699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.583369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.646877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:47.649604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:47.663073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.663968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.665793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.666969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.797121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:47.816759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7d92de4f-512d-485e-8719-b366bfab8d77 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1620 microversion: 2.1 time: 0.238685 Aug 03 04:53:47.816759 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2530/5071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:47 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1620 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:47.898302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:47.898921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:47.905302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.906264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:47.907131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:47.907577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:48.062408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.084906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.084906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.086549 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c84e099e-3f87-4d07-b860-2fe52e25dc29 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.192151 Aug 03 04:53:48.087675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2531/5072] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:47 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:48.094259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:48.095329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:48.110591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.121348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:48.121809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.122248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:48.123364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.124187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:48.125614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:48.130383 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-285f8de8-d1d2-42ed-91db-47042ca81395 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.483111 Aug 03 04:53:48.144852 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2542/5073] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:47 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:48.253560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:48.262339 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2708e073-48d6-47f3-a672-cf22304f4579 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1283 microversion: 2.1 time: 0.172979 Aug 03 04:53:48.262949 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2532/5074] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:48 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:48.696014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-236e75a4-6827-41c6-afe8-7cae210e951d req-a8e3283b-5f3b-4645-b12d-0598f50c02b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d828b3-2ce2-4d35-b592-b2b98530f114", "name": "network-vif-deleted", "tag": "34f335a4-97d0-43f9-bec6-b0e8a07b504a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:48.708301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-236e75a4-6827-41c6-afe8-7cae210e951d req-a8e3283b-5f3b-4645-b12d-0598f50c02b6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:48.709046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-236e75a4-6827-41c6-afe8-7cae210e951d req-a8e3283b-5f3b-4645-b12d-0598f50c02b6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:48.722202 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-236e75a4-6827-41c6-afe8-7cae210e951d req-a8e3283b-5f3b-4645-b12d-0598f50c02b6 service nova] Creating event network-vif-deleted:34f335a4-97d0-43f9-bec6-b0e8a07b504a for instance 95d828b3-2ce2-4d35-b592-b2b98530f114 on n-h1-826756-5 Aug 03 04:53:48.728079 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-236e75a4-6827-41c6-afe8-7cae210e951d req-a8e3283b-5f3b-4645-b12d-0598f50c02b6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Aug 03 04:53:48.728991 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2543/5075] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:48.827129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:48.828629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:48.885747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:48.890888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:48.892541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:48.893233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.029730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.041834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30a9a20f-6a64-4f8d-ba05-dc8f20fcc80e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1620 microversion: 2.1 time: 0.218799 Aug 03 04:53:49.057790 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2533/5076] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:48 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1620 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:49.115950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:49.117109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:49.132767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.133238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.134028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.134474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.163629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:49.164253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:49.172690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.173979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.176501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.177032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.269672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.276202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:49.280959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.283531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.285034 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c45e987-77cf-491f-9d8e-f8ac02ffcc97 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1408 microversion: 2.54 time: 0.174885 Aug 03 04:53:49.286197 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2544/5077] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:49 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:49.291318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:49.291936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:49.298657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.299370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.300421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:49.301061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:49.446529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.457613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-14d3ea0f-cec8-4245-9f6d-678176fe2c7f tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1283 microversion: 2.1 time: 0.170071 Aug 03 04:53:49.458468 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2545/5078] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:49 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:49.543890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.563855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.566947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:49.570980 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e2458d6-4bcc-4c17-8a0c-a07769876d6d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1361 microversion: 2.26 time: 0.412333 Aug 03 04:53:49.591823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2534/5079] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:49 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:50.069804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:50.071789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:50.092090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.093194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.095821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.095821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.136930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.137840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.138605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'fault' on Instance uuid 95d828b3-2ce2-4d35-b592-b2b98530f114 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:50.273253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.280839 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dd652a9-ae38-4edc-993c-8e0175386df2 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 200 len: 1334 microversion: 2.1 time: 0.216552 Aug 03 04:53:50.288453 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2546/5080] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:50 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 1334 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:50.313342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:50.313342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:50.325242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.325719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.326530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.327002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.465920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.465920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.465920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.465920 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c24bd5bf-e4ed-4f00-bed7-fff9cffc335c tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1414 microversion: 2.54 time: 0.159026 Aug 03 04:53:50.465920 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2535/5081] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:50 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:50.488434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:50.489113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:50.497268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.497813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.498656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.499790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.577767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.585915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e63da910-2b26-45ea-8195-b6fafbb88d43 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1281 microversion: 2.1 time: 0.108671 Aug 03 04:53:50.587208 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2547/5082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:50 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:50.599846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:50.600499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:50.606623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.607196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.607978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.609011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.879628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.892826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.894955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:50.896892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-361ea148-64ef-4326-b078-491d76d07b2e tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1544 microversion: 2.26 time: 0.300972 Aug 03 04:53:50.898204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2536/5083] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:50 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1544 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:50.929666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd546d4af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:50.959744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.960213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.960738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:50.969808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.970185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:50.971155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:50.971597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.000805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.001507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.022333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.022974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.224319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:51.248070 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7cc6c980-a773-487e-86b7-1cbfe76aa316 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-952812275" status: 201 len: 0 microversion: 2.26 time: 0.324662 Aug 03 04:53:51.249003 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2548/5084] 10.222.0.72 () {62 vars in 1377 bytes} [Wed Aug 3 04:53:50 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-952812275 => generated 0 bytes in 327 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 04:53:51.258944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a1cfa2d-a0c1-49e8-a2a2-25adade8813c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47d5f3a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.267340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1cfa2d-a0c1-49e8-a2a2-25adade8813c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.267790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1cfa2d-a0c1-49e8-a2a2-25adade8813c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.282984 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a1cfa2d-a0c1-49e8-a2a2-25adade8813c tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-952812275" status: 204 len: 0 microversion: 2.26 time: 0.028166 Aug 03 04:53:51.283549 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2537/5085] 10.222.0.72 () {60 vars in 1358 bytes} [Wed Aug 3 04:53:51 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-952812275 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:51.292286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47f60e50>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.300611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.301067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.301616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:51.307120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.307575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.308465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.308906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.331433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.331885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.481538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:51.502394 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c99a0fd-d494-434e-9900-21b83d8710e5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 204 len: 0 microversion: 2.26 time: 0.214051 Aug 03 04:53:51.503637 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2549/5086] 10.222.0.72 () {60 vars in 1295 bytes} [Wed Aug 3 04:53:51 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:51.513733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.516335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:51.524248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.524979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.525930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.526364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.555020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.555757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 95d828b3-2ce2-4d35-b592-b2b98530f114] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:51.569149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.569756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.576304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.576985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.593849 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 HTTP/1.1 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '95d828b3-2ce2-4d35-b592-b2b98530f114'} Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:51.595961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. Aug 03 04:53:51.599839 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:53:51.602165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 404 to user: Instance 95d828b3-2ce2-4d35-b592-b2b98530f114 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:53:51.603688 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-defda42a-f960-44ce-9a3c-0e8c41acbb91 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114" status: 404 len: 111 microversion: 2.1 time: 0.300375 Aug 03 04:53:51.607780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2538/5087] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:51 2022] GET /compute/v2.1/servers/95d828b3-2ce2-4d35-b592-b2b98530f114 => generated 111 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:53:51.613443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4436892f-e834-4f4f-943b-f18edf4b198d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47df4280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.622841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4436892f-e834-4f4f-943b-f18edf4b198d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.623633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4436892f-e834-4f4f-943b-f18edf4b198d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.636387 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4436892f-e834-4f4f-943b-f18edf4b198d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 12 microversion: 2.26 time: 0.026971 Aug 03 04:53:51.642975 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2539/5088] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 3 04:53:51 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:51.644573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.645508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:51.654527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.655275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.656702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.657393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.699281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:51.711603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:51.713092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:51.714313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2425d612-19c0-4600-b51b-948b934a20e6 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1414 microversion: 2.54 time: 0.208366 Aug 03 04:53:51.714887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2550/5089] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:51 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1414 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:51.721603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9ae10be-4c58-4cd4-8631-2b315329ad8f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '.version_select at 0x7fdd479d69d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.737279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:51.886956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9ae10be-4c58-4cd4-8631-2b315329ad8f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837305109" status: 202 len: 0 microversion: 2.1 time: 0.170868 Aug 03 04:53:51.889471 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2551/5090] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837305109 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:53:51.895368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47999160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:51.906915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.907562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.908210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:51.914898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.915563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.916548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.917147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.949364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.950015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:51.960956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:51.961820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.083819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:52.096686 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc144434-8202-46a5-b55f-9906816bdfd7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.454807 Aug 03 04:53:52.110982 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2540/5091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:51 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:52.111232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:52.131360 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22938054-15da-4e38-a1f1-41d8137fda31 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1675239886" status: 201 len: 0 microversion: 2.26 time: 0.241805 Aug 03 04:53:52.136283 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2552/5092] 10.222.0.72 () {62 vars in 1380 bytes} [Wed Aug 3 04:53:51 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1675239886 => generated 0 bytes in 243 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 03 04:53:52.141799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f8776e4-e770-457d-83c2-4da2c775fee3 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd550dc0d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.151673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f8776e4-e770-457d-83c2-4da2c775fee3 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.155840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f8776e4-e770-457d-83c2-4da2c775fee3 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.163929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f8776e4-e770-457d-83c2-4da2c775fee3 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 36 microversion: 2.26 time: 0.026272 Aug 03 04:53:52.164730 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2541/5093] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 3 04:53:52 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 36 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:52.176046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47f01160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.184189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.184189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.184698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:52.190658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.191124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.191894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.192352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.220970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.221679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.315239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:52.353975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b1b5598-3180-4c31-9d5f-e5e79f271420 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1675239886" status: 204 len: 0 microversion: 2.26 time: 0.182749 Aug 03 04:53:52.355931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2553/5094] 10.222.0.72 () {60 vars in 1364 bytes} [Wed Aug 3 04:53:52 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1675239886 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:52.370409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34521dec-db9a-40b6-b59b-51896c3acb04 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47d5f550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.380565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34521dec-db9a-40b6-b59b-51896c3acb04 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.381041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34521dec-db9a-40b6-b59b-51896c3acb04 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.392997 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34521dec-db9a-40b6-b59b-51896c3acb04 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 12 microversion: 2.26 time: 0.027096 Aug 03 04:53:52.393646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2542/5095] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 3 04:53:52 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:52.406326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd479ff280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.416786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.417240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.417722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:52.424153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.425342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.426125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.426570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.450608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.451066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.469167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:52.492996 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61736c9d-27c8-4fc3-a586-ac3187560d19 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 204 len: 0 microversion: 2.26 time: 0.092618 Aug 03 04:53:52.497758 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2554/5096] 10.222.0.72 () {60 vars in 1295 bytes} [Wed Aug 3 04:53:52 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:52.503741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47c8a790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.515271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.516146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.516875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:52.523215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.523891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.524882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.525483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.554915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.555562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.565811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.566509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.715621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:52.736788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6383476c-32d7-4c57-a8b2-d4e863941639 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-373107261" status: 201 len: 0 microversion: 2.26 time: 0.237476 Aug 03 04:53:52.738010 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2543/5097] 10.222.0.72 () {62 vars in 1377 bytes} [Wed Aug 3 04:53:52 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-373107261 => generated 0 bytes in 239 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 03 04:53:52.738269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.739046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:52.751337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.751809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.752625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.753062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.769755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd545a6ca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:52.786448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.787550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.788398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:52.798045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.798737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.799743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.800668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.836202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.836870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.849984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:52.850603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:52.865200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:52.875012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:52.877076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:52.878290 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34003eb2-e8a0-4a61-82cc-070b479e3d15 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1414 microversion: 2.54 time: 0.144049 Aug 03 04:53:52.878897 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2555/5098] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:52 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:53.026050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:53.043235 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6eca9ff7-45e6-4d7b-9910-5d9928a88b67 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1087706677" status: 201 len: 0 microversion: 2.26 time: 0.288835 Aug 03 04:53:53.048622 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2544/5099] 10.222.0.72 () {62 vars in 1380 bytes} [Wed Aug 3 04:53:52 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1087706677 => generated 0 bytes in 291 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 03 04:53:53.055060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd479ffca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.059336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:53.065542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.066095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.066651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.072927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.073466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.074349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.074897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.100102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.100662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.116115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.116790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.122985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.123436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.124461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.124907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.151310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:53.269894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:53.292809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01c50382-14c9-4f9c-8649-e628656443d1 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 204 len: 0 microversion: 2.26 time: 0.242559 Aug 03 04:53:53.299465 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2556/5100] 10.222.0.72 () {60 vars in 1295 bytes} [Wed Aug 3 04:53:53 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:53.306065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-77be033c-9155-4c58-b4a1-cdf7837b00f1 req-0b9fa568-28da-4118-8a94-aac49ef96901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ac9569-c424-4280-b26a-670ed68ef871", "tag": "1f533663-0cd2-4d9d-9453-576e13eef0e6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:53.331757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-77be033c-9155-4c58-b4a1-cdf7837b00f1 req-0b9fa568-28da-4118-8a94-aac49ef96901 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.333675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-77be033c-9155-4c58-b4a1-cdf7837b00f1 req-0b9fa568-28da-4118-8a94-aac49ef96901 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.364417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-77be033c-9155-4c58-b4a1-cdf7837b00f1 req-0b9fa568-28da-4118-8a94-aac49ef96901 service nova] Creating event network-changed:1f533663-0cd2-4d9d-9453-576e13eef0e6 for instance d2ac9569-c424-4280-b26a-670ed68ef871 on n-h2-826756-5 Aug 03 04:53:53.376190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-77be033c-9155-4c58-b4a1-cdf7837b00f1 req-0b9fa568-28da-4118-8a94-aac49ef96901 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080171 Aug 03 04:53:53.377517 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2557/5101] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:53.386696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afe0b1b0-7939-4091-a44f-626395a3d9d6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd479fff70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.396722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afe0b1b0-7939-4091-a44f-626395a3d9d6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.397237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afe0b1b0-7939-4091-a44f-626395a3d9d6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.422126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-afe0b1b0-7939-4091-a44f-626395a3d9d6 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 12 microversion: 2.26 time: 0.041501 Aug 03 04:53:53.427434 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2558/5102] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 3 04:53:53 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:53.436485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd479ff310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.445357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.448381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.448381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.454204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.454679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.455469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.455956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.491922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.492455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.510402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:53.528060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-425c8e7e-ac8e-4036-9264-a56ddc5a1bec tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 204 len: 0 microversion: 2.26 time: 0.099065 Aug 03 04:53:53.528647 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2559/5103] 10.222.0.72 () {60 vars in 1295 bytes} [Wed Aug 3 04:53:53 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:53.540100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd546d4af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.550749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.551333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.552420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.558781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.559334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.560215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.560818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.598737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.599382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.610569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.611025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.719320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:53.727856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-574044bb-ba4c-4a9e-95a3-98e72a391c73 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.615741 Aug 03 04:53:53.728813 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2545/5104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:53 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:53:53.819673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:53.840995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-484920e7-9efe-4237-91b5-c8a35598856f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1962510600" status: 201 len: 0 microversion: 2.26 time: 0.306471 Aug 03 04:53:53.847909 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2560/5105] 10.222.0.72 () {62 vars in 1380 bytes} [Wed Aug 3 04:53:53 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1962510600 => generated 0 bytes in 308 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 03 04:53:53.853008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd5504b5e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.866128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.866903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.867497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.876057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.876667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.877465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.877906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.904017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:53.904624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:53.911944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.912603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.914988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.915587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.927089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.927804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:53.938558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:53.939102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.054720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:54.066153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:54.068784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:54.070014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4072e78e-7090-47ab-aae7-fd691a7e24ff tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1399 microversion: 2.54 time: 0.170966 Aug 03 04:53:54.070784 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2561/5106] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:53 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1399 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:54.105978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:54.123434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-641479ec-aebb-4ec5-9ba0-6e0237e32486 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '.version_select at 0x7fdd54848a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.125080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf7ef778-e61a-4f36-a370-61bc2e038acc tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1664102231" status: 201 len: 0 microversion: 2.26 time: 0.276341 Aug 03 04:53:54.126275 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2546/5107] 10.222.0.72 () {62 vars in 1380 bytes} [Wed Aug 3 04:53:53 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags/tempest-tag-1664102231 => generated 0 bytes in 278 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 03 04:53:54.143149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Action: 'update_all', calling method: .version_select at 0x7fdd59e6ee50>, body: {"tags": ["tempest-tag-311456469", "tempest-tag-1544723141"]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:54.164381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.165138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.165869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:54.173570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.174248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.175194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.176049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.207340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.210871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.224093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:54.335025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-641479ec-aebb-4ec5-9ba0-6e0237e32486 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1956805590" status: 204 len: 0 microversion: 2.54 time: 0.227753 Aug 03 04:53:54.336453 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2562/5108] 10.222.0.72 () {60 vars in 1319 bytes} [Wed Aug 3 04:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1956805590 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:54.350200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.351993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:54.360317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.360785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.361575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.362065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.389669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:53:54.396153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:54.425083 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-edc15804-696a-4701-8822-607f70f4a142 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 61 microversion: 2.26 time: 0.289569 Aug 03 04:53:54.431919 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2547/5109] 10.222.0.72 () {62 vars in 1312 bytes} [Wed Aug 3 04:53:54 2022] PUT /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 61 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:54.442673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f80606ea-3d56-411f-ab5e-789d9d957d0d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47d5f430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.460898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f80606ea-3d56-411f-ab5e-789d9d957d0d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.461373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f80606ea-3d56-411f-ab5e-789d9d957d0d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.486337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f80606ea-3d56-411f-ab5e-789d9d957d0d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 200 len: 61 microversion: 2.26 time: 0.053427 Aug 03 04:53:54.487434 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2548/5110] 10.222.0.72 () {60 vars in 1292 bytes} [Wed Aug 3 04:53:54 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 61 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:54.502580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '.version_select at 0x7fdd47c5bf70>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.517094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.518018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.519399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:54.528335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.529169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.534982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.535894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.572921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.573763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.749707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'flavor' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:53:54.766809 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1fd53b8-c08f-4b0e-b6c9-2ed8335de39f tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags" status: 204 len: 0 microversion: 2.26 time: 0.273235 Aug 03 04:53:54.767744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2549/5111] 10.222.0.72 () {60 vars in 1295 bytes} [Wed Aug 3 04:53:54 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748/tags => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:54.774954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.781686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:54.787907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.788396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.789305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.789748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.948313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff2c6afb-b60e-46a9-99a8-9d534a919059 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "DELETE /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 204 len: 0 microversion: 2.54 time: 0.601722 Aug 03 04:53:54.949227 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2563/5112] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:53:54 2022] DELETE /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:54.956188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:54.961500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:54.976706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.980050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:54.980050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:54.980050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:55.011107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:53:55.034988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.043635 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b533bd19-5798-48af-92c0-745b9b836e18 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.274461 Aug 03 04:53:55.047629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2550/5113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:54 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:55.052769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:55.055429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:55.067003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:55.067581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:55.068468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:55.068934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:55.151540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.172452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.175072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.177184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ea5afb6-b48b-436c-b2b8-13bc083307ab tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1405 microversion: 2.54 time: 0.127677 Aug 03 04:53:55.178089 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2551/5114] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:55 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:55.626715 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-001032ff-da07-4f9b-800f-cefa2a56521d tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 204 len: 0 microversion: 2.26 time: 0.675076 Aug 03 04:53:55.628061 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2564/5115] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:53:54 2022] DELETE /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:53:55.640439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:55.644681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:55.647037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:53:55.668565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:55.670020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:55.672883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:55.675529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:55.847400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.859680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.861720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:55.863439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f9cbc30-5179-43ce-a999-f56101388436 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1550 microversion: 2.26 time: 0.230708 Aug 03 04:53:55.864707 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2552/5116] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:55 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1550 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:56.078099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:56.079332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:56.122396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.123175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:56.129762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.130323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:56.207226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:56.207226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:56.221011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.221761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:56.224662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.226391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:56.418094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:56.434182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:56.436330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:56.446968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94e7a6e6-261b-4dc8-a6a3-7640a8849813 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1405 microversion: 2.54 time: 0.238728 Aug 03 04:53:56.446968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2553/5117] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:56 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:56.447282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:56.453450 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a96ac12e-6461-4925-a224-23bdc55f5a95 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.387376 Aug 03 04:53:56.454565 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2565/5118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:56 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:56.901442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:56.903259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:56.923167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.923702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:56.927971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:56.928763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:57.147675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.156861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.158278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.161027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3657d510-e6b9-4af2-87b9-4d105c22f0d5 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1550 microversion: 2.26 time: 0.270623 Aug 03 04:53:57.172993 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2554/5119] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:56 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:57.465199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:57.466401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:57.476976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:57.482630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:57.486657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:57.487332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:57.488080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:57.488542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:57.488741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:57.489323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:57.489611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:57.492712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:57.632147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.659366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.685232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.706779 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3dbd473d-5d29-486c-9e54-57bf64c9fefe tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1405 microversion: 2.54 time: 0.228368 Aug 03 04:53:57.711389 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2566/5120] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:57 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:57.902537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:57.913094 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f088aa8-4acb-4874-8bee-9d5166beaf3d tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.442312 Aug 03 04:53:57.917200 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2555/5121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:57 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:53:58.192511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:58.193456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:58.209273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:58.210134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:58.211159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:58.213691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:58.748541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:58.750275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:58.763651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:58.765758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:58.767039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:58.767492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:59.033955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.042886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.044428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.067039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2d19669-2538-40e0-8f2d-4bcb73cfe1f2 tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1405 microversion: 2.54 time: 0.322184 Aug 03 04:53:59.070678 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2556/5122] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:58 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:53:59.083686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:53:59.084694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:53:59.101354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:59.101769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:59.102587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:59.103032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:59.417780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.480680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.488431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:53:59.499003 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4737e5a4-b904-4165-9cae-461c77c8f503 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1550 microversion: 2.26 time: 1.308784 Aug 03 04:53:59.501306 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2567/5123] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:53:58 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1550 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:53:59.539202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4983a8fc-2d5a-4a1a-a6da-e58cd9777c92 req-76437d5b-3b38-477b-b3f5-2ed003f465bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5f7415-ddea-4142-bad4-9f32aed9d748", "name": "network-vif-deleted", "tag": "a257c0f0-aa79-469e-b9f0-77185d76c4d5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:59.605277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4983a8fc-2d5a-4a1a-a6da-e58cd9777c92 req-76437d5b-3b38-477b-b3f5-2ed003f465bf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:59.606174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4983a8fc-2d5a-4a1a-a6da-e58cd9777c92 req-76437d5b-3b38-477b-b3f5-2ed003f465bf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:59.732645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4983a8fc-2d5a-4a1a-a6da-e58cd9777c92 req-76437d5b-3b38-477b-b3f5-2ed003f465bf service nova] Creating event network-vif-deleted:a257c0f0-aa79-469e-b9f0-77185d76c4d5 for instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 on n-h2-826756-5 Aug 03 04:53:59.760431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4983a8fc-2d5a-4a1a-a6da-e58cd9777c92 req-76437d5b-3b38-477b-b3f5-2ed003f465bf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254078 Aug 03 04:53:59.761926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2568/5124] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:53:59.770711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-faa5c44a-6f0c-414f-bc5c-d9207ed75148 req-11897a14-a2e3-4999-815f-f444a353517a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ac9569-c424-4280-b26a-670ed68ef871", "name": "network-vif-plugged", "status": "completed", "tag": "1f533663-0cd2-4d9d-9453-576e13eef0e6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:53:59.833709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-faa5c44a-6f0c-414f-bc5c-d9207ed75148 req-11897a14-a2e3-4999-815f-f444a353517a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:53:59.841638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-faa5c44a-6f0c-414f-bc5c-d9207ed75148 req-11897a14-a2e3-4999-815f-f444a353517a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:53:59.865333 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-faa5c44a-6f0c-414f-bc5c-d9207ed75148 req-11897a14-a2e3-4999-815f-f444a353517a service nova] Creating event network-vif-plugged:1f533663-0cd2-4d9d-9453-576e13eef0e6 for instance d2ac9569-c424-4280-b26a-670ed68ef871 on n-h2-826756-5 Aug 03 04:53:59.884932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-faa5c44a-6f0c-414f-bc5c-d9207ed75148 req-11897a14-a2e3-4999-815f-f444a353517a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116902 Aug 03 04:53:59.888374 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2569/5125] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:00.056789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.066892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcd5fbb5-9121-4894-8b27-883ddd3450bd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.994796 Aug 03 04:54:00.069545 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2557/5126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:53:59 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:00.105252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:00.107525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:00.126377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.126860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.128971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.129423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.227298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.228155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.229109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lazy-loading 'fault' on Instance uuid 51bbffc3-eecf-454c-add8-f3db8f70e288 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:54:00.330611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.340649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.342831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b3ace78fa847228b46beb3765761ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169f8169523e4e819b25e384c3404c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.344478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d33983c-21f8-436f-a8b9-f1d23b14d57f tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 200 len: 1410 microversion: 2.54 time: 0.249486 Aug 03 04:54:00.370371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2570/5127] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:00 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 1410 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:00.535162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:00.536171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:00.557020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.557830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.558862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.559492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.599423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:00.600216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:00.600959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lazy-loading 'fault' on Instance uuid 3f5f7415-ddea-4142-bad4-9f32aed9d748 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:54:00.676468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.687919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.690230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5b3399284834fca932d3eee63a08457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25a614cae1641a0a9d4f166282d3e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:00.691767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7fdfe498-94bd-4428-9e44-2a4cb291c511 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 200 len: 1351 microversion: 2.26 time: 0.160963 Aug 03 04:54:00.705170 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2558/5128] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:00 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 1351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:01.102657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:01.103405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:01.118408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.118866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.119656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.120095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.339188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:01.348596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04c1dc68-e369-449b-8349-ff918650b842 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1323 microversion: 2.1 time: 0.253393 Aug 03 04:54:01.362945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2571/5129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:01 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:01.370255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:01.370896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] [instance: 51bbffc3-eecf-454c-add8-f3db8f70e288] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:01.382841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.383305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.386336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.390243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.423120 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] HTTP exception thrown: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Request method failure captured: Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 HTTP/1.1 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f8zGJJSaf3y4TQBY7KD6c1RYXNERr5q8gEAdWQiffWrPmpFFnw2w5KACEnlDXUha-gL9nhdHXvDcnHekZDwOqeiwS1ZaBkbxU_jC-bF8O6ZeIy_O538kUFbf_w3K_VG4egXj2w1ue5Wb89xU9FtY00EOQ4TPxaFykK8SAMc4gujjOU Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.54 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 169f8169523e4e819b25e384c3404c41 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerShowV254Test-1412634792 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/169f8169523e4e819b25e384c3404c41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/169f8169523e4e819b25e384c3404c41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_169f8169523e4e819b25e384c3404c41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/169f8169523e4e819b25e384c3404c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerShowV254Test-1412634792 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 169f8169523e4e819b25e384c3404c41 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerShowV254Test-1412634792 Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerShowV254Test-1412634792-project Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e8b3ace78fa847228b46beb3765761ee Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerShowV254Test-1412634792-project Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '51bbffc3-eecf-454c-add8-f3db8f70e288'} Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:01.424745 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] Returning 404 to user: Instance 51bbffc3-eecf-454c-add8-f3db8f70e288 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2650a50-1207-4a48-9296-ff17f61eb5bf tempest-ServerShowV254Test-1412634792 tempest-ServerShowV254Test-1412634792-project] 10.222.0.72 "GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288" status: 404 len: 111 microversion: 2.54 time: 0.065418 Aug 03 04:54:01.437140 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2559/5130] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:01 2022] GET /compute/v2.1/servers/51bbffc3-eecf-454c-add8-f3db8f70e288 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:54:01.725730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:01.727167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] [instance: 3f5f7415-ddea-4142-bad4-9f32aed9d748] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:01.737347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.738027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.740153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:01.740778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:01.755859 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] HTTP exception thrown: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Request method failure captured: Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 HTTP/1.1 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9IJBukZZ_pdB9VI6D8FDjotJZvUVfCr7_TWaDCUSwFvTKP3sE5xqpHpeyz12cZN2P99ym2QvDxvBhEOvYRF-MB7W-YC7Tp4pOOBUPBF6sEPyPijTnzbUmhHleSgyVBz1FyEYd5zN_1PYNcWCUD7_xAwYBKGA38ZlHow0qtqgKLUrY Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.26 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a25a614cae1641a0a9d4f166282d3e94 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerTagsTestJSON-816161 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a25a614cae1641a0a9d4f166282d3e94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a25a614cae1641a0a9d4f166282d3e94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a25a614cae1641a0a9d4f166282d3e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a25a614cae1641a0a9d4f166282d3e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerTagsTestJSON-816161 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a25a614cae1641a0a9d4f166282d3e94 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerTagsTestJSON-816161 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerTagsTestJSON-816161-project Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: a5b3399284834fca932d3eee63a08457 Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerTagsTestJSON-816161-project Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3f5f7415-ddea-4142-bad4-9f32aed9d748'} Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:01.760622 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] Returning 404 to user: Instance 3f5f7415-ddea-4142-bad4-9f32aed9d748 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6883938a-f248-4556-abeb-3add8b40ac36 tempest-ServerTagsTestJSON-816161 tempest-ServerTagsTestJSON-816161-project] 10.222.0.72 "GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748" status: 404 len: 111 microversion: 2.26 time: 0.046119 Aug 03 04:54:01.766345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2572/5131] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:01 2022] GET /compute/v2.1/servers/3f5f7415-ddea-4142-bad4-9f32aed9d748 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:54:02.372753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:02.373686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:02.391029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:02.393535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:02.394618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:02.397969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:02.767543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:02.778688 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37fe552d-d90d-43ed-8d19-ae188ea2ef0e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1519 microversion: 2.1 time: 0.411906 Aug 03 04:54:02.781722 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2560/5132] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:02 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1519 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:02.935112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c4aa730-b307-4245-94ef-d3efae0e45bb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1125419218", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c4aa730-b307-4245-94ef-d3efae0e45bb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 243 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1125419218", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1125419218', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4e662d4b-a10e-4675-ab7d-cbb130da6c6d'}]}}} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:02.942105 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.946716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c4aa730-b307-4245-94ef-d3efae0e45bb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:02.949491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c4aa730-b307-4245-94ef-d3efae0e45bb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018904 Aug 03 04:54:02.950731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2573/5133] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:54:02 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:54:02.963447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:02.963958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: f2602d37-6cbb-42d7-ad25-ec8381a833aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:02.973059 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] HTTP exception thrown: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f2602d37-6cbb-42d7-ad25-ec8381a833aa/metadata HTTP/1.1 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': 'f2602d37-6cbb-42d7-ad25-ec8381a833aa'} Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:02.980807 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:02.987103 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:02.987103 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:02.987103 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. Aug 03 04:54:02.987103 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:02.988585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 404 to user: Instance f2602d37-6cbb-42d7-ad25-ec8381a833aa could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:02.989652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48570122-80cd-41a5-8b5d-5460b876e6d7 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/f2602d37-6cbb-42d7-ad25-ec8381a833aa/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031082 Aug 03 04:54:02.990239 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2561/5134] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 04:54:02 2022] GET /compute/v2.1/servers/f2602d37-6cbb-42d7-ad25-ec8381a833aa/metadata => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:03.197692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa676345-976e-4635-a81b-7c0d6ea03ee3 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1399105573", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa676345-976e-4635-a81b-7c0d6ea03ee3 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 499 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1399105573", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1399105573', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e662d4b-a10e-4675-ab7d-cbb130da6c6d'}]}}} Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:54:03.213000 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa676345-976e-4635-a81b-7c0d6ea03ee3 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa676345-976e-4635-a81b-7c0d6ea03ee3 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024058 Aug 03 04:54:03.225590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2574/5135] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:54:03 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:54:03.234205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:03.234205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:03.239897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.255560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.255560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.255560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.304806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:54:03.481489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-31617daa-86c6-493e-8ced-de960085c30e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-13103299", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-31617daa-86c6-493e-8ced-de960085c30e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 498 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-13103299", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-13103299', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e662d4b-a10e-4675-ab7d-cbb130da6c6d'}]}}} Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:54:03.504800 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.508568 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.525789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-31617daa-86c6-493e-8ced-de960085c30e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:03.526685 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-31617daa-86c6-493e-8ced-de960085c30e tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.052053 Aug 03 04:54:03.527281 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2575/5136] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:54:03 2022] POST /compute/v2.1/servers => generated 689 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:54:03.606139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:03.611481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2adfd3e7-0805-46cb-823f-15c583a93436 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2025265381", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2adfd3e7-0805-46cb-823f-15c583a93436 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 754 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2025265381", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2025265381', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e662d4b-a10e-4675-ab7d-cbb130da6c6d'}]}}} Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:54:03.623570 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:54:03.626562 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:54:03.629317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.629317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.637565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2adfd3e7-0805-46cb-823f-15c583a93436 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:03.638495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2adfd3e7-0805-46cb-823f-15c583a93436 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.033654 Aug 03 04:54:03.639148 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2576/5137] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:54:03 2022] POST /compute/v2.1/servers => generated 1197 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 03 04:54:03.730811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71bedc9b-17c7-46e4-b35d-7c572939cccb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-675468072", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71bedc9b-17c7-46e4-b35d-7c572939cccb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 1265 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-675468072", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e662d4b-a10e-4675-ab7d-cbb130da6c6d"}]}} Aug 03 04:54:03.737055 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-675468072', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e662d4b-a10e-4675-ab7d-cbb130da6c6d'}]}}} Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.739508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:54:03.744681 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:54:03.746361 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 03 04:54:03.746361 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.746361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71bedc9b-17c7-46e4-b35d-7c572939cccb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:03.746361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71bedc9b-17c7-46e4-b35d-7c572939cccb tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014136 Aug 03 04:54:03.746361 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2577/5138] 10.222.0.72 () {60 vars in 1148 bytes} [Wed Aug 3 04:54:03 2022] POST /compute/v2.1/servers => generated 2221 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 03 04:54:03.761713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:03.765632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: b81a5dad-5f5c-4479-88a9-c47a8198883a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:03.792176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] HTTP exception thrown: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/b81a5dad-5f5c-4479-88a9-c47a8198883a/metadata/test2 HTTP/1.1 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': 'b81a5dad-5f5c-4479-88a9-c47a8198883a', 'id': 'test2'} Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:03.797443 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 404 to user: Instance b81a5dad-5f5c-4479-88a9-c47a8198883a could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:03.802036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd729cc6-8f5c-4f83-86bb-5a11b18ac938 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/b81a5dad-5f5c-4479-88a9-c47a8198883a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043766 Aug 03 04:54:03.802487 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2578/5139] 10.222.0.72 () {58 vars in 1281 bytes} [Wed Aug 3 04:54:03 2022] GET /compute/v2.1/servers/b81a5dad-5f5c-4479-88a9-c47a8198883a/metadata/test2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:03.811495 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e0b5c4f-66a0-4749-b699-6449b97a090b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 204 len: 0 microversion: 2.1 time: 0.584801 Aug 03 04:54:03.812135 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2562/5140] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:54:03 2022] DELETE /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:54:03.823221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:03.823876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:03.833330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.834021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.835002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.835669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.836068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:03.837141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:03.848069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.862088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.873315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:03.879211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:03.940428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:54:03.943950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:04.310406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:04.406018 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3205c3eb-5d17-4a83-a177-adb70a33aea1 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 204 len: 0 microversion: 2.1 time: 0.572811 Aug 03 04:54:04.406712 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2563/5141] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:54:03 2022] DELETE /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:54:04.416209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:04.420472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:04.432667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:04.436431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:04.437531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:04.438267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:04.470120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:04.502766 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f10b197-8a8b-4de2-972c-458cea55750d tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1507 microversion: 2.1 time: 0.675827 Aug 03 04:54:04.504006 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2579/5142] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:03 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:05.222882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:05.236464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d4adc52-cf6b-4835-b48b-a1808b3e7884 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1525 microversion: 2.1 time: 0.819361 Aug 03 04:54:05.237348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2564/5143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:04 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1525 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:05.531104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:05.532782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:05.543668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:05.544408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:05.546798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:05.549085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:06.090632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:06.117118 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-96e6a760-f1ed-4fbc-86df-45eda53aa17e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1507 microversion: 2.1 time: 0.586574 Aug 03 04:54:06.131085 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2580/5144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:05 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:06.259798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:06.261120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:06.274431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:06.275314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:06.276528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:06.279815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:06.786652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:06.794710 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-efbcd2a0-05e3-4f1b-b20f-b2db10064304 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1525 microversion: 2.1 time: 0.539801 Aug 03 04:54:06.810308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2565/5145] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:06 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1525 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:07.143028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:07.144583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:07.156738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.157827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.158993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.160024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.548934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:07.562729 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe1f773c-4ef9-41b9-a95c-f204826e5e93 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1507 microversion: 2.1 time: 0.426670 Aug 03 04:54:07.570855 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2566/5146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:07 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:07.583611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-51a63918-9a94-454e-8142-9761fcfd413d req-917bc186-f02a-4ed2-8a24-297eff5257c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ac9569-c424-4280-b26a-670ed68ef871", "name": "network-vif-deleted", "tag": "1f533663-0cd2-4d9d-9453-576e13eef0e6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:07.608351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-51a63918-9a94-454e-8142-9761fcfd413d req-917bc186-f02a-4ed2-8a24-297eff5257c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.608814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-51a63918-9a94-454e-8142-9761fcfd413d req-917bc186-f02a-4ed2-8a24-297eff5257c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.646062 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-51a63918-9a94-454e-8142-9761fcfd413d req-917bc186-f02a-4ed2-8a24-297eff5257c7 service nova] Creating event network-vif-deleted:1f533663-0cd2-4d9d-9453-576e13eef0e6 for instance d2ac9569-c424-4280-b26a-670ed68ef871 on n-h2-826756-5 Aug 03 04:54:07.672571 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-51a63918-9a94-454e-8142-9761fcfd413d req-917bc186-f02a-4ed2-8a24-297eff5257c7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098663 Aug 03 04:54:07.675075 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2567/5147] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:07.678254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-adde6264-89bf-4c8b-a6a7-59e816652856 req-e11996e4-ac34-454d-9739-9567051a2eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb71887-715d-4774-a22b-d690ca968fc1", "name": "network-vif-deleted", "tag": "5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:07.717912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-adde6264-89bf-4c8b-a6a7-59e816652856 req-e11996e4-ac34-454d-9739-9567051a2eb7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.718448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-adde6264-89bf-4c8b-a6a7-59e816652856 req-e11996e4-ac34-454d-9739-9567051a2eb7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.750619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-adde6264-89bf-4c8b-a6a7-59e816652856 req-e11996e4-ac34-454d-9739-9567051a2eb7 service nova] Creating event network-vif-deleted:5c6a2bbd-11b9-44c2-93b3-7bcfa0d33be3 for instance 0fb71887-715d-4774-a22b-d690ca968fc1 on n-h1-826756-5 Aug 03 04:54:07.755951 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-adde6264-89bf-4c8b-a6a7-59e816652856 req-e11996e4-ac34-454d-9739-9567051a2eb7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081456 Aug 03 04:54:07.757659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2568/5148] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:07.816477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:07.817311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:07.840624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.841298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.846401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.847086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.898685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:07.899355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:07.900726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lazy-loading 'fault' on Instance uuid d2ac9569-c424-4280-b26a-670ed68ef871 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:54:07.988175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1117496030", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:08.038112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '279aedd4ceab4f72a921f2ea248bc791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1755d3827e404d31a9730e7ec4137c77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:08.066131 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4e0f6af-c84b-41ff-a851-4c682f318bdd tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 200 len: 1313 microversion: 2.1 time: 0.251209 Aug 03 04:54:08.077574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2569/5149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:07 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:54:08.118786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:54:08.121484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:54:08.124851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:54:08.125453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:54:08.125893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:54:08.175134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:08.175598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:08.176452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:08.182092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:08.224126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Getting quotas for project 6a2556164c884cd4b88bcc5989b19c25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:54:08.234554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Getting quotas for user 6df172080da94237a1b1a6e008ac2dbe and project 6a2556164c884cd4b88bcc5989b19c25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:54:08.252848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:54:08.255680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:54:08.436668 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab124218-1989-4a37-b4d2-54f36c095f40 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.304011 Aug 03 04:54:08.439123 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2581/5150] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 04:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 04:54:08.451511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:08.452126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:08.556477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:08.569455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:08.571358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:08.572893 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ccd821d-7315-4913-9d15-6df5dcaec776 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1278 microversion: 2.57 time: 0.127512 Aug 03 04:54:08.589291 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2570/5151] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:08 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1278 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:08.593756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:08.593756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:08.604233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:08.608936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:08.608936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:08.611683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:08.654884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:08.654884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:08.654884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'fault' on Instance uuid 0fb71887-715d-4774-a22b-d690ca968fc1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:54:08.722567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:08.736104 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16fc5ad7-9e52-4036-b5e1-303fcb106b0f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 200 len: 1311 microversion: 2.1 time: 0.152035 Aug 03 04:54:08.736759 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2582/5152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:08 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:54:09.096345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:09.097291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] [instance: d2ac9569-c424-4280-b26a-670ed68ef871] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:09.129798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.130283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.133076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.134520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.187181 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] HTTP exception thrown: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Request method failure captured: Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 HTTP/1.1 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9Wi7A3H2Q13FpDOdgyNJaYq1zA5ob1EyjlOLPeAgbmQZuvAoX8vcGQIXtUaIX608nSirBm9oG-bjqinkJciWj3k7F3nfQw7H3QO0Wm913FZ14w1tOHrAp3odpmVOnpYFeI2y0ZkxmesXA0d7WtNMaqFBwJIpHUqTQyNz9I6_icNbg Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1755d3827e404d31a9730e7ec4137c77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1755d3827e404d31a9730e7ec4137c77 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1588247543 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 279aedd4ceab4f72a921f2ea248bc791 Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1588247543-project Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd2ac9569-c424-4280-b26a-670ed68ef871'} Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.190662 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] Returning 404 to user: Instance d2ac9569-c424-4280-b26a-670ed68ef871 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:09.204939 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96000c77-da65-4329-ba48-063bee573d51 tempest-ServerMetadataNegativeTestJSON-1588247543 tempest-ServerMetadataNegativeTestJSON-1588247543-project] 10.222.0.72 "GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871" status: 404 len: 111 microversion: 2.1 time: 0.108649 Aug 03 04:54:09.206643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2571/5153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:09 2022] GET /compute/v2.1/servers/d2ac9569-c424-4280-b26a-670ed68ef871 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:09.604079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:09.604732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:09.614940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:09.700609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:09.713859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:09.722722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:09.722722 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02761738-1529-45ed-9024-f6a95b17a611 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1278 microversion: 2.57 time: 0.122769 Aug 03 04:54:09.725034 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2583/5154] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:09 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:09.770113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:09.774767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: 0fb71887-715d-4774-a22b-d690ca968fc1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:09.792512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.796984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.799164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.800812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.856292 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 HTTP/1.1 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0fb71887-715d-4774-a22b-d690ca968fc1'} Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.859400 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. Aug 03 04:54:09.863976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:09.866644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 404 to user: Instance 0fb71887-715d-4774-a22b-d690ca968fc1 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:09.868829 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-60b4cceb-aa41-4ef7-8415-636ccb007b3b tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1" status: 404 len: 111 microversion: 2.1 time: 0.110259 Aug 03 04:54:09.870292 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2572/5155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:09 2022] GET /compute/v2.1/servers/0fb71887-715d-4774-a22b-d690ca968fc1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:09.881501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:09.882012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:09.893341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.894672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.895749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:09.896395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:09.943419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:54:10.618429 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ddde80a8-4d85-46a5-b2b8-5ff74ad25404 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 204 len: 0 microversion: 2.1 time: 0.740819 Aug 03 04:54:10.619566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2584/5156] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:54:09 2022] DELETE /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:54:10.637069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:10.637817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:10.651142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:10.651605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:10.654916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:10.655388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:10.751181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:10.752644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:10.770098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:10.770903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:10.771895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:10.772568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:10.939131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:10.947613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:10.960910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:10.968729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f01ce15d-0d84-486b-b060-3cdf4b57ba50 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1282 microversion: 2.57 time: 0.223350 Aug 03 04:54:10.969730 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2585/5157] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:10 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:11.103429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:11.114065 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7df80c9-51bc-4190-9068-a4e5ed1b3ea0 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.490312 Aug 03 04:54:11.134716 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2573/5158] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:10 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:11.995485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:11.996103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:12.006125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:12.006566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:12.007527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:12.008010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:12.088195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:12.098025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:12.101060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:12.102644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-abd547da-8456-4bfc-affa-5ed8039368a1 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1282 microversion: 2.57 time: 0.111351 Aug 03 04:54:12.116492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2586/5159] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:11 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:12.144940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:12.146147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:12.153624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:12.154708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:12.155507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:12.155941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:12.431580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:12.441749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e74d6591-d83f-49f1-a5e9-4b99a23fc47e tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.301347 Aug 03 04:54:12.461954 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2574/5160] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:12 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:13.132495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:13.134954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:13.152231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:13.156890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:13.158730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:13.160664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:13.486713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:13.487867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:13.516122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:13.517532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:13.518407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:13.518904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:14.291813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:14.301013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:14.314569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:14.316100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03bc6f34-c4f0-409b-a7ef-a1b9b147b7c8 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1282 microversion: 2.57 time: 1.190430 Aug 03 04:54:14.317039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2587/5161] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:13 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1282 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:14.422314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:14.439245 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13b8ef93-6a44-43e1-bb01-7cb43e2ff15f tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1521 microversion: 2.1 time: 0.959536 Aug 03 04:54:14.442666 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2575/5162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:13 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1521 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:15.250959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4e973115-4cff-415f-9bb0-01db78382e1a req-75d880d0-9e4e-4dbb-af7e-9a3dd5ebfeed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4786d26-74a5-4327-90aa-9d70b19e447c", "name": "network-vif-deleted", "tag": "542af35f-4bfd-4340-9808-6dfdb66d975e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:15.266277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e973115-4cff-415f-9bb0-01db78382e1a req-75d880d0-9e4e-4dbb-af7e-9a3dd5ebfeed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:15.266907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e973115-4cff-415f-9bb0-01db78382e1a req-75d880d0-9e4e-4dbb-af7e-9a3dd5ebfeed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:15.285039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4e973115-4cff-415f-9bb0-01db78382e1a req-75d880d0-9e4e-4dbb-af7e-9a3dd5ebfeed service nova] Creating event network-vif-deleted:542af35f-4bfd-4340-9808-6dfdb66d975e for instance c4786d26-74a5-4327-90aa-9d70b19e447c on n-h2-826756-5 Aug 03 04:54:15.291905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4e973115-4cff-415f-9bb0-01db78382e1a req-75d880d0-9e4e-4dbb-af7e-9a3dd5ebfeed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052810 Aug 03 04:54:15.293168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2588/5163] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:15.343000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:15.343504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:15.352533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:15.353244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:15.354409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:15.354989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:15.465019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:15.465748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:15.484311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:15.484311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:15.484311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:15.484311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:15.637217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:15.654669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:15.656440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:15.657493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6756805-d7e6-4e4c-b477-b862157b03ad tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1330 microversion: 2.57 time: 0.319053 Aug 03 04:54:15.668975 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2576/5164] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:15 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1330 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:15.745803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:15.754840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e63d3bc2-be44-4eb9-8d34-2f695d660c79 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1479 microversion: 2.1 time: 0.295767 Aug 03 04:54:15.764603 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2589/5165] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:15 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1479 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:54:16.710573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:16.711727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:16.728647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:16.729273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:16.730249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:16.730849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:16.784803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:16.785371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:16.796501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:16.796964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:16.797806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:16.798434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:16.894470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:16.900496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:16.901252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:16.901891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lazy-loading 'fault' on Instance uuid c4786d26-74a5-4327-90aa-9d70b19e447c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:54:16.909978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:16.925844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:16.925844 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad813371-b671-4aa9-a4a7-ab1def005144 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1338 microversion: 2.57 time: 0.226957 Aug 03 04:54:16.925844 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2577/5166] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:16 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:16.962900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776b1938a6ea44a68923f368fd03fd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ee5d435f6a4d6f9310915b86b709ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:16.973520 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e9a9a0e-be6e-4231-b4d5-974caa279375 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 200 len: 1311 microversion: 2.1 time: 0.196999 Aug 03 04:54:16.977211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2590/5167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:16 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 1311 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:54:17.961825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:17.968890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:17.973895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:17.974593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:17.975701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:17.977874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:18.002468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:18.004491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] [instance: c4786d26-74a5-4327-90aa-9d70b19e447c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:18.016627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:18.021696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:18.026220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:18.026220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:18.028305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:18.039110 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] HTTP exception thrown: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Request method failure captured: Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c HTTP/1.1 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f40KX0PPQ5BHQlqeHajz-Ie-u2HPyVUSXt9E-IBNQBwcdz0CgG2Lh724BUwFe-aZ6vlbrSRRBv8VSqzzWzeX8XSRybMcMwmzmE_m3zvv_an1r6htWRss5_6wWOXVOE77XLIdkhvw8xgPtU9yqayNUzmDl6jjo2QQNoztz6VR-54evI Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d3ee5d435f6a4d6f9310915b86b709ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d3ee5d435f6a4d6f9310915b86b709ba Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1647174692 Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 776b1938a6ea44a68923f368fd03fd8a Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1647174692-project Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c4786d26-74a5-4327-90aa-9d70b19e447c'} Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:18.041439 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. Aug 03 04:54:18.045765 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:18.047762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] Returning 404 to user: Instance c4786d26-74a5-4327-90aa-9d70b19e447c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:18.048769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99b650e0-2fe4-44bc-842e-4d1992033692 tempest-ServerRescueNegativeTestJSON-1647174692 tempest-ServerRescueNegativeTestJSON-1647174692-project] 10.222.0.72 "GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c" status: 404 len: 111 microversion: 2.1 time: 0.055376 Aug 03 04:54:18.049440 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2591/5168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:17 2022] GET /compute/v2.1/servers/c4786d26-74a5-4327-90aa-9d70b19e447c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:18.059813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:18.073573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:18.075083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:18.076519 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9775d631-390a-4f3e-9bb6-d0aa2e87eb2e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1336 microversion: 2.57 time: 0.134141 Aug 03 04:54:18.081542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2578/5169] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:17 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:19.106593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:19.108416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:19.111993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:19.129076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:19.136337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:19.137120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:19.137577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:19.333644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:19.347823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:19.356087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:19.359002 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6838579b-8c59-4ced-8838-7e436df50b2b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1336 microversion: 2.57 time: 0.257551 Aug 03 04:54:19.362809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2592/5170] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:19 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1336 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:20.386032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:20.387256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:20.390503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:20.409057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:20.409716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:20.410682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:20.411316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:20.660582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:20.677127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:20.679460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:20.681088 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3fe5f2a-6a9c-4635-b858-dcb7e7073f49 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1336 microversion: 2.57 time: 0.298985 Aug 03 04:54:20.685619 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2579/5171] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:20 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1336 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:21.714984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:21.714984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:21.716109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:21.728368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:21.732386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:21.733305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:21.733754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:22.090460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:22.102729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:22.127581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:22.131626 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c627e270-3321-4d60-b38d-f4a94507602d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1357 microversion: 2.57 time: 0.424742 Aug 03 04:54:22.132881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2593/5172] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:21 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1357 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:22.166613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:22.171945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:22.204542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:22.205194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:22.209575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:22.210072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:22.438664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:54:22.440874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:54:22.441852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:54:22.442327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:54:22.442753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:54:22.664100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:22.727745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b79cbd1a-a761-4219-9331-e0049912f880 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Action: 'create', calling method: .version_select at 0x7fdd479d63a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1362128336"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:22.847808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:22.855834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:22.857293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:22.858311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:22.898522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:22.992471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-06621331-13dc-4d70-a319-4fc4a24915af tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "POST /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6/action" status: 202 len: 1138 microversion: 2.57 time: 0.831995 Aug 03 04:54:22.995655 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2580/5173] 10.222.0.72 () {62 vars in 1320 bytes} [Wed Aug 3 04:54:22 2022] POST /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6/action => generated 1138 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 04:54:23.022281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:23.024569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:23.055305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:23.065629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:23.065629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:23.065629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:23.249669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:23.258911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:23.261227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:23.263337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68e71021-9518-4a27-b70e-ead2fb8a9a5a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.251409 Aug 03 04:54:23.264662 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2581/5174] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:23 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:23.991478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b79cbd1a-a761-4219-9331-e0049912f880 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.508701 Aug 03 04:54:23.993080 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2594/5175] 10.222.0.72 () {60 vars in 1155 bytes} [Wed Aug 3 04:54:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1512 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 03 04:54:24.006420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ea983d4e-db8a-4c1a-808f-ff8dd0df38cc tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47df4af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:24.102531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ea983d4e-db8a-4c1a-808f-ff8dd0df38cc tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 345 microversion: 2.1 time: 0.099763 Aug 03 04:54:24.103160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2582/5176] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:24 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:24.288305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:24.289545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:24.300084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:24.300815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:24.302571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:24.303187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:24.496111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:24.538296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:24.539738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:24.542141 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02bcca9c-4b6d-461b-8e78-3eac3efd233e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.258720 Aug 03 04:54:24.552905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2595/5177] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:24 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:25.118660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92b3e10f-fa26-4aa2-b653-564bf9709075 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd4759c5e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:25.229794 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-92b3e10f-fa26-4aa2-b653-564bf9709075 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 345 microversion: 2.1 time: 0.111491 Aug 03 04:54:25.230618 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2583/5178] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:25 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:25.570706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:25.572653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:25.606835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:25.607318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:25.612949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:25.613448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:26.224686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:26.241933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:26.243474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:26.252236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d74266e-e89e-406f-a570-ed792fe4f955 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd4759a820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:26.271738 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2cdbb2b-1fa8-4ccf-82e1-bb3a225981bb tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.679908 Aug 03 04:54:26.291057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2596/5179] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:25 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:26.432556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d74266e-e89e-406f-a570-ed792fe4f955 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 346 microversion: 2.1 time: 0.157662 Aug 03 04:54:26.432556 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2584/5180] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:26 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:54:26.432824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a04ea03-6f54-4422-afcd-49f443e97b38 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Action: 'create', calling method: .version_select at 0x7fdd54623790>, body: {"snapshot": {"volume_id": "5613118b-ab4d-46d8-8939-40c072baad04", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-916139903"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:27.304045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:27.305415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:27.323173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:27.328951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:27.333065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:27.333065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:27.535007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:27.549974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:27.551509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:27.552756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9151a2e0-b423-4e4a-9788-ff3d65e1715e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.253594 Aug 03 04:54:27.553330 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2585/5181] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:27 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:27.582186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a04ea03-6f54-4422-afcd-49f443e97b38 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.168053 Aug 03 04:54:27.582806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2597/5182] 10.222.0.72 () {60 vars in 1162 bytes} [Wed Aug 3 04:54:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:27.602546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-643a4785-11bf-4b52-960b-a1688863790e tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47e46790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:27.757261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-643a4785-11bf-4b52-960b-a1688863790e tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.166707 Aug 03 04:54:27.757605 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2598/5183] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:27 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:27.769362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1e03dde-7cf0-4b3c-abce-33c7d38ee4f7 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd475979d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:27.834539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1e03dde-7cf0-4b3c-abce-33c7d38ee4f7 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.069135 Aug 03 04:54:27.837600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2586/5184] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 3 04:54:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:54:27.853958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8ffe2d8-de9d-4f15-888a-a4ec0922979b tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd479dff70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:27.930896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8ffe2d8-de9d-4f15-888a-a4ec0922979b tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.084668 Aug 03 04:54:27.932037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2599/5185] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:27 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:28.585972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:28.587473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:28.610237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:28.613081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:28.616178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:28.630892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:28.827996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:28.891131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:28.898838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:28.900248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ce8971c-d525-453b-acea-49be2de2c3a9 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.319326 Aug 03 04:54:28.906116 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2587/5186] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:28 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:28.949388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2afbd4e1-b845-445a-b3fc-f6011740e74b tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd54623b80>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:29.029176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2afbd4e1-b845-445a-b3fc-f6011740e74b tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.082259 Aug 03 04:54:29.029176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2600/5187] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:28 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:29.933816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:29.934514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:29.943679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:29.944139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:29.944964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:29.945392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:30.052103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1c194dd-e1c2-412e-8171-145b3818b07d tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd54623040>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:30.128853 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1c194dd-e1c2-412e-8171-145b3818b07d tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.092962 Aug 03 04:54:30.129679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2601/5188] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:30 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:30.257867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:30.271392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:30.279605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:30.281590 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30f149c8-15f5-44e9-bc69-55043f87c9ee tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.352959 Aug 03 04:54:30.283767 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2588/5189] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:29 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:30.518884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6c00474-775c-4913-a984-c11ab42d5054 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: .version_select at 0x7fdd479dfe50>, body: {"keypair": {"name": "tempest-keypair-1697324497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgzwB3ZK9TcS+WpPayo988bBpJeEmZ0XJ2/UIwV1YEMTIbWW+tmdWKSmUsE2E05t+2fef3EUFRsGv6jnADUtEsPGTHHJPfHazrt4XxPD//ToxvcAe1nnrXM/aR/DuAgxw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:30.540337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e6c00474-775c-4913-a984-c11ab42d5054 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:54:30.547676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-e6c00474-775c-4913-a984-c11ab42d5054 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:54:30.822617 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6c00474-775c-4913-a984-c11ab42d5054 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.457851 Aug 03 04:54:30.845934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2602/5190] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:54:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:31.144379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3e93dbb-c17b-42c5-a724-8c0a253956d3 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47c12280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:31.232992 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3e93dbb-c17b-42c5-a724-8c0a253956d3 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.094522 Aug 03 04:54:31.236035 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2589/5191] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:31 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:31.312099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:31.312781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:31.326218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:31.326709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:31.341435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:31.341435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:31.530478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:31.530478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:31.531345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:31.532627 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91d44cb8-316c-42ba-aa33-63f85e5bd779 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.226876 Aug 03 04:54:31.533454 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2603/5192] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:31 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:32.251544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6c1b0532-646d-44cf-a868-5cd2afbc8299 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47597700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:32.330827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6c1b0532-646d-44cf-a868-5cd2afbc8299 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 287 microversion: 2.1 time: 0.087480 Aug 03 04:54:32.336322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2590/5193] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:32 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:32.344725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-685af43e-d454-4291-9a45-4e2b5206e8f8 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd479dfaf0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:32.562782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:32.566112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:32.570728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:32.571475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:32.572631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:32.573151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:32.615201 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-685af43e-d454-4291-9a45-4e2b5206e8f8 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 202 len: 0 microversion: 2.1 time: 0.275949 Aug 03 04:54:32.617631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2604/5194] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 3 04:54:32 2022] DELETE /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:54:32.634878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ecb0296-1504-4515-b648-bdd8649fc5b1 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47e46d30>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:32.679936 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ecb0296-1504-4515-b648-bdd8649fc5b1 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.056677 Aug 03 04:54:32.681316 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2605/5195] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:32 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:32.755729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:32.774211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:32.776906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:32.784467 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-adb9c38b-61b3-4f2e-adb5-f3ee8c879d8b tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.226040 Aug 03 04:54:32.789490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2591/5196] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:32 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:33.713172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03b0408e-36c9-408a-b224-21257c2e0ce9 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd479d6280>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:33.758417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03b0408e-36c9-408a-b224-21257c2e0ce9 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.068240 Aug 03 04:54:33.759528 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2606/5197] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:33 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:33.823354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:33.824060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:33.848124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:33.848634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:33.850329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:33.853568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:34.030466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:34.049682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:34.059569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:34.060522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f4c0424-3afc-4ab7-baa7-64618a5e0340 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.243747 Aug 03 04:54:34.065129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2592/5198] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:33 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:34.155806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03b0408e-36c9-408a-b224-21257c2e0ce9 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:34.156814 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03b0408e-36c9-408a-b224-21257c2e0ce9 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001348 Aug 03 04:54:34.157630 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2607/5199] 10.222.0.72 () {56 vars in 886 bytes} [Wed Aug 3 04:54:34 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 04:54:34.772878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a3dd99a-e0e3-4393-93a1-f60232cb6ccc tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47597af0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:34.826278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a3dd99a-e0e3-4393-93a1-f60232cb6ccc tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 200 len: 286 microversion: 2.1 time: 0.057415 Aug 03 04:54:34.831539 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2593/5200] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:34 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:35.093911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:35.094607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:35.103636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:35.104416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:35.105420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:35.106995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:35.191620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:35.202008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:35.203936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:35.205182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b580bd0-c5c4-4e8f-8c25-dfe032fc80c5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.117388 Aug 03 04:54:35.206088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2608/5201] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:35 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:35.840347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-537b1ff0-7064-44b8-8133-930e923368ad tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd545a6790>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:35.881351 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-537b1ff0-7064-44b8-8133-930e923368ad tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] HTTP exception thrown: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-537b1ff0-7064-44b8-8133-930e923368ad tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Request method failure captured: Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee HTTP/1.1 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9-QIzU-Ib8cUdG_0ZYIPYrvmq91KZrBMpukGw1VjUlx3UAdiinilqxQKGNFii63dyyt7ZdNAjWsHZuBtBBbQcrfCDQd-rBSLNr23vm1zy0LetLqvgkPPSTOZlNEaBsNZqELxQCHm9GQb4dYwGWYKY1vchjDnoNiSLlVRiYSfhTWW0 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: f46c5f1f8e36413fbbad5b760789ccea Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: exception: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '249e250c-8a28-40d5-8465-46187a14d6ee'} Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. (HTTP 404) (Request-ID: req-1d66912a-1ce5-483b-9cef-ef2781129771) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:54:35.890220 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-537b1ff0-7064-44b8-8133-930e923368ad tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Returning 404 to user: Snapshot 249e250c-8a28-40d5-8465-46187a14d6ee could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-537b1ff0-7064-44b8-8133-930e923368ad tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee" status: 404 len: 111 microversion: 2.1 time: 0.059521 Aug 03 04:54:35.905004 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2594/5202] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 04:54:35 2022] GET /compute/v2.1/os-snapshots/249e250c-8a28-40d5-8465-46187a14d6ee => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:35.917998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f4fff02-a3ec-41c6-a3f5-360e57d4034f tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47e1a9d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:36.231927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:36.232981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:36.248166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:36.249181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:36.250525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:36.251148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:36.273834 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f4fff02-a3ec-41c6-a3f5-360e57d4034f tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 202 len: 0 microversion: 2.1 time: 0.361345 Aug 03 04:54:36.277187 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2609/5203] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:54:35 2022] DELETE /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:54:36.287573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0afe3f15-ca31-46bc-8509-be2c5e55e042 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd4795e790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:36.423099 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0afe3f15-ca31-46bc-8509-be2c5e55e042 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 345 microversion: 2.1 time: 0.142277 Aug 03 04:54:36.424021 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2610/5204] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:36 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 345 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:54:36.430109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-386569981", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "112d0d14-3b17-41f3-81d4-e1328e5bdf87"}], "security_groups": [{"name": "tempest-securitygroup--91948741"}], "key_name": "tempest-keypair-1697324497", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:36.478402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:36.499459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:36.501069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:36.502421 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-971d2980-3cbd-4866-8ddc-cf6f91e67c2d tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.275422 Aug 03 04:54:36.507192 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2595/5205] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:36 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:36.878874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] validate_networks() for [('112d0d14-3b17-41f3-81d4-e1328e5bdf87', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:54:37.446683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16e313b2-4f35-44d9-8226-9d985323f01e tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd475771f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:37.509037 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16e313b2-4f35-44d9-8226-9d985323f01e tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 345 microversion: 2.1 time: 0.066941 Aug 03 04:54:37.509865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2596/5206] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:37 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:37.594959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:37.595797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:37.605067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:37.606462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:37.607860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:37.608572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:37.813427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:37.829853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:37.836292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:37.837795 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e98049c-cbd2-4a85-a028-9a0a5b03f9b6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.248287 Aug 03 04:54:37.857835 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2597/5207] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:37 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:38.458674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:54:38.459703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:54:38.460413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:54:38.460838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:54:38.461266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:54:38.475724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:38.476187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:38.478932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:38.483827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:38.504956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:54:38.511288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:54:38.525300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-167c37aa-07ce-47b7-87ea-6b4e17c0adc8 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd475bf940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:38.531898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:54:38.539024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:54:38.623617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-167c37aa-07ce-47b7-87ea-6b4e17c0adc8 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 200 len: 345 microversion: 2.1 time: 0.102553 Aug 03 04:54:38.624489 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2598/5208] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:38 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:54:38.745992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb7c88af-4a54-49d3-b0b0-916873d34482 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.318230 Aug 03 04:54:38.754497 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2611/5209] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:54:36 2022] POST /compute/v2.1/servers => generated 400 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:54:38.791741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-400346ec-5136-471c-85ec-e9859f681c36 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:38.792576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-400346ec-5136-471c-85ec-e9859f681c36 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:38.803706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=59 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:38.870102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:38.871321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:38.891701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:38.905618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:38.905618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:38.905618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:39.165499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-400346ec-5136-471c-85ec-e9859f681c36 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:39.169039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:39.186018 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-400346ec-5136-471c-85ec-e9859f681c36 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1241 microversion: 2.1 time: 0.423150 Aug 03 04:54:39.189010 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2599/5210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:38 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1241 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:39.199760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:39.208988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:39.211073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a4e0c8f-c2d0-4c71-8011-73a7dc77e807 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.346151 Aug 03 04:54:39.216402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2612/5211] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:38 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:39.638831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38b53c20-b0a1-4102-9df3-2de4115c2537 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd475bfa60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:39.707432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-38b53c20-b0a1-4102-9df3-2de4115c2537 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] HTTP exception thrown: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38b53c20-b0a1-4102-9df3-2de4115c2537 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Request method failure captured: Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 HTTP/1.1 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9-QIzU-Ib8cUdG_0ZYIPYrvmq91KZrBMpukGw1VjUlx3UAdiinilqxQKGNFii63dyyt7ZdNAjWsHZuBtBBbQcrfCDQd-rBSLNr23vm1zy0LetLqvgkPPSTOZlNEaBsNZqELxQCHm9GQb4dYwGWYKY1vchjDnoNiSLlVRiYSfhTWW0 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: f46c5f1f8e36413fbbad5b760789ccea Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: exception: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '5613118b-ab4d-46d8-8939-40c072baad04'} Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. (HTTP 404) (Request-ID: req-aaedc12f-b683-455e-acb3-52e36f8f6546) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:54:39.710650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38b53c20-b0a1-4102-9df3-2de4115c2537 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Returning 404 to user: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:39.715830 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-38b53c20-b0a1-4102-9df3-2de4115c2537 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 404 len: 109 microversion: 2.1 time: 0.079652 Aug 03 04:54:39.727657 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2600/5212] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:39 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:39.727854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0085a68b-2206-444b-8fa4-c215069a77c5 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd479ec790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:39.781578 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0085a68b-2206-444b-8fa4-c215069a77c5 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] HTTP exception thrown: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0085a68b-2206-444b-8fa4-c215069a77c5 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Request method failure captured: Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 HTTP/1.1 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f9-QIzU-Ib8cUdG_0ZYIPYrvmq91KZrBMpukGw1VjUlx3UAdiinilqxQKGNFii63dyyt7ZdNAjWsHZuBtBBbQcrfCDQd-rBSLNr23vm1zy0LetLqvgkPPSTOZlNEaBsNZqELxQCHm9GQb4dYwGWYKY1vchjDnoNiSLlVRiYSfhTWW0 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f46c5f1f8e36413fbbad5b760789ccea Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: exception: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5613118b-ab4d-46d8-8939-40c072baad04'} Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. (HTTP 404) (Request-ID: req-ca72ad03-0dac-4079-ab2a-5d66917c565c) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:54:39.784012 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.788202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0085a68b-2206-444b-8fa4-c215069a77c5 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Returning 404 to user: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:39.794154 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0085a68b-2206-444b-8fa4-c215069a77c5 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 404 len: 109 microversion: 2.1 time: 0.069560 Aug 03 04:54:39.794154 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2613/5213] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:54:39 2022] DELETE /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:39.804837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fb35672-515b-4aac-88d5-b869e1084b19 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Calling method '.version_select at 0x7fdd47597d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:39.849946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4fb35672-515b-4aac-88d5-b869e1084b19 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] HTTP exception thrown: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fb35672-515b-4aac-88d5-b869e1084b19 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Request method failure captured: Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 HTTP/1.1 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9-QIzU-Ib8cUdG_0ZYIPYrvmq91KZrBMpukGw1VjUlx3UAdiinilqxQKGNFii63dyyt7ZdNAjWsHZuBtBBbQcrfCDQd-rBSLNr23vm1zy0LetLqvgkPPSTOZlNEaBsNZqELxQCHm9GQb4dYwGWYKY1vchjDnoNiSLlVRiYSfhTWW0 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/26b51bc6d71947418eee5ad901e152b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 26b51bc6d71947418eee5ad901e152b1 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-802912074 Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: f46c5f1f8e36413fbbad5b760789ccea Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesSnapshotsTestJSON-802912074-project Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: exception: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '5613118b-ab4d-46d8-8939-40c072baad04'} Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. (HTTP 404) (Request-ID: req-af74b567-a4f8-4c6e-87d8-d4b60875537a) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 04:54:39.852315 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fb35672-515b-4aac-88d5-b869e1084b19 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] Returning 404 to user: Volume 5613118b-ab4d-46d8-8939-40c072baad04 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fb35672-515b-4aac-88d5-b869e1084b19 tempest-VolumesSnapshotsTestJSON-802912074 tempest-VolumesSnapshotsTestJSON-802912074-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04" status: 404 len: 109 microversion: 2.1 time: 0.055348 Aug 03 04:54:39.860811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2601/5214] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:54:39 2022] GET /compute/v2.1/os-volumes/5613118b-ab4d-46d8-8939-40c072baad04 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:54:40.216965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8de0795-7cb6-4b6b-b294-278f7d041e4d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:40.217923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e8de0795-7cb6-4b6b-b294-278f7d041e4d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:40.241491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:40.244526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:40.284745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:40.288155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:40.289922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:40.291776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:40.441580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e8de0795-7cb6-4b6b-b294-278f7d041e4d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:40.459808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e8de0795-7cb6-4b6b-b294-278f7d041e4d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1241 microversion: 2.1 time: 0.250687 Aug 03 04:54:40.481832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2614/5215] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:40 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1241 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:40.505174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:40.515640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:40.518236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:40.519898 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56a7b3ff-afa7-4857-b7c9-d7f9b61e58e5 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.284158 Aug 03 04:54:40.533880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2602/5216] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:40 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:41.488532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:41.489205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:41.507010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:41.507542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:41.508369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:41.508811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:41.650173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7557ae8f-f1d8-4ed1-a07b-205f975575e6 tempest-ComputeTenantNetworksTest-1161061198 tempest-ComputeTenantNetworksTest-1161061198-project] Calling method '.version_select at 0x7fdd4795e790>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:41.716981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:41.725049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-312cffd9-e86f-48c0-af5e-377b41a8b68f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1237 microversion: 2.1 time: 0.241623 Aug 03 04:54:41.725649 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2603/5217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:41 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1237 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:41.731690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:41.732620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:41.739591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:41.740513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:41.741543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:41.742176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:41.898748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:41.909930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:41.913859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:41.913859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0565abb-8669-4b76-91d5-38f98639c3ce tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.186147 Aug 03 04:54:41.923412 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2604/5218] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:41 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:42.049798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7557ae8f-f1d8-4ed1-a07b-205f975575e6 tempest-ComputeTenantNetworksTest-1161061198 tempest-ComputeTenantNetworksTest-1161061198-project] 10.222.0.72 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.609212 Aug 03 04:54:42.051248 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2615/5219] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 04:54:41 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:42.065156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-145be553-ad55-46fb-bc56-159d1e23498e tempest-ComputeTenantNetworksTest-1161061198 tempest-ComputeTenantNetworksTest-1161061198-project] Calling method '.version_select at 0x7fdd47c5ba60>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:42.214024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-145be553-ad55-46fb-bc56-159d1e23498e tempest-ComputeTenantNetworksTest-1161061198 tempest-ComputeTenantNetworksTest-1161061198-project] 10.222.0.72 "GET /compute/v2.1/os-tenant-networks/90896922-a77f-42ce-b730-da528a5cb4eb" status: 200 len: 140 microversion: 2.1 time: 0.154135 Aug 03 04:54:42.214024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2605/5220] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 04:54:42 2022] GET /compute/v2.1/os-tenant-networks/90896922-a77f-42ce-b730-da528a5cb4eb => generated 140 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:42.752349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:42.755396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:42.774311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:42.774311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:42.774311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:42.774311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:42.953526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:42.962199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:42.981170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:43.010356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:43.019108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:43.022512 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4397d457-3eef-4d35-a121-e96115e45eeb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1311 microversion: 2.1 time: 0.275369 Aug 03 04:54:43.023599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:43.025728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:43.032236 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2616/5221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:42 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1311 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:43.171637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:43.184565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:43.186909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:43.190115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0d9160fd-fb3a-43c0-8cc6-8fdf3c34e0a6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.256510 Aug 03 04:54:43.194887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2606/5222] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:42 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:44.065653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:44.066282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:44.079580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:44.081050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:44.082108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:44.082952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:44.190557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:44.202129 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d46e444-3552-4d6f-80c1-0d56e7279353 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1299 microversion: 2.1 time: 0.144353 Aug 03 04:54:44.205617 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2617/5223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:44 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1299 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:44.222961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:44.223585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:44.233648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:44.235953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:44.238235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:44.238878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:44.362763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:44.371491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:44.374979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:44.377531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a00a039-4070-48dd-abe2-b42d2194bc89 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.157325 Aug 03 04:54:44.377531 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2607/5224] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:44 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:45.226481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:45.227772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:45.235373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:45.236204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:45.237312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:45.237970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:45.403254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:45.403968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:45.444392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:45.444392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:45.444392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:45.444392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:45.608588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:45.623804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:45.625848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:45.627073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0dde5c90-439e-428b-85a8-b365e734ac95 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.228267 Aug 03 04:54:45.627657 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2608/5225] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:45 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:54:45.678936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:45.714189 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c822b1f4-8dd0-45ea-a7f3-9bb1415862f6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.476018 Aug 03 04:54:45.714189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2618/5226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:45 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:46.657754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:46.661236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:46.715919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:46.718257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:46.721088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:46.721309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:46.724969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:46.725587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:46.733522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:46.733981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:46.734893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:46.735195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:46.956230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:46.971217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:46.983743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:46.985972 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b1207af-4c10-4f61-9b8b-49544357815e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.335727 Aug 03 04:54:46.988961 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2609/5227] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:46 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:47.000595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a2b37158-4455-40d3-8a44-d83f585720f9 req-39540d79-28b1-4658-8cee-6208dd404e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe", "tag": "e7903890-38a4-4c17-8809-0b88a14113d1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:47.018282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a2b37158-4455-40d3-8a44-d83f585720f9 req-39540d79-28b1-4658-8cee-6208dd404e24 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:47.018770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a2b37158-4455-40d3-8a44-d83f585720f9 req-39540d79-28b1-4658-8cee-6208dd404e24 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:47.031606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a2b37158-4455-40d3-8a44-d83f585720f9 req-39540d79-28b1-4658-8cee-6208dd404e24 service nova] Creating event network-changed:e7903890-38a4-4c17-8809-0b88a14113d1 for instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe on n-h1-826756-5 Aug 03 04:54:47.040333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a2b37158-4455-40d3-8a44-d83f585720f9 req-39540d79-28b1-4658-8cee-6208dd404e24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049877 Aug 03 04:54:47.042689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2610/5228] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:47.222585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:47.246737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ef4e81aa-40e7-4998-a53a-f8ab53eaabc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.517691 Aug 03 04:54:47.247776 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2619/5229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:46 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:48.017660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:48.019029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:48.034824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:48.037274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:48.038306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:48.040873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:48.098749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:48.222876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:48.239375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:48.252337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:48.254148 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb9cb099-7351-4941-a017-d5b0fcf45783 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.242678 Aug 03 04:54:48.255647 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2611/5230] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:48 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:48.270078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:48.270078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:48.294596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:48.298265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:48.299387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:48.302883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:48.501392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:48.540092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:48.548727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88a2ef63-814d-471c-843e-b9aaca32cc54 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.294279 Aug 03 04:54:48.549333 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2620/5231] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:48 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:54:49.284121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:49.285495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:49.288884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:49.311666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:49.312221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:49.313778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:49.314231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:49.456370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:49.470477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:49.473365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:49.475073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b278d98-e331-4bc7-8e91-4f449c537a1e tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.194919 Aug 03 04:54:49.479046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2612/5232] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:49 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:49.572084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:49.574110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:49.594466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:49.598304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:49.600624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:49.605136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:49.606061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:49.914174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:49.933100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f50497dd-5c8a-418f-9ac0-bede6a9f30cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.366401 Aug 03 04:54:49.934614 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2621/5233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:49 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:50.505797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:50.506852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:50.523506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:50.524178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:50.525015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:50.525477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:50.655924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:50.684460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:50.687047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:50.690480 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d777588-f04a-4239-b294-1996cef301e0 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.190089 Aug 03 04:54:50.697970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2613/5234] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:50 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:50.957008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:50.960220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:50.963464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:50.975080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:50.976255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:50.977327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:50.977995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:51.204967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:51.217234 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b57b1741-3814-48b5-8ff3-2adfeb340fcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.267288 Aug 03 04:54:51.218670 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2622/5235] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:50 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:51.724917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:51.726183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:51.734753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:51.735344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:51.736923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:51.737794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:51.831573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:51.843691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:51.847607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:51.849832 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ea28211-9497-45d3-8eea-39322e064a3c tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.128810 Aug 03 04:54:51.859973 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2614/5236] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:51 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:52.239363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:52.240020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:52.273028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:52.273028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:52.273028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:52.273028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:52.425171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9f108751-6e3e-4332-9de0-877500e342a1 req-e28d8150-dd1c-4eb4-97a5-5d71804c5724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe", "name": "network-vif-plugged", "status": "completed", "tag": "e7903890-38a4-4c17-8809-0b88a14113d1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:52.463103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9f108751-6e3e-4332-9de0-877500e342a1 req-e28d8150-dd1c-4eb4-97a5-5d71804c5724 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:52.463742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9f108751-6e3e-4332-9de0-877500e342a1 req-e28d8150-dd1c-4eb4-97a5-5d71804c5724 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:52.485841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9f108751-6e3e-4332-9de0-877500e342a1 req-e28d8150-dd1c-4eb4-97a5-5d71804c5724 service nova] Creating event network-vif-plugged:e7903890-38a4-4c17-8809-0b88a14113d1 for instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe on n-h1-826756-5 Aug 03 04:54:52.493343 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9f108751-6e3e-4332-9de0-877500e342a1 req-e28d8150-dd1c-4eb4-97a5-5d71804c5724 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072011 Aug 03 04:54:52.494299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2615/5237] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:52.610041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:52.622054 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f319d0fa-5ebe-4661-a8b6-02140b3228db tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.386652 Aug 03 04:54:52.623306 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2623/5238] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:52 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:52.890810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:52.892141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:52.899874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:52.905546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:52.906702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:52.907163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:53.335597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:53.361758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:53.361758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:53.361758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-005227e8-f5b9-4152-b4af-02ef0d7016d4 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.474467 Aug 03 04:54:53.382085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2616/5239] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:52 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:53.645276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:53.645889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:53.659862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:53.662068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:53.663103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:53.664172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:54.023531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:54.030677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8438311-fa2e-4724-94b1-96ae1aa6b6ff tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1365 microversion: 2.1 time: 0.391175 Aug 03 04:54:54.032601 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2624/5240] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:53 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1365 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:54.390183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:54.391487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:54.398676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:54.404894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:54.411961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:54.414180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:54.593965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:54.607352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:54.609183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:54.619027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-75b1d4d4-02c8-42a2-bbac-0e771ecda103 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.226111 Aug 03 04:54:54.620542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2617/5241] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:54 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:55.054221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:55.059072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:55.069278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.073075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.074770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.075403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.081346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:54:55.494612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:55.521187 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a30ce1d-d47c-40ea-a446-9d3250ed2195 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1555 microversion: 2.1 time: 0.470690 Aug 03 04:54:55.522547 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2625/5242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:54:55 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1555 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:54:55.544498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:55.545870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:55.554125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.554713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.555589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.558689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.648418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:55.649390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:55.657874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.669432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.669432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:55.669432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:55.756424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:55.764116 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5552a0b-5672-4582-a7a6-09dc91fae18b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223939 Aug 03 04:54:55.764987 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2618/5243] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:54:55 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:55.765782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:55.767298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:55.768515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-df1f7012-f013-40cc-97bb-167d26dfe066 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1366 microversion: 2.57 time: 0.124172 Aug 03 04:54:55.769079 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2626/5244] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:55 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:56.794631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:56.795809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:56.808692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:56.810716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:56.811764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:56.812219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:56.933309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:56.944136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:56.945706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:56.947216 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44fbd61a-cb06-4232-84bc-9abec352567a tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1372 microversion: 2.57 time: 0.158665 Aug 03 04:54:56.948013 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2619/5245] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:56 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:57.973620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:57.974839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:57.983690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:57.995673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:57.995673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:57.995673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:58.056134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:58.076226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:58.076226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:58.076226 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bea054b4-d1a8-4f81-b130-6c5da4840240 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1372 microversion: 2.57 time: 0.106436 Aug 03 04:54:58.076226 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2627/5246] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:57 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:58.114030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-42818cd6-f408-4e31-bd16-194a369c58d9 req-d362331d-27bf-4486-9ea8-c74871e06cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe", "tag": "e7903890-38a4-4c17-8809-0b88a14113d1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:54:58.131930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-42818cd6-f408-4e31-bd16-194a369c58d9 req-d362331d-27bf-4486-9ea8-c74871e06cab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:58.133212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-42818cd6-f408-4e31-bd16-194a369c58d9 req-d362331d-27bf-4486-9ea8-c74871e06cab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:58.147653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-42818cd6-f408-4e31-bd16-194a369c58d9 req-d362331d-27bf-4486-9ea8-c74871e06cab service nova] Creating event network-changed:e7903890-38a4-4c17-8809-0b88a14113d1 for instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe on n-h1-826756-5 Aug 03 04:54:58.162326 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-42818cd6-f408-4e31-bd16-194a369c58d9 req-d362331d-27bf-4486-9ea8-c74871e06cab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044272 Aug 03 04:54:58.162326 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2620/5247] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:54:59.098816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:59.099562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:59.109191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:59.109866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:59.111061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:59.111846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:59.287013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:59.311156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:59.311156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:54:59.311603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0016a867-0269-4173-bcd4-1b9e7bab2bf6 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1357 microversion: 2.57 time: 0.214487 Aug 03 04:54:59.313144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2628/5248] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:54:59 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:54:59.350648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:54:59.351238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:54:59.366688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:59.372695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:59.372695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:54:59.372695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:54:59.441875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:55:00.171202 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c9dab2b0-60da-4c35-ad37-f599d906dd02 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 204 len: 0 microversion: 2.57 time: 0.824396 Aug 03 04:55:00.184500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2621/5249] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:54:59 2022] DELETE /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:55:00.186676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:00.187320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:00.202509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:00.203478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:00.204515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:00.205144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:00.286445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:00.295278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:00.296904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:00.298254 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dec7e891-f9e3-46bf-a3b9-74805cdc2d66 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1363 microversion: 2.57 time: 0.121449 Aug 03 04:55:00.303863 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2629/5250] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:55:00 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:55:01.322321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:01.325044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:01.337891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:01.342256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:01.346476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:01.347669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:01.505691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:01.519325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:01.522929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:01.528894 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41a63fe1-a8e6-4b64-8e04-35c9c5754137 tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1363 microversion: 2.57 time: 0.207092 Aug 03 04:55:01.545277 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2622/5251] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:55:01 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:55:02.559784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:02.560475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:02.577272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:02.578852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:02.580035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:02.580830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:02.638931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:02.639388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:02.639851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lazy-loading 'fault' on Instance uuid a8ee6a31-aba7-4a93-949e-b8be91ce37e6 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:55:02.719578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:02.731244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:02.740682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6df172080da94237a1b1a6e008ac2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2556164c884cd4b88bcc5989b19c25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:02.742139 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-257b68a1-f356-4056-86f1-b4a3db4bd8bd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 200 len: 1368 microversion: 2.57 time: 0.187037 Aug 03 04:55:02.742896 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2630/5252] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:55:02 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:55:03.771978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:03.773665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] [instance: a8ee6a31-aba7-4a93-949e-b8be91ce37e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:03.785584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:03.787971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:03.800234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:03.801204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:03.820127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] HTTP exception thrown: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Request method failure captured: Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 HTTP/1.1 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f9u-pPVJ61jdmO075OqWTHPHHAMT3WenHlAPTR0kZ45wKW1Qtfo4qUXRisJXP-o-dx18Dq-Y9uz6eFvIlpkISdAfH_6ksyuttzzv7bORk09urOSbuGZQ01JwiMSpQ7LUY1MsUvkjBH4GI8Rln2q6N6CXRzmI3tgFUMn5s67zU91vvY Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.57 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6a2556164c884cd4b88bcc5989b19c25 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerShowV257Test-34025416 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a2556164c884cd4b88bcc5989b19c25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6a2556164c884cd4b88bcc5989b19c25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6a2556164c884cd4b88bcc5989b19c25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6a2556164c884cd4b88bcc5989b19c25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerShowV257Test-34025416 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6a2556164c884cd4b88bcc5989b19c25 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerShowV257Test-34025416 Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerShowV257Test-34025416-project Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 6df172080da94237a1b1a6e008ac2dbe Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerShowV257Test-34025416-project Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a8ee6a31-aba7-4a93-949e-b8be91ce37e6'} Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:55:03.827308 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. Aug 03 04:55:03.833106 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:55:03.835012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] Returning 404 to user: Instance a8ee6a31-aba7-4a93-949e-b8be91ce37e6 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:55:03.835996 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd9660b0-80ee-4321-94e8-2636862e3fbd tempest-ServerShowV257Test-34025416 tempest-ServerShowV257Test-34025416-project] 10.222.0.72 "GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6" status: 404 len: 111 microversion: 2.57 time: 0.068783 Aug 03 04:55:03.839059 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2623/5253] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:55:03 2022] GET /compute/v2.1/servers/a8ee6a31-aba7-4a93-949e-b8be91ce37e6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:55:06.289331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:06.290540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:06.299214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:06.299856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:06.300893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:06.301493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:06.624291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:06.634394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:06.637306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:06.638602 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13da9d10-864f-431e-8206-490ac784eefd tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2947 microversion: 2.32 time: 0.353567 Aug 03 04:55:06.639248 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2631/5254] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:55:06 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2947 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:55:06.663769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:06.664379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:06.671957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:06.672546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:06.673445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:06.673971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:06.919909 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ac7b771-dbab-4045-b334-94c50684a712 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.260168 Aug 03 04:55:06.920526 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2624/5255] 10.222.0.72 () {60 vars in 1316 bytes} [Wed Aug 3 04:55:06 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72/os-interface => generated 1829 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:55:23.405353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=23 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:23.406187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=42 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:23.803370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2109893558", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:23.895729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] validate_networks() for [('c9e303a7-5abe-447d-a653-301627f99052', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:55:24.712086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:55:24.713815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:55:24.714407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:55:24.716478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:55:24.717298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:55:24.758953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:24.771233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:24.772507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:24.773142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:24.826608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Getting quotas for project 1e2a698ebeb94cd2a6237bd97fed5423. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:55:24.849500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Getting quotas for user 2bf21b3734764c4a839df9af9c07d3eb and project 1e2a698ebeb94cd2a6237bd97fed5423. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:55:24.869070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:55:24.872099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:55:25.082223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66f68395-9e89-47d8-83f1-ddfa9d7a2b86 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678784 Aug 03 04:55:25.084406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2632/5256] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:55:25.094416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:25.095232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:25.100852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67f28dc9-3472-46c9-a2a9-3f9f13c8d6a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:25.101981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67f28dc9-3472-46c9-a2a9-3f9f13c8d6a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:25.359195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-67f28dc9-3472-46c9-a2a9-3f9f13c8d6a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:25.384459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67f28dc9-3472-46c9-a2a9-3f9f13c8d6a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1217 microversion: 2.1 time: 0.287642 Aug 03 04:55:25.397922 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2625/5257] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:25 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1217 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:26.407645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ae68f2d-9a27-41f4-a241-b7e45c51fb2d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:26.409252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ae68f2d-9a27-41f4-a241-b7e45c51fb2d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:26.535059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ae68f2d-9a27-41f4-a241-b7e45c51fb2d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:26.542574 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ae68f2d-9a27-41f4-a241-b7e45c51fb2d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1217 microversion: 2.1 time: 0.141166 Aug 03 04:55:26.543700 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2633/5258] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:26 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:27.563410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:27.564750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:27.588292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:27.589024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:27.590073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:27.592704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:27.720546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:27.729475 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88724107-c618-4e9f-b27c-22ec307c347c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1221 microversion: 2.1 time: 0.169839 Aug 03 04:55:27.732674 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2626/5259] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:27 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:28.762564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:28.763203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:28.790034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:28.793002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:28.795817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:28.796358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:28.897055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:28.906795 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e8e8404d-ed36-4a68-ad4e-bc64f30ece05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1269 microversion: 2.1 time: 0.153309 Aug 03 04:55:28.913400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2634/5260] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:28 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:29.942735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:29.944086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:29.957507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:29.967730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:29.968631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:29.969086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:30.059935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:30.092664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24d3ab27-09a0-4c56-be53-7822a2e0da88 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1275 microversion: 2.1 time: 0.143222 Aug 03 04:55:30.092664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2627/5261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:31.104627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:31.107189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:31.125998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:31.126601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:31.127584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:31.128121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:31.877821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:31.878390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:31.883405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:31.894774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1dd2ec78-eb23-4f0a-b94c-b392318c59bd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.796749 Aug 03 04:55:31.897250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2635/5262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:31 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:31.897588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:31.898597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:31.900968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:31.932236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:31.932236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e84f0b3-b9ec-4d82-aedf-c1a6d80971b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/ips" status: 200 len: 150 microversion: 2.1 time: 0.053852 Aug 03 04:55:31.932236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2628/5263] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:55:31 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:32.122581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-eb2888e0-3384-40c2-8f54-7a9a94f02d32 req-22f64479-d030-4ab1-a855-9b72ceb1f061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:32.146167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb2888e0-3384-40c2-8f54-7a9a94f02d32 req-22f64479-d030-4ab1-a855-9b72ceb1f061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:32.150321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb2888e0-3384-40c2-8f54-7a9a94f02d32 req-22f64479-d030-4ab1-a855-9b72ceb1f061 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:32.187559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-eb2888e0-3384-40c2-8f54-7a9a94f02d32 req-22f64479-d030-4ab1-a855-9b72ceb1f061 service nova] Creating event network-changed:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:55:32.200808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-eb2888e0-3384-40c2-8f54-7a9a94f02d32 req-22f64479-d030-4ab1-a855-9b72ceb1f061 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086776 Aug 03 04:55:32.205807 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2636/5264] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:32.951852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:32.952504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:32.960169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:32.963555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:32.963555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:32.963555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:33.239338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:33.249188 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61bb8acb-2b4a-45f3-9ba0-b68184fa3b3f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.300981 Aug 03 04:55:33.250102 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2629/5265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:32 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:55:34.272573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:34.274776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:34.288232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:34.289032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:34.290952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:34.292425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:34.654981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:34.665567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33e9ac44-a80f-4f0f-8cfb-f2607abf1e54 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.397870 Aug 03 04:55:34.679145 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2637/5266] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:34 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:34.927920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07b3950c-baf1-4101-81b6-0c27c0fd33ff"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:34.931221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:34.939519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:34.944861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:34.944861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:34.944861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:35.363528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:35.693091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:35.693722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:35.706015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:35.709121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:35.709121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:35.710104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:35.710399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:36.014210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:36.025600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e667f4b7-6394-4115-b941-23ffbfe6e289 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.342291 Aug 03 04:55:36.026802 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2638/5267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:35 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:36.215106 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bbaf3da1-1a07-416f-a96b-e0ab5260c04e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.290404 Aug 03 04:55:36.216854 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2630/5268] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:55:34 2022] POST /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 194 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:37.044213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:37.050690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:37.051018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:37.064542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:37.069216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:37.070423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:37.072820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:37.289878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:37.299871 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a339336-b101-4ae3-88c4-0232692dbd9f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.256702 Aug 03 04:55:37.300543 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2639/5269] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:37 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:37.566483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a055a0c8-1152-44c8-b325-6beb6ae2425f req-98b52a53-cd00-4f11-ae11-8e494ce12796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "name": "network-vif-plugged", "status": "completed", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:37.587014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a055a0c8-1152-44c8-b325-6beb6ae2425f req-98b52a53-cd00-4f11-ae11-8e494ce12796 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:37.588974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a055a0c8-1152-44c8-b325-6beb6ae2425f req-98b52a53-cd00-4f11-ae11-8e494ce12796 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:37.607074 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a055a0c8-1152-44c8-b325-6beb6ae2425f req-98b52a53-cd00-4f11-ae11-8e494ce12796 service nova] Creating event network-vif-plugged:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:55:37.612611 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a055a0c8-1152-44c8-b325-6beb6ae2425f req-98b52a53-cd00-4f11-ae11-8e494ce12796 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051003 Aug 03 04:55:37.614094 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2631/5270] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:38.323555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:38.324321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:38.341665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:38.341665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:38.341665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:38.341665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:38.650040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:38.662341 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-045ad73d-6e07-4584-a58b-99d8b04ca3bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1317 microversion: 2.1 time: 0.344095 Aug 03 04:55:38.662952 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2640/5271] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:39.692804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:39.692804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:39.698170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:39.704236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:39.705537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:39.706199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:40.005942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:40.017080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-047414b4-2f54-43b7-a587-699a7d5c3e82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.337286 Aug 03 04:55:40.035787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2632/5272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:40.485016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1045148298", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:40.583682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] validate_networks() for [('c9e303a7-5abe-447d-a653-301627f99052', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:55:41.298411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:55:41.298844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:55:41.299331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:55:41.299745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:55:41.300166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:55:41.320398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:41.321145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:41.321998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:41.322448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:41.376755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Getting quotas for project 1e2a698ebeb94cd2a6237bd97fed5423. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:55:41.404583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Getting quotas for user 2bf21b3734764c4a839df9af9c07d3eb and project 1e2a698ebeb94cd2a6237bd97fed5423. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:55:41.440745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:55:41.443431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:55:41.734279 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0e04321-892d-43e5-9d71-6ed189d2cb34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255152 Aug 03 04:55:41.735043 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2641/5273] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:55:41.748568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8163060-3995-446f-8c1c-72d5d37655b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:41.749170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8163060-3995-446f-8c1c-72d5d37655b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:41.839870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8163060-3995-446f-8c1c-72d5d37655b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:41.852541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8163060-3995-446f-8c1c-72d5d37655b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1217 microversion: 2.1 time: 0.109746 Aug 03 04:55:41.856739 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2633/5274] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:41 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:42.875869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ec7c8db-4b7e-4ce8-9d20-4cd4f7b3aa4c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:42.876546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ec7c8db-4b7e-4ce8-9d20-4cd4f7b3aa4c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:43.016967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ec7c8db-4b7e-4ce8-9d20-4cd4f7b3aa4c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:43.031161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ec7c8db-4b7e-4ce8-9d20-4cd4f7b3aa4c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1217 microversion: 2.1 time: 0.154473 Aug 03 04:55:43.032166 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2642/5275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:42 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:44.058739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:44.061729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:44.067225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:44.067680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:44.068492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:44.068938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:44.153895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:44.162854 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc96d102-644d-46fb-9e5d-9608fb07cb3a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1213 microversion: 2.1 time: 0.107923 Aug 03 04:55:44.163701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2634/5276] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:44 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:45.187362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:45.187984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:45.198791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:45.199253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:45.200040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:45.200536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:45.266120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:45.274485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79302601-b956-48ad-b22e-741737ee2e13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1287 microversion: 2.1 time: 0.091066 Aug 03 04:55:45.275107 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2643/5277] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:45 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:55:46.295852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:46.296607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:46.315168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:46.315626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:46.316441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:46.317064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:46.655396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:46.663389 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8da94c7c-6485-49c7-bf5b-5184841c4f2e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.371585 Aug 03 04:55:46.664360 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2635/5278] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:46 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:47.552305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-67e3dc7a-a036-4a26-ae83-125ff3592787 req-342fd60e-5de6-44a1-9315-9a40b3ab24ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54596db8-90c9-4687-a640-3f2188c69920", "tag": "89bc74fa-6f9e-480c-aac6-eb23ddd38db3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:47.564711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-67e3dc7a-a036-4a26-ae83-125ff3592787 req-342fd60e-5de6-44a1-9315-9a40b3ab24ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:47.566360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-67e3dc7a-a036-4a26-ae83-125ff3592787 req-342fd60e-5de6-44a1-9315-9a40b3ab24ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:47.577191 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-67e3dc7a-a036-4a26-ae83-125ff3592787 req-342fd60e-5de6-44a1-9315-9a40b3ab24ac service nova] Creating event network-changed:89bc74fa-6f9e-480c-aac6-eb23ddd38db3 for instance 54596db8-90c9-4687-a640-3f2188c69920 on n-h1-826756-5 Aug 03 04:55:47.582438 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-67e3dc7a-a036-4a26-ae83-125ff3592787 req-342fd60e-5de6-44a1-9315-9a40b3ab24ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034006 Aug 03 04:55:47.583053 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2644/5279] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:47.689361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:47.691294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:47.704449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:47.707683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:47.708739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:47.709987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:48.644927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:48.651071 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71d47a2e-2aba-44ad-9afe-ef8c5566903a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.969853 Aug 03 04:55:48.670830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2636/5280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:47 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:49.681518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:49.683090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:49.696423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:49.697190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:49.698236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:49.698850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:50.015506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:50.028176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e67eb9be-ce76-4c25-b6b0-68e43a9e61ac tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.353433 Aug 03 04:55:50.029557 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2645/5281] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:49 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:50.682248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-407e7adb-d009-47fa-9118-a2e9f5df59ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: .version_select at 0x7fdd475bfee0>, body: {"keypair": {"name": "tempest-keypair-55184354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyFDqv9M46AWAIIGsZB3UEmrgL8yC7TtjE2h9RIHNPdk5EkIgdI/YUdPcqJGx67nf7lHr0uKDw8hL3riqXgaf9RaIT6TUmhByvqpRhrue93wNBqXXyO8IIs1g0c1JAKSw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:50.735149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-407e7adb-d009-47fa-9118-a2e9f5df59ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:55:50.754140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-407e7adb-d009-47fa-9118-a2e9f5df59ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:55:50.884572 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-407e7adb-d009-47fa-9118-a2e9f5df59ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.208822 Aug 03 04:55:50.885530 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2637/5282] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:55:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:51.051591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:51.053142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:51.063532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:51.064324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:51.065352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:51.066211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:51.342127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:51.423630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:51.437591 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cba42f81-af00-4ab2-b61d-5c2d7a79f9e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.390221 Aug 03 04:55:51.438304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2646/5283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:51 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:52.468932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:52.472408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:52.481145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:52.481612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:52.482583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:52.483032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:52.747641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:52.758735 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54962ebc-4a45-474e-b5f9-aadbad91883f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.299136 Aug 03 04:55:52.759337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2638/5284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:52 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:53.781028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:53.781656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:53.784783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:53.791339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:53.791911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:53.792731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:53.793173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:54.153550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:54.161992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e738c34-e4a2-4494-9d1e-c5be975c5a19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.385715 Aug 03 04:55:54.162593 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2647/5285] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:53 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:54.808837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b274cf59-1854-406f-9652-a2c3430240b3 req-f36e45fb-d863-4573-b3a6-eb46a867146e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54596db8-90c9-4687-a640-3f2188c69920", "name": "network-vif-plugged", "status": "completed", "tag": "89bc74fa-6f9e-480c-aac6-eb23ddd38db3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:54.833202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b274cf59-1854-406f-9652-a2c3430240b3 req-f36e45fb-d863-4573-b3a6-eb46a867146e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:54.833202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b274cf59-1854-406f-9652-a2c3430240b3 req-f36e45fb-d863-4573-b3a6-eb46a867146e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:54.852964 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b274cf59-1854-406f-9652-a2c3430240b3 req-f36e45fb-d863-4573-b3a6-eb46a867146e service nova] Creating event network-vif-plugged:89bc74fa-6f9e-480c-aac6-eb23ddd38db3 for instance 54596db8-90c9-4687-a640-3f2188c69920 on n-h1-826756-5 Aug 03 04:55:54.859634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b274cf59-1854-406f-9652-a2c3430240b3 req-f36e45fb-d863-4573-b3a6-eb46a867146e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055960 Aug 03 04:55:54.860253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2639/5286] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:55:55.189497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:55.190384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:55.196854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:55.216729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:55.221336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:55.222671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:55.226961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:55.231831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=69 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:55:55.620331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:55.630878 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ade4167-29f3-4717-901d-58a5a4bd2ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.449881 Aug 03 04:55:55.633400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2648/5287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:55 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:56.656776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:56.657469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:56.664374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:56.664947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:56.665726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:56.666391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:56.955208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:56.969476 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3ac637b-47eb-4791-9e09-cb1434212905 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1317 microversion: 2.1 time: 0.317842 Aug 03 04:55:56.971913 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2640/5288] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:56 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:57.027948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2073321898", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "112d0d14-3b17-41f3-81d4-e1328e5bdf87"}], "security_groups": [{"name": "tempest-securitygroup--140034073"}], "key_name": "tempest-keypair-55184354", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:55:57.166021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] validate_networks() for [('112d0d14-3b17-41f3-81d4-e1328e5bdf87', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:55:57.903132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:55:57.903594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:55:57.904095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:55:57.904861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:55:57.905581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:55:57.917543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:57.918069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:57.918984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:57.919491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:57.939994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:55:57.945943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:55:57.972447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:55:57.975753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:55:57.996815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:57.997689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:58.005094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:58.005564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:58.006349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:58.006793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:58.136109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-276804f3-9967-4084-a5b6-e1c3f07f6c2f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.113559 Aug 03 04:55:58.146659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2649/5289] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:55:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:55:58.162845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0dce60dd-8d4b-45e3-92ae-ed67f6beb998 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:58.165234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0dce60dd-8d4b-45e3-92ae-ed67f6beb998 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:58.331037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0dce60dd-8d4b-45e3-92ae-ed67f6beb998 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:58.344238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0dce60dd-8d4b-45e3-92ae-ed67f6beb998 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1240 microversion: 2.1 time: 0.189214 Aug 03 04:55:58.344880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2650/5290] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:58 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1240 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:58.353486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:58.364791 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40afcfca-ceb8-437b-8323-d0192c85a7a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1505 microversion: 2.1 time: 0.372067 Aug 03 04:55:58.365387 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2641/5291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:57 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:55:58.389017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:58.389533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:58.442916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:58.444421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:58.447583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:58.455529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:58.507628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:55:58.983502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a64f4388-8475-4da4-84ee-02cee09b4a6a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 204 len: 0 microversion: 2.1 time: 0.598147 Aug 03 04:55:58.984843 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2651/5292] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:55:58 2022] DELETE /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:55:58.993733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:58.994699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:59.006137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:59.006843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:59.007911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:55:59.017289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:55:59.326525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:59.334680 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a0582252-6097-41a4-b8c3-9af32d743a3c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1511 microversion: 2.1 time: 0.345743 Aug 03 04:55:59.336371 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2642/5293] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:58 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:55:59.367678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0d14f61-12f6-45ec-ae46-f9f139758d65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:55:59.368452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0d14f61-12f6-45ec-ae46-f9f139758d65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:55:59.477151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c0d14f61-12f6-45ec-ae46-f9f139758d65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:55:59.492248 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0d14f61-12f6-45ec-ae46-f9f139758d65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1240 microversion: 2.1 time: 0.128970 Aug 03 04:55:59.493684 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2652/5294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:55:59 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:00.358464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:00.359408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:00.365372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:00.387431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:00.390571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:00.392340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:00.394640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:00.516791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:00.517412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:00.532667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:00.533161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:00.535462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:00.535911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:00.665288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:00.674902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a0b0a8a-0202-462c-9ae6-c00103486b02 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1511 microversion: 2.1 time: 0.321380 Aug 03 04:56:00.680793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2643/5295] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:00 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:00.720689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:00.733408 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5be514f8-3849-4dc1-8408-28b7df31e0d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1292 microversion: 2.1 time: 0.220753 Aug 03 04:56:00.734329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2653/5296] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:00 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:01.390080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d6f6ddcf-a282-44f9-8704-87638587be51 req-49a14ad2-5fe4-4056-ab3f-765970f8b882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54596db8-90c9-4687-a640-3f2188c69920", "name": "network-vif-deleted", "tag": "89bc74fa-6f9e-480c-aac6-eb23ddd38db3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:01.405404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:01.417040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d6f6ddcf-a282-44f9-8704-87638587be51 req-49a14ad2-5fe4-4056-ab3f-765970f8b882 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:01.421082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d6f6ddcf-a282-44f9-8704-87638587be51 req-49a14ad2-5fe4-4056-ab3f-765970f8b882 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:01.457228 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d6f6ddcf-a282-44f9-8704-87638587be51 req-49a14ad2-5fe4-4056-ab3f-765970f8b882 service nova] Creating event network-vif-deleted:89bc74fa-6f9e-480c-aac6-eb23ddd38db3 for instance 54596db8-90c9-4687-a640-3f2188c69920 on n-h1-826756-5 Aug 03 04:56:01.458614 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d6f6ddcf-a282-44f9-8704-87638587be51 req-49a14ad2-5fe4-4056-ab3f-765970f8b882 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073793 Aug 03 04:56:01.459865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2644/5297] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:01.698655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:01.700181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:01.716769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:01.717262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:01.718119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:01.718569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:01.763452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:01.764539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:01.783085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:01.783547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:01.784356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:01.784802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:01.814639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:01.816239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:01.828285 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5048023f-decb-47ce-b437-b7be1e28b88f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 200 len: 1302 microversion: 2.1 time: 0.133051 Aug 03 04:56:01.829515 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2654/5298] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:01 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:01.874652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:01.886973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a484302d-5e1d-4100-a0eb-7be4ce40f383 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1298 microversion: 2.1 time: 0.136091 Aug 03 04:56:01.888097 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2645/5299] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:01 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:02.861087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:02.865525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:02.882891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.882891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:02.882891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.882891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:02.909963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:02.911158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 HTTP/1.1 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '54596db8-90c9-4687-a640-3f2188c69920'} Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:02.931003 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:02.937420 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:02.939068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.939068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:02.939479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:02.939479 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c65087c4-a5d1-42c9-80a6-3f58bfbc77b7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 404 len: 111 microversion: 2.1 time: 0.075721 Aug 03 04:56:02.940403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.940403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:02.940854 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2655/5300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:02 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:02.940854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:02.940854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:02.954400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.954860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:02.955647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:02.956111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:03.285019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:03.294955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e83b3b1a-23b0-4fcf-9654-e752b5992947 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.389225 Aug 03 04:56:03.295565 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2646/5301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:02 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:03.410948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:03.424033 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c4d3138-f9cf-4822-85ba-8222c6e0b6ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.488958 Aug 03 04:56:03.425159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2656/5302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:02 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:03.875814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68617bcb-67fd-43f5-abf5-4c9af1992b4e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68617bcb-67fd-43f5-abf5-4c9af1992b4e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 163 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": 12345, "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 12345 Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:03.880490 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68617bcb-67fd-43f5-abf5-4c9af1992b4e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68617bcb-67fd-43f5-abf5-4c9af1992b4e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010929 Aug 03 04:56:03.891124 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2647/5303] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:03 2022] POST /compute/v2.1/servers => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:03.905044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:03.907875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:03.926792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:03.927250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:03.928247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:03.929568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:04.248210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:04.261468 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34f420c3-900b-4d9a-8dee-e9cd7529ca5d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.365969 Aug 03 04:56:04.262148 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2657/5304] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:03 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:04.296326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:04.300313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:04.311397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:04.312068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:04.312915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:04.313337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:04.319143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:04.321238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:04.331678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:04.332382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:04.333458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:04.333916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:04.679767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:04.689114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95097054-6c44-4edb-a830-828a9fc1235b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.404146 Aug 03 04:56:04.708912 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2648/5305] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:04 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:04.748340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:04.763270 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc003bc7-cc43-41ba-8fcf-2089488163cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.450107 Aug 03 04:56:04.763887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2658/5306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:04 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:05.003763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b8612fff-4287-4250-a16a-20ae454b2d26 req-e4d1410d-78e9-4cf4-baab-c80a88224342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7440c86-3faa-4672-971d-e38500ddb577", "tag": "e8aa1a6c-74ef-4550-9542-abc74fd3eb36"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:05.020820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b8612fff-4287-4250-a16a-20ae454b2d26 req-e4d1410d-78e9-4cf4-baab-c80a88224342 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:05.020820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b8612fff-4287-4250-a16a-20ae454b2d26 req-e4d1410d-78e9-4cf4-baab-c80a88224342 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:05.060720 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b8612fff-4287-4250-a16a-20ae454b2d26 req-e4d1410d-78e9-4cf4-baab-c80a88224342 service nova] Creating event network-changed:e8aa1a6c-74ef-4550-9542-abc74fd3eb36 for instance f7440c86-3faa-4672-971d-e38500ddb577 on n-h2-826756-5 Aug 03 04:56:05.074869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b8612fff-4287-4250-a16a-20ae454b2d26 req-e4d1410d-78e9-4cf4-baab-c80a88224342 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077698 Aug 03 04:56:05.076136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2649/5307] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:05.789349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:05.789349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:05.801751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:05.803419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:05.807780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:05.816814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:06.366122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:06.378774 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6875b398-9fcb-46ea-bceb-e3fe18a32057 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.595457 Aug 03 04:56:06.387699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2659/5308] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:05 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:07.404438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:07.406386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:07.416379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:07.417473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:07.419956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:07.420626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:07.769082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:07.778365 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0061fcdb-8491-43cc-b604-cefcfd1c8012 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.381436 Aug 03 04:56:07.779065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2650/5309] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:07 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:08.296501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05f8994b-5cdd-44af-ba70-930402965629 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2130366620", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2d9c778-d7fa-46f5-b981-87a13b0e112d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:08.314650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:08.379478 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-05f8994b-5cdd-44af-ba70-930402965629 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05f8994b-5cdd-44af-ba70-930402965629 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 358 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2130366620", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e2d9c778-d7fa-46f5-b981-87a13b0e112d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: exception: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2130366620', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e2d9c778-d7fa-46f5-b981-87a13b0e112d'}], 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:08.396227 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05f8994b-5cdd-44af-ba70-930402965629 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Block Device e2d9c778-d7fa-46f5-b981-87a13b0e112d is not bootable. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:08.401405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05f8994b-5cdd-44af-ba70-930402965629 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.109597 Aug 03 04:56:08.405786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2660/5310] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:08.408909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:08.409548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:08.423674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.424094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:08.425121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.425729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:08.799067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:08.799951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:08.807108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.807563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:08.808378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.809098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:08.840206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:08.852823 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8510f781-268a-4c66-9a21-2e0be819b368 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.447721 Aug 03 04:56:08.865471 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2651/5311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:08 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:08.877953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:08.879281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:08.886293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.886992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:08.888411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:08.889033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:09.487168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:09.505935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:09.514275 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4ae06ae-b438-4572-977a-21967a8e601b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.641920 Aug 03 04:56:09.515190 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2652/5312] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:08 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:09.558091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:09.573199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7dd8991c-1ea6-4a4d-a3eb-4350bd5ec4e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.776075 Aug 03 04:56:09.575249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2661/5313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:08 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:10.597738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:10.605273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:10.618235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:10.626542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:10.632911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:10.634733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:11.456027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:11.473328 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49bba597-8316-4621-824d-8242659a9387 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.879072 Aug 03 04:56:11.475065 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2653/5314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:10 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:11.628712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-205cfe5c-70e8-484e-8896-9d0d4791fa51 req-ec6f7dc6-2f43-494d-b242-dbfed9fc71c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7440c86-3faa-4672-971d-e38500ddb577", "name": "network-vif-plugged", "status": "completed", "tag": "e8aa1a6c-74ef-4550-9542-abc74fd3eb36"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:11.651887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-205cfe5c-70e8-484e-8896-9d0d4791fa51 req-ec6f7dc6-2f43-494d-b242-dbfed9fc71c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:11.652666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-205cfe5c-70e8-484e-8896-9d0d4791fa51 req-ec6f7dc6-2f43-494d-b242-dbfed9fc71c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:11.667272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-205cfe5c-70e8-484e-8896-9d0d4791fa51 req-ec6f7dc6-2f43-494d-b242-dbfed9fc71c1 service nova] Creating event network-vif-plugged:e8aa1a6c-74ef-4550-9542-abc74fd3eb36 for instance f7440c86-3faa-4672-971d-e38500ddb577 on n-h2-826756-5 Aug 03 04:56:11.681609 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-205cfe5c-70e8-484e-8896-9d0d4791fa51 req-ec6f7dc6-2f43-494d-b242-dbfed9fc71c1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054097 Aug 03 04:56:11.683571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2662/5315] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:12.499504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:12.501195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:12.513984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:12.515612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:12.516533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:12.517207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:12.802269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:12.806194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ceb4b6f-fa03-4dc6-9331-d5e2c07fcc57 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1365 microversion: 2.1 time: 0.309527 Aug 03 04:56:12.806194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2654/5316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:12 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:12.813287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4456c83e-4614-4df9-bbfa-e85f554ed171 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146972241", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f43e106e-5d11-4960-8ca7-6f17956e0464", "destination_type": "local"}, {"source_type": "volume", "uuid": "3ba91962-fac8-46d1-aad5-c6a2ee787cb9", "destination_type": "invalid"}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4456c83e-4614-4df9-bbfa-e85f554ed171 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 494 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146972241", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f43e106e-5d11-4960-8ca7-6f17956e0464", "destination_type": "local"}, {"source_type": "volume", "uuid": "3ba91962-fac8-46d1-aad5-c6a2ee787cb9", "destination_type": "invalid"}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-146972241', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '3ba91962-fac8-46d1-aad5-c6a2ee787cb9', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'invalid' Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:12.818456 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:12.823680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4456c83e-4614-4df9-bbfa-e85f554ed171 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:12.826162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4456c83e-4614-4df9-bbfa-e85f554ed171 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018316 Aug 03 04:56:12.826809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2663/5317] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:12 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:12.838863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:12.839631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:12.853071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:12.853841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:12.854705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:12.855259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.257281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:13.278337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b85f7875-cb3f-4b1a-892e-6bcd61771e42 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.442125 Aug 03 04:56:13.281015 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2655/5318] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:12 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:13.310327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:13.311321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:13.331277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.331736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.332557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.333002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.745642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:13.759306 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc35bbe5-037e-4d96-b38e-853235f9b950 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.453692 Aug 03 04:56:13.760418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2664/5319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:13 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:13.828136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:13.830043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:13.844315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.845338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.848136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.850293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.925025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-336a817b-16b4-4fd7-a14e-8cc82c46664b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1548613056", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-336a817b-16b4-4fd7-a14e-8cc82c46664b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 492 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1548613056", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1548613056', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.929342 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-336a817b-16b4-4fd7-a14e-8cc82c46664b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-336a817b-16b4-4fd7-a14e-8cc82c46664b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.009773 Aug 03 04:56:13.932998 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2665/5320] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:13 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:56:13.945551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:13.946112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:13.961539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.961539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:13.963991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:13.964679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.102091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:14.111154 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3130b8d-73f9-4dc9-92b9-58b6b022b2cc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1555 microversion: 2.1 time: 0.288926 Aug 03 04:56:14.112320 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2656/5321] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:13 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1555 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:14.133074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:14.133855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:14.141446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.142128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.143115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.143708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.172716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:14.184675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ddba6ef1-d279-47b2-8d5d-fed46c50ce17 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.247184 Aug 03 04:56:14.185883 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2666/5322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:13 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:14.208344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:14.209199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:14.216204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.217778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.219138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.219851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.254053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65dea8a2-aa1e-4614-91c7-100a3544b6dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126229 Aug 03 04:56:14.257299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2657/5323] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:56:14 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:14.618408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:14.636421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1af2543-a3bd-492d-802d-378788a68632 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.432882 Aug 03 04:56:14.637122 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2667/5324] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:14 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:14.765570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1331e0f6-27fc-4328-af61-bb5802e85e90 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1331e0f6-27fc-4328-af61-bb5802e85e90 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 416 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 04:56:14.771204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1331e0f6-27fc-4328-af61-bb5802e85e90 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1331e0f6-27fc-4328-af61-bb5802e85e90 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011822 Aug 03 04:56:14.780623 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2658/5325] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:14 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:14.783219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:14.783661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:14.791094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.791553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:14.797289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:14.797772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:15.079659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:15.090888 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d10546e1-d9ae-4871-9d01-9c8e961ff9e7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.311685 Aug 03 04:56:15.092476 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2668/5326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:14 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:15.120319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:15.121046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:15.159164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:15.162249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:15.163850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:15.167481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:15.875514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:15.887238 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65ab7ea0-0935-40de-b6c0-68eff5c9db8c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.776216 Aug 03 04:56:15.890957 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2659/5327] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:15 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:16.175464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-271bc246-8b71-4f9f-9b40-bf24ddc472a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807730848", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": -1, "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:16.176083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-005f6311-1528-4b61-96c2-2e9644037a69 req-6b275d7e-a895-4549-b549-36afeca2323f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7440c86-3faa-4672-971d-e38500ddb577", "tag": "e8aa1a6c-74ef-4550-9542-abc74fd3eb36"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:16.188072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-005f6311-1528-4b61-96c2-2e9644037a69 req-6b275d7e-a895-4549-b549-36afeca2323f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:16.191908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-005f6311-1528-4b61-96c2-2e9644037a69 req-6b275d7e-a895-4549-b549-36afeca2323f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:16.216117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-005f6311-1528-4b61-96c2-2e9644037a69 req-6b275d7e-a895-4549-b549-36afeca2323f service nova] Creating event network-changed:e8aa1a6c-74ef-4550-9542-abc74fd3eb36 for instance f7440c86-3faa-4672-971d-e38500ddb577 on n-h2-826756-5 Aug 03 04:56:16.224701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-005f6311-1528-4b61-96c2-2e9644037a69 req-6b275d7e-a895-4549-b549-36afeca2323f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056256 Aug 03 04:56:16.230109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2660/5328] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:16.237235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-271bc246-8b71-4f9f-9b40-bf24ddc472a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Flavor -1 could not be found. Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-271bc246-8b71-4f9f-9b40-bf24ddc472a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 205 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807730848", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": -1, "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: exception: Flavor -1 could not be found. Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-807730848', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': -1, 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:16.246545 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-271bc246-8b71-4f9f-9b40-bf24ddc472a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:16.252960 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-271bc246-8b71-4f9f-9b40-bf24ddc472a1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.080674 Aug 03 04:56:16.255111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2669/5329] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:16 2022] POST /compute/v2.1/servers => generated 73 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:56:16.268539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:16.269782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:16.285913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:16.286741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:16.288297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:16.291845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:16.617868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:16.631930 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cd924aa-61e4-4d70-a9a1-fbdd28b3fb70 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.369535 Aug 03 04:56:16.652656 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2661/5330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:16 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:16.671353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:16.671972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:16.686873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:16.692755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:16.693858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:16.694661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:17.107408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:17.141492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f60d92ce-7073-405b-8650-46466e4c4263 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.465527 Aug 03 04:56:17.143929 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2670/5331] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:16 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:17.358019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42945c76-05ae-4cc4-affe-afe1322bcf45 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739196622", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42945c76-05ae-4cc4-affe-afe1322bcf45 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 173 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1739196622", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1739196622', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi -1 Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:17.365402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:17.373890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-42945c76-05ae-4cc4-affe-afe1322bcf45 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:17.388978 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-42945c76-05ae-4cc4-affe-afe1322bcf45 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.034098 Aug 03 04:56:17.391729 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2662/5332] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:17 2022] POST /compute/v2.1/servers => generated 145 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:17.401749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:17.403204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:17.415504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:17.418486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:17.422435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:17.432632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:17.439583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:17.680574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:17.720446 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-967791a9-965c-4298-bb9e-d7a94c82c68a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.324478 Aug 03 04:56:17.724559 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2671/5333] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:17 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:17.747816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:17.748527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:17.770193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:17.770934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:17.771650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:17.772516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:18.112749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:18.123867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb2cf385-38f3-4975-a67c-be69fd3795cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.380628 Aug 03 04:56:18.124777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2663/5334] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:17 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:18.301307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a62d10f4-15fe-4547-887f-3ea07de245fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1332260906", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:18.310845 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a62d10f4-15fe-4547-887f-3ea07de245fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a62d10f4-15fe-4547-887f-3ea07de245fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 216 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1332260906", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1332260906', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 04:56:18.314939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a62d10f4-15fe-4547-887f-3ea07de245fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a62d10f4-15fe-4547-887f-3ea07de245fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021805 Aug 03 04:56:18.334002 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2672/5335] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:18 2022] POST /compute/v2.1/servers => generated 123 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:18.344109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:18.346886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:18.367826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:18.369005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:18.371628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:18.373484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:18.654841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:18.667088 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2cf114bf-9fec-4a69-a78c-8c2e4d8721b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.334743 Aug 03 04:56:18.668564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2664/5336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:18 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:18.691722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:18.695334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:18.716079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:18.716659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:18.719984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:18.720990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:19.030740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:19.055483 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6cab419-ecbc-4aa8-a3f8-021542c48631 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.369541 Aug 03 04:56:19.056124 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2673/5337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:18 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:19.595131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1518874881", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-key-387910539", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:19.711171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] validate_networks() for [('c9e303a7-5abe-447d-a653-301627f99052', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:56:20.014364 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Invalid key_name provided. Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 246 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1518874881", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-key-387910539", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid key_name provided. Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1518874881', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'key_name': 'tempest-key-387910539', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-387910539 not found for user 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:20.017737 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 03 04:56:20.022402 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:20.025393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid key_name provided. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:20.027348 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-379eb382-700b-4f50-8c84-f7e1e9d93503 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.443361 Aug 03 04:56:20.028112 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2665/5338] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 03 04:56:20.036514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:20.037971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:20.054846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:20.055662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:20.058346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:20.059004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:20.280954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:20.299563 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e7a0c31-61d5-40fe-a3ad-0dbef6e56f48 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.266653 Aug 03 04:56:20.300712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2674/5339] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:20 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:20.321492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:20.322393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:20.329357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:20.329952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:20.330927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:20.331367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:20.600951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:20.612131 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35829806-9ee4-475b-b2f4-f05bd432aa93 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.293870 Aug 03 04:56:20.612982 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2666/5340] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:20 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:20.782404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-911763462", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:21.252946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.security_group_api [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Neutron security group does_not_exist not found {{(pid=120831) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 03 04:56:21.253711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 257 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-911763462", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-911763462', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.270386 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 03 04:56:21.275058 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:21.279746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:21.279746 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9cb7090f-4225-49a7-98c5-7a253c398a5e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.492008 Aug 03 04:56:21.279746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2675/5341] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:20 2022] POST /compute/v2.1/servers => generated 106 bytes in 493 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:21.286392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:21.288093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:21.297194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:21.298137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:21.299065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:21.299576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.088603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:22.092901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:22.101164 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa329cc1-89b8-4b2f-95b9-b1b7aa7f9d46 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.816918 Aug 03 04:56:22.101164 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2667/5342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:21 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:22.120971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:22.121681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:22.128479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.128940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.129709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.130151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.262693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:22.270220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41e3662e-92ba-4740-99c8-b863521cae10 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.154317 Aug 03 04:56:22.270793 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2676/5343] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:22 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:22.290767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:22.291269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 24b26072-f940-4e4c-a7c1-5daf3f015356] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:22.297687 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/24b26072-f940-4e4c-a7c1-5daf3f015356 HTTP/1.1 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '24b26072-f940-4e4c-a7c1-5daf3f015356'} Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. Aug 03 04:56:22.299196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 24b26072-f940-4e4c-a7c1-5daf3f015356 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63c146a8-d220-425e-89fd-db2e6aceb556 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/24b26072-f940-4e4c-a7c1-5daf3f015356" status: 404 len: 111 microversion: 2.1 time: 0.013964 Aug 03 04:56:22.304086 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2668/5344] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:56:22 2022] DELETE /compute/v2.1/servers/24b26072-f940-4e4c-a7c1-5daf3f015356 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:22.308947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:22.309593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:22.315582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.316032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.316817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.317255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.800384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:22.810558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7284502f-d58b-44c6-a874-07e771775072 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.505215 Aug 03 04:56:22.812079 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2677/5345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:22 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:22.839859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:22.840941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:22.851435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.852229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:22.853378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:22.854152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:23.271135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:23.280644 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d43b945-597d-460f-bd6e-7858b2d5f2a5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.447882 Aug 03 04:56:23.281229 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2669/5346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:22 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:23.301986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:23.303201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:56:23.303912 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9223372036854775808 could not be found. Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9223372036854775808'} Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:23.305543 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 03 04:56:23.309662 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:23.312653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:23.314051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76a75671-dfe3-4d8d-ae76-7141bc2af0de tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.016119 Aug 03 04:56:23.314720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2678/5347] 10.222.0.72 () {58 vars in 1188 bytes} [Wed Aug 3 04:56:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:56:23.326941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:23.327950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:23.335564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:23.336071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:23.337269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:23.337947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:23.640929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:23.654165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-605762fd-d764-443c-8a81-093cff7026d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.329904 Aug 03 04:56:23.655651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2670/5348] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:23 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:23.682156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:23.683707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:23.717305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:23.718156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:23.720808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:23.721473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:24.027735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:24.035590 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e7eea09-c9df-48a4-ad3b-beafb2e46ae9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.359205 Aug 03 04:56:24.036179 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2679/5349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:23 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:24.058762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:24.059556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Failed to fetch instance by id -1 {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 03 04:56:24.060199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance -1 could not be found. Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance -1 could not be found. Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '-1'} Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:24.062033 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:24.068284 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-55a7b105-a803-4db1-ac08-5a8c14f20714 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012090 Aug 03 04:56:24.070598 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2671/5350] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 04:56:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:56:24.078297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:24.078978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:24.086135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:24.086615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:24.087394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:24.087840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:24.356980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:24.384340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-341b4f10-255d-4e0d-920d-b3d6e3549838 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.310412 Aug 03 04:56:24.399614 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2680/5351] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:24 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:24.413355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:24.415022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:24.424102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:24.424862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:24.425643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:24.437383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:25.136701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:25.145095 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ebee801f-586b-478a-9061-6ec125bfcabe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.738547 Aug 03 04:56:25.162843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2672/5352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:24 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:25.167170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:25.167717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:25.174441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/2ae047a0-f99f-414e-8ef8-0cadc10ff6e2/action HTTP/1.1 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 19 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: {"forceDelete": {}} Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2ae047a0-f99f-414e-8ef8-0cadc10ff6e2', 'body': {'forceDelete': {}}} Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:25.187076 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 2ae047a0-f99f-414e-8ef8-0cadc10ff6e2 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f066396-56c2-4a0c-8c6b-04f7b0a000c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/2ae047a0-f99f-414e-8ef8-0cadc10ff6e2/action" status: 404 len: 111 microversion: 2.1 time: 0.025630 Aug 03 04:56:25.194503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2681/5353] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:25 2022] POST /compute/v2.1/servers/2ae047a0-f99f-414e-8ef8-0cadc10ff6e2/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:25.201485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:25.202994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:25.211839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:25.212622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:25.213145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:25.213586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:25.607793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:25.619366 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d27fcb8-5f1c-4c49-a42f-895955185cee tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.423974 Aug 03 04:56:25.623696 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2673/5354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:25 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:25.652443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:25.654003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:25.668014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:25.668761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:25.672693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:25.674190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:26.191728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:26.207727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec39d7f1-f5b6-491a-954b-741d7b76c1d7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.564901 Aug 03 04:56:26.209643 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2682/5355] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:25 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:26.234257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:26.236825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 382842f6-37b2-4bd1-bcda-3f6c6ac747dd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:26.245241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/382842f6-37b2-4bd1-bcda-3f6c6ac747dd/action HTTP/1.1 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 39 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: {"os-getConsoleOutput": {"length": 10}} Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '382842f6-37b2-4bd1-bcda-3f6c6ac747dd', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:26.256080 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 382842f6-37b2-4bd1-bcda-3f6c6ac747dd could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-582da358-1380-4b03-a0b0-721424134468 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/382842f6-37b2-4bd1-bcda-3f6c6ac747dd/action" status: 404 len: 111 microversion: 2.1 time: 0.034819 Aug 03 04:56:26.266434 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2674/5356] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:26 2022] POST /compute/v2.1/servers/382842f6-37b2-4bd1-bcda-3f6c6ac747dd/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:26.277143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:26.277848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:26.285953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:26.289087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:26.289087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:26.289087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:26.617899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:26.626115 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0be5ad65-43e5-4f1e-b27b-c622ad628e9c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.355105 Aug 03 04:56:26.627269 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2683/5357] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:26 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:26.654754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:26.654754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:26.660141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:26.660851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:26.662815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:26.663437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:27.362609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:27.378756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a95877ae-036f-4a3e-a6a6-1c3f19f8adfc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.732985 Aug 03 04:56:27.400262 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2675/5358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:26 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:27.429319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:27.430618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: c9ea1aba-a30d-4fe1-98f2-b6d840633677] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:27.448744 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c9ea1aba-a30d-4fe1-98f2-b6d840633677 HTTP/1.1 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c9ea1aba-a30d-4fe1-98f2-b6d840633677'} Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:27.450996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. Aug 03 04:56:27.457356 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:27.461034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance c9ea1aba-a30d-4fe1-98f2-b6d840633677 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:27.462335 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa9935e6-182b-484a-95ec-3bfe841550ab tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/c9ea1aba-a30d-4fe1-98f2-b6d840633677" status: 404 len: 111 microversion: 2.1 time: 0.041099 Aug 03 04:56:27.466799 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2684/5359] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:27 2022] GET /compute/v2.1/servers/c9ea1aba-a30d-4fe1-98f2-b6d840633677 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:27.478951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:27.479945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:27.493020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:27.499501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:27.500633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:27.501302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:27.836912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:27.851609 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f2d265d-7de0-4285-aa04-e8e8a780a810 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.380347 Aug 03 04:56:27.854322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2676/5360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:27 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:27.886768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:27.887693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:27.897237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:27.898412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:27.899806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:27.900765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:28.318358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:28.330213 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ad0624d-80f6-48ed-a762-041f058767fa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.455717 Aug 03 04:56:28.338012 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2685/5361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:27 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:28.404851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abb7e671-b9d9-4a95-9398-1165a8bea20a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2009172045", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abb7e671-b9d9-4a95-9398-1165a8bea20a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 238 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2009172045", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2009172045', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.431697 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-abb7e671-b9d9-4a95-9398-1165a8bea20a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-abb7e671-b9d9-4a95-9398-1165a8bea20a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034416 Aug 03 04:56:28.441990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2677/5362] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 04:56:28.446913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:28.447472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:28.464198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:28.466177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:28.466642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:28.470051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:28.473215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:28.978421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:28.988495 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efae2f6d-26c2-4b09-914d-0329e3b89ff7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.545962 Aug 03 04:56:29.000472 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2686/5363] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:28 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:29.014257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:29.015792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:29.060059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:29.060597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:29.061419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:29.061938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:29.532463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:29.544530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fb2508f-89db-4664-97ac-91688f3f9fae tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.534861 Aug 03 04:56:29.546899 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2678/5364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:29.649835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-768d5da4-d1dc-45d4-8ede-c587f6ed84b0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-277240713", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-768d5da4-d1dc-45d4-8ede-c587f6ed84b0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 234 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-277240713", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-277240713', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:29.655587 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-768d5da4-d1dc-45d4-8ede-c587f6ed84b0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-768d5da4-d1dc-45d4-8ede-c587f6ed84b0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.012426 Aug 03 04:56:29.668471 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2687/5365] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:29 2022] POST /compute/v2.1/servers => generated 133 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:29.676061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:29.678094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:29.684631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:29.685086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:29.685884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:29.686331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:29.981796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:29.991298 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ca60eef-8e92-4a4f-8d63-a636b144472f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.318979 Aug 03 04:56:29.992236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2679/5366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:30.024517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:30.026533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:30.035948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.037579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:30.038673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.039370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:30.308720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:30.319873 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f35ee9c8-0d71-4dc1-841a-bad3f7a6070a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.303796 Aug 03 04:56:30.321456 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2688/5367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:30 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:30.343260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:30.343829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 3510b228-124d-4d46-bc60-492674609913] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:30.352760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/3510b228-124d-4d46-bc60-492674609913/action HTTP/1.1 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 13 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: {"pause": {}} Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '3510b228-124d-4d46-bc60-492674609913', 'body': {'pause': {}}} Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:30.357721 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:30.361866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:30.361866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:30.361866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:30.361866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. Aug 03 04:56:30.361866 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:30.364761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 3510b228-124d-4d46-bc60-492674609913 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:30.366086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c500befb-8981-4bd7-abe6-943b469a5460 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/3510b228-124d-4d46-bc60-492674609913/action" status: 404 len: 111 microversion: 2.1 time: 0.026894 Aug 03 04:56:30.367200 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2680/5368] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:30 2022] POST /compute/v2.1/servers/3510b228-124d-4d46-bc60-492674609913/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:30.377220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:30.378318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:30.388122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.389438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:30.390625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.391312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:30.826061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:30.839846 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f5967a4-489f-4fba-9aec-9f8aadc0aed7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.468274 Aug 03 04:56:30.845199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2689/5369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:30 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:30.868479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:30.869983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:30.879486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.880419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:30.881607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:30.882256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:31.331032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:31.343567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e36be08-ba31-442d-8a3f-1f3b49098800 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.480877 Aug 03 04:56:31.356448 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2681/5370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:30 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:31.366972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:31.367725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:31.388688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:31.389236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:31.390105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:31.392035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:31.794446 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b981cd70-8e32-47c1-8229-cc288c4fee9d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.432224 Aug 03 04:56:31.795581 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2690/5371] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:31 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:56:31.811095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:31.811742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:31.827661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:31.828513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:31.830086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:31.834469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:32.241325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:32.273923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3df96634-4c16-470f-80c4-97d15c0f31b2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1510 microversion: 2.1 time: 0.469971 Aug 03 04:56:32.275176 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2682/5372] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:31 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:33.304635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:33.306600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:33.315839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.320332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.323788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.323788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.545417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:33.557518 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ed174786-cf8a-4f4f-9b46-622eea9c125c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1490 microversion: 2.1 time: 0.257897 Aug 03 04:56:33.557518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2691/5373] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:33 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1490 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:33.575518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:33.576052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:33.579277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=72 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:33.592556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.592556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.592556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.592556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.610423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'pause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state paused Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 13 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: {"pause": {}} Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'pause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state paused Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'pause': {}}} Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state paused. Cannot pause while the instance is in this state. Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state paused Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:33.611966 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state paused Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'pause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state paused {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-338bfe76-232c-4b96-a2b5-f63a7b17fb41 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 143 microversion: 2.1 time: 0.042213 Aug 03 04:56:33.618062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2683/5374] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:33 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 143 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:56:33.623337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:33.623912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:33.631187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.643654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.643654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.643654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.663404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:33.901441 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6303caa3-6e00-42f8-9866-bc771d5151e1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.282418 Aug 03 04:56:33.902165 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2692/5375] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:33 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:56:33.912195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:33.913961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:33.922700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.923523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:33.924626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:33.931572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:34.263856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:34.297871 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7df9cea7-a31b-4aa7-a9ff-1290a2e77f0b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1497 microversion: 2.1 time: 0.390946 Aug 03 04:56:34.298179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2684/5376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:33 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:35.324857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:35.325380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:35.345959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:35.346827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:35.347814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:35.348262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.027337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:36.036702 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72a21596-a05c-42b7-8dcc-eb13ce64c5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.716708 Aug 03 04:56:36.040506 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2693/5377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:35 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:36.071362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:36.072004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:36.081128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.081599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.082499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.082947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.394309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:36.404567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a75f487-f3d6-476f-9ab1-e66f6079af32 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.336372 Aug 03 04:56:36.406968 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2685/5378] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:36 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:36.431171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:36.434241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:36.441995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.443466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.444551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.445230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.461020 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action HTTP/1.1 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 28 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: {"reboot": {"type": "SOFT"}} Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '54596db8-90c9-4687-a640-3f2188c69920', 'body': {'reboot': {'type': 'SOFT'}}} Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:36.462778 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:36.466950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98e81a85-d64f-4e32-958a-4386b659cde5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action" status: 404 len: 111 microversion: 2.1 time: 0.037280 Aug 03 04:56:36.473461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:36.474832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:36.478379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2694/5379] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:36 2022] POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:36.482164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.482938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.483760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.484204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.790850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:36.800150 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d03a8966-d075-45c5-874b-6df777ca6fa6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.330675 Aug 03 04:56:36.802563 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2686/5380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:36 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:36.828018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:36.828897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:36.837111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.837537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:36.838502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:36.839276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.119067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:37.127522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40ae1864-88cb-4a50-b02c-2a8a3c583934 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.304331 Aug 03 04:56:37.143323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2695/5381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:36 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:37.153108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:37.158101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: ddd36b8c-72df-432a-a294-1424923e73ee] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:37.169199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/ddd36b8c-72df-432a-a294-1424923e73ee/action HTTP/1.1 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 28 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: {"reboot": {"type": "SOFT"}} Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'ddd36b8c-72df-432a-a294-1424923e73ee', 'body': {'reboot': {'type': 'SOFT'}}} Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:37.172824 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. Aug 03 04:56:37.181144 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.187599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance ddd36b8c-72df-432a-a294-1424923e73ee could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:37.192032 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3195edc-86ac-4b16-9469-5c598cd5db83 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/ddd36b8c-72df-432a-a294-1424923e73ee/action" status: 404 len: 111 microversion: 2.1 time: 0.046481 Aug 03 04:56:37.192032 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2687/5382] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:37 2022] POST /compute/v2.1/servers/ddd36b8c-72df-432a-a294-1424923e73ee/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:37.201156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:37.201781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:37.218336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.219049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.220194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.220817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.498829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:37.507790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95195321-d754-4fcc-a7b9-c5b99e3fbac0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.310874 Aug 03 04:56:37.523573 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2696/5383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:37 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:37.530667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:37.531387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:37.540371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.541014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.541924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.542613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.795600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:37.809125 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a11daf9d-728d-4155-b311-2f47deb19ef1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.282772 Aug 03 04:56:37.811213 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2688/5384] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:37 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:37.835559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:37.838502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:37.847271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.847760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.848697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.851411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.881618 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action HTTP/1.1 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 65 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '54596db8-90c9-4687-a640-3f2188c69920', 'body': {'rebuild': {'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464'}}} Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:37.883473 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ca60344-ced2-49dc-88ec-57d214b25156 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action" status: 404 len: 111 microversion: 2.1 time: 0.057651 Aug 03 04:56:37.888069 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2697/5385] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:37 2022] POST /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:37.894044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:37.904752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:37.904752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.904752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:37.904752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:37.906581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.064361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:38.073110 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bee5ea9f-73a7-40fb-81d7-efd986aa1258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.183024 Aug 03 04:56:38.073699 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2689/5386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:37 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:38.100771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:38.103492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.117436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.120201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.121204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.123439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.376090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:38.389134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80e9ddae-243f-4c4c-b5fa-efd7f7e8889e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.295194 Aug 03 04:56:38.390223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2698/5387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:38.410268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:38.414278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 0aab5080-e853-4028-9c3e-601e420f7d09] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.420934 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/0aab5080-e853-4028-9c3e-601e420f7d09/action HTTP/1.1 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 65 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '0aab5080-e853-4028-9c3e-601e420f7d09', 'body': {'rebuild': {'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464'}}} Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 03 04:56:38.422576 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 0aab5080-e853-4028-9c3e-601e420f7d09 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9e97579e-a603-4ade-bdde-752a2aaaa64d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/0aab5080-e853-4028-9c3e-601e420f7d09/action" status: 404 len: 111 microversion: 2.1 time: 0.017844 Aug 03 04:56:38.427443 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2690/5388] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:38 2022] POST /compute/v2.1/servers/0aab5080-e853-4028-9c3e-601e420f7d09/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:38.434458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:38.435138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.443845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.444480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.445484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.446062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.584558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:38.591521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d3f2b11-b42d-44a6-8302-e038605963e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.161874 Aug 03 04:56:38.592096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2699/5389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:38.612832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:38.623328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.629967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.630800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.631649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.632097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.890236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:38.896451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:38.901820 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c9d6905-dd39-40b7-8fbc-de38879dcbd0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.292910 Aug 03 04:56:38.903081 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2691/5390] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:38.926993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:38.927728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: d746630e-b1ae-4bf7-9325-ad46a1508745] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.935522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/d746630e-b1ae-4bf7-9325-ad46a1508745/action HTTP/1.1 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 15 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: {"restore": {}} Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'd746630e-b1ae-4bf7-9325-ad46a1508745', 'body': {'restore': {}}} Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:38.937460 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:38.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:38.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:38.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:38.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. Aug 03 04:56:38.944133 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:38.945682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance d746630e-b1ae-4bf7-9325-ad46a1508745 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:38.946751 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e448ae10-7b25-4305-8564-bd4713eb31d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/d746630e-b1ae-4bf7-9325-ad46a1508745/action" status: 404 len: 111 microversion: 2.1 time: 0.023939 Aug 03 04:56:38.956176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:38.957120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:38.962643 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2700/5391] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:38 2022] POST /compute/v2.1/servers/d746630e-b1ae-4bf7-9325-ad46a1508745/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:38.964237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.964915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:38.966250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:38.966909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.273555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:39.281177 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ed2bf26-7115-492c-b0f1-f9aea98fe394 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.329184 Aug 03 04:56:39.282203 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2692/5392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:39.308003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:39.309166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:39.317167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.317803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.318660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.319132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.746924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:39.755034 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80379e72-50ef-42fc-af9d-57fca3538ccb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.455072 Aug 03 04:56:39.756421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2701/5393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:39.782875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:39.786435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:39.798458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.799172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.800837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.802598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.860626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'restore' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: {"restore": {}} Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'restore' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'restore': {}}} Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state active. Cannot restore while the instance is in this state. Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:39.862918 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:39.867359 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:39.869998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'restore' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:39.871055 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56eb8814-c871-4725-bdac-a4764476250e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 145 microversion: 2.1 time: 0.099068 Aug 03 04:56:39.871693 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2693/5394] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:39 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 145 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:56:39.881040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:39.881757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:39.888176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.888771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:39.889648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:39.890189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.174050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:40.197485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-295ad616-2b09-4c57-a800-70dd8996620c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.321440 Aug 03 04:56:40.198186 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2702/5395] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:40.227266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:40.227891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:40.234967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.235658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.236626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.237964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.491444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:40.500425 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc177ce1-c3db-46b6-9bd7-42904719e724 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.277020 Aug 03 04:56:40.501002 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2694/5396] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:40 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:40.522868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:40.523412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 6e58ea87-35b9-47e7-a121-56adcb22c994] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:40.530134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/6e58ea87-35b9-47e7-a121-56adcb22c994/action HTTP/1.1 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 14 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: {"resume": {}} Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '6e58ea87-35b9-47e7-a121-56adcb22c994', 'body': {'resume': {}}} Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:40.539235 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:40.546399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 6e58ea87-35b9-47e7-a121-56adcb22c994 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:40.547389 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74d686e4-2bea-4338-bf50-af7c7ac16bfe tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/6e58ea87-35b9-47e7-a121-56adcb22c994/action" status: 404 len: 111 microversion: 2.1 time: 0.029358 Aug 03 04:56:40.548293 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2703/5397] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:40 2022] POST /compute/v2.1/servers/6e58ea87-35b9-47e7-a121-56adcb22c994/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:56:40.558771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:40.559553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:40.566764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.568380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.569381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.569825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.927858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:40.939165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96db63f1-60eb-4c7f-9743-e650ff5d7200 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.385672 Aug 03 04:56:40.939769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2695/5398] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:40 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:40.962775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:40.964924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:40.987516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.987516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:40.987516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:40.987516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:41.722635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:41.732593 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-231a55c8-b6e0-4be8-a8de-ed1300e6ba76 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.774215 Aug 03 04:56:41.733188 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2704/5399] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:40 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:41.760538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:41.761651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:41.770648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:41.771635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:41.772779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:41.773456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:41.812986 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'resume' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 14 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: {"resume": {}} Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'resume' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'resume': {}}} Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state active. Cannot resume while the instance is in this state. Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:41.815082 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'resume' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:41.827516 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9b96cf9-2a52-4d65-a8f1-ba6263b6899d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 144 microversion: 2.1 time: 0.064855 Aug 03 04:56:41.829936 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2696/5400] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:41 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 03 04:56:41.831761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:41.832562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:41.840758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:41.841435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:41.842316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:41.842855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.113265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:42.126855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8911ee3-e1ed-422a-a35e-eb720bf71aaa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.299606 Aug 03 04:56:42.127712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2705/5401] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:41 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:42.149543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:42.150766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:42.157202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.157871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.158843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.159442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.554220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:42.565969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a95ab698-e215-4424-a6f7-26f91a9f9408 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.420097 Aug 03 04:56:42.569543 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2697/5402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:42 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:42.694022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40f97b5e-e230-4088-ab5e-4a3860789aec tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40f97b5e-e230-4088-ab5e-4a3860789aec tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 160 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9e303a7-5abe-447d-a653-301627f99052"}]}} Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f43e106e-5d11-4960-8ca7-6f17956e0464', 'flavorRef': '452', 'networks': [{'uuid': 'c9e303a7-5abe-447d-a653-301627f99052'}]}}} Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi '' Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:56:42.708495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40f97b5e-e230-4088-ab5e-4a3860789aec tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40f97b5e-e230-4088-ab5e-4a3860789aec tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021757 Aug 03 04:56:42.713508 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2706/5403] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:56:42 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:42.722226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:42.722855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:42.729710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.730165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.731142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.731744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.928423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:42.938838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19375395-16f2-4395-9d3a-0de472f04495 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.220522 Aug 03 04:56:42.939414 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2698/5404] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:42 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:42.962582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:42.963856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:42.973400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.978194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:42.978194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:42.978194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.274501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:43.282772 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d682e9c-b4a7-49c1-b5e2-b17286278f80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.325534 Aug 03 04:56:43.293180 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2707/5405] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:42 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:43.306231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:43.306863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 064a678c-453f-45ec-9eb0-eb36a0925223] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:43.315568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/064a678c-453f-45ec-9eb0-eb36a0925223/action HTTP/1.1 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 14 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: {"shelve": {}} Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '064a678c-453f-45ec-9eb0-eb36a0925223', 'body': {'shelve': {}}} Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:43.322109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 064a678c-453f-45ec-9eb0-eb36a0925223 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c1a5f5d-688c-4681-9e04-5b5a54dc12cb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/064a678c-453f-45ec-9eb0-eb36a0925223/action" status: 404 len: 111 microversion: 2.1 time: 0.022656 Aug 03 04:56:43.326746 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2699/5406] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:43 2022] POST /compute/v2.1/servers/064a678c-453f-45ec-9eb0-eb36a0925223/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:56:43.336219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:43.337405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:43.353207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.360340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.360340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.360340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.584902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:43.592146 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a7f5722-0263-4782-a75d-fc80af4ae8e0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.261841 Aug 03 04:56:43.592762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2708/5407] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:43 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:43.616758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:43.617562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:43.625922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.626389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.627168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.627610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.813914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:43.830349 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5268582-1e11-4fbb-bd3f-450a80e75443 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.217037 Aug 03 04:56:43.830349 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2700/5408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:43 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:43.850975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:43.851956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:43.858864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.859598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.860753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:43.861475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:43.911813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lazy-loading 'flavor' on Instance uuid dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:56:44.616182 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3e30f75-ab6a-4855-8f73-5878da72d48e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.769491 Aug 03 04:56:44.617474 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2709/5409] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:56:43 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:56:44.632628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:44.633422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:44.641958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:44.642406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:44.649518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:44.655761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:45.032866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:45.042017 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14c97058-410a-4147-8b41-42c0fd5498b3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.418895 Aug 03 04:56:45.043561 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2701/5410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:44 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:46.079012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:46.080077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:46.091210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:46.095043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:46.095043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:46.095043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:46.881342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:46.885986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:56:46.891057 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ee4daff-b185-4378-9c58-cc475bd35037 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.817818 Aug 03 04:56:46.892086 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2710/5411] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:46 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:47.923961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:47.925716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:47.940430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:47.942424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:47.943580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:47.944898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:48.182360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:48.190682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47c57585-0415-4dd4-9b3d-1f5a19c19c0a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.281353 Aug 03 04:56:48.199448 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2702/5412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:47 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:49.215184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:49.216007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:49.225315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:49.225912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:49.226851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:49.227458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:49.599103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:49.612112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-937b7e38-009d-445c-8970-c14e54e4b51b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.398925 Aug 03 04:56:49.615825 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2711/5413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:49 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:50.637038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:50.637801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:50.647440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:50.648616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:50.659441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:50.659441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:50.923219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:50.945309 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a78b11ab-cd0c-41d8-b1c3-c3ce95059957 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.312252 Aug 03 04:56:50.967090 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2703/5414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:50 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:51.973256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:51.973881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:51.987562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:51.988211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:51.989723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:51.991062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:52.404119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:52.439212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-21e842d5-b939-44d9-b477-1b5207dbd773 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.470055 Aug 03 04:56:52.456671 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2712/5415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:51 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:53.477126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:53.478581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:53.486641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:53.487513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:53.488865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:53.489704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:53.769678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:53.784371 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4857b9c1-575d-4d00-84ca-c0d39a317b37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.312657 Aug 03 04:56:53.802980 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2704/5416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:53 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:54.815685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:54.817495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:54.845733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:54.846599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:54.848541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:54.849242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:55.079613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:55.090620 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d1b6d7a4-3784-41a0-9322-9cad491c2601 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.279628 Aug 03 04:56:55.091758 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2713/5417] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:54 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:56.112715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:56.114641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:56.123115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.123853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:56.126130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.126130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:56.417287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:56.430348 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a18f0fc5-37b0-4ee4-923b-77583bb98acb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.321728 Aug 03 04:56:56.431168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2705/5418] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:56 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:56.764491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:56.765582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:56.786242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.786989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:56.787973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.789758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:56.857075 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e0249fa-f961-4723-ba0d-0f204b0e580a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/ips" status: 200 len: 150 microversion: 2.1 time: 0.094981 Aug 03 04:56:56.857723 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2714/5419] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:56:56 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/ips => generated 150 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:56:56.872725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07b3950c-baf1-4101-81b6-0c27c0fd33ff"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:56:56.875774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:56.883805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.884933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:56.886142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:56.886796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.015232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/os-volume_attachments HTTP/1.1 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 74 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: {"volumeAttachment": {"volumeId": "07b3950c-baf1-4101-81b6-0c27c0fd33ff"}} Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': 'f7440c86-3faa-4672-971d-e38500ddb577', 'body': {'volumeAttachment': {'volumeId': '07b3950c-baf1-4101-81b6-0c27c0fd33ff'}}} Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:57.016910 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe Aug 03 04:56:57.022380 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:56:57.025197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 400 to user: Invalid volume: volume 07b3950c-baf1-4101-81b6-0c27c0fd33ff is already attached to instances: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:56:57.026769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9de6ef06-ccdf-41c3-8b9e-697a8d83f81d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.160753 Aug 03 04:56:57.027705 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2706/5420] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:56:56 2022] POST /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:56:57.040657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:57.041319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:57.049016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.049607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.051032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.052367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.104601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:56:57.399197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7eb3ce46-9f61-47b8-8979-7b93e5b6b66a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 204 len: 0 microversion: 2.1 time: 0.364853 Aug 03 04:56:57.399674 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2715/5421] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:56:57 2022] DELETE /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:56:57.415658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:57.416408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:57.433286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.433982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.437471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.438136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.458357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:57.459080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:57.468359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.468966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.469788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:57.471849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:57.853593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:57.862040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1c5fba03-9abf-48b5-b61b-401215c1964b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.408550 Aug 03 04:56:57.862040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2716/5422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:57 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:57.880184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:57.888979 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d5d315b-258e-449d-a68b-b1abf70adfef tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1680 microversion: 2.1 time: 0.477372 Aug 03 04:56:57.890226 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2707/5423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:57 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1680 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:56:58.888332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:58.888954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:58.906594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:58.907818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:58.908894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:58.909540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:58.915734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:56:58.916408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:56:58.936348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:58.940562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:58.941871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:56:58.942403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:56:59.381558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:59.387427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:56:59.395555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8526158b-a480-487e-8f50-8880c6e013c9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1680 microversion: 2.1 time: 0.486872 Aug 03 04:56:59.401679 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2708/5424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:58 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1680 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:56:59.402187 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e03651c5-4a0b-45a8-bec2-007bd6eb8c25 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.511679 Aug 03 04:56:59.402187 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2717/5425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:56:58 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:00.440091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:00.442737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:00.443447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:00.445799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:00.466541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:00.468516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:00.469674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:00.470309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:00.481384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:00.481875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:00.482671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:00.483112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:01.014826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:01.027586 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5cc51c4b-80e6-4b43-a864-4681999da278 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.600116 Aug 03 04:57:01.028194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2709/5426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:00 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:01.045552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:01.058178 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e94fdb33-f7d5-47d3-8e13-e41d92f1302b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1680 microversion: 2.1 time: 0.626538 Aug 03 04:57:01.062243 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2718/5427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:00 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1680 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:02.056559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:02.057820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:02.077532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:02.083188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:02.085296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:02.085595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:02.086363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:02.092904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:02.130130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:02.132770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:02.137801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:02.138462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:02.146818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:02.395687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:02.407462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4abc11e-a065-4092-9123-25af1e3816ab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1613 microversion: 2.1 time: 0.328223 Aug 03 04:57:02.427205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2719/5428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:02 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1613 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:02.427205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1a16f5a6-6b31-4b03-a6bf-91df3481483d req-2b8d17ee-76c9-4d07-b9b6-5d766e8f8b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7440c86-3faa-4672-971d-e38500ddb577", "name": "network-vif-deleted", "tag": "e8aa1a6c-74ef-4550-9542-abc74fd3eb36"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:02.441560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a16f5a6-6b31-4b03-a6bf-91df3481483d req-2b8d17ee-76c9-4d07-b9b6-5d766e8f8b80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:02.442345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1a16f5a6-6b31-4b03-a6bf-91df3481483d req-2b8d17ee-76c9-4d07-b9b6-5d766e8f8b80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:02.478047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1a16f5a6-6b31-4b03-a6bf-91df3481483d req-2b8d17ee-76c9-4d07-b9b6-5d766e8f8b80 service nova] Creating event network-vif-deleted:e8aa1a6c-74ef-4550-9542-abc74fd3eb36 for instance f7440c86-3faa-4672-971d-e38500ddb577 on n-h2-826756-5 Aug 03 04:57:02.495637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1a16f5a6-6b31-4b03-a6bf-91df3481483d req-2b8d17ee-76c9-4d07-b9b6-5d766e8f8b80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079334 Aug 03 04:57:02.497642 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2720/5429] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:02.540606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:02.552164 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cda4d43-2948-4506-934f-a48afdc0d1d1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.500702 Aug 03 04:57:02.558661 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2710/5430] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:02 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:03.439440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:03.440450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:03.447144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:03.490539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:03.495374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:03.497023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:03.497641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:03.608707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:03.614485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:03.641545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:03.641848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:03.643652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:03.645631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:03.646940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:03.647828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'fault' on Instance uuid f7440c86-3faa-4672-971d-e38500ddb577 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:57:03.657401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:03.707203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:03.716573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55cc8d63-fd61-431f-9481-122f76b9546c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 200 len: 1330 microversion: 2.1 time: 0.281670 Aug 03 04:57:03.718248 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2721/5431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:03 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 1330 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:03.981594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:03.993535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef1352c9-839b-474e-80b2-9330f909fddc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.418329 Aug 03 04:57:03.995157 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2711/5432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:03 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:04.739111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:04.739759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:04.752825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:04.753303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:04.754740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:04.755195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:04.773914 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 HTTP/1.1 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f7440c86-3faa-4672-971d-e38500ddb577'} Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:04.776495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3dbcf171-4efe-47ec-b7b0-c4c7f8ef57c8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 404 len: 111 microversion: 2.1 time: 0.042980 Aug 03 04:57:04.780939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2722/5433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:04 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:57:04.788546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3abc1e6b-e339-4750-91a9-e58704044b80 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '.version_select at 0x7fdd475bfe50>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:04.903039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3abc1e6b-e339-4750-91a9-e58704044b80 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-55184354" status: 202 len: 0 microversion: 2.1 time: 0.119844 Aug 03 04:57:04.905552 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2712/5434] 10.222.0.72 () {58 vars in 1215 bytes} [Wed Aug 3 04:57:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-55184354 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:57:05.015277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:05.016153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:05.026389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:05.027901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:05.031592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:05.032997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:05.381350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:05.391559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61bc479c-e7e3-4d8e-b0f1-5b586e811943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.380359 Aug 03 04:57:05.392157 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2723/5435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:05 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:05.781333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Calling method '.version_select at 0x7fdd4751c280>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:05.782233 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 04:57:05.782233 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 04:57:05.783400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:05.783853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:05.818641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:05.819202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:05.830890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:05.831627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:05.838951 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d3226453-4010-42c4-b164-488e81800966 tempest-PortsAdminExtendedAttrsTestJSON-1795009802 tempest-PortsAdminExtendedAttrsTestJSON-1795009802-project-admin] 10.222.0.72 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.381417 Aug 03 04:57:05.847768 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2713/5436] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 04:57:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:06.286519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:06.287087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:06.296295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.297155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.298805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.299645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.399457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'services' on Instance uuid ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:57:06.415269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:06.415969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:06.435617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:06.446442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.446983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.447775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.448218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.666288 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a59ef00d-3d22-476c-b1c6-b977277dc9f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments/07b3950c-baf1-4101-81b6-0c27c0fd33ff" status: 202 len: 0 microversion: 2.1 time: 0.386069 Aug 03 04:57:06.669640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2724/5437] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:57:06 2022] DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments/07b3950c-baf1-4101-81b6-0c27c0fd33ff => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:57:06.677668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:06.683369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:06.692825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.693648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.695020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:06.695685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:06.769229 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d6f58d9-aff8-47a7-ab99-1e487cf61a70 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095929 Aug 03 04:57:06.770795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2725/5438] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:06 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:06.806688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:06.824948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-605574e7-e17e-4916-b61c-a1d490ce783c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.409313 Aug 03 04:57:06.825931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2714/5439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:06 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:07.783425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:07.786445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:07.806605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:07.809207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:07.810267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:07.811535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:07.832120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:07.849797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:07.850415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:07.854579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d19ae4f7-9d0a-441b-8286-baa8e02c50f4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075888 Aug 03 04:57:07.856359 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2726/5440] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:07 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:07.875720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:07.881766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:07.881766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:07.881766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:08.236298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:08.239050 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83fd095c-2d55-405d-a931-1765d4cad0e5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.394190 Aug 03 04:57:08.240766 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2715/5441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:07 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:08.869981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:08.872217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:08.892725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:08.893183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:08.894162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:08.894636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:08.958740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc1db36f-e159-47b0-ac2e-c27b6fb77b9d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093970 Aug 03 04:57:08.963345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2727/5442] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:08 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:09.269026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:09.274063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:09.294508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:09.294844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:09.298359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:09.299011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:09.971242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:09.974199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:09.985240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:09.985699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:09.988978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:09.988978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:10.058672 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05b38a58-28db-495e-a73c-2aed00241e69 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090587 Aug 03 04:57:10.059613 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2728/5443] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:09 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:10.266249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:10.277839 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-418d9867-bbe0-4177-a769-a53d42963b05 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 1.021074 Aug 03 04:57:10.281864 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2716/5444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:09 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:11.088613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:11.088613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:11.101145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:11.102190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:11.108664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:11.109528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:11.213533 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db08b60a-cabe-46da-adc3-38d2862a6ec7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143843 Aug 03 04:57:11.230669 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2729/5445] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:11 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:11.305610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:11.307081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:11.319235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:11.332975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:11.333841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:11.334298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:11.993856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:12.007009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-549e4c87-913c-4ac9-8ab5-5b7bbef517aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1532 microversion: 2.1 time: 0.706805 Aug 03 04:57:12.008493 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2717/5446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:11 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1532 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:12.241866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:12.244211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:12.259994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:12.261729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:12.262825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:12.263580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:12.351567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e83ea7fa-73d6-4254-a71b-bf99a3eca82d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102096 Aug 03 04:57:12.351567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2730/5447] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:12 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:13.035865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:13.036525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:13.057195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:13.058307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:13.065370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:13.071348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:13.513952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:13.514472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:13.525885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:13.526353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:13.527155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:13.553528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:13.657280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:57:14.178747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:14.191842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d75dea80-c841-49b0-8a31-c2105a7c6b9a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 1.160374 Aug 03 04:57:14.213109 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2731/5448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:13 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:14.219393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:14.227827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:14.249329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:14.251074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:14.255229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:14.256897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:14.305617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-def92f3f-aa62-4531-9628-d999307c6cd7 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 204 len: 0 microversion: 2.32 time: 1.437885 Aug 03 04:57:14.305617 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2718/5449] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:57:12 2022] DELETE /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 0 bytes in 1441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:57:14.306836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:14.307549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:14.330382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:14.334066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:14.338049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:14.343587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:14.433737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2b010b1-419c-475e-afed-3e00375e16cd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217631 Aug 03 04:57:14.434596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2732/5450] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:14 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:14.998103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:15.014165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:15.017814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:15.025030 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a5f81c4-637f-40aa-a8bc-00e7ca5f519a tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2953 microversion: 2.32 time: 0.722475 Aug 03 04:57:15.026895 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2719/5451] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:14 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2953 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:15.231021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:15.232718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:15.246412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:15.249207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:15.250239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:15.250926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:15.449135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:15.449135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:15.463462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:15.464502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:15.468071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:15.468766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:15.563042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-edb7e5d5-da71-4623-91a3-93f9850f0c0f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120916 Aug 03 04:57:15.563629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2720/5452] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:15 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:57:15.749201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:15.760760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f276d0d-53d8-452c-8dda-4a3d1517ce99 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.538136 Aug 03 04:57:15.761878 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2733/5453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:15 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:16.065260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:16.066111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:16.092499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.094419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:16.099666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.100799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:16.577282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:16.579621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:16.603165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.603820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:16.604491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.604927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:16.763907 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a367dffa-364f-4058-b7c4-b922ebfe51bd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.190846 Aug 03 04:57:16.764881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2734/5454] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:57:16 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:57:16.790811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:16.791438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:16.805427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.805894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:16.806692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:16.807137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:17.107852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:17.125577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:17.132303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:17.138233 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b8f0920-18fc-440a-bfe0-82441f610b36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2953 microversion: 2.32 time: 1.082872 Aug 03 04:57:17.139382 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2721/5455] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:16 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2953 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:17.152003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:17.152765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:17.168965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:17.170808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:17.173934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:17.173934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:17.262395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:57:18.126525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:18.144801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-198c3ddc-0652-4baa-8c16-83a54f73ea82 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 1.354549 Aug 03 04:57:18.145664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2735/5456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:16 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:18.597960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a8390ca1-536c-4752-9d2c-df9a88b46b0d req-11a9a530-6a47-4600-b714-860ce7dd1901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "name": "network-vif-plugged", "status": "completed", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:18.613950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a8390ca1-536c-4752-9d2c-df9a88b46b0d req-11a9a530-6a47-4600-b714-860ce7dd1901 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:18.615728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a8390ca1-536c-4752-9d2c-df9a88b46b0d req-11a9a530-6a47-4600-b714-860ce7dd1901 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:18.650315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a8390ca1-536c-4752-9d2c-df9a88b46b0d req-11a9a530-6a47-4600-b714-860ce7dd1901 service nova] Creating event network-vif-plugged:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:57:18.671503 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a8390ca1-536c-4752-9d2c-df9a88b46b0d req-11a9a530-6a47-4600-b714-860ce7dd1901 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.523590 Aug 03 04:57:18.673240 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2736/5457] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:18.679598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:18.680794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:18.694565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:18.694565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:18.694565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:18.694565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:18.694949 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d94351ba-7ed7-482e-af68-2c031cf81a65 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 204 len: 0 microversion: 2.1 time: 1.550398 Aug 03 04:57:18.694949 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2722/5458] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:57:17 2022] DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 0 bytes in 1554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:57:18.709481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:18.711470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:18.754145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:18.768885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:18.771514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:18.778729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:19.499887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:19.545127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1aac882c-032b-4b74-8e36-fbd3213c50a6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1680 microversion: 2.1 time: 0.838952 Aug 03 04:57:19.548331 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2723/5459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:18 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1680 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:19.570899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:19.574412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:19.598061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:19.615753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:19.617519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:19.621749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:19.623045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:19.624089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:19.626171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:19.627585 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e50017e1-c0c1-4e4b-8b62-28098ce21962 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2953 microversion: 2.32 time: 0.952974 Aug 03 04:57:19.641307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2737/5460] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:18 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2953 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:19.722026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:20.168757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:20.183270 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-59d33159-3cf4-4093-b2d4-85c428f91e29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.626207 Aug 03 04:57:20.184117 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2724/5461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:19 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:20.568773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:20.569314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:20.596150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:20.596953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:20.599871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:20.603264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:20.658872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:20.659668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:20.673616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:20.674424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:20.680695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:20.681450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:22.396477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:22.412810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:22.418096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:22.418096 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e978777-000b-420d-a051-f52653d7c04c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2953 microversion: 2.32 time: 1.762320 Aug 03 04:57:22.421722 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2725/5462] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:20 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2953 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:22.433474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:22.434120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:22.450077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:22.450525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:22.451322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:22.452383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:22.919029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:22.927567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a88c867-9fff-4077-8c9a-0f3a2258abf7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1680 microversion: 2.1 time: 2.364039 Aug 03 04:57:22.936770 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2738/5463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:20 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1680 bytes in 2374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:22.942135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c5018f9e-f970-43f5-a1f0-7447d4d2a4dd req-a1eaa78c-75b2-468c-a57c-7519ef6e16e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "97b16f2c-c92b-4982-841b-793440779ba3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:23.006384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c5018f9e-f970-43f5-a1f0-7447d4d2a4dd req-a1eaa78c-75b2-468c-a57c-7519ef6e16e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:23.006845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c5018f9e-f970-43f5-a1f0-7447d4d2a4dd req-a1eaa78c-75b2-468c-a57c-7519ef6e16e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:23.053068 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c5018f9e-f970-43f5-a1f0-7447d4d2a4dd req-a1eaa78c-75b2-468c-a57c-7519ef6e16e6 service nova] Creating event network-vif-unplugged:97b16f2c-c92b-4982-841b-793440779ba3 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:23.091563 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c5018f9e-f970-43f5-a1f0-7447d4d2a4dd req-a1eaa78c-75b2-468c-a57c-7519ef6e16e6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152716 Aug 03 04:57:23.096671 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2739/5464] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:23.139352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:23.142287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8a58326-0e84-4d02-802d-e74f896e1dba tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.718057 Aug 03 04:57:23.143066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2726/5465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:22 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:23.446954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:23.451048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:23.476811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:23.480738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:23.491042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:23.491999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:23.965336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:23.966199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:23.979397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:23.979831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:23.989408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:23.989847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:25.210272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:25.229092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:25.233998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:25.239159 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eaaec49a-edb0-4df7-9941-5cd37f8f629c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2932 microversion: 2.32 time: 1.792846 Aug 03 04:57:25.241348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2740/5466] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:23 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2932 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:25.255370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:25.256936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:25.275934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:25.278347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:25.281793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:25.282298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:25.351959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:25.380401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8ea5c1f-f6f2-4d75-8527-d8934c9e860f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1680 microversion: 2.1 time: 1.414846 Aug 03 04:57:25.382987 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2727/5467] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:23 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1680 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:25.417155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "e592c4e7-ebc7-4698-a174-874f118b41b6"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "cf3e5ac9-04a7-4f43-a57e-a03909ef5526"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:25.486074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:25.487881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:25.529738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Creating event network-vif-unplugged:e592c4e7-ebc7-4698-a174-874f118b41b6 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:25.530573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Creating event network-vif-unplugged:c8f462f5-5cc5-4cf2-9cd8-a17a4ca7fc70 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:25.531256 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] Creating event network-vif-unplugged:cf3e5ac9-04a7-4f43-a57e-a03909ef5526 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:25.571323 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-660ed5d5-b5bb-4c20-b676-52e286db275f req-782f9dc6-0827-4128-befc-ec3559b2a1a7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.184795 Aug 03 04:57:25.572134 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2728/5468] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:26.215726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:26.231551 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45a2c718-5437-464f-9923-3ef56d0b712c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.983265 Aug 03 04:57:26.237166 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2741/5469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:25 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:26.268286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:26.268999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:26.291033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:26.291533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:26.292528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:26.293016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:26.404197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:26.404931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:26.416251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:26.419921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:26.421167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:26.421907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:27.309760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:27.320432 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d976b961-7777-4d76-a5aa-3075ef9a8d92 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1614 microversion: 2.1 time: 0.921030 Aug 03 04:57:27.331870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2742/5470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:26 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1614 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:27.339743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:27.348750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:27.371287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:27.376010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:27.386732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:27.387508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:28.226876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:28.246947 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45f1067d-e963-4703-986b-75e1907635d5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.903336 Aug 03 04:57:28.246947 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2743/5471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:27 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:28.251008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "dbf790c9-1b50-46b1-aee1-8e6be6b98806"}, {"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-unplugged", "status": "completed", "tag": "e34306e5-c6ae-4036-861c-45f67d309de1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:28.273377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:28.274504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:28.306698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] Creating event network-vif-unplugged:dbf790c9-1b50-46b1-aee1-8e6be6b98806 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:28.307676 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] Creating event network-vif-unplugged:e34306e5-c6ae-4036-861c-45f67d309de1 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:28.315787 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-376073e7-eb8a-47fc-b1a6-9ea740d37c2b req-20567883-0ec8-4f6e-90f5-8faea812c01d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.072813 Aug 03 04:57:28.321314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2744/5472] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:28.363756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:28.364780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:28.383554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:28.384386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:28.386193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:28.386834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:28.459381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:28.620124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:28.630868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:28.632902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:28.634697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bac8df94-c88b-408d-bff6-d5b70ace5c29 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2932 microversion: 2.32 time: 2.371120 Aug 03 04:57:28.648910 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2729/5473] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:26 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2932 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:28.685081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:28.699420 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ef2507e-8130-40a7-9c27-7f50163267ca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1614 microversion: 2.1 time: 0.346508 Aug 03 04:57:28.700416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2745/5474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:28 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1614 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:29.271805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:29.272470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:29.286422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:29.293158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:29.297376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:29.298089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:29.662803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:29.663540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:29.676320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:29.676797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:29.677586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:29.678034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:30.705629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:30.717562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:30.719080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:30.720400 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94ea336a-44eb-4f9f-8294-8b852484697c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2911 microversion: 2.32 time: 1.062828 Aug 03 04:57:30.728750 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2746/5475] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:29 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2911 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:30.739296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:30.739992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:30.748557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:30.749067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:30.749971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:30.750572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:30.793141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:30.793597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:30.794064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'fault' on Instance uuid ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:57:30.803462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:30.811373 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-954da5ad-a1b7-4a27-b320-77cb1b4819b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 1.544232 Aug 03 04:57:30.812028 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2730/5476] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:30.858756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:30.867553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-46fabd14-d076-405f-bc50-ae417639458c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 200 len: 1331 microversion: 2.1 time: 0.136760 Aug 03 04:57:30.868132 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2747/5477] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:30 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:30.950362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0a3e0b97-af1d-4ae5-bef0-b19473bff592 req-79187a4b-dff3-454b-8ffb-cde355a9d9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe", "name": "network-vif-deleted", "tag": "e7903890-38a4-4c17-8809-0b88a14113d1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:30.962669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0a3e0b97-af1d-4ae5-bef0-b19473bff592 req-79187a4b-dff3-454b-8ffb-cde355a9d9db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:30.966316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0a3e0b97-af1d-4ae5-bef0-b19473bff592 req-79187a4b-dff3-454b-8ffb-cde355a9d9db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:30.974835 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0a3e0b97-af1d-4ae5-bef0-b19473bff592 req-79187a4b-dff3-454b-8ffb-cde355a9d9db service nova] Creating event network-vif-deleted:e7903890-38a4-4c17-8809-0b88a14113d1 for instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe on n-h1-826756-5 Aug 03 04:57:30.979858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0a3e0b97-af1d-4ae5-bef0-b19473bff592 req-79187a4b-dff3-454b-8ffb-cde355a9d9db service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166523 Aug 03 04:57:30.980538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2731/5478] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:31.748825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:31.750482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:31.781983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:31.792566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:31.792566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:31.792566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:31.835298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:31.836050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:31.853376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:31.853925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:31.854738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:31.855187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:32.792491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:32.840641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:32.843503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:32.845083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c69d5100-dfdd-444b-a68b-4040dd1743a3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2864 microversion: 2.32 time: 1.103696 Aug 03 04:57:32.866493 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2748/5479] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:31 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2864 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:32.871970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:32.872851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:32.901771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:32.903314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:32.904460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:32.915616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:32.974209 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe HTTP/1.1 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe'} Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:32.977283 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 04:57:32.982093 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:32.987732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:57:32.990798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-abedb218-d136-4d6f-aeda-21c703df4d73 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 404 len: 111 microversion: 2.1 time: 0.122789 Aug 03 04:57:32.992927 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2749/5480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:32 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:57:33.005095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc86ca81-a289-4702-98a8-345963270b9e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '.version_select at 0x7fdd548a64c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:33.014193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:33.018232 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc86ca81-a289-4702-98a8-345963270b9e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 04:57:33.037303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cfd6334f-c2e3-4642-a502-10d2eb8e3204 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 1.205734 Aug 03 04:57:33.038615 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2732/5481] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:31 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:33.085305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1f10548b-c975-4aa8-87d9-aad1b64a0abf req-1cb9e126-052f-4181-931a-2043cb7a7a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-deleted", "tag": "cf3e5ac9-04a7-4f43-a57e-a03909ef5526"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:33.100915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f10548b-c975-4aa8-87d9-aad1b64a0abf req-1cb9e126-052f-4181-931a-2043cb7a7a36 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:33.101689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1f10548b-c975-4aa8-87d9-aad1b64a0abf req-1cb9e126-052f-4181-931a-2043cb7a7a36 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:33.123958 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1f10548b-c975-4aa8-87d9-aad1b64a0abf req-1cb9e126-052f-4181-931a-2043cb7a7a36 service nova] Creating event network-vif-deleted:cf3e5ac9-04a7-4f43-a57e-a03909ef5526 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:33.133409 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1f10548b-c975-4aa8-87d9-aad1b64a0abf req-1cb9e126-052f-4181-931a-2043cb7a7a36 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074783 Aug 03 04:57:33.136354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2733/5482] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:33.872229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:33.873948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:33.896012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:33.896703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:33.898917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:33.900710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:34.036473 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc86ca81-a289-4702-98a8-345963270b9e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 35718. Aug 03 04:57:34.188395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc86ca81-a289-4702-98a8-345963270b9e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697324497" status: 202 len: 0 microversion: 2.1 time: 1.190032 Aug 03 04:57:34.190273 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2750/5483] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:57:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1697324497 => generated 0 bytes in 1193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:57:34.197742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:34.201057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:34.218137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:34.220346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:34.221610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:34.222474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:35.010063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:35.025625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:35.030805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:35.038426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7b4189d5-2435-436e-b929-9728d6190fd6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2703 microversion: 2.32 time: 1.169395 Aug 03 04:57:35.039761 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2734/5484] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:33 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2703 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:57:35.069422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:35.080746 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0849d8b-ba2f-47b0-93c1-e98254801b57 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.888560 Aug 03 04:57:35.085724 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2751/5485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:34 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:36.067147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:36.067761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:36.087411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:36.094644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:36.096650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:36.097339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:36.106240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:36.107458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:36.119291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:36.126897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:36.130453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:36.133458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:37.100879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:37.109313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:37.135072 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4798ed8e-a4c9-4618-972c-20d7d6acc967 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 1.032547 Aug 03 04:57:37.137787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:37.139398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:37.145616 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2752/5486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:36 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:37.151347 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1d5298b-3491-4dd9-bed5-cc4bc75e1e36 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2703 microversion: 2.32 time: 1.088072 Aug 03 04:57:37.158963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ab5fb8e1-ff2a-44c5-8377-5febadac79ac req-abe639c8-44a8-479a-9bf8-f48a28c77be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-deleted", "tag": "e34306e5-c6ae-4036-861c-45f67d309de1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:37.163163 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2735/5487] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:36 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2703 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:37.193383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:37.205693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab5fb8e1-ff2a-44c5-8377-5febadac79ac req-abe639c8-44a8-479a-9bf8-f48a28c77be4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:37.206145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ab5fb8e1-ff2a-44c5-8377-5febadac79ac req-abe639c8-44a8-479a-9bf8-f48a28c77be4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:37.266786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ab5fb8e1-ff2a-44c5-8377-5febadac79ac req-abe639c8-44a8-479a-9bf8-f48a28c77be4 service nova] Creating event network-vif-deleted:e34306e5-c6ae-4036-861c-45f67d309de1 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:37.291734 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ab5fb8e1-ff2a-44c5-8377-5febadac79ac req-abe639c8-44a8-479a-9bf8-f48a28c77be4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144697 Aug 03 04:57:37.297541 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2753/5488] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:37.315646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b55b9c9b-090e-421f-ad5b-4f9623cb5acf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: .version_select at 0x7fdd47477430>, body: {"keypair": {"name": "tempest-keypair-1311148036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLOZ8LeipEyHzgZ9otTOQB8BkKveu4JtVJTsh+t4sXL7v8NPNNOK0myrziM5t2VIMSkwYFE0q1LU6chSBtBUzS1pRl+YsWj/mYC/hwXv4ZR1PUubcRyiGhQM8hRlIl4XA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:37.359459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b55b9c9b-090e-421f-ad5b-4f9623cb5acf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:57:37.372752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b55b9c9b-090e-421f-ad5b-4f9623cb5acf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:57:37.490761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b55b9c9b-090e-421f-ad5b-4f9623cb5acf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185476 Aug 03 04:57:37.491826 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2736/5489] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:57:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:38.168863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:38.169588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:38.197229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:38.198277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:38.301099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:38.301099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:38.301099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:38.301099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:38.301788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:38.301788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:38.301788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:38.301788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:39.018555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:39.035487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-148e3c81-30dc-46a0-8bd0-d5e99527959f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.871804 Aug 03 04:57:39.036438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2754/5490] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:39.154369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:39.166242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:39.168154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:39.171126 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-346ab488-12a9-44b7-a982-61c7b8df1de6 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2370 microversion: 2.32 time: 0.978779 Aug 03 04:57:39.173693 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2737/5491] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:38 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2370 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:39.752911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3036c563-fb94-4689-88ba-826ea2ca74be req-1770b632-c66e-4ebb-93d3-a0dcf384d1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-deleted", "tag": "dbf790c9-1b50-46b1-aee1-8e6be6b98806"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:39.792127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3036c563-fb94-4689-88ba-826ea2ca74be req-1770b632-c66e-4ebb-93d3-a0dcf384d1f8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:39.792127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3036c563-fb94-4689-88ba-826ea2ca74be req-1770b632-c66e-4ebb-93d3-a0dcf384d1f8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:39.821530 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3036c563-fb94-4689-88ba-826ea2ca74be req-1770b632-c66e-4ebb-93d3-a0dcf384d1f8 service nova] Creating event network-vif-deleted:dbf790c9-1b50-46b1-aee1-8e6be6b98806 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:39.832620 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3036c563-fb94-4689-88ba-826ea2ca74be req-1770b632-c66e-4ebb-93d3-a0dcf384d1f8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082545 Aug 03 04:57:39.832620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2755/5492] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:40.058259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:40.058880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:40.061981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:40.080765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:40.081485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:40.082473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:40.083082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:40.202261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:40.202964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:40.210142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:40.211007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:40.212408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:40.213030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:40.795650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:40.851968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-715e366a-e890-4692-9038-9871cdfe8d35 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1527 microversion: 2.1 time: 0.793818 Aug 03 04:57:40.855367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2738/5493] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:40 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1527 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:40.910650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:40.925994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:40.931833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:40.936043 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c6f7e9b-0e0a-414d-8e27-a028aa41db2b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2257 microversion: 2.32 time: 0.737239 Aug 03 04:57:40.949915 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2756/5494] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:40 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2257 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:41.878556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:41.879443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:41.894253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:41.906955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f847d9f3-aeab-4b88-88b6-3bb2785d8241 req-43b15e28-20f1-4307-92d6-23904323d101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-deleted", "tag": "e592c4e7-ebc7-4698-a174-874f118b41b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:41.915435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:41.918202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:41.919226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:41.936209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f847d9f3-aeab-4b88-88b6-3bb2785d8241 req-43b15e28-20f1-4307-92d6-23904323d101 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:41.936767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f847d9f3-aeab-4b88-88b6-3bb2785d8241 req-43b15e28-20f1-4307-92d6-23904323d101 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:41.982856 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f847d9f3-aeab-4b88-88b6-3bb2785d8241 req-43b15e28-20f1-4307-92d6-23904323d101 service nova] Creating event network-vif-deleted:e592c4e7-ebc7-4698-a174-874f118b41b6 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:41.994155 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f847d9f3-aeab-4b88-88b6-3bb2785d8241 req-43b15e28-20f1-4307-92d6-23904323d101 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092463 Aug 03 04:57:41.997194 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2757/5495] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 03 04:57:42.012376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:42.013046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:42.023514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:42.023978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:42.032262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:42.033280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:42.393712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:42.404059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:42.408368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:42.411329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e38c47fe-7bb1-40ab-988e-b77a84c6a7ee tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 2210 microversion: 2.32 time: 0.412825 Aug 03 04:57:42.415304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2758/5496] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:41 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 2210 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:42.863195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:42.872705 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-979a82ee-810e-4092-85f8-d68b1503f343 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1509 microversion: 2.1 time: 0.998788 Aug 03 04:57:42.888576 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2739/5497] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:41 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1509 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:43.444207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:43.446897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:43.458096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:43.458553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:43.459337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:43.462331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:43.896125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:43.898969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:43.910123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:43.910588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:43.921726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:43.923590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:44.187082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:44.204357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:44.206437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:44.209084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d46f3ac0-092f-434a-93d3-d71109029976 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.775295 Aug 03 04:57:44.217151 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2759/5498] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:43 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:44.222869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-133f004e-19f5-465d-a5df-ec91a8fb3d54 req-f3e06043-745d-48a1-b031-67cd9d86ef67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f745672-e7a9-435d-922b-38d5f5264d72", "name": "network-vif-deleted", "tag": "97b16f2c-c92b-4982-841b-793440779ba3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:44.242088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-133f004e-19f5-465d-a5df-ec91a8fb3d54 req-f3e06043-745d-48a1-b031-67cd9d86ef67 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:44.244829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-133f004e-19f5-465d-a5df-ec91a8fb3d54 req-f3e06043-745d-48a1-b031-67cd9d86ef67 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:44.265972 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-133f004e-19f5-465d-a5df-ec91a8fb3d54 req-f3e06043-745d-48a1-b031-67cd9d86ef67 service nova] Creating event network-vif-deleted:97b16f2c-c92b-4982-841b-793440779ba3 for instance 6f745672-e7a9-435d-922b-38d5f5264d72 on n-h1-826756-5 Aug 03 04:57:44.280958 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-133f004e-19f5-465d-a5df-ec91a8fb3d54 req-f3e06043-745d-48a1-b031-67cd9d86ef67 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062065 Aug 03 04:57:44.282673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2760/5499] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:57:44.456084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:44.469714 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b73e9ab3-5857-4068-b06a-138b373d8980 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1509 microversion: 2.1 time: 0.578261 Aug 03 04:57:44.471755 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2740/5500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:43 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:57:45.247596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:45.248828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:45.257218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:45.257662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:45.258954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:45.259403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:45.497294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:45.497294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:45.516538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:45.517005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:45.517814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:45.518259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:45.796814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:45.807332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:45.817700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:45.821778 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f03938c-dd06-45ba-a779-c7a24e36b58f tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.581844 Aug 03 04:57:45.823223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2761/5501] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:45 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:46.155401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0e12536b-c6f8-4d9c-97b3-5a91b6a41819 req-908c1944-8aca-47d5-a1a5-40ae9b6c3b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "name": "network-vif-unplugged", "status": "completed", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:46.172596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0e12536b-c6f8-4d9c-97b3-5a91b6a41819 req-908c1944-8aca-47d5-a1a5-40ae9b6c3b9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:46.173798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0e12536b-c6f8-4d9c-97b3-5a91b6a41819 req-908c1944-8aca-47d5-a1a5-40ae9b6c3b9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:46.190579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0e12536b-c6f8-4d9c-97b3-5a91b6a41819 req-908c1944-8aca-47d5-a1a5-40ae9b6c3b9c service nova] Creating event network-vif-unplugged:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:57:46.197533 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0e12536b-c6f8-4d9c-97b3-5a91b6a41819 req-908c1944-8aca-47d5-a1a5-40ae9b6c3b9c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046649 Aug 03 04:57:46.199057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2762/5502] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:57:46.246008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:46.256056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-862502801", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "112d0d14-3b17-41f3-81d4-e1328e5bdf87"}], "security_groups": [{"name": "tempest-securitygroup--2108223269"}], "key_name": "tempest-keypair-1311148036", "user_data": "}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:46.261049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dab8d833-c2dd-45f3-aa0a-d79aaa44f4aa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1509 microversion: 2.1 time: 0.771299 Aug 03 04:57:46.269672 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2741/5503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:45 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1509 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:46.773102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] validate_networks() for [('112d0d14-3b17-41f3-81d4-e1328e5bdf87', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:57:46.850755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:46.855474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:46.888330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:46.888937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:46.889961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:46.893031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:47.122782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:47.138372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:47.138372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:47.149256 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d67fbd47-650f-47dd-97af-7b246bf58bf1 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.290039 Aug 03 04:57:47.149953 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2742/5504] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:46 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:47.286349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:47.286872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:47.299326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:47.301738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:47.303031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:47.303656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:47.396495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:47.999878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.011205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:57:48.011801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:57:48.012047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:57:48.012567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:57:48.012988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:57:48.023734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d87c0589-71da-470c-8d21-3d3644b94429 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1452 microversion: 2.1 time: 0.741285 Aug 03 04:57:48.024411 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2743/5505] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:47 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1452 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:57:48.037980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.038475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.039417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.039854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.046500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:48.047492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:48.059978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.062440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.065118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.065789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.075291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:48.101309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:57:48.124007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:57:48.164296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:57:48.178116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:57:48.376075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.401042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c03c12c0-1bd5-4c3c-87ce-a64d7fb063b4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1452 microversion: 2.1 time: 0.359355 Aug 03 04:57:48.413166 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2744/5506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:48 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1452 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:57:48.425487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:48.426396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:48.432931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.433678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.434141 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-040111da-577a-412b-8077-6608d680e073 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.185750 Aug 03 04:57:48.434838 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2763/5507] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:57:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:57:48.435346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.436111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.446873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ba39a7a-3bd5-45e8-8582-e2243c5d2e68 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:48.458669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ba39a7a-3bd5-45e8-8582-e2243c5d2e68 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:48.749234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ba39a7a-3bd5-45e8-8582-e2243c5d2e68 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.763522 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ba39a7a-3bd5-45e8-8582-e2243c5d2e68 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1241 microversion: 2.1 time: 0.320445 Aug 03 04:57:48.769966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.793524 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2764/5508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:48 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1241 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:48.809430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:48.809994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:48.812577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.820832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:48.825308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b4d044e3-6aa4-4dc4-994a-61d5d7ac03e5 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.410704 Aug 03 04:57:48.828214 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2745/5509] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:48 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:48.832961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.833811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.835626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.836404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.873954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lazy-loading 'flavor' on Instance uuid dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:57:48.946238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'shelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state shelved_offloaded Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 14 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: {"shelve": {}} Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'shelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state shelved_offloaded Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'shelve': {}}} Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:57:48.955744 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state shelved_offloaded Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state shelved_offloaded Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'shelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state shelved_offloaded {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:57:48.961198 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fcd764ac-ba5f-4f32-a548-dd82b2a3a3ca tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 155 microversion: 2.1 time: 0.163249 Aug 03 04:57:48.973449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:57:48.974400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:48.979985 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2765/5510] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:57:48 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 155 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:57:48.994945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:48.995922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:48.998864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:49.001319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:49.129635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 04:57:49.814582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-413da72a-4e7f-478f-b1de-de9a843eb4e2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:49.815242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-413da72a-4e7f-478f-b1de-de9a843eb4e2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:49.995081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-413da72a-4e7f-478f-b1de-de9a843eb4e2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:50.009313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-413da72a-4e7f-478f-b1de-de9a843eb4e2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1241 microversion: 2.1 time: 0.199492 Aug 03 04:57:50.010181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2766/5511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:49 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:57:50.030348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:50.030348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:50.051165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:50.051927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:50.053797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:50.055035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:50.224190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ca2d94c-69d0-4a72-ac96-c6b19977bae1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 1.257373 Aug 03 04:57:50.232847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2746/5512] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:57:48 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:57:50.269075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:50.270385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:50.294430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:50.301349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:50.302554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:50.303394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:50.414999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:50.444789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:50.468152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:50.474197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae8d4159-ec5e-43e4-834c-687d0e77310d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.452068 Aug 03 04:57:50.490083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2767/5513] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:50 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:50.861611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:50.877377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-babfecc6-67db-4f74-9048-d750cc3710d4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1460 microversion: 2.1 time: 0.636549 Aug 03 04:57:50.878290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2747/5514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:50 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1460 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:51.052788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:51.055983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:51.074957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.075743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:51.079666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.080361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:51.504415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:51.505601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:51.520681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.521243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:51.522238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.522879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:51.918677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:51.940160 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d530d4c-f89b-476a-b3b8-bc56319bf3cf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1245 microversion: 2.1 time: 0.887898 Aug 03 04:57:51.940160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2768/5515] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:51 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1245 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:51.943045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:51.956765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:51.961274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:51.963812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:51.963965 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95d78e24-1ca4-40d6-ad70-037153c89265 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.464520 Aug 03 04:57:51.966517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:51.989477 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2748/5516] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:51 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:51.995856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.996698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:51.997537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:51.998388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:52.030725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:52.315692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:52.332107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9b92268-bd04-47c3-8904-709eb9b142d2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1460 microversion: 2.1 time: 0.382133 Aug 03 04:57:52.338174 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2769/5517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:51 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1460 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:52.962777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:52.963412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:52.979316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:52.980187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:52.981265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:52.993000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:52.993902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:52.997800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:53.005454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:53.010095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:53.014823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:53.016658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:53.176298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:53.186602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:53.190485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:53.200361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b12cc0d1-410c-48fb-a32e-46ca26ced915 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.212087 Aug 03 04:57:53.200896 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2770/5518] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:52 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 04:57:53.254635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:53.269768 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6defac2f-fd18-4d16-9af3-ffc10982b66c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1301 microversion: 2.1 time: 0.312525 Aug 03 04:57:53.272907 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2749/5519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:52 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1301 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:53.370200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:53.372298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:53.387720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:53.388093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:53.388930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:53.389376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:53.955941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:53.992843 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-724ee768-642c-46e9-945b-53563a8125cd tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.625500 Aug 03 04:57:53.994567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2771/5520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:53 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:54.229513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:54.230163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:54.257472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:54.261784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:54.264723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:54.269463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:54.308824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:54.309620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:54.332781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:54.340518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:54.341667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:54.345672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:54.471153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:54.505597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09401117-3397-4c19-9386-e0ff8e6035e7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1299 microversion: 2.1 time: 0.211259 Aug 03 04:57:54.508149 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2772/5521] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:54 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:54.542093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:54.565781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:54.567367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:54.568853 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f654ae94-6986-40d2-908b-5f186889d21b tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.345969 Aug 03 04:57:54.569618 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2750/5522] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:54 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:55.031093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:55.031093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:55.036622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:55.040697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:55.044944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:55.046145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:55.536577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:55.536577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:55.549934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:55.552121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:55.554461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:55.555811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:56.016853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:56.033352 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22ac4362-4418-4580-9f5b-6763196a5ab5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1299 microversion: 2.1 time: 0.503305 Aug 03 04:57:56.047709 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2751/5523] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:55 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1299 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:56.048560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:56.063943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:56.065195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:56.066944 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c5b9bc1-0364-4e5f-b2fa-e11bc5f9c7e6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 1.051435 Aug 03 04:57:56.068970 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2773/5524] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:55 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:56.083003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:56.083717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:56.085183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:56.086664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:56.681969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:56.705128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:56.706828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:56.712496 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f99be0b4-d637-42e3-bffd-4a23db354698 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.658479 Aug 03 04:57:56.713468 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2752/5525] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:56 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:57.060437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:57.061073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:57.093260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:57.096809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:57.099231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:57.099863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:57.101517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:57.104050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:57.112644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:57.112991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:57.113799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:57.114250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:57.958711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:57.975934 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e52bff7-2c46-4788-8101-74e86ccedd84 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.881602 Aug 03 04:57:57.976655 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2753/5526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:57 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:57.988837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:57.989797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:57.999782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:58.000681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:58.001660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:58.002563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:58.061368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:57:58.069953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:58.089065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2998d4e8-1901-4b27-b337-4071bb291765 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 1.029695 Aug 03 04:57:58.089065 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2774/5527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:57 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:58.606810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:58.622462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:58.624303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:58.628301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72167a50-c707-44bb-ac80-8286be89d3b2 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.649192 Aug 03 04:57:58.628301 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2754/5528] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:57 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:57:59.008971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:59.009992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:59.045850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.050375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.052468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.066646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.108933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:59.109960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:59.125777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.134174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.135178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.139606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.683516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:59.699658 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2913069d-4139-4888-bcd2-89faa0dbca30 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 0.595324 Aug 03 04:57:59.716621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2755/5529] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:59 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:59.729645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:57:59.751340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:57:59.783596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.785364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.789374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:57:59.794136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:57:59.872636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:59.900805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1c166d10-8bbb-422a-952f-4936d76adcbf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.903164 Aug 03 04:57:59.901484 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2775/5530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:57:58 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:57:59.979131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:57:59.998586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:00.008826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:00.008826 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb1380f1-b6f7-4479-bbac-ae811dd5e5c4 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.291678 Aug 03 04:58:00.008826 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2756/5531] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:57:59 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:00.087730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2fb25f91-01ce-4083-ae41-1d81006f968a req-218d5e23-4a5c-4a1e-9a85-ac02a39aae38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5d994-12c8-4f47-8f63-ca9780c98127", "tag": "ecc3ea10-7145-46fb-8872-0891302f7585"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:00.106442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=10 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:00.112559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2fb25f91-01ce-4083-ae41-1d81006f968a req-218d5e23-4a5c-4a1e-9a85-ac02a39aae38 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:00.118708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2fb25f91-01ce-4083-ae41-1d81006f968a req-218d5e23-4a5c-4a1e-9a85-ac02a39aae38 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:00.148974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2fb25f91-01ce-4083-ae41-1d81006f968a req-218d5e23-4a5c-4a1e-9a85-ac02a39aae38 service nova] Creating event network-changed:ecc3ea10-7145-46fb-8872-0891302f7585 for instance c1e5d994-12c8-4f47-8f63-ca9780c98127 on n-h2-826756-5 Aug 03 04:58:00.159904 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2fb25f91-01ce-4083-ae41-1d81006f968a req-218d5e23-4a5c-4a1e-9a85-ac02a39aae38 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075062 Aug 03 04:58:00.164013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2776/5532] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:58:00.728537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:00.730690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:00.764656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:00.767296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:00.770351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:00.773266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:00.926308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:00.927335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:00.938568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:00.944174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:00.945265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:00.945892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:02.201905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:02.232080 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca95f619-90a4-4c35-ab8b-4e8b04ba0826 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 1.310674 Aug 03 04:58:02.238391 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2777/5533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:00 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:02.249256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:02.255811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:02.267268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:02.270817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:02.273137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:02.273137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:02.532386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:02.532386 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c15fe2d1-2a2a-40e3-af9d-bdeb520d8ec4 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 1.805534 Aug 03 04:58:02.532386 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2757/5534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:00 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:03.217069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:03.237425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:03.240821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:03.244788 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07300a86-e840-47f2-91e3-21af36782faa tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 1.001220 Aug 03 04:58:03.247042 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2778/5535] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:02 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:03.274393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:03.275067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:03.290189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:03.290663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:03.291527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:03.291993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:03.552517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:03.553146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:03.569925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:03.572300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:03.572300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:03.572300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:03.898476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:03.938121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c554ddb4-efd3-46fc-89cc-a4ff37fcaeb5 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.661112 Aug 03 04:58:03.942773 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2758/5536] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:03 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:04.145714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:04.148487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ced6a3b-2a6b-4e1c-8d4a-b3f468d43bcb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 0.596446 Aug 03 04:58:04.152364 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2779/5537] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:03 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:04.275100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:04.275739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:04.290994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:04.291734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:04.295853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:04.296367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:04.672026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:04.677005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:04.685307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:04.687210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:04.688478 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-558b6ddb-36cc-4e8b-9a34-dfaaca30a4d8 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.419640 Aug 03 04:58:04.689412 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2759/5538] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:04 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:04.968589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:04.970126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:04.977400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:04.984993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:04.984993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:04.984993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:05.174331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:05.174995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:05.186960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:05.188438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:05.198715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:05.198715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:05.432920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:05.449748 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f5aa38cf-f1d8-4e6a-a496-83c61726e0d6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.482783 Aug 03 04:58:05.452262 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2780/5539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:04 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:05.514052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:05.524777 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-09a7cc89-9cd5-40e3-9f54-1c94b76c69f3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 0.354390 Aug 03 04:58:05.525438 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2760/5540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:05 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:05.727522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:05.729584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:05.760626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:05.760626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:05.762264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:05.764364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:05.926061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:05.939176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:05.941096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:05.943020 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a3e9359-b232-4973-b4b4-139c98979de3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.231600 Aug 03 04:58:05.957762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2781/5541] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:05 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:06.479295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:06.480892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:06.506108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:06.510046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:06.511428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:06.519682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:06.546257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:06.547209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:06.557515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:06.557974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:06.558768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:06.559215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:07.567453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:07.575593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-933e3e43-9646-482f-9ed9-e6cf653fd721 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 1.100473 Aug 03 04:58:07.576429 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2761/5542] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:06 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:07.593434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:07.597787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:07.601244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:07.613898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dfce02b9-bb79-44d5-82ad-0205afca3fc6 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 1.070096 Aug 03 04:58:07.617754 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2782/5543] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:06 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:07.628745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:07.629435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:07.630400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:07.630862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:07.910719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:07.962213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:07.973237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:08.002925 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f790d79-dd0c-4ee2-bc65-d9b3f1d8f86c tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.398411 Aug 03 04:58:08.005383 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2762/5544] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:07 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:08.612407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:08.612407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:08.639194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:08.639777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:08.663727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:08.664253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:08.665105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:08.665567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:08.670377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:08.670958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:08.672525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:08.673043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:09.298072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:09.308583 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9af5c71f-8fd7-4765-903a-2849a53d125b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.711091 Aug 03 04:58:09.311577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2783/5545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:08 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:09.335812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:09.350253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c354c7b1-ad1f-4fe0-94d3-a502a7ed1186 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 0.715443 Aug 03 04:58:09.351409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2763/5546] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:08 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:09.373061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:09.374035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:09.389023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:09.397626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:09.403682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:09.403682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:09.403682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:10.050292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:10.083863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:10.089244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:10.092917 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55e59108-bce4-42a0-8d8c-1d5d117a4279 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1603 microversion: 2.32 time: 0.761587 Aug 03 04:58:10.095615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2784/5547] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:09 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1603 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:10.330022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:10.331122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:10.359897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:10.365223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:10.365223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:10.365223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:10.375982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:10.377259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:10.386794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:10.389028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:10.390387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:10.393453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:11.226220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:11.248152 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3eb2ce3c-67df-4776-8c94-91a681bdd5f8 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.922268 Aug 03 04:58:11.255999 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2764/5548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:10 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:11.275602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e9f8d3f7-7120-453c-ba1b-32879b6de7e4 req-d220a604-53b0-4fa1-943e-1bb370741daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e5d994-12c8-4f47-8f63-ca9780c98127", "name": "network-vif-plugged", "status": "completed", "tag": "ecc3ea10-7145-46fb-8872-0891302f7585"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:11.312892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e9f8d3f7-7120-453c-ba1b-32879b6de7e4 req-d220a604-53b0-4fa1-943e-1bb370741daa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:11.313967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e9f8d3f7-7120-453c-ba1b-32879b6de7e4 req-d220a604-53b0-4fa1-943e-1bb370741daa service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:11.329732 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e9f8d3f7-7120-453c-ba1b-32879b6de7e4 req-d220a604-53b0-4fa1-943e-1bb370741daa service nova] Creating event network-vif-plugged:ecc3ea10-7145-46fb-8872-0891302f7585 for instance c1e5d994-12c8-4f47-8f63-ca9780c98127 on n-h2-826756-5 Aug 03 04:58:11.369004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e9f8d3f7-7120-453c-ba1b-32879b6de7e4 req-d220a604-53b0-4fa1-943e-1bb370741daa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105977 Aug 03 04:58:11.377787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2765/5549] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:58:11.391742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:11.406642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:11.409237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:11.422613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01a6140d-9119-4e17-9712-f3c8e04c8f64 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 1.050754 Aug 03 04:58:11.423369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2785/5550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:10 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:11.435923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:11.440095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:11.442467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:11.457055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:11.511123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:11.511854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:11.513102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lazy-loading 'fault' on Instance uuid 6f745672-e7a9-435d-922b-38d5f5264d72 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:58:11.639389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:11.654834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:11.662842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c278da47fdac47af94ed8d402bc76faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90277125790c4575a67d25fff89029ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:11.666261 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d33cf67-386b-4cec-b2b5-bc2690be2cb3 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 200 len: 1370 microversion: 2.32 time: 0.286999 Aug 03 04:58:11.684917 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2766/5551] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:11 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 04:58:12.278055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:12.279225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:12.288174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:12.288965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:12.290467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:12.291510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:12.339559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:12.446128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:12.447188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:12.478148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:12.484754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:12.486129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:12.486847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:12.988633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:13.000434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8cbcfea1-df72-450a-a4e7-7f34ac2b78f7 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.726253 Aug 03 04:58:13.018903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2786/5552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:12 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:13.036497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:13.037769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:13.065791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:13.067493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:13.070024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:13.071588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:13.105735 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] HTTP exception thrown: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Request method failure captured: Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 HTTP/1.1 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f6MIKCp9ufHHcx8FRsTQTT_Y71USHPwLLy4o5MJMFv8hcHV71WRaRGqn7rXACDzTlOtt2AvJx39bzVkW4-zIyjecJpCLQWNU2SPtLXwL_k_jzSmnEZiT2v-evvVcDGkde8cnZf5-_qiLfVWtakj7g98qU24Dt9yq2EA5ra9so-9qOA Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_90277125790c4575a67d25fff89029ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/90277125790c4575a67d25fff89029ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c278da47fdac47af94ed8d402bc76faf Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '6f745672-e7a9-435d-922b-38d5f5264d72'} Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:13.127289 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Returning 404 to user: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:13.137123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-afafe475-8ded-424e-85f0-c72cfa067986 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 404 len: 111 microversion: 2.32 time: 0.107518 Aug 03 04:58:13.137861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:13.137968 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2787/5553] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:13 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:58:13.151976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff81950a-ecc9-4c0b-8cef-e879672d3cdf tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1367 microversion: 2.1 time: 0.711777 Aug 03 04:58:13.167917 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2767/5554] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:12 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1367 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:13.170686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ec80c6e-501d-411e-a192-b2a74b47f71d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '.version_select at 0x7fdd54f643a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:13.272709 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ec80c6e-501d-411e-a192-b2a74b47f71d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660885828" status: 204 len: 0 microversion: 2.32 time: 0.137254 Aug 03 04:58:13.274122 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2788/5555] 10.222.0.72 () {60 vars in 1259 bytes} [Wed Aug 3 04:58:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660885828 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 04:58:14.023781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:14.024598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:14.047780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:14.048362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:14.056614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:14.057144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:14.177985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:14.179349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:14.198835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:14.199711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:14.200854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:14.202608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:15.386353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:15.397212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8123e619-0163-4a3a-a363-15aad87c6b29 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1556 microversion: 2.1 time: 1.224752 Aug 03 04:58:15.398832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2789/5556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:14 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1556 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:15.424244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:15.425837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:15.438344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:15.439788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:15.440930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:15.441729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:15.472621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:15.483692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af67b033-4b82-4136-902b-bbf084ebf12a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 1.463743 Aug 03 04:58:15.484354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2768/5557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:14 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:15.635299 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7d27ff6-cf4b-48ca-a971-fd577677142e tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216941 Aug 03 04:58:15.637205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2790/5558] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 04:58:15 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:58:16.506382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:16.507023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:16.515697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:16.520156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:16.520899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:16.521901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:16.522515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:17.168441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:17.184215 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-157474c8-03f8-437f-b930-14ae882ffdf6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.683014 Aug 03 04:58:17.184898 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2769/5559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:16 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:18.209699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:18.210325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:18.216653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:18.217160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:18.218248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:18.218859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:19.163821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:19.184876 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e434cd4-4b52-4c12-9ad5-fb74dc01739f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.979934 Aug 03 04:58:19.189843 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2791/5560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:18 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:19.241644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6157eba4-673c-4d1e-9d54-e9231e9e1bd5 req-3fefaaf7-0536-4a16-9a38-5b7a80366ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e5d994-12c8-4f47-8f63-ca9780c98127", "tag": "ecc3ea10-7145-46fb-8872-0891302f7585"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:19.255117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6157eba4-673c-4d1e-9d54-e9231e9e1bd5 req-3fefaaf7-0536-4a16-9a38-5b7a80366ca1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:19.258052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6157eba4-673c-4d1e-9d54-e9231e9e1bd5 req-3fefaaf7-0536-4a16-9a38-5b7a80366ca1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:19.281353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6157eba4-673c-4d1e-9d54-e9231e9e1bd5 req-3fefaaf7-0536-4a16-9a38-5b7a80366ca1 service nova] Creating event network-changed:ecc3ea10-7145-46fb-8872-0891302f7585 for instance c1e5d994-12c8-4f47-8f63-ca9780c98127 on n-h2-826756-5 Aug 03 04:58:19.288110 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6157eba4-673c-4d1e-9d54-e9231e9e1bd5 req-3fefaaf7-0536-4a16-9a38-5b7a80366ca1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369336 Aug 03 04:58:19.289109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2770/5561] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:58:20.048123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-40f3d1d1-3ef6-4915-9f13-ff66bfe2e616 req-ef590bbf-aa83-4115-91b9-1a8ba2c9c8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "name": "network-vif-plugged", "status": "completed", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:20.068193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-40f3d1d1-3ef6-4915-9f13-ff66bfe2e616 req-ef590bbf-aa83-4115-91b9-1a8ba2c9c8f5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:20.068674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-40f3d1d1-3ef6-4915-9f13-ff66bfe2e616 req-ef590bbf-aa83-4115-91b9-1a8ba2c9c8f5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:20.082190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-40f3d1d1-3ef6-4915-9f13-ff66bfe2e616 req-ef590bbf-aa83-4115-91b9-1a8ba2c9c8f5 service nova] Creating event network-vif-plugged:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:58:20.088216 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-40f3d1d1-3ef6-4915-9f13-ff66bfe2e616 req-ef590bbf-aa83-4115-91b9-1a8ba2c9c8f5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043803 Aug 03 04:58:20.089449 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2792/5562] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:58:20.212702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:20.213782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:20.227043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:20.227549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:20.231805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:20.232288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:20.788463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:20.809066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cc12f52-3673-4c89-b488-0e36204d2efa tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.601678 Aug 03 04:58:20.812232 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2771/5563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:20 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:21.835150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:21.836663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:21.852684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:21.853762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:21.854779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:21.855468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:22.347551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:22.368628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6904ac7d-d759-4518-a428-9ba5624a29c9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.525614 Aug 03 04:58:22.378378 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2793/5564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:21 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:23.403454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:23.404168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:23.417259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:23.421963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:23.423021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:23.424942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:24.051120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:24.067861 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9849ba88-7966-4992-bb6c-0a087ee4abe2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.662423 Aug 03 04:58:24.071866 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2772/5565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:23 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:25.099790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:25.100492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:25.146892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.146892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.146892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.149100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.311934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:25.312576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:25.325201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.334208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.334208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.334208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.373524 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] HTTP exception thrown: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Request method failure captured: Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 HTTP/1.1 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f6MIKCp9ufHHcx8FRsTQTT_Y71USHPwLLy4o5MJMFv8hcHV71WRaRGqn7rXACDzTlOtt2AvJx39bzVkW4-zIyjecJpCLQWNU2SPtLXwL_k_jzSmnEZiT2v-evvVcDGkde8cnZf5-_qiLfVWtakj7g98qU24Dt9yq2EA5ra9so-9qOA Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_90277125790c4575a67d25fff89029ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/90277125790c4575a67d25fff89029ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c278da47fdac47af94ed8d402bc76faf Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6f745672-e7a9-435d-922b-38d5f5264d72'} Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:25.377707 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.383019 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.389063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Returning 404 to user: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:25.391115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d78961fb-c2cf-400b-8872-cf8037340b77 tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 404 len: 111 microversion: 2.32 time: 0.087606 Aug 03 04:58:25.398868 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2773/5566] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 04:58:25 2022] DELETE /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:58:25.411591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:25.412137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] [instance: 6f745672-e7a9-435d-922b-38d5f5264d72] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:25.429286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.429741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.430529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:25.430964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:25.470498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] HTTP exception thrown: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Request method failure captured: Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 HTTP/1.1 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f6MIKCp9ufHHcx8FRsTQTT_Y71USHPwLLy4o5MJMFv8hcHV71WRaRGqn7rXACDzTlOtt2AvJx39bzVkW4-zIyjecJpCLQWNU2SPtLXwL_k_jzSmnEZiT2v-evvVcDGkde8cnZf5-_qiLfVWtakj7g98qU24Dt9yq2EA5ra9so-9qOA Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Openstack-Nova-Api-Version: 2.32 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/90277125790c4575a67d25fff89029ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_90277125790c4575a67d25fff89029ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/90277125790c4575a67d25fff89029ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 90277125790c4575a67d25fff89029ae Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TaggedBootDevicesTest-899242056 Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c278da47fdac47af94ed8d402bc76faf Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TaggedBootDevicesTest-899242056-project Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6f745672-e7a9-435d-922b-38d5f5264d72'} Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:25.477735 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. Aug 03 04:58:25.482377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:25.489887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] Returning 404 to user: Instance 6f745672-e7a9-435d-922b-38d5f5264d72 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:25.489887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c45efb15-efc4-46a7-bba0-dce73bbab96d tempest-TaggedBootDevicesTest-899242056 tempest-TaggedBootDevicesTest-899242056-project] 10.222.0.72 "GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72" status: 404 len: 111 microversion: 2.32 time: 0.085908 Aug 03 04:58:25.490653 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2774/5567] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 04:58:25 2022] GET /compute/v2.1/servers/6f745672-e7a9-435d-922b-38d5f5264d72 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:58:25.679903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:25.716572 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7befd9cc-c408-4251-8166-65b1c0456293 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1518 microversion: 2.1 time: 0.620862 Aug 03 04:58:25.723170 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2794/5568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:25 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1518 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:26.743831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:26.745339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:26.761607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:26.762174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:26.764382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:26.767833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:27.555960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:27.582783 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa85a2c0-0de1-4680-b6b5-a1af677842a9 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.843551 Aug 03 04:58:27.583898 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2775/5569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:26 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:27.605851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:27.606388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:27.621651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:27.622329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:27.623214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:27.624100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:28.020258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:28.032949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69f74884-622d-4cec-8383-7c14e08082a4 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.431803 Aug 03 04:58:28.033855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2795/5570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:27 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:28.067709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:28.068445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:28.100408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:28.102131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:28.116061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:28.119682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:28.595113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:28.609802 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c288a64-b961-4211-8295-e88fd99cff19 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.540838 Aug 03 04:58:28.611154 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2776/5571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:28 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:28.632521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d93f76b-d827-48c4-be7f-57509ee6b770 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:28.643974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7d93f76b-d827-48c4-be7f-57509ee6b770 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d93f76b-d827-48c4-be7f-57509ee6b770 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/5eaf120f-3880-403c-b919-92cb1b1401cb/action HTTP/1.1 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 15 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: {"os-stop": {}} Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '5eaf120f-3880-403c-b919-92cb1b1401cb', 'body': {'os-stop': {}}} Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 03 04:58:28.651288 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. Aug 03 04:58:28.657565 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:28.660024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d93f76b-d827-48c4-be7f-57509ee6b770 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 5eaf120f-3880-403c-b919-92cb1b1401cb has no mapping to a cell. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:28.661215 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d93f76b-d827-48c4-be7f-57509ee6b770 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/5eaf120f-3880-403c-b919-92cb1b1401cb/action" status: 404 len: 117 microversion: 2.1 time: 0.033286 Aug 03 04:58:28.666345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2796/5572] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:28 2022] POST /compute/v2.1/servers/5eaf120f-3880-403c-b919-92cb1b1401cb/action => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:58:28.670900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:28.671655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:28.695057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:28.695519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:28.696347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:28.696799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:29.118831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:29.129674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9dabfaca-770f-47e8-941c-4730ccfe4998 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.462662 Aug 03 04:58:29.144680 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2777/5573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:28 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:29.156605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:29.157534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:29.179845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:29.180454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:29.181204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:29.181548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:29.579696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:29.587712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5bfbfa3b-5648-4583-a85d-59ec57150f13 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.436062 Aug 03 04:58:29.588715 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2797/5574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:29.614029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:29.614823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 242b42aa-cb24-4ffa-8d1c-dc053cc36d11] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:29.622556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/242b42aa-cb24-4ffa-8d1c-dc053cc36d11/action HTTP/1.1 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: {"suspend": {}} Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '242b42aa-cb24-4ffa-8d1c-dc053cc36d11', 'body': {'suspend': {}}} Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:29.624959 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:29.630524 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:29.630524 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:29.630524 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:29.630524 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. Aug 03 04:58:29.630524 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:29.652349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 242b42aa-cb24-4ffa-8d1c-dc053cc36d11 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:29.656193 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb687713-e94a-4df8-a52a-b8476b38ba18 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/242b42aa-cb24-4ffa-8d1c-dc053cc36d11/action" status: 404 len: 111 microversion: 2.1 time: 0.048938 Aug 03 04:58:29.668576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:29.674794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:29.683098 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2778/5575] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:29 2022] POST /compute/v2.1/servers/242b42aa-cb24-4ffa-8d1c-dc053cc36d11/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:58:29.692487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:29.693228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:29.694294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:29.698679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:30.205715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:30.221527 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0c7b5db-6cc8-44f0-b7bf-a18add14bcd3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.557507 Aug 03 04:58:30.222357 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2798/5576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:29 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:30.249368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:30.250020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:30.265039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:30.265570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:30.266413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:30.266870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:30.822855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:30.829287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:30.836488 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e68dda67-c245-40b1-ac75-981f6c4eb258 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.591262 Aug 03 04:58:30.839365 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2779/5577] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:30 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:30.868908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:30.870309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:30.888079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:30.896651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:30.897834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:30.898408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:30.963626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lazy-loading 'flavor' on Instance uuid dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:58:31.551369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-57012fd5-6581-4475-99e4-44adc8cd6474 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.691796 Aug 03 04:58:31.552441 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2799/5578] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:30 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:58:31.560653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:31.562170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:31.570032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:31.570751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:31.571685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:31.572307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:31.825774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:31.838842 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0573a00-b84b-4ca1-a315-939064862593 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1513 microversion: 2.1 time: 0.282021 Aug 03 04:58:31.839919 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2780/5579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:31 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1513 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:32.889656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:32.892028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:32.901280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:32.902054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:32.903075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:32.903706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:33.582857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:33.597494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-87ea96ed-8eb5-4139-95bb-b15ce66c8307 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1496 microversion: 2.1 time: 0.739554 Aug 03 04:58:33.601381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2800/5580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:32 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1496 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:33.624237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:33.624981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:33.642511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:33.643128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:33.644029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:33.644785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:33.703068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lazy-loading 'flavor' on Instance uuid dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:58:33.725754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'suspend' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state suspended Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: {"suspend": {}} Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: exception: Cannot 'suspend' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state suspended Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'suspend': {}}} Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state suspended. Cannot suspend while the instance is in this state. Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:33.727381 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state suspended Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state suspended Aug 03 04:58:33.734542 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:33.747400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'suspend' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state suspended {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:33.747400 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e7523d6-0aa5-4daa-8f8e-b3219a7856bc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 148 microversion: 2.1 time: 0.120281 Aug 03 04:58:33.747400 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2781/5581] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:33 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 148 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:58:33.753271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:33.753950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:33.765397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:33.766771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:33.767872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:33.770114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:34.172252 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d5224bd-6dc5-4fa6-9420-c5bd606b61df tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 202 len: 0 microversion: 2.1 time: 0.422948 Aug 03 04:58:34.174256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2801/5582] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:33 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:58:34.181862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:34.182487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:34.199534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:34.199993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:34.201231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:34.202147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:35.045012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:35.056549 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0d5daaf-18f4-4398-a774-f6f9c3be8a37 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1502 microversion: 2.1 time: 0.877399 Aug 03 04:58:35.070974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2782/5583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:34 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1502 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:36.080720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:36.081429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:36.099395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:36.100150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:36.101149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:36.101754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:36.612304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:36.617648 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ff8b87b-ea41-4ff2-9dc0-c1071bb306b6 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1502 microversion: 2.1 time: 0.542178 Aug 03 04:58:36.640699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2802/5584] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:36 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1502 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:37.642663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:37.646092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:37.659988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:37.662204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:37.663061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:37.663501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:38.119174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:38.129580 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ca44d4d-6b11-4453-b69a-800a6b5e78f1 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.493232 Aug 03 04:58:38.144891 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2783/5585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:37 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:38.171199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:38.171832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:38.185680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:38.190538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:38.190538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:38.190538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.019677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:39.037903 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ea421b1-87cb-4290-a123-f3f74128fabc tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.885385 Aug 03 04:58:39.045620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2803/5586] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:38 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:39.065060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:39.066263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:39.073502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d/action HTTP/1.1 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 15 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: {"unpause": {}} Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d', 'body': {'unpause': {}}} Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.075424 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:39.081934 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:39.081934 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:39.081934 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:39.081934 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. Aug 03 04:58:39.081934 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.083445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:39.084550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac5d1ddd-bb67-4ccf-aea4-fb02998d64ea tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d/action" status: 404 len: 111 microversion: 2.1 time: 0.023499 Aug 03 04:58:39.094534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:39.095165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:39.099859 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2784/5587] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:39 2022] POST /compute/v2.1/servers/1f3ff884-4cbe-4f00-a01f-c91fc8fbeb2d/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:58:39.101696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.102159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.103125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.103531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.108202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:39.443489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:39.444250 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b846886-34a9-4efb-9220-6862991599d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.353866 Aug 03 04:58:39.448677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2804/5588] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:39.468028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:39.468603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:39.475826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.476303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.477094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.477532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.703891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:39.715800 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c0700a13-11c3-4335-838c-6bd1c013467a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.252370 Aug 03 04:58:39.717772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2785/5589] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:39.741396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:39.741961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:39.750359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.750820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.751602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.752045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.795640 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'unpause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 15 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: {"unpause": {}} Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'unpause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'unpause': {}}} Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state active. Cannot unpause while the instance is in this state. Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.806015 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:39.812783 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:39.815364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'unpause' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:39.816695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efce68fc-1138-4947-86e1-7eb9ba24691f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 145 microversion: 2.1 time: 0.082633 Aug 03 04:58:39.821703 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2805/5590] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:39 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:58:39.826729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:39.827958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:39.834702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.835512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:39.836491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:39.837099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:40.486922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:40.510502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-45a60b73-1bed-490a-9246-bddb7564d40b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.688136 Aug 03 04:58:40.521218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2786/5591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:39 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:40.549268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:40.550062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:40.553858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:40.572682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:40.572682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:40.572682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:40.572682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:41.297998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:41.310004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d0428b0-363f-4e32-8a10-2c56b2d87c80 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.764014 Aug 03 04:58:41.312413 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2806/5592] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:40 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:41.354718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:41.355702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: f6fe75e7-8349-48fc-9759-2347779df5b8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:41.365534 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/f6fe75e7-8349-48fc-9759-2347779df5b8/action HTTP/1.1 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 18 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: {"unshelve": null} Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f6fe75e7-8349-48fc-9759-2347779df5b8', 'body': {'unshelve': None}} Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. Aug 03 04:58:41.373942 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. Aug 03 04:58:41.378572 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:41.380977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance f6fe75e7-8349-48fc-9759-2347779df5b8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:41.382167 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdc6c320-25a1-47c5-91de-55b546381f29 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/f6fe75e7-8349-48fc-9759-2347779df5b8/action" status: 404 len: 111 microversion: 2.1 time: 0.031556 Aug 03 04:58:41.383290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2787/5593] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:41 2022] POST /compute/v2.1/servers/f6fe75e7-8349-48fc-9759-2347779df5b8/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:58:41.393809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:41.399714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:41.406702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:41.407442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:41.408482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:41.412870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:41.956916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:41.983304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69a25e6d-6db9-4920-89c8-13bc46193dbb tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.593545 Aug 03 04:58:41.989942 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2807/5594] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:41 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:58:42.032038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:42.032814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:42.050936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:42.055086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:42.056081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:42.060282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:42.846773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:42.860168 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19b3cdbc-a9af-49dd-9cc3-4fbbbc07c04c tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.831771 Aug 03 04:58:42.861416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2788/5595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:42 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:42.885716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:42.886330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:42.904648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:42.905107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:42.912209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:42.912845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:43.050426 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Cannot 'unshelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action HTTP/1.1 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 18 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: {"unshelve": null} Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: exception: Cannot 'unshelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'unshelve': None}} Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f in vm_state active. Cannot unshelve while the instance is in this state. Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 03 04:58:43.055961 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 409 to user: Cannot 'unshelve' instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f while it is in vm_state active {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f8c5a9c-4925-4f1f-b785-c4c480c24a8e tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action" status: 409 len: 146 microversion: 2.1 time: 0.172479 Aug 03 04:58:43.063269 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2808/5596] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 04:58:42 2022] POST /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f/action => generated 146 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 04:58:43.065694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:43.065694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:43.078383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:43.080350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:43.081541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:43.090223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.013919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:44.024747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9723a70b-e028-4b5c-961c-3ef795109943 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.966266 Aug 03 04:58:44.039961 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2789/5597] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:43 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:44.049363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:44.051778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:44.061980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.062437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.063219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.063895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.472581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:44.481362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2177aa5-a949-4419-8f79-67b7e0aeca34 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.435890 Aug 03 04:58:44.483213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2809/5598] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:44 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:44.507044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-528734559_updated"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:44.509514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 8041cefb-0de4-4492-803d-9bccedddea3a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:44.519575 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/servers/8041cefb-0de4-4492-803d-9bccedddea3a HTTP/1.1 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 80 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-528734559_updated"}} Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8041cefb-0de4-4492-803d-9bccedddea3a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-528734559_updated'}}} Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 03 04:58:44.523124 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. Aug 03 04:58:44.528215 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:44.532558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 8041cefb-0de4-4492-803d-9bccedddea3a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:44.533627 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d04cd36-9f34-4a6f-821c-7bee134a9a03 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "PUT /compute/v2.1/servers/8041cefb-0de4-4492-803d-9bccedddea3a" status: 404 len: 111 microversion: 2.1 time: 0.031503 Aug 03 04:58:44.543765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:44.545786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:44.550914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2790/5599] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:58:44 2022] PUT /compute/v2.1/servers/8041cefb-0de4-4492-803d-9bccedddea3a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:58:44.554187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.554737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.555809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.556459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.780556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:44.791623 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-259b819b-de4c-4a48-bfc8-73d5bbca44d0 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.252551 Aug 03 04:58:44.792443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2810/5600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:44 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:44.817910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:44.818737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:44.826734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.829633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:44.829633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:44.829633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:45.121953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:45.141719 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fda2b69d-f40c-40ac-9f7f-1463ef66f144 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.327495 Aug 03 04:58:45.168399 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2791/5601] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:44 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:45.170492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03bbcc75-a479-4999-ac86-0b4d56d4174d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03bbcc75-a479-4999-ac86-0b4d56d4174d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: request: PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f HTTP/1.1 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 280 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:45.174495 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03bbcc75-a479-4999-ac86-0b4d56d4174d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03bbcc75-a479-4999-ac86-0b4d56d4174d tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 400 len: 619 microversion: 2.1 time: 0.010206 Aug 03 04:58:45.181879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2811/5602] 10.222.0.72 () {60 vars in 1257 bytes} [Wed Aug 3 04:58:45 2022] PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:58:45.206531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:45.207414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:45.218479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:45.219095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:45.220301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:45.220972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:45.594821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:45.605952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dcf61470-d08f-4723-be8b-45677d567440 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.415789 Aug 03 04:58:45.619608 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2792/5603] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:45 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:45.652912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:45.652912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:45.669040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:45.670399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:45.671200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:45.671648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:45.926000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:45.939210 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1642813-8ed6-4213-9144-2f8595bf6830 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.300207 Aug 03 04:58:45.940181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2812/5604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:45 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:45.971315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc52ae37-5ea3-4c6a-9a64-8af44175f8cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc52ae37-5ea3-4c6a-9a64-8af44175f8cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: request: PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f HTTP/1.1 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 24 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: {"server": {"name": ""}} Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f', 'body': {'server': {'name': ''}}} Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '' Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 04:58:45.978293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc52ae37-5ea3-4c6a-9a64-8af44175f8cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc52ae37-5ea3-4c6a-9a64-8af44175f8cf tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 400 len: 108 microversion: 2.1 time: 0.014424 Aug 03 04:58:45.988525 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2793/5605] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 04:58:45 2022] PUT /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:58:45.990534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:45.991154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:46.000062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:46.000540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:46.004744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:46.005217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:46.214904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:46.224087 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-862ded27-ad2d-4744-a8a7-b5f6c7842bb3 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1505 microversion: 2.1 time: 0.237309 Aug 03 04:58:46.224845 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2813/5606] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:45 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:55.312050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:55.313215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:55.318640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=47 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:55.352240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:55.355590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:55.358351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:55.367904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:55.479785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-083a1b7a-37aa-45df-9433-b70af2bf47b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/ips" status: 200 len: 149 microversion: 2.1 time: 0.171794 Aug 03 04:58:55.481123 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2794/5607] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 04:58:55 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/ips => generated 149 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:58:56.421352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:56.422594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:56.443749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:56.446415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=49 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:58:56.448048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.448606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.453226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.457525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.555004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 HTTP/1.1 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '54596db8-90c9-4687-a640-3f2188c69920'} Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:56.556701 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:56.562740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bea6ca1b-7e0f-4347-98c6-08068d975a0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 404 len: 111 microversion: 2.1 time: 0.141267 Aug 03 04:58:56.567709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:56.568375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: 54596db8-90c9-4687-a640-3f2188c69920] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:56.586856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.587324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.595451 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2814/5608] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:58:56 2022] DELETE /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:58:56.607814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.608353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.672176 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 HTTP/1.1 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '54596db8-90c9-4687-a640-3f2188c69920'} Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.674084 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance 54596db8-90c9-4687-a640-3f2188c69920 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ed9977e-ec12-4de5-bccb-9b41a6da6374 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920" status: 404 len: 111 microversion: 2.1 time: 0.116637 Aug 03 04:58:56.685410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2795/5609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:56 2022] GET /compute/v2.1/servers/54596db8-90c9-4687-a640-3f2188c69920 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 04:58:56.691183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:56.692131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:56.706353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.707772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.712996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:56.725046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:56.798495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:58:57.407722 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88ea6161-c4f8-4ad0-b418-908d53868649 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "DELETE /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 204 len: 0 microversion: 2.1 time: 0.720263 Aug 03 04:58:57.412147 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2815/5610] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:58:56 2022] DELETE /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:58:57.418253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:57.419123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:57.434829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:57.440329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:57.441531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:57.446643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:58.211755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:58:58.225556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d001bfa-9fba-4678-a0be-15596bd05295 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.812034 Aug 03 04:58:58.226852 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2796/5611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:57 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:58:59.248590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:58:59.249946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:58:59.271313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:59.271993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:58:59.273025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:58:59.273645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:00.098024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ec3739-7f27-489c-b446-2e34f5ab8d17"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:00.102667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:00.131704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:00.141887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:00.141887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:00.141887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:00.433663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:00.443220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dca45ff1-311a-4a5d-8688-40fb15331c0f tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 1.199897 Aug 03 04:59:00.444140 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2816/5612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:58:59 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:01.469322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:01.470670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:01.486366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:01.487284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:01.490758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:01.491453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:01.585502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6e2921e-01c4-4605-8629-0abc6d6cdcec tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.491652 Aug 03 04:59:01.595454 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2797/5613] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:59:00 2022] POST /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 194 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:02.093811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:02.103353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f2a6cea4-bc1e-4649-bc3a-c01246ed2fa2 tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1511 microversion: 2.1 time: 0.640267 Aug 03 04:59:02.108982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2817/5614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:01 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:02.816031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e2ca3491-7fac-4bd2-b792-b80c0e4f9953 req-ccdf2b83-f4ab-4606-b07b-b898d8c3b2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f", "name": "network-vif-deleted", "tag": "f97ad12a-6967-4a98-8d71-8fe1cfb5e6da"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:02.877544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2ca3491-7fac-4bd2-b792-b80c0e4f9953 req-ccdf2b83-f4ab-4606-b07b-b898d8c3b2d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:02.877997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2ca3491-7fac-4bd2-b792-b80c0e4f9953 req-ccdf2b83-f4ab-4606-b07b-b898d8c3b2d6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:02.951108 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e2ca3491-7fac-4bd2-b792-b80c0e4f9953 req-ccdf2b83-f4ab-4606-b07b-b898d8c3b2d6 service nova] Creating event network-vif-deleted:f97ad12a-6967-4a98-8d71-8fe1cfb5e6da for instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f on n-h2-826756-5 Aug 03 04:59:02.987673 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e2ca3491-7fac-4bd2-b792-b80c0e4f9953 req-ccdf2b83-f4ab-4606-b07b-b898d8c3b2d6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172470 Aug 03 04:59:02.988693 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2798/5615] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:59:03.141296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:03.142035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:03.162641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:03.163398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:03.166793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:03.167583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:03.544851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf21b3734764c4a839df9af9c07d3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e2a698ebeb94cd2a6237bd97fed5423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:03.566332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ebcf40c0-c969-4bce-b190-a8cf0c44526b tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 200 len: 1302 microversion: 2.1 time: 0.421362 Aug 03 04:59:03.568241 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2818/5616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:03 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 1302 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:04.602467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:04.603331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] [instance: dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:04.632379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:04.634168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:04.635161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:04.636649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:04.661545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:04.714382 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] HTTP exception thrown: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Request method failure captured: Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f HTTP/1.1 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-7VPtqdKg01GGl0tRbMjxTlsstMsOJFQrnbXOGjuMWQ0yEEyf8AyFUc_MjFPZoieEODqqmt8GSNFHnLifaf-Z3-tenCvdNTRvgkd8XVxV8Ft5qfbHs7KueyxY6Tu1y2o6IvaAOycpQLZrg_2Y5PbVO6KSBYp1xM17mMSuLYkAeJ4E Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "tempest-ServicesTestJSON-Type-1374285472", "name": "tempest-ServicesTestJSON-Service-141560330", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1e2a698ebeb94cd2a6237bd97fed5423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1e2a698ebeb94cd2a6237bd97fed5423 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1841579477 Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 2bf21b3734764c4a839df9af9c07d3eb Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-1841579477-project Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f'} Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. Aug 03 04:59:04.717040 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] Returning 404 to user: Instance dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:59:04.722324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-38e397d9-b1f5-452e-85ed-ef623003406a tempest-ServersNegativeTestJSON-1841579477 tempest-ServersNegativeTestJSON-1841579477-project] 10.222.0.72 "GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f" status: 404 len: 111 microversion: 2.1 time: 0.121827 Aug 03 04:59:04.724815 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2799/5617] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:04 2022] GET /compute/v2.1/servers/dedfa0ca-d00a-494b-acb3-e9e84d4bdd6f => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:59:20.960324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ec3739-7f27-489c-b446-2e34f5ab8d17"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:20.964433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:20.968171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:20.969175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:20.977108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:20.982006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:20.982006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:20.982006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:21.103208 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments HTTP/1.1 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 74 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: {"volumeAttachment": {"volumeId": "19ec3739-7f27-489c-b446-2e34f5ab8d17"}} Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': 'c1e5d994-12c8-4f47-8f63-ca9780c98127', 'body': {'volumeAttachment': {'volumeId': '19ec3739-7f27-489c-b446-2e34f5ab8d17'}}} Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:59:21.105555 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 400 to user: Invalid volume: volume 19ec3739-7f27-489c-b446-2e34f5ab8d17 is already attached to instances: c1e5d994-12c8-4f47-8f63-ca9780c98127 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75e2ae37-8347-477d-9202-74f83b3626e3 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152215 Aug 03 04:59:21.118696 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2819/5618] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 04:59:20 2022] POST /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 04:59:21.241773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:21.242379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:21.249831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:21.251370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:21.251934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:21.252898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:21.254339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:21.534198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'services' on Instance uuid c1e5d994-12c8-4f47-8f63-ca9780c98127 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:59:22.033477 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-787776ea-bccc-4f9a-8fb1-9ef79a6f7e41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments/19ec3739-7f27-489c-b446-2e34f5ab8d17" status: 202 len: 0 microversion: 2.1 time: 0.795812 Aug 03 04:59:22.034106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2800/5619] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 04:59:21 2022] DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments/19ec3739-7f27-489c-b446-2e34f5ab8d17 => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:59:22.044908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:22.048561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:22.075696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:22.081999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:22.081999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:22.081999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:22.144947 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40a8d27f-7f4c-4417-9909-45666cb8c098 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105335 Aug 03 04:59:22.151268 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2820/5620] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:22 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:23.162722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:23.169424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:23.190678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:23.193102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:23.194408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:23.195878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:23.313194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73e48be2-e869-498b-9fcb-c75fe87155f7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157752 Aug 03 04:59:23.317961 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2801/5621] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:23 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:23.802540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee95374c-bd7d-43ac-9cda-d19b7efa7b84 tempest-ExtensionsTest-1540804841 tempest-ExtensionsTest-1540804841-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:23.804459 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee95374c-bd7d-43ac-9cda-d19b7efa7b84 tempest-ExtensionsTest-1540804841 tempest-ExtensionsTest-1540804841-project] 10.222.0.72 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.236410 Aug 03 04:59:23.805009 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2821/5622] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:59:23 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:23.815482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d35e8bb3-dd76-458c-9760-90187b71eb79 tempest-ExtensionsTest-1540804841 tempest-ExtensionsTest-1540804841-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:23.836512 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d35e8bb3-dd76-458c-9760-90187b71eb79 tempest-ExtensionsTest-1540804841 tempest-ExtensionsTest-1540804841-project] 10.222.0.72 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007684 Aug 03 04:59:23.836512 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2802/5623] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 3 04:59:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 04:59:24.339916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:24.355622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:24.388688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:24.390026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:24.390944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:24.392561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:24.466697 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e88aeec-53be-446e-8fff-b1b6cc75e17a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143987 Aug 03 04:59:24.472819 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2822/5624] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:24 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:25.482283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:25.487401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:25.529089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:25.529550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:25.538991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:25.553437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:25.637498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40764b7b-c330-4cfe-a42b-590b3935317f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160685 Aug 03 04:59:25.649715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2803/5625] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:25 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:26.658090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:26.661306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:26.691963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:26.714357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:26.721869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:26.724548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:26.852084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22e6c5f4-63c1-4fe1-90e6-8881802a65dc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198369 Aug 03 04:59:26.872002 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2823/5626] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:26 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:27.887374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:27.887374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:27.916223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:27.920572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:27.920572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:27.920572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:27.984650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b4286b1-8d94-4c90-9bb5-5cec858f212c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109345 Aug 03 04:59:27.988486 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2804/5627] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:27 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:29.003378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:29.005546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:29.028669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:29.034030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:29.035231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:29.037242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:29.122944 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2baeddd7-b4f8-48d4-8677-812052d8738d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124885 Aug 03 04:59:29.132926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2824/5628] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:28 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:30.136473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:30.140416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:30.168827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:30.179798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:30.183676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:30.184512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:30.311028 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8150866d-a306-4c4b-8aa2-a330442f49b0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176646 Aug 03 04:59:30.312833 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2805/5629] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:30 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:31.733583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:31.750160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:31.767557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:31.768448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:31.769654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:31.770613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:31.824161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f608c0d-8740-4722-a09e-737ceb78f3b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.504399 Aug 03 04:59:31.826424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2825/5630] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:31 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:32.841987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:32.845311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:32.855168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:32.856039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:32.857102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:32.857775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:32.895648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-32dad66b-a932-490a-9bb4-775d86baedca tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060804 Aug 03 04:59:32.897037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2806/5631] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:32 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:33.941232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:33.945211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:33.970688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:33.971512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:33.972624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:33.974431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:34.048357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d97e7aec-a38a-487a-9a96-255760722a3a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134881 Aug 03 04:59:34.048357 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2826/5632] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 04:59:33 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 04:59:34.164391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:34.165675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:34.174180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:34.175277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:34.177073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:34.177677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:34.216721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 04:59:34.779175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15c48592-9f1a-4566-ac15-e85299bb0d63 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 204 len: 0 microversion: 2.1 time: 0.618623 Aug 03 04:59:34.783605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2807/5633] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 04:59:34 2022] DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:59:34.800956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:34.802633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:34.811468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:34.812322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:34.813502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:34.814464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:35.174425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:35.186901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49d839f5-bd9e-4929-8ef2-3f38b55cbc3b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1681 microversion: 2.1 time: 0.396655 Aug 03 04:59:35.194852 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2827/5634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:34 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:35.254374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-031cac15-c00c-4d3f-8118-ae968dff05cc tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd47346b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:35.361282 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-031cac15-c00c-4d3f-8118-ae968dff05cc tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dbaa1932-875d-4dc5-a443-9230c117bacd" status: 200 len: 350 microversion: 2.1 time: 0.111313 Aug 03 04:59:35.361870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2808/5635] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:59:35 2022] GET /compute/v2.1/os-volumes/dbaa1932-875d-4dc5-a443-9230c117bacd => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:36.218757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:36.219493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:36.232440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:36.238430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:36.238430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:36.238430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:36.606958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:36.621686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb29dff1-e806-4938-9a73-5901f634c393 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1681 microversion: 2.1 time: 0.406840 Aug 03 04:59:36.622191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2828/5636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:36 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1681 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:37.698293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:38.299487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:38.311061 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3c71b6df-0755-43f8-b59e-71b2eebacd1f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1681 microversion: 2.1 time: 0.664097 Aug 03 04:59:38.312967 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2809/5637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:37 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1681 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:38.778798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7ea5473-fe54-4466-bd12-6c9c48ebaeff tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd5475c940>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:38.852423 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7ea5473-fe54-4466-bd12-6c9c48ebaeff tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5ad10606-a76f-4213-98dc-bf7a4402ba8c" status: 200 len: 351 microversion: 2.1 time: 0.077729 Aug 03 04:59:38.853943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2829/5638] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:59:38 2022] GET /compute/v2.1/os-volumes/5ad10606-a76f-4213-98dc-bf7a4402ba8c => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:39.339699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:39.340810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:39.352597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:39.394034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:39.394034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:39.394034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:39.471177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:39.482872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c643fd5b-3c0c-4f02-a648-99c02be2692f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1613 microversion: 2.1 time: 0.149224 Aug 03 04:59:39.484157 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2810/5639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:39 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:40.401635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4aacf4c2-2aec-4c33-a1d6-a413db87d63e req-7e6e8e04-53b1-4f99-bc90-40a0859b4e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e5d994-12c8-4f47-8f63-ca9780c98127", "name": "network-vif-deleted", "tag": "ecc3ea10-7145-46fb-8872-0891302f7585"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:40.422276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4aacf4c2-2aec-4c33-a1d6-a413db87d63e req-7e6e8e04-53b1-4f99-bc90-40a0859b4e05 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:40.425029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4aacf4c2-2aec-4c33-a1d6-a413db87d63e req-7e6e8e04-53b1-4f99-bc90-40a0859b4e05 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:40.455167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4aacf4c2-2aec-4c33-a1d6-a413db87d63e req-7e6e8e04-53b1-4f99-bc90-40a0859b4e05 service nova] Creating event network-vif-deleted:ecc3ea10-7145-46fb-8872-0891302f7585 for instance c1e5d994-12c8-4f47-8f63-ca9780c98127 on n-h2-826756-5 Aug 03 04:59:40.462689 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4aacf4c2-2aec-4c33-a1d6-a413db87d63e req-7e6e8e04-53b1-4f99-bc90-40a0859b4e05 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064269 Aug 03 04:59:40.465526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2830/5640] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 04:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:40.510233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:40.511007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:40.532228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:40.533135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:40.534316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:40.534932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:40.721700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:40.733902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa05062a-7a8d-4cf3-8af5-ceee0bf04825 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1613 microversion: 2.1 time: 0.225164 Aug 03 04:59:40.734614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2811/5641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:40 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1613 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:41.763535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:41.767391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:41.779118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:41.785231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:41.786486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:41.787174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:41.952737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:41.954858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:41.956897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'fault' on Instance uuid c1e5d994-12c8-4f47-8f63-ca9780c98127 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 04:59:42.323879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:42.337486 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7fcb91dd-6c2f-42dd-9f8f-af0614dcd981 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 200 len: 1331 microversion: 2.1 time: 0.579901 Aug 03 04:59:42.339285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2831/5642] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:41 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 1331 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:43.295498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71c2f582-6172-408e-873a-4ee019e509c0 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd47502700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.363586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.364783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:43.375140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71c2f582-6172-408e-873a-4ee019e509c0 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8b8bd577-086b-4290-a221-8c047fc5262c" status: 200 len: 351 microversion: 2.1 time: 0.089484 Aug 03 04:59:43.375735 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2812/5643] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/os-volumes/8b8bd577-086b-4290-a221-8c047fc5262c => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:43.385489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:43.387699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:43.389321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c79834db-9c98-4b55-9cd1-5dc785340929 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd47346d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.391786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:43.405036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:43.470008 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 HTTP/1.1 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c1e5d994-12c8-4f47-8f63-ca9780c98127'} Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 04:59:43.472531 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 04:59:43.479344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 04:59:43.480541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-548f0e4b-c60d-47a9-8939-66f01180444a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 404 len: 111 microversion: 2.1 time: 0.120708 Aug 03 04:59:43.486605 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2832/5644] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 04:59:43.507534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-25aea065-5f4e-4aab-89e5-3926a2064224 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '.version_select at 0x7fdd5497c310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.508365 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c79834db-9c98-4b55-9cd1-5dc785340929 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123290 Aug 03 04:59:43.527363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2813/5645] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:59:43.528055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a513745-f0c7-4779-beb8-756cbe0f0fff tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd4747e550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.640644 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-25aea065-5f4e-4aab-89e5-3926a2064224 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311148036" status: 202 len: 0 microversion: 2.1 time: 0.152158 Aug 03 04:59:43.640829 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2833/5646] 10.222.0.72 () {58 vars in 1221 bytes} [Wed Aug 3 04:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311148036 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 04:59:43.672114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a513745-f0c7-4779-beb8-756cbe0f0fff tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.148890 Aug 03 04:59:43.672734 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2814/5647] 10.222.0.72 () {58 vars in 1149 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:43.689842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3611d5cc-c084-4104-8324-0d8013baac63 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd54936820>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:43.862162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3611d5cc-c084-4104-8324-0d8013baac63 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.177334 Aug 03 04:59:43.863668 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2834/5648] 10.222.0.72 () {58 vars in 1134 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:43.877272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54a82834-f5b4-4647-bb38-dcefe16ee154 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd47346700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:44.083798 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54a82834-f5b4-4647-bb38-dcefe16ee154 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210714 Aug 03 04:59:44.093095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2815/5649] 10.222.0.72 () {58 vars in 1167 bytes} [Wed Aug 3 04:59:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:44.098550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3fbd6ae-ae83-4409-8f35-b779bea3ff45 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd54a65a60>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:44.268301 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3fbd6ae-ae83-4409-8f35-b779bea3ff45 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173749 Aug 03 04:59:44.269183 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2835/5650] 10.222.0.72 () {58 vars in 1170 bytes} [Wed Aug 3 04:59:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:44.286027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4da1d9f8-591d-4e4a-b10e-5f05a0ea65e2 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd47442550>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:44.481526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4da1d9f8-591d-4e4a-b10e-5f05a0ea65e2 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202047 Aug 03 04:59:44.482185 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2816/5651] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:59:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:59:44.498070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66f04e43-e16f-4e42-8dd9-0a9c48bd2341 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd54955af0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:44.738309 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66f04e43-e16f-4e42-8dd9-0a9c48bd2341 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.246881 Aug 03 04:59:44.749110 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2836/5652] 10.222.0.72 () {58 vars in 1188 bytes} [Wed Aug 3 04:59:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:44.754787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a88256f7-cb12-478a-91b1-6e2dac93e6f0 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] Calling method '.version_select at 0x7fdd475029d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:44.927051 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a88256f7-cb12-478a-91b1-6e2dac93e6f0 tempest-VolumesTestJSON-945833891 tempest-VolumesTestJSON-945833891-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.176239 Aug 03 04:59:44.938179 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2817/5653] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 04:59:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 04:59:47.387163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43c8d921-02a4-45bc-9557-d3527cc32c4a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: .version_select at 0x7fdd546e0280>, body: {"keypair": {"name": "tempest-keypair-769457721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeij6TkvKbRpSXYGly+EwGXIRDgAmqavtCYHhkvgJfRPT5IPkKU7WLYr6tL7OJ0K8efDQo+Hlg+yf147+12ihvymeZkU48bhP9uZ42cV1jNdXaPAJ19FdugKHs/Vdqe3g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:47.407693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-43c8d921-02a4-45bc-9557-d3527cc32c4a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:47.421262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-43c8d921-02a4-45bc-9557-d3527cc32c4a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:47.563354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43c8d921-02a4-45bc-9557-d3527cc32c4a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206650 Aug 03 04:59:47.564192 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2837/5654] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 04:59:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:49.121095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: .version_select at 0x7fdd473563a0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-927930659", "policies": ["affinity"]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:49.161984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:49.175940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:49.454186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:49.467421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:49.490156 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d690a399-e150-4244-8eb4-bc5306ce8a6e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.656029 Aug 03 04:59:49.498298 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2818/5655] 10.222.0.72 () {60 vars in 1174 bytes} [Wed Aug 3 04:59:48 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:49.503348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: .version_select at 0x7fdd54600550>, body: {"server_group": {"name": "tempest-server-group-2046075295", "policies": ["affinity"]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:49.551908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:49.564158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:49.821860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:49.835996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:49.888223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7801121-0ec5-48c1-afdb-69ca45681a5c tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.389507 Aug 03 04:59:49.902076 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2838/5656] 10.222.0.72 () {60 vars in 1173 bytes} [Wed Aug 3 04:59:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:49.913177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: .version_select at 0x7fdd47356820>, body: {"server_group": {"name": "tempest-server-group-2046075295", "policies": ["affinity"]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:49.993270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:50.024621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:50.261192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:50.273787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:50.349412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-452b5691-5e4f-4214-80ff-de70a69177d2 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.435199 Aug 03 04:59:50.366438 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2819/5657] 10.222.0.72 () {60 vars in 1173 bytes} [Wed Aug 3 04:59:49 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:50.391350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e84e0f51-90fa-4a0e-a7e2-7ea93ea433d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.211666 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e84e0f51-90fa-4a0e-a7e2-7ea93ea433d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/a560af91-64cb-4b4b-97d7-54a4a917def0" status: 204 len: 0 microversion: 2.1 time: 0.365587 Aug 03 04:59:51.211666 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2839/5658] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:59:50 2022] DELETE /compute/v2.1/os-server-groups/a560af91-64cb-4b4b-97d7-54a4a917def0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:59:51.223595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b0773eb9-48cf-4a39-a092-55d40a39162d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.223595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:51.223595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b0773eb9-48cf-4a39-a092-55d40a39162d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.061128 Aug 03 04:59:51.223595 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2820/5659] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:59:50 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:51.230550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-044996c4-43e4-45a1-ac71-84be5bfae56b tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.230550 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-044996c4-43e4-45a1-ac71-84be5bfae56b tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/07c60d6d-4b2d-4ce4-b2b1-1dc96af34840" status: 204 len: 0 microversion: 2.1 time: 0.377069 Aug 03 04:59:51.230550 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2840/5660] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:59:50 2022] DELETE /compute/v2.1/os-server-groups/07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:59:51.231568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18e78b26-2801-4e04-9985-5a01e928e9e8 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.238826 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18e78b26-2801-4e04-9985-5a01e928e9e8 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.034487 Aug 03 04:59:51.253130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: .version_select at 0x7fdd54712670>, body: {"server_group": {"name": "tempest-server-group-1534997358", "policies": ["affinity"]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:51.275203 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2821/5661] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:59:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:51.330599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:51.330599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:51.334556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:51.682059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:51.720166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:51.749691 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b3bade9-4e2b-49c0-a9c6-86334916ac50 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.500637 Aug 03 04:59:51.751039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2841/5662] 10.222.0.72 () {60 vars in 1173 bytes} [Wed Aug 3 04:59:51 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 04:59:51.762326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e1cdf74-6ecb-47f1-bfb0-84ccf4add211 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.934178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e1cdf74-6ecb-47f1-bfb0-84ccf4add211 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/b3b52add-1061-4aaf-a15a-61f99c8ebe7b" status: 204 len: 0 microversion: 2.1 time: 0.168732 Aug 03 04:59:51.934178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2822/5663] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:59:51 2022] DELETE /compute/v2.1/os-server-groups/b3b52add-1061-4aaf-a15a-61f99c8ebe7b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:59:51.938993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3939296-3e0c-4956-8f21-1ecf5f0b67eb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:51.983133 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3939296-3e0c-4956-8f21-1ecf5f0b67eb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.038344 Aug 03 04:59:51.984171 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2842/5664] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:59:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:51.996965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: .version_select at 0x7fdd47368d30>, body: {"server_group": {"name": "tempest-server-group-2033637264", "policies": ["anti-affinity"]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:52.066107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:52.090828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:52.107692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:52.304981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:52.327805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_groups'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:52.365229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8768715-5d92-41fb-bc1f-3af7741ee716 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.370156 Aug 03 04:59:52.368143 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2823/5665] 10.222.0.72 () {60 vars in 1173 bytes} [Wed Aug 3 04:59:51 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:52.376663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7a29a6b-f176-4603-b5bb-fce1e3fc13a5 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:52.543764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7a29a6b-f176-4603-b5bb-fce1e3fc13a5 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/cf73bc5a-fb97-4354-9859-4be8c6bae18c" status: 204 len: 0 microversion: 2.1 time: 0.170965 Aug 03 04:59:52.544679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2843/5666] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 04:59:52 2022] DELETE /compute/v2.1/os-server-groups/cf73bc5a-fb97-4354-9859-4be8c6bae18c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 04:59:52.552628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d7a3c98b-28a9-451f-b288-afbb47947045 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:52.573727 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d7a3c98b-28a9-451f-b288-afbb47947045 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.024938 Aug 03 04:59:52.590550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2824/5667] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 04:59:52 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 04:59:52.906468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1426156128", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "16aebb9a-0982-4434-87da-0ed48fde0078"}]}, "os:scheduler_hints": {"group": "5c4d03e2-9136-44b6-946c-6c64311e3613"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:53.096316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] validate_networks() for [('16aebb9a-0982-4434-87da-0ed48fde0078', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:59:53.466088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=66 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 04:59:55.496671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:59:55.497209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:59:55.497571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:59:55.497986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:59:55.498595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:59:55.531979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:55.533638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:55.536062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:55.537009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:55.561035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:55.568698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:55.597037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:59:55.600838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:59:55.811401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:55.835090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:56.111571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:56.130494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Getting quotas for user cfd6048acd2c4c16ab3dbbe0d66e2909 and project 392e11bfebd743b9b8425a4eb23106f2. Resources: {'server_group_members'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:56.173570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-622706269", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "112d0d14-3b17-41f3-81d4-e1328e5bdf87"}], "security_groups": [{"name": "tempest-securitygroup--1330943890"}], "key_name": "tempest-keypair-769457721", "user_data": "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 04:59:56.249610 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b719a41-05e1-4c01-9e8e-f5b26a029d0a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.347130 Aug 03 04:59:56.260249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2844/5668] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 04:59:56.270894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0f8bbfc-c770-4995-8696-55ade6566b63 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:56.278324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0f8bbfc-c770-4995-8696-55ade6566b63 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:56.607979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c0f8bbfc-c770-4995-8696-55ade6566b63 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:56.615801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0f8bbfc-c770-4995-8696-55ade6566b63 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1213 microversion: 2.1 time: 0.348744 Aug 03 04:59:56.617143 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2845/5669] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:56 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1213 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:59:56.677089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] validate_networks() for [('112d0d14-3b17-41f3-81d4-e1328e5bdf87', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 04:59:57.642734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b98dfcd-cd9e-4bb3-8e35-46230145b4a0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:57.643476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b98dfcd-cd9e-4bb3-8e35-46230145b4a0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:57.986412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b98dfcd-cd9e-4bb3-8e35-46230145b4a0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:58.003896 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b98dfcd-cd9e-4bb3-8e35-46230145b4a0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1213 microversion: 2.1 time: 0.362003 Aug 03 04:59:58.007211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2846/5670] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:57 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1213 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:59:58.721428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 04:59:58.722429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 04:59:58.723074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 04:59:58.724484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 04:59:58.724969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 04:59:58.750294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:58.750925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:58.751930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:58.755548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:58.802604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 04:59:58.802604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Getting quotas for user 5b3e1151b1b940d29986fdb32fbabd9e and project a7b0455ee1404e11a5c4fdf93cdd8b25. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 04:59:58.820014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 04:59:58.823745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 04:59:59.037100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:59.037661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:59.050449 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6c31a0f-7b9c-4033-9f00-717dd249763f tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.881513 Aug 03 04:59:59.057418 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2825/5671] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 04:59:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 04:59:59.058641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:59.059539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:59.067586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 04:59:59.070071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-622ecf75-72e5-401c-a507-1e0755dc9581 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 04:59:59.071710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-622ecf75-72e5-401c-a507-1e0755dc9581 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 04:59:59.076552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 04:59:59.404455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-622ecf75-72e5-401c-a507-1e0755dc9581 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:59.423332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 04:59:59.450211 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-622ecf75-72e5-401c-a507-1e0755dc9581 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1240 microversion: 2.1 time: 0.383239 Aug 03 04:59:59.452340 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2826/5672] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:59 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1240 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 04:59:59.454663 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6bca041a-b711-432b-9194-8fc50b764290 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1217 microversion: 2.1 time: 0.427264 Aug 03 04:59:59.457999 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2847/5673] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 04:59:59 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:00.481414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:00.481961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:00.483452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e634e24b-e67b-4006-94b9-46e73d0369fa tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:00.484696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e634e24b-e67b-4006-94b9-46e73d0369fa tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:00.513584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:00.515059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:00.516909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:00.526677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:00.570656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e634e24b-e67b-4006-94b9-46e73d0369fa tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:00.601220 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e634e24b-e67b-4006-94b9-46e73d0369fa tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1240 microversion: 2.1 time: 0.124071 Aug 03 05:00:00.604235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2827/5674] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:00 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:00.660294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:00.674384 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-246c4bf8-1f39-40b8-94c9-8f44ecbc0eed tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1265 microversion: 2.1 time: 0.200029 Aug 03 05:00:00.675041 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2848/5675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:00 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:01.628317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:01.629830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:01.644756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:01.649990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:01.651164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:01.651622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:01.708466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:01.709096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:01.735452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:01.737202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:01.738927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:01.740694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:02.265830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:02.278884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b8f7e620-4fc3-4be9-bdde-a8c186b4bdbb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1271 microversion: 2.1 time: 0.577013 Aug 03 05:00:02.282175 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2849/5676] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:01 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1271 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:02.300022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:02.323747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db2ef30b-7274-47ed-8d3a-c13bd9345a2a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1236 microversion: 2.1 time: 0.699596 Aug 03 05:00:02.324375 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2828/5677] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:01 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1236 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:03.305823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:03.306734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:03.326741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:03.327369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:03.328698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:03.329320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:03.346376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:03.347014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:03.369497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:03.369973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:03.370766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:03.378843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:03.591317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:03.601114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c418e211-dca1-49ea-81f5-52b0833a8f12 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1298 microversion: 2.1 time: 0.258469 Aug 03 05:00:03.605994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2829/5678] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:03 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:04.285304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:04.295514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5b623d2-dd19-4e58-8287-adbcff78caca tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.993989 Aug 03 05:00:04.299219 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2850/5679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:03 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:04.627174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:04.627805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:04.638427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:04.639420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:04.640822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:04.641599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:04.878798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:04.890931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15908c8b-513c-4036-aba3-0135cb009de2 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1298 microversion: 2.1 time: 0.267869 Aug 03 05:00:04.914223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2830/5680] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:04 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1298 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:05.322431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:05.323083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:05.343110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:05.345626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:05.348082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:05.350332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:05.546252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:05.931315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:05.931953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:05.947562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:05.948017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:05.948844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:05.949312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:06.002148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:06.015642 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99a88fe9-c497-4182-ac2d-948eca5d4083 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.698479 Aug 03 05:00:06.034891 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2851/5681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:05 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:06.123716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:06.137715 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47a3de53-9359-43a1-8703-5f5908a425b1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1298 microversion: 2.1 time: 0.210948 Aug 03 05:00:06.154537 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2831/5682] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:05 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:07.050601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:07.051844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:07.081581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:07.081581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:07.081581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:07.081581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:07.160487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:07.161413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:07.171799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:07.172599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:07.173689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:07.174316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:07.991617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=38 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:08.097912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:08.107704 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01fa872e-cc5e-45c3-baef-f39010f66c66 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 1.062104 Aug 03 05:00:08.109949 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2852/5683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:07 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:08.121336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6158b430-5b8c-4236-8dec-234fabfbd46d req-d32024e6-dcf8-43dc-a86e-c7e353d486ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9abc689-3192-4928-bebb-ad4d5edc9321", "tag": "240213e6-9ed7-4104-b3f3-bc5e356343bd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:08.137030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6158b430-5b8c-4236-8dec-234fabfbd46d req-d32024e6-dcf8-43dc-a86e-c7e353d486ef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:08.137946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6158b430-5b8c-4236-8dec-234fabfbd46d req-d32024e6-dcf8-43dc-a86e-c7e353d486ef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:08.151685 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6158b430-5b8c-4236-8dec-234fabfbd46d req-d32024e6-dcf8-43dc-a86e-c7e353d486ef service nova] Creating event network-changed:240213e6-9ed7-4104-b3f3-bc5e356343bd for instance a9abc689-3192-4928-bebb-ad4d5edc9321 on n-h1-826756-5 Aug 03 05:00:08.158054 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6158b430-5b8c-4236-8dec-234fabfbd46d req-d32024e6-dcf8-43dc-a86e-c7e353d486ef service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044986 Aug 03 05:00:08.159433 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2853/5684] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:08.281375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:08.302512 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9110384a-e41b-490c-9e1b-549cab9c2084 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 1.145950 Aug 03 05:00:08.303253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2832/5685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:07 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:09.137620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:09.141176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:09.158034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:09.158494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:09.163122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:09.164027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:09.323796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:09.324443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:09.337058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:09.356574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:09.357040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:09.357848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:09.358304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:10.060172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:10.070793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2aef5706-fc76-42f8-840c-9a56535bd3e7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.941861 Aug 03 05:00:10.076626 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2854/5686] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:09 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:10.194706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:10.200310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bdab8626-25fb-424a-bae2-13e3c53d80a6 req-268ef425-8973-4545-9b04-411d0bddd50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25f6738-11c2-49ce-90b0-01b3e7aad617", "tag": "cc2c23e6-71ab-48d1-9323-1725749e0763"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:10.209269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-871d0d32-62f1-4eab-89ec-a74de54003a7 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 0.890037 Aug 03 05:00:10.214193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2833/5687] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:09 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:10.217983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bdab8626-25fb-424a-bae2-13e3c53d80a6 req-268ef425-8973-4545-9b04-411d0bddd50e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:10.218440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bdab8626-25fb-424a-bae2-13e3c53d80a6 req-268ef425-8973-4545-9b04-411d0bddd50e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:10.246885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bdab8626-25fb-424a-bae2-13e3c53d80a6 req-268ef425-8973-4545-9b04-411d0bddd50e service nova] Creating event network-changed:cc2c23e6-71ab-48d1-9323-1725749e0763 for instance f25f6738-11c2-49ce-90b0-01b3e7aad617 on n-h1-826756-5 Aug 03 05:00:10.253622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bdab8626-25fb-424a-bae2-13e3c53d80a6 req-268ef425-8973-4545-9b04-411d0bddd50e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057112 Aug 03 05:00:10.257600 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2855/5688] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:00:11.098948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:11.101194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:11.105591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:11.111113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:11.115541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:11.116670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:11.124873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:11.239103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:11.240523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:11.258191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:11.262240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:11.262240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:11.262240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:11.760523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:11.769941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e41d4b3c-c549-4690-b9f4-d01b54e61ab0 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.679650 Aug 03 05:00:11.769941 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2834/5689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:11 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:11.777650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:11.791451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1da22f1-3115-4847-9bcf-3088c9afeddd tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 0.556547 Aug 03 05:00:11.792635 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2856/5690] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:11 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:12.798624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:12.803610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:12.821723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:12.823579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:12.857794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:12.867614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:12.871076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:12.871647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:12.872459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:12.875973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:12.879081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:12.884310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:13.918331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:13.934841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-83aaa6fe-278f-4fd0-ad97-1c3c35fe371a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 1.145300 Aug 03 05:00:13.937628 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2835/5691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:12 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:14.428207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:14.440475 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9d6004aa-99cf-4f82-b357-5dbb9da1c1de tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 1.629476 Aug 03 05:00:14.449057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2857/5692] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:12 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:14.965875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:14.967093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:14.982618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:14.983280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:14.985036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:14.986967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:15.236333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:15.246554 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f530708a-ef2a-47b1-a2e0-acf92d84cc31 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.285089 Aug 03 05:00:15.255363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2836/5693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:14 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:15.476468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:15.477118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:15.519229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:15.521754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:15.527395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:15.530250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:15.943500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:15.954255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-571082f1-44c7-4605-819f-c5f4067a669c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 0.482100 Aug 03 05:00:15.955057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2858/5694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:15 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:16.268328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:16.269032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:16.277524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:16.278276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:16.279177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:16.279648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:16.427095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:16.436303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ffc7378-f350-426c-a28c-c38cd2fab1ec tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.172299 Aug 03 05:00:16.437242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2837/5695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:16 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:16.979474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:16.980689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:17.002661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:17.003681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:17.008225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:17.012636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:17.313547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:17.325124 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-627c7d44-611f-489f-a098-8fc98f3d7153 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 0.350130 Aug 03 05:00:17.326649 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2859/5696] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:16 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:17.458471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:17.459787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:17.475445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:17.475445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:17.475445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:17.475445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:17.666478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6f43e4f9-458c-4d49-9b3c-5f3660e16059 req-2e456f2f-865f-4c4d-82a7-601dc0f6c267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9abc689-3192-4928-bebb-ad4d5edc9321", "name": "network-vif-plugged", "status": "completed", "tag": "240213e6-9ed7-4104-b3f3-bc5e356343bd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:17.691365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:17.696305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6f43e4f9-458c-4d49-9b3c-5f3660e16059 req-2e456f2f-865f-4c4d-82a7-601dc0f6c267 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:17.696722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6f43e4f9-458c-4d49-9b3c-5f3660e16059 req-2e456f2f-865f-4c4d-82a7-601dc0f6c267 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:17.735044 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6f43e4f9-458c-4d49-9b3c-5f3660e16059 req-2e456f2f-865f-4c4d-82a7-601dc0f6c267 service nova] Creating event network-vif-plugged:240213e6-9ed7-4104-b3f3-bc5e356343bd for instance a9abc689-3192-4928-bebb-ad4d5edc9321 on n-h1-826756-5 Aug 03 05:00:17.742715 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6f43e4f9-458c-4d49-9b3c-5f3660e16059 req-2e456f2f-865f-4c4d-82a7-601dc0f6c267 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080342 Aug 03 05:00:17.743673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2860/5697] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:17.797191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:17.808858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8add91f-0ea3-4b26-a16b-b556051c85d4 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 0.354118 Aug 03 05:00:17.813769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2838/5698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:17 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:18.363970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:18.363970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:18.380731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:18.381359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:18.382220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:18.382810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:18.831373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:18.832039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:18.852826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:18.853748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:18.856031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:18.860508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:19.800868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:19.831780 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e8845e9-5f43-4204-a623-d1e7b89140b8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 1.480867 Aug 03 05:00:19.832527 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2861/5699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:18 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:19.879260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:19.892067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d302f0ab-1bb0-4290-9e78-6a772844385f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1313 microversion: 2.1 time: 1.065466 Aug 03 05:00:19.893787 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2839/5700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:18 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1313 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:20.017246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-47ed1834-9058-4ac3-a44f-a3d37cf435ae req-2c26c45d-ee78-4ebe-ab58-453ac4aa3a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25f6738-11c2-49ce-90b0-01b3e7aad617", "name": "network-vif-plugged", "status": "completed", "tag": "cc2c23e6-71ab-48d1-9323-1725749e0763"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:20.039546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-47ed1834-9058-4ac3-a44f-a3d37cf435ae req-2c26c45d-ee78-4ebe-ab58-453ac4aa3a57 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:20.047932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-47ed1834-9058-4ac3-a44f-a3d37cf435ae req-2c26c45d-ee78-4ebe-ab58-453ac4aa3a57 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:20.077257 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-47ed1834-9058-4ac3-a44f-a3d37cf435ae req-2c26c45d-ee78-4ebe-ab58-453ac4aa3a57 service nova] Creating event network-vif-plugged:cc2c23e6-71ab-48d1-9323-1725749e0763 for instance f25f6738-11c2-49ce-90b0-01b3e7aad617 on n-h1-826756-5 Aug 03 05:00:20.091828 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-47ed1834-9058-4ac3-a44f-a3d37cf435ae req-2c26c45d-ee78-4ebe-ab58-453ac4aa3a57 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079328 Aug 03 05:00:20.092485 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2862/5701] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:20.856497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:20.857403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:20.871682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:20.875110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:20.877726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:20.878438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:20.917383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:20.918821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:20.965788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:20.966463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:20.974129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:20.977908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:21.824547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:21.899465 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd56d0bd-8ea1-4d5c-965a-020ddc534fc3 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1498 microversion: 2.1 time: 0.988571 Aug 03 05:00:21.912735 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2863/5702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:20 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1498 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:00:21.932824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7a5ffd1-b968-4237-b13e-b4638a14e09f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:21.938605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:21.954824 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84b31ded-a0b5-4236-babc-cd93ded09711 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1366 microversion: 2.1 time: 1.105155 Aug 03 05:00:21.957053 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2840/5703] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:20 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1366 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:21.972930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.server_groups [None req-c7a5ffd1-b968-4237-b13e-b4638a14e09f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Querying cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) for 1 instances {{(pid=120831) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 05:00:21.975391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffd1-b968-4237-b13e-b4638a14e09f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:21.975999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffd1-b968-4237-b13e-b4638a14e09f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:22.012851 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7a5ffd1-b968-4237-b13e-b4638a14e09f tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613" status: 200 len: 221 microversion: 2.1 time: 0.089599 Aug 03 05:00:22.014682 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2864/5704] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 05:00:21 2022] GET /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613 => generated 221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:22.027160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:22.028127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:22.035715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:22.037359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:22.038685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:22.039307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:22.134623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:00:22.763227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43d28e26-b235-4ec1-9ad4-a1d6baec59c7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 204 len: 0 microversion: 2.1 time: 0.742397 Aug 03 05:00:22.763826 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2841/5705] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:00:22 2022] DELETE /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:00:22.774037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:22.775686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:22.810622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:22.810622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:22.810622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:22.810622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:22.988619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:22.992122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:23.045571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:23.049071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:23.050199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:23.052724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:23.157032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:23.289161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:23.302942 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc5d947d-405c-4094-a5d2-0fca16f10608 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1504 microversion: 2.1 time: 0.534515 Aug 03 05:00:23.326412 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2865/5706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:22 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:23.504388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:23.512251 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ea30397-1721-4555-b611-3be85af8d8b9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1555 microversion: 2.1 time: 0.536853 Aug 03 05:00:23.520614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2842/5707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:22 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1555 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:23.540775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:23.541275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:23.572883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:23.577014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:23.577014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:23.577014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:23.639810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:23.744960 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2038dfb8-cad1-4ae0-98d5-0b4c27ac0e00 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.208788 Aug 03 05:00:23.746035 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2866/5708] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:00:23 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-interface => generated 284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:24.329428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:24.330989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:24.357098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:24.357578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:24.364985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:24.365488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:25.725749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:25.741411 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0691c9d4-60d4-4347-9b32-3bf40d7989fe tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1504 microversion: 2.1 time: 1.415351 Aug 03 05:00:25.746407 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2843/5709] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:24 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1504 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:26.293424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d6eccfc4-c5a8-47e7-8e1b-2d5298bd3b7b req-cc84b03d-054f-4b8b-8b70-b12c80a1da64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9abc689-3192-4928-bebb-ad4d5edc9321", "name": "network-vif-deleted", "tag": "240213e6-9ed7-4104-b3f3-bc5e356343bd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:26.317001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d6eccfc4-c5a8-47e7-8e1b-2d5298bd3b7b req-cc84b03d-054f-4b8b-8b70-b12c80a1da64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:26.319998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d6eccfc4-c5a8-47e7-8e1b-2d5298bd3b7b req-cc84b03d-054f-4b8b-8b70-b12c80a1da64 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:26.355692 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d6eccfc4-c5a8-47e7-8e1b-2d5298bd3b7b req-cc84b03d-054f-4b8b-8b70-b12c80a1da64 service nova] Creating event network-vif-deleted:240213e6-9ed7-4104-b3f3-bc5e356343bd for instance a9abc689-3192-4928-bebb-ad4d5edc9321 on n-h1-826756-5 Aug 03 05:00:26.365470 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d6eccfc4-c5a8-47e7-8e1b-2d5298bd3b7b req-cc84b03d-054f-4b8b-8b70-b12c80a1da64 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076009 Aug 03 05:00:26.387568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2867/5710] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:26.688503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c84845bf-e38f-4a2f-aa43-5127e28e7e6b req-9053fff3-a28d-4f37-9bf3-90e49450b5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25f6738-11c2-49ce-90b0-01b3e7aad617", "tag": "cc2c23e6-71ab-48d1-9323-1725749e0763"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:26.715084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c84845bf-e38f-4a2f-aa43-5127e28e7e6b req-9053fff3-a28d-4f37-9bf3-90e49450b5f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:26.715792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c84845bf-e38f-4a2f-aa43-5127e28e7e6b req-9053fff3-a28d-4f37-9bf3-90e49450b5f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:26.736395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c84845bf-e38f-4a2f-aa43-5127e28e7e6b req-9053fff3-a28d-4f37-9bf3-90e49450b5f6 service nova] Creating event network-changed:cc2c23e6-71ab-48d1-9323-1725749e0763 for instance f25f6738-11c2-49ce-90b0-01b3e7aad617 on n-h1-826756-5 Aug 03 05:00:26.750430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c84845bf-e38f-4a2f-aa43-5127e28e7e6b req-9053fff3-a28d-4f37-9bf3-90e49450b5f6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061593 Aug 03 05:00:26.754246 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2844/5711] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:26.768689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:26.770264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:26.782503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:26.782971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:26.783802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:26.784301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:26.855254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:26.855762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:26.859019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lazy-loading 'fault' on Instance uuid a9abc689-3192-4928-bebb-ad4d5edc9321 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:00:27.025742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd6048acd2c4c16ab3dbbe0d66e2909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '392e11bfebd743b9b8425a4eb23106f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:27.040108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-746399de-ae7c-4dbb-837e-cda37f1fd0dc tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 200 len: 1303 microversion: 2.1 time: 0.275671 Aug 03 05:00:27.058832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2868/5712] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:26 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:00:28.065411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.066590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:28.081966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.082660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.083455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.084055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 HTTP/1.1 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a9abc689-3192-4928-bebb-ad4d5edc9321'} Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:00:28.112520 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.120387 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf74b661-5ed4-47bb-baca-38f5c28b0284 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 404 len: 111 microversion: 2.1 time: 0.046159 Aug 03 05:00:28.121429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a66be4e-20df-499d-b9d8-b1b05bd0012e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.128646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2845/5713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:28 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:00:28.144223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.server_groups [None req-4a66be4e-20df-499d-b9d8-b1b05bd0012e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Querying cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) for 1 instances {{(pid=120831) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 05:00:28.148180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a66be4e-20df-499d-b9d8-b1b05bd0012e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.148180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a66be4e-20df-499d-b9d8-b1b05bd0012e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.157953 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a66be4e-20df-499d-b9d8-b1b05bd0012e tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.045415 Aug 03 05:00:28.165657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2869/5714] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 05:00:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:28.170739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82347836-acea-4444-bab4-d60a7362e15a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.193220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.server_groups [None req-82347836-acea-4444-bab4-d60a7362e15a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Querying cell 88ed4435-a3db-44bd-a042-900e396de7ba(cell1) for 1 instances {{(pid=120832) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 03 05:00:28.194160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82347836-acea-4444-bab4-d60a7362e15a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.199189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82347836-acea-4444-bab4-d60a7362e15a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.225770 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82347836-acea-4444-bab4-d60a7362e15a tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613" status: 200 len: 183 microversion: 2.1 time: 0.058623 Aug 03 05:00:28.232658 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2846/5715] 10.222.0.72 () {58 vars in 1263 bytes} [Wed Aug 3 05:00:28 2022] GET /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613 => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:28.238223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.238864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:28.247628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.248453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.249443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.250627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.271249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 HTTP/1.1 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a9abc689-3192-4928-bebb-ad4d5edc9321'} Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:00:28.273918 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.277364 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.279860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.281350 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b2ee48a6-5fa4-479d-b119-f869852deacb tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 404 len: 111 microversion: 2.1 time: 0.047098 Aug 03 05:00:28.282568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2870/5716] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:00:28.299587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.299587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] [instance: a9abc689-3192-4928-bebb-ad4d5edc9321] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:28.312738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.313285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.314164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:28.314839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:28.371312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 HTTP/1.1 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a9abc689-3192-4928-bebb-ad4d5edc9321'} Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.381212 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. Aug 03 05:00:28.389780 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.393637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance a9abc689-3192-4928-bebb-ad4d5edc9321 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.400217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53352285-8c4e-442d-bf10-e8c0736329a7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321" status: 404 len: 111 microversion: 2.1 time: 0.109190 Aug 03 05:00:28.401665 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2847/5717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:00:28 2022] GET /compute/v2.1/servers/a9abc689-3192-4928-bebb-ad4d5edc9321 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:00:28.416227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-780bb225-26c8-4922-b6b3-c66bb05e31d7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.451195 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-780bb225-26c8-4922-b6b3-c66bb05e31d7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-780bb225-26c8-4922-b6b3-c66bb05e31d7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-server-groups/cf73bc5a-fb97-4354-9859-4be8c6bae18c HTTP/1.1 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'cf73bc5a-fb97-4354-9859-4be8c6bae18c'} Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.463981 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. Aug 03 05:00:28.468010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.479395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-780bb225-26c8-4922-b6b3-c66bb05e31d7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance group cf73bc5a-fb97-4354-9859-4be8c6bae18c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.485904 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-780bb225-26c8-4922-b6b3-c66bb05e31d7 tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/cf73bc5a-fb97-4354-9859-4be8c6bae18c" status: 404 len: 117 microversion: 2.1 time: 0.075417 Aug 03 05:00:28.487743 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2871/5718] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/os-server-groups/cf73bc5a-fb97-4354-9859-4be8c6bae18c => generated 117 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:00:28.511381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f7f4db2-8f70-4c08-a474-1503f6ee63fa tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.531082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0f7f4db2-8f70-4c08-a474-1503f6ee63fa tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f7f4db2-8f70-4c08-a474-1503f6ee63fa tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-server-groups/b3b52add-1061-4aaf-a15a-61f99c8ebe7b HTTP/1.1 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'b3b52add-1061-4aaf-a15a-61f99c8ebe7b'} Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.533429 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f7f4db2-8f70-4c08-a474-1503f6ee63fa tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance group b3b52add-1061-4aaf-a15a-61f99c8ebe7b could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f7f4db2-8f70-4c08-a474-1503f6ee63fa tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/b3b52add-1061-4aaf-a15a-61f99c8ebe7b" status: 404 len: 117 microversion: 2.1 time: 0.038560 Aug 03 05:00:28.541045 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2848/5719] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/os-server-groups/b3b52add-1061-4aaf-a15a-61f99c8ebe7b => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:00:28.549953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c7cd386-1c16-453a-b8de-4e6042caa7ea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.557661 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0c7cd386-1c16-453a-b8de-4e6042caa7ea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c7cd386-1c16-453a-b8de-4e6042caa7ea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-server-groups/07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 HTTP/1.1 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '07c60d6d-4b2d-4ce4-b2b1-1dc96af34840'} Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.559538 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. Aug 03 05:00:28.562755 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.564854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c7cd386-1c16-453a-b8de-4e6042caa7ea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance group 07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.566160 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c7cd386-1c16-453a-b8de-4e6042caa7ea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/07c60d6d-4b2d-4ce4-b2b1-1dc96af34840" status: 404 len: 117 microversion: 2.1 time: 0.021229 Aug 03 05:00:28.567223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2872/5720] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/os-server-groups/07c60d6d-4b2d-4ce4-b2b1-1dc96af34840 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:00:28.583775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8a36866-d28d-47f6-a0bd-70c3cceb914d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.598430 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d8a36866-d28d-47f6-a0bd-70c3cceb914d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] HTTP exception thrown: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8a36866-d28d-47f6-a0bd-70c3cceb914d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Request method failure captured: Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-server-groups/a560af91-64cb-4b4b-97d7-54a4a917def0 HTTP/1.1 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gDEzVjuUtkOt7eA12zhRIahvSggnQr6ioB_9HUVBcltoDkYy21Gy7isjTn-Sa-Ey4mdmfy3mB9k7IcbwsMaRQWGgGvlAASmdBaLrq7So1DneUF4-0K2YeAJydNmLqOabIcBPsL9ygtxVkpUG7GecwYC4HiUpN-x4tFyRQ4JLRMqsvU Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/392e11bfebd743b9b8425a4eb23106f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 392e11bfebd743b9b8425a4eb23106f2 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerGroupTestJSON-358988532 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: cfd6048acd2c4c16ab3dbbe0d66e2909 Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerGroupTestJSON-358988532-project Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'a560af91-64cb-4b4b-97d7-54a4a917def0'} Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.603109 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. Aug 03 05:00:28.608566 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:00:28.610331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8a36866-d28d-47f6-a0bd-70c3cceb914d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Returning 404 to user: Instance group a560af91-64cb-4b4b-97d7-54a4a917def0 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:00:28.611393 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8a36866-d28d-47f6-a0bd-70c3cceb914d tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/a560af91-64cb-4b4b-97d7-54a4a917def0" status: 404 len: 117 microversion: 2.1 time: 0.038125 Aug 03 05:00:28.612286 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2849/5721] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/os-server-groups/a560af91-64cb-4b4b-97d7-54a4a917def0 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:00:28.621050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e1f7a51-a94e-493d-9492-f871fe1fdbea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:28.891027 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e1f7a51-a94e-493d-9492-f871fe1fdbea tempest-ServerGroupTestJSON-358988532 tempest-ServerGroupTestJSON-358988532-project] 10.222.0.72 "DELETE /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613" status: 204 len: 0 microversion: 2.1 time: 0.274330 Aug 03 05:00:28.895537 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2873/5722] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:00:28 2022] DELETE /compute/v2.1/os-server-groups/5c4d03e2-9136-44b6-946c-6c64311e3613 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:00:40.971505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=16 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:40.977176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:41.236038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-141753035", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:41.328839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:00:41.329336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:00:41.329825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:00:41.330245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:00:41.330669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:00:41.347818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:41.348435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:41.349621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:41.350799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:41.398057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Getting quotas for project 0b7931f66a08498f9be9a6161e5acaec. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:00:41.411200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Getting quotas for user c33db70824ef43c281f70d79374fde0b and project 0b7931f66a08498f9be9a6161e5acaec. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:00:41.438908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:00:41.442478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:00:41.628339 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a842c28-dc9e-46a1-969d-c6bb64347293 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.669073 Aug 03 05:00:41.651793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2850/5723] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 05:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 05:00:41.660611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:41.661494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:41.665619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:41.666471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:41.811184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:41.840514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:41.840514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:41.840514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33f6857e-94b5-4d4c-badf-ee8d609b4612 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 200 len: 1277 microversion: 2.47 time: 0.173391 Aug 03 05:00:41.840514 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2874/5724] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:41 2022] GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:41.915456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-812876178", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": "none"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:41.999907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:00:42.000578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:00:42.000823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:00:42.001233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:00:42.001648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:00:42.012065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:42.017535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:42.017535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:42.017535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:42.032845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Getting quotas for project 0b7931f66a08498f9be9a6161e5acaec. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:00:42.038515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Getting quotas for user c33db70824ef43c281f70d79374fde0b and project 0b7931f66a08498f9be9a6161e5acaec. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:00:42.051409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:00:42.053658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:00:42.293387 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b4938d1c-39b3-41d3-9148-f77473a588f7 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.382366 Aug 03 05:00:42.295715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2851/5725] 10.222.0.72 () {62 vars in 1188 bytes} [Wed Aug 3 05:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 05:00:42.307344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-01b233a8-f826-4ca8-acf1-96628cd34002 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:42.310988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-01b233a8-f826-4ca8-acf1-96628cd34002 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:42.408353 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-01b233a8-f826-4ca8-acf1-96628cd34002 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "PUT /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 991 microversion: 2.47 time: 0.106507 Aug 03 05:00:42.422659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2875/5726] 10.222.0.72 () {62 vars in 1297 bytes} [Wed Aug 3 05:00:42 2022] PUT /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:00:42.432769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:42.434096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:42.653239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:42.662937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:42.669641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:42.670825 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3b827d1-72d8-4a79-b962-263f27b439a2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1277 microversion: 2.47 time: 0.244416 Aug 03 05:00:42.694083 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2852/5727] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:42 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:00:43.722778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:43.722778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:43.815382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:43.839461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:43.843089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:43.843861 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc295041-5b20-457e-9811-fb50013958fe tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1277 microversion: 2.47 time: 0.144984 Aug 03 05:00:43.849963 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2876/5728] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:43 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:44.874351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:44.875173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:44.950604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:44.952180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:44.967927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:44.968661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:45.276282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:45.292969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:45.294621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:45.305242 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c67d327b-c1f8-422d-be05-7b4be13c8e3e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1273 microversion: 2.47 time: 0.437219 Aug 03 05:00:45.306939 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2853/5729] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:44 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:46.331320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:46.331943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:46.359019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:46.359019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:46.359019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:46.359019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:46.555641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:46.568893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:46.577072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:46.577072 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a550ba1-5a9e-4039-855d-060249de7f3b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1337 microversion: 2.47 time: 0.244662 Aug 03 05:00:46.586510 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2877/5730] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:46 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1337 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:47.610960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:47.613502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:47.637154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:47.638100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:47.641183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:47.642792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:47.842562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:47.855380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:47.861995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:47.863422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39e31c03-31d1-4dde-80c8-9960c56cb607 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1335 microversion: 2.47 time: 0.257122 Aug 03 05:00:47.871184 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2854/5731] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:47 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1335 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:48.894848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:48.898375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:48.927863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:48.931356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:48.932366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:48.932970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:49.073934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:49.086334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:49.090814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:49.096396 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b0fd5ee5-a93a-4f5f-9fda-f0989de95dc0 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1335 microversion: 2.47 time: 0.206068 Aug 03 05:00:49.100413 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2878/5732] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:48 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1335 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:50.125516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:50.126719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:50.134534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:50.134984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:50.135952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:50.136422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:50.206885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:50.216041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:50.218062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:50.219446 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff3558d8-7464-490f-9c83-a305ebc5c8da tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1335 microversion: 2.47 time: 0.097973 Aug 03 05:00:50.220489 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2855/5733] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:50 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:51.245251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:51.246649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:51.268110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:51.268840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:51.272075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:51.273174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:51.456629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:51.490593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:51.503091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:51.510274 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-399acab9-36fc-489a-b4e3-33c7a303d7d9 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1356 microversion: 2.47 time: 0.270389 Aug 03 05:00:51.516415 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2879/5734] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:51 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:51.548011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:51.553776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:51.586509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:51.586509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:51.611635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:51.618995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:51.836883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:00:51.840795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:00:51.841490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:00:51.846409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:00:51.847072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:00:52.053630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:52.237400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:52.244496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:52.245246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:52.246196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:52.246783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:52.281522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba95c22b-ec65-4e55-9764-d807e7596189 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "POST /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f/action" status: 202 len: 1078 microversion: 2.47 time: 0.738885 Aug 03 05:00:52.282722 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2856/5735] 10.222.0.72 () {62 vars in 1319 bytes} [Wed Aug 3 05:00:51 2022] POST /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f/action => generated 1078 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 03 05:00:52.303032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:52.304210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:52.340019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:52.341759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:52.342388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:52.343305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:52.682816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:52.697015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:52.698956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:52.701776 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ac73b823-853d-40bc-b655-b8d8c0bfad4e tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.403441 Aug 03 05:00:52.704564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2880/5736] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:52 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:53.734616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:53.735465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:53.738749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:53.754686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:53.759756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:53.760805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:53.761399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:53.866806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:53.875041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:53.877206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:53.879959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a051664-bda6-46de-8290-e3446a5613db tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.151422 Aug 03 05:00:53.881843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2857/5737] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:53 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:54.907178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:54.907796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:54.912302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:00:54.916010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:54.916496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:54.933212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:54.933684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:55.373428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:55.388136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:55.393562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:55.396558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2469dcf7-96d4-4e2c-b0f3-f46618935f34 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.492607 Aug 03 05:00:55.401470 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2881/5738] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:54 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:55.985969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:55.988511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:55.999049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:55.999832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:56.000950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:56.001567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:56.060357 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eef77b32-f96f-462f-b8c8-84b2a9eb4fc1 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/ips" status: 200 len: 149 microversion: 2.1 time: 0.078872 Aug 03 05:00:56.071905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2858/5739] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 05:00:55 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/ips => generated 149 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:00:56.433516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:56.435326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:56.452112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:56.453415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:56.454441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:56.473009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:56.558964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:56.577354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:56.579740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:56.590071 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd2f4479-2cd1-4262-b78e-43ff875a3cfd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.161595 Aug 03 05:00:56.590071 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2882/5740] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:56 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:57.606496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:57.614227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:57.647030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:57.665049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:57.666143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:57.666816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:57.845538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:57.857218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:57.859405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:57.860043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c62755da-58b2-4fd3-8d8a-c8e1c3f40f25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.257730 Aug 03 05:00:57.866058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2859/5741] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:57 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:58.891030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:00:58.892400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:58.906017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:58.906658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:58.907618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:58.910149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:58.992428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:59.003608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:59.006263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:00:59.010350 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-353b4562-7efd-4852-afbf-d822bbc3daa2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.122879 Aug 03 05:00:59.021621 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2883/5742] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:00:58 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:00:59.432109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afc2913a-0163-4389-86a8-16e4ffb4b5bb"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:00:59.434671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:00:59.442107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:59.443582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:00:59.444843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:00:59.445519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:00.033067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:00.039954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:00.042001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:00.042452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:00.043398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:00.044019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:00.150163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:00.163611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:00.166349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:00.171360 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76d15602-3902-4b30-9480-6cfe3f77fe7a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.140957 Aug 03 05:01:00.172108 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2884/5743] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:00 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:00.651648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23d5672e-3fda-46e4-97a4-11c4a6f60238 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "POST /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.226985 Aug 03 05:01:00.655096 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2860/5744] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:00:59 2022] POST /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 194 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:01.198009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:01.206522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:01.224663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:01.225546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:01.227712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:01.231675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:01.448685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:01.466071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:01.477921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:01.479171 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35b5dd3c-0965-468d-a192-51cfc1a3ec2d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.286148 Aug 03 05:01:01.485644 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2885/5745] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:01 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:02.521969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:02.524700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:02.552543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:02.554008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:02.555477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:02.558616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:02.659758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:02.677388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:02.677388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:02.679697 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7c9835e-1f33-4362-bcaf-3b45183c5036 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.167119 Aug 03 05:01:02.690508 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2861/5746] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:02 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:03.706623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:03.707245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:03.720166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:03.720984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:03.721956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:03.723078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:03.842649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:03.855284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:03.862399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:03.863870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ed48fbb-6c49-4ae0-b99a-0ab1b7a70666 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.161095 Aug 03 05:01:03.865182 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2886/5747] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:03 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:04.889621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:04.890259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:04.898757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:04.899272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:04.900100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:04.900572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:04.980216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:04.981821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:04.984159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:04.985471 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7a1f1e7-ff16-40c0-b2e4-17cc319bd5d2 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.099882 Aug 03 05:01:04.994071 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2862/5748] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:04 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:05.332645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1768272052", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9b2abc2-b285-4f47-ae4a-ba21e850fd2c"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:05.402705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] validate_networks() for [('c9b2abc2-b285-4f47-ae4a-ba21e850fd2c', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:01:06.011427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:06.012813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:06.021477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:06.022456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:06.023517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:06.024189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:06.151129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:06.160443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:06.164227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:06.167584 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5feded88-5cdd-4e3e-8d73-7fbfa2a430a5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.161695 Aug 03 05:01:06.181734 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2863/5749] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:06 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:06.210148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:01:06.210600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:01:06.211077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:01:06.211491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:01:06.211902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:01:06.234609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:06.235656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:06.236679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:06.237273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:06.262581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Getting quotas for project b7393e355df344358c8967ac800a577e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:01:06.275593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Getting quotas for user 660fc67eadd846ce800e30a28ad11ef1 and project b7393e355df344358c8967ac800a577e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:01:06.298419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:01:06.300781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:01:06.589688 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-308df2fd-1403-4a68-a031-3109da982ae1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263294 Aug 03 05:01:06.593281 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2887/5750] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:01:06.603161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54090f2d-c1b8-406b-9aa2-925d0a8809a5 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:06.604026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54090f2d-c1b8-406b-9aa2-925d0a8809a5 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:06.719395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54090f2d-c1b8-406b-9aa2-925d0a8809a5 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:06.726594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54090f2d-c1b8-406b-9aa2-925d0a8809a5 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1214 microversion: 2.1 time: 0.128166 Aug 03 05:01:06.739923 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2864/5751] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:06 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:07.196869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:07.197837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:07.213169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:07.214952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:07.215942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:07.216422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:07.353220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:07.367792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:07.369762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:07.370987 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-059f9f00-66b0-46ff-b96b-c315869a2112 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.179422 Aug 03 05:01:07.384348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2888/5752] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:07 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:07.750481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-446bb33b-93e7-46ca-93ba-f9f937b45634 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:07.751755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-446bb33b-93e7-46ca-93ba-f9f937b45634 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:07.831024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-446bb33b-93e7-46ca-93ba-f9f937b45634 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:07.843122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-446bb33b-93e7-46ca-93ba-f9f937b45634 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1214 microversion: 2.1 time: 0.099834 Aug 03 05:01:07.845596 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2865/5753] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:07 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:08.403294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:08.404085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:08.412786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:08.413292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:08.414358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:08.414901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:08.503058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:08.512315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:08.514253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:08.515587 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2600c444-ae6b-4336-a1e6-d9a039bf1f8f tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.116964 Aug 03 05:01:08.516230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2889/5754] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:08 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:08.872340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:08.873572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:08.884105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:08.885120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:08.886904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:08.887527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:08.978914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:08.991221 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a9db6ef-bd5f-4f1f-bfc9-5d1f2bcbf834 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1218 microversion: 2.1 time: 0.123537 Aug 03 05:01:08.992377 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2866/5755] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:08 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:09.545316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:09.546145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:09.565048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:09.565827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:09.566711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:09.569095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:09.696804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:09.713154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:09.715048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:09.716818 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2a276c4b-1383-4b67-9868-ebc6606b3e72 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.175216 Aug 03 05:01:09.735948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2890/5756] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:09 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:01:10.019715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:10.019715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:10.041788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:10.042470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:10.043286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:10.043738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:10.343268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:10.347274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:10.355490 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e05e166-221b-4134-8148-1c823f6657e0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1266 microversion: 2.1 time: 0.343861 Aug 03 05:01:10.368621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2867/5757] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:10 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:10.751183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:10.752578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:10.773235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:10.773715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:10.774537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:10.783125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:10.916694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:10.933888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:10.935624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:10.939416 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ea977ef-4f8c-4ffa-b9b9-929644d35928 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.191541 Aug 03 05:01:10.940806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2891/5758] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:10 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:11.383007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:11.383620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:11.398096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:11.398567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:11.399375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:11.399925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:11.951857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:11.973928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:11.975265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:11.999119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c9419e8a-cb47-48e9-a777-9c453efd0186 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1272 microversion: 2.1 time: 0.584970 Aug 03 05:01:12.000324 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2868/5759] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:11 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1272 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:12.028560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:12.029395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:12.033770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:12.034532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:12.239786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:12.249551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:12.256669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:12.262885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d87d90df-5392-4349-b60e-ddc771e1c24b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.295394 Aug 03 05:01:12.263507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2892/5760] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:11 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:13.025693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:13.025693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:13.035247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:13.035838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:13.041976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:13.043239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:13.168457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:13.175450 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e7591113-7749-44b7-8fcc-05ca46aa3753 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1272 microversion: 2.1 time: 0.154217 Aug 03 05:01:13.176880 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2869/5761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:13 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:13.291278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:13.292099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:13.308482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:13.310014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:13.312460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:13.312934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:13.544200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:13.569417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:13.571061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:13.573156 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b4c0e9e-5eba-4abf-8b09-d9aa5441895b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.286663 Aug 03 05:01:13.592795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2893/5762] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:13 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:14.115484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:14.116554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:14.130776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.134974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:14.134974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.139377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:14.202293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:14.202921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:14.217004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.218993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:14.218993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.218993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:14.242453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:14.511095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'services' on Instance uuid f25f6738-11c2-49ce-90b0-01b3e7aad617 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:01:14.928838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6933782a-8b0d-45df-9bf3-06644362cdab tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments/afc2913a-0163-4389-86a8-16e4ffb4b5bb" status: 202 len: 0 microversion: 2.1 time: 0.797437 Aug 03 05:01:14.931414 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2870/5763] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:01:14 2022] DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments/afc2913a-0163-4389-86a8-16e4ffb4b5bb => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:01:14.960516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:14.961255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:14.977343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.980829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:14.982523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:14.985880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:15.470545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:15.482154 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dc177c9b-97c0-488e-9ec3-3a41d9521545 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 1.284616 Aug 03 05:01:15.483640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2894/5764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:14 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:15.491472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:15.497836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:15.520975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:15.521451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:15.526476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:15.527071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:15.635339 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-902bc0ce-d61c-4567-b202-7ea875fc4715 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150076 Aug 03 05:01:15.636184 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2895/5765] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:15 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:16.088087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:16.103329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:16.119000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:16.120246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-459f2290-77a0-4964-a0a9-7763d3ba5d25 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 1.187566 Aug 03 05:01:16.120843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2871/5766] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:14 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:16.229972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-82796840-f101-4b80-82ea-04a8f6baba1f req-3668a662-29a2-4b08-9b95-b9a896807c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59685c7-0e38-4396-ad04-f469670dc23a", "tag": "bac506f3-5291-4ad8-9db8-a3b9509f9c03"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:16.258504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:16.266273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-82796840-f101-4b80-82ea-04a8f6baba1f req-3668a662-29a2-4b08-9b95-b9a896807c75 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:16.270094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-82796840-f101-4b80-82ea-04a8f6baba1f req-3668a662-29a2-4b08-9b95-b9a896807c75 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:16.309290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:16.317319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-82796840-f101-4b80-82ea-04a8f6baba1f req-3668a662-29a2-4b08-9b95-b9a896807c75 service nova] Creating event network-changed:bac506f3-5291-4ad8-9db8-a3b9509f9c03 for instance f59685c7-0e38-4396-ad04-f469670dc23a on n-h1-826756-5 Aug 03 05:01:16.327510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-82796840-f101-4b80-82ea-04a8f6baba1f req-3668a662-29a2-4b08-9b95-b9a896807c75 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100945 Aug 03 05:01:16.328572 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2896/5767] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:16.510228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:16.510851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:16.530838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:16.531309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:16.540808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:16.540808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:16.655351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:16.663674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:16.683092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:16.690267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:16.692248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:16.695323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:16.696919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:16.759535 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-097b57f5-4f30-48c0-91ef-b06eea752ec8 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112578 Aug 03 05:01:16.764642 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2897/5768] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:16 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:17.151698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:17.153035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:17.172949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:17.173681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:17.174683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:17.176096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:17.302254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:17.312758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fc3fff5-daf1-4531-8f94-16d0e2335dcb tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.807379 Aug 03 05:01:17.319084 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2872/5769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:16 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:17.428789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:17.449640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:17.456134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:17.470908 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71a78fe0-ada2-4610-a1ae-8ce14bb03e9c tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.324456 Aug 03 05:01:17.476309 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2898/5770] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:17 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 05:01:17.776904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:17.779676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:17.787434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:17.799201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:17.800047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:17.801784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:17.805233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:17.883255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:17.955621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a91597a-d0e1-4ab4-8e03-bfcae52c0a90 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183091 Aug 03 05:01:17.965519 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2873/5771] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:17 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:18.340547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:18.341752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:18.362500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:18.380289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:18.381247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:18.390071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:18.501907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:18.503733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:18.523853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:18.525017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:18.530006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:18.530006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:19.122201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:19.146877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:19.151195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:19.153800 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-477b094a-6981-4006-8d5a-b149afcd0c33 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.656758 Aug 03 05:01:19.157990 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2874/5772] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:18 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:19.173298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:19.182862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:19.195842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:19.198812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:19.201928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:19.206071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:19.325039 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e5f3524-d1a4-4626-9400-ada444d3835c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164408 Aug 03 05:01:19.332738 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2875/5773] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:19 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:19.434747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:19.449973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-333255f2-20d5-4931-9a72-fe1133a8618d tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 1.114863 Aug 03 05:01:19.450586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2899/5774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:18 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:20.189006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:20.189980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:20.198156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.198655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.203371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.204736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.343617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:20.346237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:20.379161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.380081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.384206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.389370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.511048 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78c46f5d-d94f-4592-91f0-a4b9ae22a64d tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172553 Aug 03 05:01:20.521691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2900/5775] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:20 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:01:20.544802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:20.548036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:20.565225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.567172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.585997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:20.586789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:20.592331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:20.608476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:20.611572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:20.616342 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-78ed9603-3b54-431b-8e12-f103c455fd01 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.430741 Aug 03 05:01:20.617566 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2876/5776] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:20 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:21.388570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:21.397368 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-57af043d-5b9f-479b-92a7-c041ffc0ac95 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.874316 Aug 03 05:01:21.398007 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2901/5777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:20 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:21.533750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:21.537227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:21.544216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:21.545003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:21.546430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:21.547244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:21.597242 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d696f508-49f9-4358-9e2d-c942d641e31c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069003 Aug 03 05:01:21.599083 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2877/5778] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:21 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:21.650036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:21.651219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:21.658698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:21.659450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:21.660918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:21.661753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:21.746971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:21.787784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:21.793980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:21.797717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a489847e-b407-477c-a217-6e9bbbee92ed tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.161529 Aug 03 05:01:21.809444 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2902/5779] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:21 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:22.423770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:22.427949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:22.438057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.438756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:22.439786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.440241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:22.611886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:22.614311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:22.645394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.645394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:22.645394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.645394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:22.646474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:22.659493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71bb84f0-f9e4-4cfa-a074-2a9fe529f174 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.239618 Aug 03 05:01:22.660408 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2878/5780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:22 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:22.745023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30f7ae9d-7126-4edb-896a-86c648133cfc tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137882 Aug 03 05:01:22.750307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2903/5781] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:22 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:22.827910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:22.828780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:22.854492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.857192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:22.858094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:22.864788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:23.054235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:23.070835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:23.072500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:23.077548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33cd5e9b-28a9-4686-b2b9-0940f0d9f2ec tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.256028 Aug 03 05:01:23.092935 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2879/5782] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:22 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:23.687352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:23.688367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:23.721653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:23.722264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:23.723128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:23.723573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:23.758016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:23.760248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:23.788383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:23.789131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:23.790100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:23.792095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:23.897491 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4724b12-8d0f-4a7e-bdd7-753d8c284c26 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143668 Aug 03 05:01:23.898689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2880/5783] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:23 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:24.026447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:24.035863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78eddc96-b7bb-4c80-a914-b52fe25073b8 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.352511 Aug 03 05:01:24.036926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2904/5784] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:23 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:24.103075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:24.103706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:24.111270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:24.112175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:24.113273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:24.113878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:24.248436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:24.263651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:24.265185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:24.270768 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f0040464-ff32-4311-800e-3b297f4a9fb3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1365 microversion: 2.47 time: 0.173098 Aug 03 05:01:24.271760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2881/5785] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:24 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:24.911604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:24.914798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:24.922362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:24.922952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:24.923822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:24.924473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:24.992708 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1f2654e-19f0-4ad6-ba90-af7e02cb17be tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085965 Aug 03 05:01:24.999052 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2905/5786] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:01:24 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:01:25.057434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:25.058052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:25.065147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.065603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.066522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.068326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.130885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:25.131577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:25.141117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.149332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.150159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.155538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.235560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:01:25.575307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:25.588512 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04180fe7-fb1f-444d-8b76-6bdf540ea490 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.534899 Aug 03 05:01:25.589843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2882/5787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:25 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:25.607524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:25.611044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:25.626057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.631714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.632788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.633243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.770101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:25.773795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:25.779860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:25.809508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:25.809508 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ac41ab42-dea2-411e-a7b9-111123f93df3 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1383 microversion: 2.47 time: 0.216219 Aug 03 05:01:25.809508 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2883/5788] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:25 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1383 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:25.836600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0351ed5-b2fb-4b7e-93f7-e4f9823a0f4c tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 204 len: 0 microversion: 2.1 time: 0.712980 Aug 03 05:01:25.839428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2906/5789] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:25 2022] DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:01:25.851533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:25.852353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:25.864157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.864537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:25.871276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:25.873419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.213529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:26.232107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4722cc8a-17fa-4075-9440-1fbc9244db68 req-467fd96d-0e7d-4615-b573-cb29604df1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59685c7-0e38-4396-ad04-f469670dc23a", "name": "network-vif-plugged", "status": "completed", "tag": "bac506f3-5291-4ad8-9db8-a3b9509f9c03"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:26.241216 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fadd0df0-aa04-426f-ae6a-f6f42716173b tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1680 microversion: 2.1 time: 0.393873 Aug 03 05:01:26.249605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2884/5790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:25 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1680 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:26.271873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4722cc8a-17fa-4075-9440-1fbc9244db68 req-467fd96d-0e7d-4615-b573-cb29604df1c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:26.272366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4722cc8a-17fa-4075-9440-1fbc9244db68 req-467fd96d-0e7d-4615-b573-cb29604df1c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.304332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4722cc8a-17fa-4075-9440-1fbc9244db68 req-467fd96d-0e7d-4615-b573-cb29604df1c9 service nova] Creating event network-vif-plugged:bac506f3-5291-4ad8-9db8-a3b9509f9c03 for instance f59685c7-0e38-4396-ad04-f469670dc23a on n-h1-826756-5 Aug 03 05:01:26.318413 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4722cc8a-17fa-4075-9440-1fbc9244db68 req-467fd96d-0e7d-4615-b573-cb29604df1c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090598 Aug 03 05:01:26.321014 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2907/5791] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:01:26.614751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:26.616201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:26.629528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:26.630627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.636172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:26.636829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.839984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:26.839984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:26.845737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:26.846199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.847632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:26.848116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:26.932045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:26.941804 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-70fa069e-dee8-429f-b750-84a41a622719 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.330209 Aug 03 05:01:26.964842 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2885/5792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:26 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:27.006150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:27.019699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:27.021338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:27.027510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fec9fb25-d1a0-412b-b791-7a7799783597 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1371 microversion: 2.47 time: 0.197878 Aug 03 05:01:27.048414 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2908/5793] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:26 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:27.263486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:27.264829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:27.280487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:27.287125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:27.290514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:27.295124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:27.965342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:27.966201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:28.000940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:28.002852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:28.008083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:28.011222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:28.011922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:28.020086 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2512f99f-d8ae-473c-ac2a-3520ac2438cb tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1680 microversion: 2.1 time: 0.760694 Aug 03 05:01:28.030446 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2886/5794] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:27 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1680 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:28.062852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:28.068223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:28.077071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:28.077825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:28.078834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:28.079481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:28.272016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:28.301754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:28.305662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:28.307118 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eb0d1ea8-8138-4acd-9f2e-dd0f516d6414 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1371 microversion: 2.47 time: 0.248148 Aug 03 05:01:28.329219 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2887/5795] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:28 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:28.410339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:28.422255 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5549d755-c92a-499f-aefc-642194215583 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1314 microversion: 2.1 time: 0.459571 Aug 03 05:01:28.423186 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2909/5796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:27 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:29.050917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:29.051625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:29.059189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.068825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.069890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.070488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.333193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:29.337431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:29.338552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:29.346738 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1787373-8446-413c-80f3-709cf113ff41 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1612 microversion: 2.1 time: 0.299266 Aug 03 05:01:29.370759 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2888/5797] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:29 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1612 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:29.376411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.381248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.381248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.381248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.425671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:29.443475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:29.444812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:29.457673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.458129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.458932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.467946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.573540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:29.590141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:29.596906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:29.602494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a90229c2-c137-436b-8388-8638f5b35ad4 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1356 microversion: 2.47 time: 0.269685 Aug 03 05:01:29.609431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2910/5798] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:29 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1356 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:29.640872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:29.646746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:29.651095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Searching by: {'deleted': False, 'project_id': '0b7931f66a08498f9be9a6161e5acaec'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 05:01:29.664701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.665777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.666856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:29.668979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:29.918655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 05:01:30.058419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:30.071211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.072106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.086421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:30.088126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:30.468326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:30.482522 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c1451fd-ec31-4418-b2bc-fbedf156917f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1496 microversion: 2.1 time: 1.043248 Aug 03 05:01:30.488565 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2889/5799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:29 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1496 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:01:30.507439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:30.508522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:30.532357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.532357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.532357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.532357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.576057 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f414c73d-e92f-4425-99c7-485083797add tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.939721 Aug 03 05:01:30.578090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2911/5800] 10.222.0.72 () {60 vars in 1187 bytes} [Wed Aug 3 05:01:29 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:30.614758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:30.615308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:30.624687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.631951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.634086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.634557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.726670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:01:30.834866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:30.848905 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-717c1c3d-3443-4300-8cba-cfdca59e16d0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1612 microversion: 2.1 time: 0.358806 Aug 03 05:01:30.866036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2890/5801] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:30 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1612 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:30.914638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-67c4887e-9455-4fd8-a0ed-0c71a8de5183 req-32329733-1835-4f7b-8086-f0f22ad5fd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25f6738-11c2-49ce-90b0-01b3e7aad617", "name": "network-vif-deleted", "tag": "cc2c23e6-71ab-48d1-9323-1725749e0763"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:30.933880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-67c4887e-9455-4fd8-a0ed-0c71a8de5183 req-32329733-1835-4f7b-8086-f0f22ad5fd9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:30.935870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-67c4887e-9455-4fd8-a0ed-0c71a8de5183 req-32329733-1835-4f7b-8086-f0f22ad5fd9c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:30.953397 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-67c4887e-9455-4fd8-a0ed-0c71a8de5183 req-32329733-1835-4f7b-8086-f0f22ad5fd9c service nova] Creating event network-vif-deleted:cc2c23e6-71ab-48d1-9323-1725749e0763 for instance f25f6738-11c2-49ce-90b0-01b3e7aad617 on n-h1-826756-5 Aug 03 05:01:30.975969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-67c4887e-9455-4fd8-a0ed-0c71a8de5183 req-32329733-1835-4f7b-8086-f0f22ad5fd9c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068606 Aug 03 05:01:30.982093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2891/5802] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:01:31.265109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69c4eed7-fa05-431b-861a-df17e415fe0d tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 204 len: 0 microversion: 2.47 time: 0.654896 Aug 03 05:01:31.265712 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2912/5803] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 05:01:30 2022] DELETE /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 0 bytes in 656 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:01:31.274903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:31.275819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:31.289240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:31.290890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:31.293415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:31.294830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:31.615990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:31.634435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:31.642767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:31.645601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24f088d2-0099-404d-9190-221b8c825ca8 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1362 microversion: 2.47 time: 0.374843 Aug 03 05:01:31.650844 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2892/5804] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:31 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:31.871259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:31.871959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:31.894634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:31.895022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:31.903032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:31.906046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.001836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:32.012935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.013814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lazy-loading 'fault' on Instance uuid f25f6738-11c2-49ce-90b0-01b3e7aad617 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:01:32.249887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b3e1151b1b940d29986fdb32fbabd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b0455ee1404e11a5c4fdf93cdd8b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:32.263225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f1aa50f-0a23-4466-8db1-21e05782ebe9 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 200 len: 1330 microversion: 2.1 time: 0.391213 Aug 03 05:01:32.270710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2913/5805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:31 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 1330 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:32.528164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:32.528818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:32.568751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:32.576876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.581102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:32.595672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.678034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:32.678831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:32.695706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:32.700701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.703088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:32.706095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:32.719838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:01:32.830719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:32.848051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:32.849924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:32.851266 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-008072fc-19c5-4534-99ab-e5ba7103a98a tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1362 microversion: 2.47 time: 0.178309 Aug 03 05:01:32.862569 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2914/5806] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:32 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:33.288192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:33.288888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:33.295897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.296380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.297151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.297588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.312147 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 HTTP/1.1 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f25f6738-11c2-49ce-90b0-01b3e7aad617'} Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:33.313839 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:33.320170 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59aba06c-340d-4742-85b1-b6aea715c102 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 404 len: 111 microversion: 2.1 time: 0.031134 Aug 03 05:01:33.322395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2915/5807] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:33 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:01:33.327449 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c63efbfd-dd7d-4e87-a3a2-3b7ea61a1ba3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 204 len: 0 microversion: 2.1 time: 0.805556 Aug 03 05:01:33.329637 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2893/5808] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:32 2022] DELETE /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:01:33.340317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2fa7e20-f6de-41cd-88e4-69e94051555a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '.version_select at 0x7fdd54922f70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:33.341503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:33.342243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:33.360915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.364509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.364509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.364509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.510272 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2fa7e20-f6de-41cd-88e4-69e94051555a tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-769457721" status: 202 len: 0 microversion: 2.1 time: 0.181782 Aug 03 05:01:33.522585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2916/5809] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 05:01:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-769457721 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:01:33.702204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:33.723833 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c319bde1-bc2d-440b-95c7-91738ffa2d81 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1502 microversion: 2.1 time: 0.386539 Aug 03 05:01:33.724463 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2894/5810] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:33 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:33.875150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:33.875678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:33.883123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.884020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.885367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.885813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.927384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:33.927976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:33.928456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lazy-loading 'fault' on Instance uuid 3c41190d-e6fa-4c97-bfd7-301586400f6f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:01:33.992177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:34.009906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:34.012151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:34.014999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ea0da35-d576-4b52-a25a-c97c2d4898e5 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 200 len: 1367 microversion: 2.47 time: 0.143148 Aug 03 05:01:34.021211 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2917/5811] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:33 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:34.752057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:34.758212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:34.775631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:34.777798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:34.779629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:34.786474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.080221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:35.084927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 3c41190d-e6fa-4c97-bfd7-301586400f6f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:35.155644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.156110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.161697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.162377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.214014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] HTTP exception thrown: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Request method failure captured: Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f HTTP/1.1 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gD497T_vfearTofIfRLtJz6xuwvdrhdsZMTWZaDhqxb8j67KbmihzEFKlExU_K5LMDSiifqdWPVs942fJ9bCs5sd0Fr5ffwMzXmsPc2bGViv5f9j_6XlVB8g5XBy4UpnWCGmxTsvtaxJHaDDo-UmelU9H7iPIsh9SLIxaGnPBzufxE Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 0b7931f66a08498f9be9a6161e5acaec Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerShowV247Test-685142281 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerShowV247Test-685142281 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 0b7931f66a08498f9be9a6161e5acaec Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerShowV247Test-685142281 Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerShowV247Test-685142281-project Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c33db70824ef43c281f70d79374fde0b Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerShowV247Test-685142281-project Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3c41190d-e6fa-4c97-bfd7-301586400f6f'} Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:35.219606 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Returning 404 to user: Instance 3c41190d-e6fa-4c97-bfd7-301586400f6f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1540e461-3bcd-4449-9682-c6a93f18fe38 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f" status: 404 len: 111 microversion: 2.47 time: 0.178246 Aug 03 05:01:35.225343 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2918/5812] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:35 2022] GET /compute/v2.1/servers/3c41190d-e6fa-4c97-bfd7-301586400f6f => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:01:35.239671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:35.239671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:35.254902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.255357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.256156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.256625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.303415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:01:35.496388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:35.509347 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47a40227-0c5d-461e-9524-458381035ba9 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1502 microversion: 2.1 time: 0.766003 Aug 03 05:01:35.510044 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2895/5813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:34 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1502 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:35.724485 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b7d8329-2e0a-4302-a68d-631711805eca tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "DELETE /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 204 len: 0 microversion: 2.47 time: 0.488361 Aug 03 05:01:35.724485 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2919/5814] 10.222.0.72 () {60 vars in 1280 bytes} [Wed Aug 3 05:01:35 2022] DELETE /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 05:01:35.731850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:35.733007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:35.743898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.747444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.748465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:35.761683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:35.910952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:35.919398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:35.921115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:35.922423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-97026511-fd75-4a75-ad56-378d32fee2bd tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 200 len: 1362 microversion: 2.47 time: 0.194816 Aug 03 05:01:35.939187 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2896/5815] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:35 2022] GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:36.321667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2530d4bc-a0de-41d2-8da1-efe1349ede83 req-e7287430-b2c3-4edc-91b8-dac2d912af9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59685c7-0e38-4396-ad04-f469670dc23a", "name": "network-vif-deleted", "tag": "bac506f3-5291-4ad8-9db8-a3b9509f9c03"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:36.352729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2530d4bc-a0de-41d2-8da1-efe1349ede83 req-e7287430-b2c3-4edc-91b8-dac2d912af9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:36.353458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2530d4bc-a0de-41d2-8da1-efe1349ede83 req-e7287430-b2c3-4edc-91b8-dac2d912af9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:36.451677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2530d4bc-a0de-41d2-8da1-efe1349ede83 req-e7287430-b2c3-4edc-91b8-dac2d912af9b service nova] Creating event network-vif-deleted:bac506f3-5291-4ad8-9db8-a3b9509f9c03 for instance f59685c7-0e38-4396-ad04-f469670dc23a on n-h1-826756-5 Aug 03 05:01:36.451677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2530d4bc-a0de-41d2-8da1-efe1349ede83 req-e7287430-b2c3-4edc-91b8-dac2d912af9b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066958 Aug 03 05:01:36.451677 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2920/5816] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:36.561653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:36.623707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:36.637902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64268b72-fa1a-47db-9ed3-cdbf19da9047 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1460 microversion: 2.1 time: 0.110556 Aug 03 05:01:36.652299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2897/5817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:36 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1460 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:36.947228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:36.947934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:36.966915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:36.977058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:36.977909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:36.978360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:37.101179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:37.110002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:37.111524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:37.113281 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4bd3440a-0387-4ea2-8345-a088dac9a6ad tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 200 len: 1362 microversion: 2.47 time: 0.170830 Aug 03 05:01:37.116326 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2921/5818] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:36 2022] GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:37.664973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:37.666146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:37.681882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:37.690928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:37.693374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:37.695558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:37.801102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:37.804692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:37.806715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lazy-loading 'fault' on Instance uuid f59685c7-0e38-4396-ad04-f469670dc23a {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:01:37.988852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:37.999096 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b75ed455-3cea-418d-b150-6b535f5537fa tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 200 len: 1304 microversion: 2.1 time: 0.338733 Aug 03 05:01:38.004948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2898/5819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:37 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 1304 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:38.141232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:38.141849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:38.156609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:38.157014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:38.158833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:38.159765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:38.278889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:38.279338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:38.279802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lazy-loading 'fault' on Instance uuid 071c8997-9704-4813-96d3-f5d3b8d96b18 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:01:38.370238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:38.386976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:38.393051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c33db70824ef43c281f70d79374fde0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b7931f66a08498f9be9a6161e5acaec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:38.397225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db08b52f-1665-43a1-a11c-08d2a4bf8d1b tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 200 len: 1367 microversion: 2.47 time: 0.258455 Aug 03 05:01:38.412305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2922/5820] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:38 2022] GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 05:01:39.025519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:39.027260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: f59685c7-0e38-4396-ad04-f469670dc23a] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:39.037764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:39.038372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:39.039335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:39.039931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] HTTP exception thrown: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Request method failure captured: Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a HTTP/1.1 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gENRX_yG_6qL29IapaZDra99yXz5N8l0Frd55VDS_l8N37zYjU3XHfVEB0tCGcMFAsM5m5OYgmJJAErHKs7y4A9FfYVjC2-wrCo9I_cGxSNknGdoOi8Rxc65kXm8Q9V5gIpqhvA-mTeFJn6ge2qhkBbi0HO3nYxrcsiJvhnh6UApAw Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b7393e355df344358c8967ac800a577e Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesActionsTest-1909414320 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7393e355df344358c8967ac800a577e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7393e355df344358c8967ac800a577e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b7393e355df344358c8967ac800a577e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b7393e355df344358c8967ac800a577e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesActionsTest-1909414320 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b7393e355df344358c8967ac800a577e Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesActionsTest-1909414320 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesActionsTest-1909414320-project Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 660fc67eadd846ce800e30a28ad11ef1 Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesActionsTest-1909414320-project Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f59685c7-0e38-4396-ad04-f469670dc23a'} Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:39.059587 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Returning 404 to user: Instance f59685c7-0e38-4396-ad04-f469670dc23a could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:39.063687 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ce16232-5a78-46cc-92da-fb8323c1586e tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a" status: 404 len: 111 microversion: 2.1 time: 0.040286 Aug 03 05:01:39.073456 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2899/5821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:39 2022] GET /compute/v2.1/servers/f59685c7-0e38-4396-ad04-f469670dc23a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:39.424289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:39.426734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] [instance: 071c8997-9704-4813-96d3-f5d3b8d96b18] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:39.452501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:39.453143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:39.453972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:39.456406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:39.502061 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] HTTP exception thrown: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Request method failure captured: Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 HTTP/1.1 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gD497T_vfearTofIfRLtJz6xuwvdrhdsZMTWZaDhqxb8j67KbmihzEFKlExU_K5LMDSiifqdWPVs942fJ9bCs5sd0Fr5ffwMzXmsPc2bGViv5f9j_6XlVB8g5XBy4UpnWCGmxTsvtaxJHaDDo-UmelU9H7iPIsh9SLIxaGnPBzufxE Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Openstack-Nova-Api-Version: 2.47 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 0b7931f66a08498f9be9a6161e5acaec Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerShowV247Test-685142281 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0b7931f66a08498f9be9a6161e5acaec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerShowV247Test-685142281 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 0b7931f66a08498f9be9a6161e5acaec Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerShowV247Test-685142281 Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerShowV247Test-685142281-project Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c33db70824ef43c281f70d79374fde0b Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerShowV247Test-685142281-project Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '071c8997-9704-4813-96d3-f5d3b8d96b18'} Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:39.505497 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. Aug 03 05:01:39.509230 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:39.515916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] Returning 404 to user: Instance 071c8997-9704-4813-96d3-f5d3b8d96b18 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:39.520588 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d25554f-8d90-4ef2-9a15-6db6bb02e994 tempest-ServerShowV247Test-685142281 tempest-ServerShowV247Test-685142281-project] 10.222.0.72 "GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18" status: 404 len: 111 microversion: 2.47 time: 0.101329 Aug 03 05:01:39.521919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2923/5822] 10.222.0.72 () {60 vars in 1277 bytes} [Wed Aug 3 05:01:39 2022] GET /compute/v2.1/servers/071c8997-9704-4813-96d3-f5d3b8d96b18 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:01:39.619528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1454845633", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "c9b2abc2-b285-4f47-ae4a-ba21e850fd2c"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:39.714654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] validate_networks() for [('c9b2abc2-b285-4f47-ae4a-ba21e850fd2c', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:01:40.798528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:01:40.799014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:01:40.799888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:01:40.800395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:01:40.800885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:01:40.812037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:40.812522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:40.813494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:40.814110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:40.834528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Getting quotas for project b7393e355df344358c8967ac800a577e. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:01:40.840008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Getting quotas for user 660fc67eadd846ce800e30a28ad11ef1 and project b7393e355df344358c8967ac800a577e. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:01:40.854602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:01:40.857204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:01:41.093217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1a955c3-82ec-4a2a-a43c-b6ca15aa8f72 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478273 Aug 03 05:01:41.099629 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2900/5823] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:01:41.110757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca51f6bc-6ec6-48dd-b3fd-c96f58b97591 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:41.112611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca51f6bc-6ec6-48dd-b3fd-c96f58b97591 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:41.115324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:41.116354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:41.218546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ca51f6bc-6ec6-48dd-b3fd-c96f58b97591 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:41.230177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca51f6bc-6ec6-48dd-b3fd-c96f58b97591 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1214 microversion: 2.1 time: 0.123810 Aug 03 05:01:41.235556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2924/5824] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:41 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:42.266125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-422c5369-1543-4a39-889e-d0f0302b43e3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:42.266910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-422c5369-1543-4a39-889e-d0f0302b43e3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:42.420799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-422c5369-1543-4a39-889e-d0f0302b43e3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:42.434658 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-422c5369-1543-4a39-889e-d0f0302b43e3 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1214 microversion: 2.1 time: 0.171290 Aug 03 05:01:42.440674 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2901/5825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:42 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:42.571647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:42.572158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:42.582713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:42.586777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:42.587613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:42.588072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:42.617327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 HTTP/1.1 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f25f6738-11c2-49ce-90b0-01b3e7aad617'} Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:42.619267 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.622942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.625270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:42.626344 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-338b29a5-bc08-4a88-9452-f1aa6b3ce980 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 404 len: 111 microversion: 2.1 time: 0.059183 Aug 03 05:01:42.627466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2925/5826] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:42 2022] DELETE /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:42.638208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:42.638911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f25f6738-11c2-49ce-90b0-01b3e7aad617] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:42.645823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:42.646288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:42.647082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:42.647528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:42.664016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 HTTP/1.1 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f25f6738-11c2-49ce-90b0-01b3e7aad617'} Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:42.666213 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. Aug 03 05:01:42.669894 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:42.671645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f25f6738-11c2-49ce-90b0-01b3e7aad617 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:42.672779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d87e7fc9-d8b3-4af6-8611-67fc4f01ab75 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617" status: 404 len: 111 microversion: 2.1 time: 0.041230 Aug 03 05:01:42.678147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2902/5827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:42 2022] GET /compute/v2.1/servers/f25f6738-11c2-49ce-90b0-01b3e7aad617 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:43.460955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f464014a-4f0f-4e03-8d92-006b9b222e96 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:43.461741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f464014a-4f0f-4e03-8d92-006b9b222e96 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:43.634158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f464014a-4f0f-4e03-8d92-006b9b222e96 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:43.641455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f464014a-4f0f-4e03-8d92-006b9b222e96 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1214 microversion: 2.1 time: 0.184839 Aug 03 05:01:43.645271 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2926/5828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:43 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:44.671088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:44.672132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:44.691436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:44.693428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:44.714357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:44.714357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:44.821138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:44.835751 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1bb3a7b3-5a5e-45d8-9715-0af7a58ef46a tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1210 microversion: 2.1 time: 0.170134 Aug 03 05:01:44.838979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2903/5829] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:44 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:45.865437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:45.866074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:45.920555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:45.921024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:45.927221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:45.927699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:46.110705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:46.125864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1274 microversion: 2.1 time: 0.266613 Aug 03 05:01:46.128660 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2927/5830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:45 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:47.147354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:47.147974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:47.157737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:47.158206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:47.160049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:47.162966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:47.279184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:47.280261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001485 Aug 03 05:01:47.280922 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2928/5831] 10.222.0.72 () {56 vars in 886 bytes} [Wed Aug 3 05:01:47 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 03 05:01:47.291994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:47.293162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004082 Aug 03 05:01:47.293579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2929/5832] 10.222.0.72 () {54 vars in 1035 bytes} [Wed Aug 3 05:01:47 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 03 05:01:47.298728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:47.306173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:47.307245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003744 Aug 03 05:01:47.318523 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2930/5833] 10.222.0.72 () {54 vars in 1041 bytes} [Wed Aug 3 05:01:47 2022] GET /compute/v2.1/ => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:47.325484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:47.326464 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-98ea9e01-fe8d-406e-8c45-2a2f89a45256 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001343 Aug 03 05:01:47.326814 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2931/5834] 10.222.0.72 () {56 vars in 886 bytes} [Wed Aug 3 05:01:47 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 03 05:01:47.331200 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52d2b0ce-a1b0-4f2a-813e-0298daab1c23 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1272 microversion: 2.1 time: 0.187931 Aug 03 05:01:47.341934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2904/5835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:47 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1272 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:48.357157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:48.357784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:48.370257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.370719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.371516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.371955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.433563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:48.693451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:48.696241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:48.708116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.710162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.713277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.713990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.743134 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 HTTP/1.1 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c1e5d994-12c8-4f47-8f63-ca9780c98127'} Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:48.746028 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.749552 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.751813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:48.753762 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b778308-ad2e-4dda-9c6c-abcb306b31ed tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 404 len: 111 microversion: 2.1 time: 0.067525 Aug 03 05:01:48.756388 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2905/5836] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:48 2022] DELETE /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:48.766159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:48.767083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: c1e5d994-12c8-4f47-8f63-ca9780c98127] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:48.779519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.780213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.781543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.782409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.809737 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 HTTP/1.1 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c1e5d994-12c8-4f47-8f63-ca9780c98127'} Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.812178 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. Aug 03 05:01:48.821536 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.837504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance c1e5d994-12c8-4f47-8f63-ca9780c98127 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:48.840066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d59c884f-2440-4737-9e23-510185dd7472 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127" status: 404 len: 111 microversion: 2.1 time: 0.077487 Aug 03 05:01:48.844464 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2906/5837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:48 2022] GET /compute/v2.1/servers/c1e5d994-12c8-4f47-8f63-ca9780c98127 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:48.854844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:48.855376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:48.875780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.885369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.886430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:48.888428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:48.927610 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 HTTP/1.1 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f7440c86-3faa-4672-971d-e38500ddb577'} Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:48.935027 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:48.939196 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:48.942520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:48.953485 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1050dd31-2b40-4d34-b367-d710fb5020e0 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 404 len: 111 microversion: 2.1 time: 0.099450 Aug 03 05:01:48.953485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2907/5838] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:48 2022] DELETE /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:48.982056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:48.982056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: f7440c86-3faa-4672-971d-e38500ddb577] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:49.000475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:49.001029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:49.005386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:49.008967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:49.048498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 HTTP/1.1 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f7440c86-3faa-4672-971d-e38500ddb577'} Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:49.050545 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. Aug 03 05:01:49.055377 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:01:49.057559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance f7440c86-3faa-4672-971d-e38500ddb577 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:49.058602 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a58628b7-55f5-4e4e-9310-59025a249402 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577" status: 404 len: 111 microversion: 2.1 time: 0.099905 Aug 03 05:01:49.062662 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2908/5839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:48 2022] GET /compute/v2.1/servers/f7440c86-3faa-4672-971d-e38500ddb577 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:49.156824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:49.171913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c437b754-7967-4b70-a60b-945cfa9f0e59 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.818456 Aug 03 05:01:49.178299 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2932/5840] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:48 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:49.629634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b5b0dc65-a475-467d-a081-5d052bf7be1d req-0ca45fdb-ba99-402a-b784-8d70f76301e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d43e653-5c1e-4cd7-89f5-b212c2cb54aa", "tag": "14a00f07-eba9-49d9-8fad-21a40933d065"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:49.668630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b5b0dc65-a475-467d-a081-5d052bf7be1d req-0ca45fdb-ba99-402a-b784-8d70f76301e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:49.672925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b5b0dc65-a475-467d-a081-5d052bf7be1d req-0ca45fdb-ba99-402a-b784-8d70f76301e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:49.719221 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b5b0dc65-a475-467d-a081-5d052bf7be1d req-0ca45fdb-ba99-402a-b784-8d70f76301e8 service nova] Creating event network-changed:14a00f07-eba9-49d9-8fad-21a40933d065 for instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa on n-h1-826756-5 Aug 03 05:01:49.755429 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b5b0dc65-a475-467d-a081-5d052bf7be1d req-0ca45fdb-ba99-402a-b784-8d70f76301e8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134283 Aug 03 05:01:49.756621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2909/5841] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:50.200665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:50.202300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:50.216218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:50.220133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:50.224833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:50.225388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:51.567767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:51.577729 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a372856c-b9d3-4ec2-a218-4255a816a438 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 1.382765 Aug 03 05:01:51.586974 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2933/5842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:50 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:52.609838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:52.616222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:52.617399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:52.621823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:52.624249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:52.635240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:52.640082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:52.644631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:52.645382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:52.968457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:52.978604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c31db18d-3505-431c-882a-bed74a807916 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.373993 Aug 03 05:01:52.988869 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2910/5843] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:52 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:54.020630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:54.021948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:54.029356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:54.031038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:01:54.051037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:54.051498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:54.052337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:54.052992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:54.351341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:54.360840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-200a39a5-73dc-448c-b3c4-583c00fb677f tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.360841 Aug 03 05:01:54.377636 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2934/5844] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:53 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:55.061540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:55.061540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:55.083399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.085490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:55.086442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.087048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:55.107818 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe HTTP/1.1 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe'} Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:55.110391 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.116615 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.118866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:55.119935 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8dc0f680-df38-4608-8ad4-4fbe943dc697 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 404 len: 111 microversion: 2.1 time: 0.063213 Aug 03 05:01:55.121297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2935/5845] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:01:55 2022] DELETE /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:55.132210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:55.133396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] [instance: ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:55.149942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.150657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:55.157485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02cd2d01-bd5c-4a83-975d-09158c16fb87 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Action: 'create', calling method: .version_select at 0x7fdd475ebc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1649186670", "metadata": {"Type": "work"}}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:01:55.168290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.169355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:55.186219 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] HTTP exception thrown: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Request method failure captured: Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe HTTP/1.1 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6f-Gbxxixi2Xt34X7ucyqpoJiqNip-xPfyZua-1JYodTdWEIKBMWqt3u0SUslONSrS5wvq54DMZECKuAYIch8GPKPTQD2PfFCNhTaTYz6jPa2G1yfbgipNesMw03uaUF4BJOCx4PAy2pdw3Xk97gt3c0sR3hL6QMAKC5e8WpGCkWYZA Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a7b0455ee1404e11a5c4fdf93cdd8b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: a7b0455ee1404e11a5c4fdf93cdd8b25 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-940144205 Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5b3e1151b1b940d29986fdb32fbabd9e Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-AttachVolumeNegativeTest-940144205-project Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe'} Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:01:55.188087 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] Returning 404 to user: Instance ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d6a3883-f2bc-4e3c-ba17-16c9a9eb00d5 tempest-AttachVolumeNegativeTest-940144205 tempest-AttachVolumeNegativeTest-940144205-project] 10.222.0.72 "GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe" status: 404 len: 111 microversion: 2.1 time: 0.064946 Aug 03 05:01:55.198374 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2936/5846] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:55 2022] GET /compute/v2.1/servers/ac741ce6-34c1-4cb7-92d1-4a3c3ae78efe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:01:55.387004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:55.391854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:55.395579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.396351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:55.397527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:55.398331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:56.032016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:56.050296 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb63352f-9426-4ed2-8f8f-2936bc4806f0 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.663889 Aug 03 05:01:56.050951 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2937/5847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:55 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:56.495887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02cd2d01-bd5c-4a83-975d-09158c16fb87 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.551002 Aug 03 05:01:56.497733 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2911/5848] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 3 05:01:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1553 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 05:01:56.510188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-83b79fb8-86ec-458e-9471-5713df27d547 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd540e28b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:56.596108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-83b79fb8-86ec-458e-9471-5713df27d547 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.089667 Aug 03 05:01:56.597158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2938/5849] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:01:56 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:57.076769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:57.077621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:57.092697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:57.093571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:57.102059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:57.102538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:57.428424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:57.437241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9d2779d-8826-4d2e-9af7-264601cd8ee7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.364502 Aug 03 05:01:57.447614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2912/5850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:57 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:01:57.612729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-57d08212-2f1d-4863-a584-bb1e2acb690e tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd59d38160>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:57.752795 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-57d08212-2f1d-4863-a584-bb1e2acb690e tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.145845 Aug 03 05:01:57.759485 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2939/5851] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:01:57 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:58.462921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:58.464202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:01:58.482091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:58.482552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:58.483588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:01:58.484771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:01:58.768763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a63e93bd-99a9-428c-9db3-bf819fc15f45 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd54095ca0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:01:58.889607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a63e93bd-99a9-428c-9db3-bf819fc15f45 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.126582 Aug 03 05:01:58.890801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2940/5852] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:01:58 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:01:59.078476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:01:59.093184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-370e279e-2d77-4631-b19e-9428ca7c3d52 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.636289 Aug 03 05:01:59.097777 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2913/5853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:01:58 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:01:59.907193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28770863-64de-41bc-89de-cf0aba536c13 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd54609670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:00.040766 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28770863-64de-41bc-89de-cf0aba536c13 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 354 microversion: 2.1 time: 0.139592 Aug 03 05:02:00.048518 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2941/5854] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:01:59 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:00.054114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-980c8ad7-8116-4c24-b64e-2f0e098e6412 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd4759cca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:00.116308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:00.117000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:00.151467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:00.151926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:00.152753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:00.153381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:00.162735 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-980c8ad7-8116-4c24-b64e-2f0e098e6412 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 354 microversion: 2.1 time: 0.112519 Aug 03 05:02:00.163323 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2914/5855] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:00 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:00.177564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3e1a89b-1516-49ef-9c50-349ee9257712 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd473a8c10>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:00.461485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:00.469437 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b0230eef-f657-4d9f-8279-bb2950281193 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.358317 Aug 03 05:02:00.474596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2942/5856] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:00 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:02:00.474596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7c9f0419-2e76-4c8d-be4d-671446b79012 req-7cc8a364-b7b9-4eb8-9e4d-c1a0176044e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d43e653-5c1e-4cd7-89f5-b212c2cb54aa", "name": "network-vif-plugged", "status": "completed", "tag": "14a00f07-eba9-49d9-8fad-21a40933d065"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:02:00.484079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7c9f0419-2e76-4c8d-be4d-671446b79012 req-7cc8a364-b7b9-4eb8-9e4d-c1a0176044e1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:00.484583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7c9f0419-2e76-4c8d-be4d-671446b79012 req-7cc8a364-b7b9-4eb8-9e4d-c1a0176044e1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:00.496227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7c9f0419-2e76-4c8d-be4d-671446b79012 req-7cc8a364-b7b9-4eb8-9e4d-c1a0176044e1 service nova] Creating event network-vif-plugged:14a00f07-eba9-49d9-8fad-21a40933d065 for instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa on n-h1-826756-5 Aug 03 05:02:00.502501 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7c9f0419-2e76-4c8d-be4d-671446b79012 req-7cc8a364-b7b9-4eb8-9e4d-c1a0176044e1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Aug 03 05:02:00.503261 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2943/5857] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:00.590435 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3e1a89b-1516-49ef-9c50-349ee9257712 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 202 len: 0 microversion: 2.1 time: 0.417593 Aug 03 05:02:00.591485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2915/5858] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 05:02:00 2022] DELETE /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:02:00.606942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b822a614-5b60-4ea2-94b7-a64b31d15e81 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd54f643a0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:00.746368 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b822a614-5b60-4ea2-94b7-a64b31d15e81 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.148716 Aug 03 05:02:00.746955 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2944/5859] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:00 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:01.499129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:01.502718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:01.520640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:01.521502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:01.523706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:01.524931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:01.767782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18d053a5-3ddb-4a0e-965e-b31791ddfd12 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd59d38820>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:02.070982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18d053a5-3ddb-4a0e-965e-b31791ddfd12 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.305347 Aug 03 05:02:02.077441 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2945/5860] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:01 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:02.408235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:02.428241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a46c13c-5847-47b0-aed4-3c972b58ef48 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1314 microversion: 2.1 time: 0.937998 Aug 03 05:02:02.434527 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2916/5861] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:01 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1314 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:02:03.085754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1bede98c-d2d0-447c-9e00-80464dce4bbe tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd54b220d0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:03.198942 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1bede98c-d2d0-447c-9e00-80464dce4bbe tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.116840 Aug 03 05:02:03.199536 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2946/5862] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:03 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:03.451127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:03.453688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:03.475959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:03.480569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:03.481487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:03.486044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:03.888625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:03.902288 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f90851f-9674-41c3-986b-3b2a5823c8b7 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1497 microversion: 2.1 time: 0.453193 Aug 03 05:02:03.903476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2917/5863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:03 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1497 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:02:04.216149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab6c0f83-4e6c-4fbe-baec-a23cfe2bd639 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd54851670>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:04.272541 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab6c0f83-4e6c-4fbe-baec-a23cfe2bd639 tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 200 len: 353 microversion: 2.1 time: 0.061191 Aug 03 05:02:04.273124 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2947/5864] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:04 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:02:05.287915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a60dfd2f-1303-4c40-8cbd-b89167f4eb7a tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Calling method '.version_select at 0x7fdd474178b0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:05.376815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a60dfd2f-1303-4c40-8cbd-b89167f4eb7a tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] HTTP exception thrown: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a60dfd2f-1303-4c40-8cbd-b89167f4eb7a tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Request method failure captured: Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df HTTP/1.1 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gFCtpkRHtKJpUevfq69ArRmHR0sSoN2F_Pmpb4cJcytuyXNkPBRXyHMcRbhrld-iiLqSKO6pOsGuEudm1C8T_l7ynbPCQecsYngl8k83mNpPRnYhaLCXFKoM4yjxdDhppaZLVCpAR9uOiItMjCNudDLGGC23QxpSHGftBKk0r07G74 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 2c1f6225207546e6b970b4a58eca0649 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesGetTestJSON-2121986775 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c1f6225207546e6b970b4a58eca0649"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2c1f6225207546e6b970b4a58eca0649"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2c1f6225207546e6b970b4a58eca0649"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2c1f6225207546e6b970b4a58eca0649"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesGetTestJSON-2121986775 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 2c1f6225207546e6b970b4a58eca0649 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesGetTestJSON-2121986775 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesGetTestJSON-2121986775-project Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: bb878706b8bd4cc4883bfc4bee096c61 Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesGetTestJSON-2121986775-project Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: exception: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'da900ae6-c507-4833-b45e-8b45165b14df'} Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. (HTTP 404) (Request-ID: req-c6407686-b4ac-4235-8eb5-1cca26150142) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:02:05.379125 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a60dfd2f-1303-4c40-8cbd-b89167f4eb7a tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] Returning 404 to user: Volume da900ae6-c507-4833-b45e-8b45165b14df could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:05.385944 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a60dfd2f-1303-4c40-8cbd-b89167f4eb7a tempest-VolumesGetTestJSON-2121986775 tempest-VolumesGetTestJSON-2121986775-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df" status: 404 len: 109 microversion: 2.1 time: 0.097430 Aug 03 05:02:05.388843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2918/5865] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:05 2022] GET /compute/v2.1/os-volumes/da900ae6-c507-4833-b45e-8b45165b14df => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:02:05.527242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:05.528020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:05.539535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:05.540228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:05.541930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:05.542545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:05.581808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:02:06.009573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dee9b338-b232-44e7-a512-0c8ffe5a3525 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "DELETE /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 204 len: 0 microversion: 2.1 time: 0.487005 Aug 03 05:02:06.011690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2948/5866] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:02:05 2022] DELETE /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:02:06.027631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:06.029503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:06.040913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:06.044965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:06.052817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:06.052817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:06.257939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:06.266779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa3b98e9-4d44-4d59-9015-0978eec26eb1 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1503 microversion: 2.1 time: 0.245560 Aug 03 05:02:06.268014 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2919/5867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:06 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:02:07.293017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:07.333182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:07.333182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:07.333182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:07.333182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:07.333182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:07.775641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:07.804526 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-575ac329-2604-4ca2-a210-92de80123b26 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1503 microversion: 2.1 time: 0.517944 Aug 03 05:02:07.814674 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2949/5868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:07 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:02:08.610280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-21559ccf-9e40-4c61-a42c-338572d4a7bf req-7146817a-e491-430d-8d27-ebce0be3b318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d43e653-5c1e-4cd7-89f5-b212c2cb54aa", "name": "network-vif-deleted", "tag": "14a00f07-eba9-49d9-8fad-21a40933d065"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:02:08.632875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21559ccf-9e40-4c61-a42c-338572d4a7bf req-7146817a-e491-430d-8d27-ebce0be3b318 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:08.633401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21559ccf-9e40-4c61-a42c-338572d4a7bf req-7146817a-e491-430d-8d27-ebce0be3b318 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:08.647526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-21559ccf-9e40-4c61-a42c-338572d4a7bf req-7146817a-e491-430d-8d27-ebce0be3b318 service nova] Creating event network-vif-deleted:14a00f07-eba9-49d9-8fad-21a40933d065 for instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa on n-h1-826756-5 Aug 03 05:02:08.663371 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-21559ccf-9e40-4c61-a42c-338572d4a7bf req-7146817a-e491-430d-8d27-ebce0be3b318 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057073 Aug 03 05:02:08.665423 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2920/5869] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:02:08.850482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:08.851270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:08.867526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:08.868114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:08.869040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:08.869735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:09.248806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660fc67eadd846ce800e30a28ad11ef1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7393e355df344358c8967ac800a577e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:02:09.259318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35d676d2-16cb-4743-9b55-77391658b4e6 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 200 len: 1299 microversion: 2.1 time: 0.414912 Aug 03 05:02:09.265253 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2950/5870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:08 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:02:10.290532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:10.292331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] [instance: 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:02:10.307421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:10.314532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:10.315392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:02:10.315841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:02:10.341841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] HTTP exception thrown: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Request method failure captured: Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa HTTP/1.1 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gENRX_yG_6qL29IapaZDra99yXz5N8l0Frd55VDS_l8N37zYjU3XHfVEB0tCGcMFAsM5m5OYgmJJAErHKs7y4A9FfYVjC2-wrCo9I_cGxSNknGdoOi8Rxc65kXm8Q9V5gIpqhvA-mTeFJn6ge2qhkBbi0HO3nYxrcsiJvhnh6UApAw Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b7393e355df344358c8967ac800a577e Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesActionsTest-1909414320 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7393e355df344358c8967ac800a577e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b7393e355df344358c8967ac800a577e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b7393e355df344358c8967ac800a577e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b7393e355df344358c8967ac800a577e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesActionsTest-1909414320 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b7393e355df344358c8967ac800a577e Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesActionsTest-1909414320 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesActionsTest-1909414320-project Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 660fc67eadd846ce800e30a28ad11ef1 Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesActionsTest-1909414320-project Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '6d43e653-5c1e-4cd7-89f5-b212c2cb54aa'} Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:10.344560 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. Aug 03 05:02:10.351554 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:10.353026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] Returning 404 to user: Instance 6d43e653-5c1e-4cd7-89f5-b212c2cb54aa could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:10.353796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10255df7-c581-4735-be6b-499755abe454 tempest-VolumesActionsTest-1909414320 tempest-VolumesActionsTest-1909414320-project] 10.222.0.72 "GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa" status: 404 len: 111 microversion: 2.1 time: 0.068984 Aug 03 05:02:10.356349 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2921/5871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:02:10 2022] GET /compute/v2.1/servers/6d43e653-5c1e-4cd7-89f5-b212c2cb54aa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:02:12.368051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c864f2d7-da58-49e1-8021-ecbe3903642f tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Action: 'create', calling method: .version_select at 0x7fdd59e52c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1771340663", "metadata": {"Type": "work"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c864f2d7-da58-49e1-8021-ecbe3903642f tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 122 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1771340663", "metadata": {"Type": "work"}}} Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1771340663', 'metadata': {'Type': 'work'}}}} Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:02:12.372119 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c864f2d7-da58-49e1-8021-ecbe3903642f tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c864f2d7-da58-49e1-8021-ecbe3903642f tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.650156 Aug 03 05:02:12.376725 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2951/5872] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 3 05:02:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 651 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:02:12.392762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03787afb-2aa7-4461-afdf-8dee21faf4b3 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Action: 'create', calling method: .version_select at 0x7fdd55086310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-664567846", "metadata": {"Type": "work"}}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03787afb-2aa7-4461-afdf-8dee21faf4b3 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 119 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-664567846", "metadata": {"Type": "work"}}} Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-664567846', 'metadata': {'Type': 'work'}}}} Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi '0' Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:02:12.396856 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03787afb-2aa7-4461-afdf-8dee21faf4b3 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03787afb-2aa7-4461-afdf-8dee21faf4b3 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009671 Aug 03 05:02:12.400646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2922/5873] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 3 05:02:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:02:12.408178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f896393-9e77-461c-9943-de62018a8bba tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Action: 'create', calling method: .version_select at 0x7fdd54089d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-94834099", "metadata": {"Type": "work"}}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f896393-9e77-461c-9943-de62018a8bba tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 117 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-94834099", "metadata": {"Type": "work"}}} Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-94834099', 'metadata': {'Type': 'work'}}}} Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi '' Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:02:12.412885 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f896393-9e77-461c-9943-de62018a8bba tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f896393-9e77-461c-9943-de62018a8bba tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010315 Aug 03 05:02:12.416742 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2952/5874] 10.222.0.72 () {60 vars in 1156 bytes} [Wed Aug 3 05:02:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 05:02:12.429123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce3e2826-a773-441b-b815-d39839ae9baa tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Calling method '.version_select at 0x7fdd47c12dc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:12.482076 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ce3e2826-a773-441b-b815-d39839ae9baa tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] HTTP exception thrown: Volume tempest-invalid-1901419775 could not be found. Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce3e2826-a773-441b-b815-d39839ae9baa tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1901419775 HTTP/1.1 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: exception: Volume tempest-invalid-1901419775 could not be found. Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'tempest-invalid-1901419775'} Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1901419775 could not be found. (HTTP 404) (Request-ID: req-d884421d-9e63-45f9-94db-1a67223e482e) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:02:12.484585 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1901419775 could not be found. Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1901419775 could not be found. Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1901419775 could not be found. Aug 03 05:02:12.489896 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.495036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce3e2826-a773-441b-b815-d39839ae9baa tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 404 to user: Volume tempest-invalid-1901419775 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.495036 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce3e2826-a773-441b-b815-d39839ae9baa tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1901419775" status: 404 len: 99 microversion: 2.1 time: 0.069183 Aug 03 05:02:12.495036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2923/5875] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 05:02:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1901419775 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 05:02:12.511929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8185d36-ec0e-40ae-8fd2-b138a269488a tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009285 Aug 03 05:02:12.513718 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2953/5876] 10.222.0.72 () {58 vars in 1140 bytes} [Wed Aug 3 05:02:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 03 05:02:12.525151 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1704637f-f82d-4c4b-bfe1-4bbb5746a63c tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004213 Aug 03 05:02:12.525659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2924/5877] 10.222.0.72 () {58 vars in 1137 bytes} [Wed Aug 3 05:02:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 05:02:12.535267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0adb0d3-6d51-49dd-b09f-069c8a6aa7a9 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Calling method '.version_select at 0x7fdd5473c5e0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:12.615798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e0adb0d3-6d51-49dd-b09f-069c8a6aa7a9 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] HTTP exception thrown: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0adb0d3-6d51-49dd-b09f-069c8a6aa7a9 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/os-volumes/9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a HTTP/1.1 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: method: Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: exception: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a'} Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. (HTTP 404) (Request-ID: req-5ec8ac17-071f-4e21-8a8a-9ca3ffd06cae) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:02:12.617812 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0adb0d3-6d51-49dd-b09f-069c8a6aa7a9 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 404 to user: Volume 9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0adb0d3-6d51-49dd-b09f-069c8a6aa7a9 tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a" status: 404 len: 109 microversion: 2.1 time: 0.088523 Aug 03 05:02:12.624915 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2954/5878] 10.222.0.72 () {58 vars in 1248 bytes} [Wed Aug 3 05:02:12 2022] DELETE /compute/v2.1/os-volumes/9badbe8a-c1ff-4a4e-b0b3-5c47c12d602a => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:02:12.634824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18c409d7-1e22-4c3a-b90a-ee9ed07a99ac tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Calling method '.version_select at 0x7fdd47477b80>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:02:12.671040 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-18c409d7-1e22-4c3a-b90a-ee9ed07a99ac tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] HTTP exception thrown: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18c409d7-1e22-4c3a-b90a-ee9ed07a99ac tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Request method failure captured: Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/os-volumes/872e70e9-f315-479b-9ab8-ec5949824aef HTTP/1.1 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gFTgtg-3LYHCnuOL102pgS4Ouw7jUBdFQJxEv9l-aEN_I9NPHqg8lkQDxev2Klj5Hb_sRfRHdFcexeOnTaoWwd6h3vX4PMDVEikj6LeR-J6r_CYnLh773XdoAgFxPAKjpuNe4OTSC-xUjLbT0Dw6U9i2J0ZMKHHizp8xxRdMxn3V64 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/6cbc3f9c0f7e425abb4fb4bc708d88d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 6cbc3f9c0f7e425abb4fb4bc708d88d6 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesNegativeTest-2108902566 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0027ad31b6d942aeb9e671eac7e11c80 Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesNegativeTest-2108902566-project Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: method: Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: exception: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '872e70e9-f315-479b-9ab8-ec5949824aef'} Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. (HTTP 404) (Request-ID: req-332a3527-ff63-4a56-8710-3ad3f933f3f4) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 05:02:12.673936 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. Aug 03 05:02:12.678148 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:02:12.685577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18c409d7-1e22-4c3a-b90a-ee9ed07a99ac tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] Returning 404 to user: Volume 872e70e9-f315-479b-9ab8-ec5949824aef could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:02:12.691901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18c409d7-1e22-4c3a-b90a-ee9ed07a99ac tempest-VolumesNegativeTest-2108902566 tempest-VolumesNegativeTest-2108902566-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/872e70e9-f315-479b-9ab8-ec5949824aef" status: 404 len: 109 microversion: 2.1 time: 0.062360 Aug 03 05:02:12.697596 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2925/5879] 10.222.0.72 () {58 vars in 1245 bytes} [Wed Aug 3 05:02:12 2022] GET /compute/v2.1/os-volumes/872e70e9-f315-479b-9ab8-ec5949824aef => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:02:48.616494 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:02:48.617317 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:03:16.544076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:16.545743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:16.550589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-977914295", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5680e4b1-b3ae-401f-b9c4-993ed9434f2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:03:16.717128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:03:18.773902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:03:18.774520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:03:18.774797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:03:18.775216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:03:18.775631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:03:18.798526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:18.798986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:18.799797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:18.800243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:18.862681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:03:18.869044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:03:19.018572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:03:19.020821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5680e4b1-b3ae-401f-b9c4-993ed9434f2d',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:03:19.635837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85fd519b-abc1-4985-b618-1b814a182cae tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.094944 Aug 03 05:03:19.640407 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2955/5880] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:03:19.649763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=15 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:19.651650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=66 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:19.657774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a32e56bc-bb8c-4932-b0f5-f93909e6ddb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:19.661299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a32e56bc-bb8c-4932-b0f5-f93909e6ddb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:19.796113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a32e56bc-bb8c-4932-b0f5-f93909e6ddb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:19.803822 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a32e56bc-bb8c-4932-b0f5-f93909e6ddb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1056 microversion: 2.1 time: 0.156457 Aug 03 05:03:19.804468 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2926/5881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:19 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1056 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:20.827896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-080c59db-b30c-448a-821b-4086927e4e08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:20.829319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-080c59db-b30c-448a-821b-4086927e4e08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:20.936128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-080c59db-b30c-448a-821b-4086927e4e08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:20.937762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-080c59db-b30c-448a-821b-4086927e4e08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1056 microversion: 2.1 time: 0.116476 Aug 03 05:03:20.938511 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2956/5882] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:20 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1056 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:21.964300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b5b904c-45f0-41ee-9c0b-231b9ace0ea6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:21.965493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b5b904c-45f0-41ee-9c0b-231b9ace0ea6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:22.139000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b5b904c-45f0-41ee-9c0b-231b9ace0ea6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:22.153720 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b5b904c-45f0-41ee-9c0b-231b9ace0ea6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1056 microversion: 2.1 time: 0.194109 Aug 03 05:03:22.164302 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2927/5883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:21 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1056 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:23.177744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:23.178701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:23.203976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:23.204490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:23.205583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:23.208540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:23.379124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:23.388961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a122613f-5487-4475-bb38-b69a5636e299 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1154 microversion: 2.1 time: 0.214818 Aug 03 05:03:23.401284 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2957/5884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:23 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1154 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:24.415570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:24.416202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:24.433483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:24.434058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:24.435025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:24.435545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:24.579075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:24.594241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68d0ca80-3098-4e21-9abd-905e5c4bb1a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1172 microversion: 2.1 time: 0.182670 Aug 03 05:03:24.612068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2928/5885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:24 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1172 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:25.619975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:25.635733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:25.652143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:25.652906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:25.653892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:25.654485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:25.975408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:25.987737 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04d01e47-186a-49e7-a678-b3f97c9dcfbf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.372875 Aug 03 05:03:25.989920 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2958/5886] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:25 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:27.020200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:27.020200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:27.035123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:27.042188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:27.045808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:27.058500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:27.498499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:27.508002 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b94ac3f4-e575-4527-88e0-768745517c0c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.495027 Aug 03 05:03:27.517091 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2929/5887] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:27 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:28.537757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:28.538359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:28.552708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5bc7421f-66f4-44d1-9fb8-24bce837a154 req-cea095cd-9db3-4964-9ea1-e1e66b266ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d0e3f5e-8937-409a-989a-73102e307c5f", "tag": "359003fd-f25d-443d-a696-cad046bc05b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:03:28.553198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:28.553198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:28.553198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:28.553198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:28.583719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5bc7421f-66f4-44d1-9fb8-24bce837a154 req-cea095cd-9db3-4964-9ea1-e1e66b266ecd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:28.584473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5bc7421f-66f4-44d1-9fb8-24bce837a154 req-cea095cd-9db3-4964-9ea1-e1e66b266ecd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:28.636227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5bc7421f-66f4-44d1-9fb8-24bce837a154 req-cea095cd-9db3-4964-9ea1-e1e66b266ecd service nova] Creating event network-changed:359003fd-f25d-443d-a696-cad046bc05b6 for instance 1d0e3f5e-8937-409a-989a-73102e307c5f on n-h1-826756-5 Aug 03 05:03:28.683327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5bc7421f-66f4-44d1-9fb8-24bce837a154 req-cea095cd-9db3-4964-9ea1-e1e66b266ecd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.916905 Aug 03 05:03:28.683327 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2959/5888] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:03:28.883748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:28.894013 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5e10a4b-f1e3-4896-a7ac-934584d5a618 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.360563 Aug 03 05:03:28.894704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2930/5889] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:28 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:03:29.916022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:29.916886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:29.925574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:29.927949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:29.928717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:29.929501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:29.929939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:30.176186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:30.198267 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66430938-47a8-404f-8f56-7913a204ffc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.284745 Aug 03 05:03:30.218844 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2960/5890] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:29 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:31.219734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:31.220676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:31.245804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:31.246609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:31.247720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:31.251157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:31.691317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:31.702734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b400fd6-92d5-4287-b0cc-20490f6d5a2f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.487482 Aug 03 05:03:31.717019 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2931/5891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:31 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:32.729337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:32.730585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:32.738032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:32.741330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:32.742769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:32.743945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:32.744691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:33.020132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:33.030628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72c6779c-a1a0-4031-8875-8da2db4ebf88 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.306617 Aug 03 05:03:33.031839 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2961/5892] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:32 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:34.056892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:34.057601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:34.060307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:34.073758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:34.087855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:34.088984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:34.089747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:34.928526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:34.942187 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3da65745-2595-4824-be43-10b5d758b791 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1214 microversion: 2.1 time: 0.889223 Aug 03 05:03:34.943007 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2932/5893] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:34 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1214 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:35.963471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:35.964095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:35.998289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:35.998751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:35.999549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:35.999989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:36.336111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:36.344898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68f45b54-ddc3-475c-9454-3f7f6f9b1468 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.385567 Aug 03 05:03:36.354678 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2962/5894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:35 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:37.377498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:37.396339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:37.409473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:37.409941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:37.410745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:37.411194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:37.939000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:37.967593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9989920-bf56-4a73-b936-15fa00ae8778 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.593863 Aug 03 05:03:37.989639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2933/5895] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:37 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:38.994537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:38.996698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:39.010170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:39.011128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:39.012751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:39.013400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:39.405909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:39.421538 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-132ade7a-2918-47ca-b5e6-a6de4bed37d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.427373 Aug 03 05:03:39.423913 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2963/5896] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:38 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:40.444308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:40.445019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:40.461594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:40.473277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:40.474318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:40.474919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:40.741553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:40.756337 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9fdd282-1aba-48aa-b691-b45e1cc3d125 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.315663 Aug 03 05:03:40.758391 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2934/5897] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:40 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:41.780990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:41.782450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:41.802492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:41.802951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:41.803726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:41.804188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:42.244803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:42.255913 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6840db38-041f-4ee0-af7d-d46288cea66f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.479718 Aug 03 05:03:42.289303 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2964/5898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:41 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:43.283470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:43.286328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:43.310223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:43.312490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:43.312490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:43.312490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:43.989207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:43.999917 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b3f8bad-ba2b-4b3e-a18c-1a1c0118a2db tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.721641 Aug 03 05:03:44.001920 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2935/5899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:43 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:45.024125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:45.025277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:45.041710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:45.042732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:45.046807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:45.047662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:45.537666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:45.550528 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d46ff8c4-5593-4eec-b4d1-688c8dad1a99 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.531229 Aug 03 05:03:45.552365 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2965/5900] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:45 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:46.028816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a80befe8-1779-48ec-83af-7bd8f79c9a7a req-a1312b48-e20f-4d30-8572-bd24eff5e1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e3f5e-8937-409a-989a-73102e307c5f", "name": "network-vif-plugged", "status": "completed", "tag": "359003fd-f25d-443d-a696-cad046bc05b6"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:03:46.054969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a80befe8-1779-48ec-83af-7bd8f79c9a7a req-a1312b48-e20f-4d30-8572-bd24eff5e1c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:46.055523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a80befe8-1779-48ec-83af-7bd8f79c9a7a req-a1312b48-e20f-4d30-8572-bd24eff5e1c1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:46.137176 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a80befe8-1779-48ec-83af-7bd8f79c9a7a req-a1312b48-e20f-4d30-8572-bd24eff5e1c1 service nova] Creating event network-vif-plugged:359003fd-f25d-443d-a696-cad046bc05b6 for instance 1d0e3f5e-8937-409a-989a-73102e307c5f on n-h1-826756-5 Aug 03 05:03:46.171945 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a80befe8-1779-48ec-83af-7bd8f79c9a7a req-a1312b48-e20f-4d30-8572-bd24eff5e1c1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.691125 Aug 03 05:03:46.177772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2936/5901] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:03:46.575656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:46.576315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:46.595871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:46.596336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:46.597122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:46.597669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:46.966797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:46.978640 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dae2478b-aad9-4710-970f-8d076e0db251 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1202 microversion: 2.1 time: 0.407068 Aug 03 05:03:46.980898 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2966/5902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:46 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:48.043496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:48.045358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:48.061050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:48.061948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:48.063017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:48.063681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:48.705196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:48.724517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a3ac603-6be2-4f42-95f7-9e8b882bd099 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1389 microversion: 2.1 time: 0.686803 Aug 03 05:03:48.729611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2937/5903] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:48 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1389 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:48.758043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:48.758043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:48.761209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:48.763848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:48.764603 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:48.765644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:48.766311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:48.826912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=59 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:49.184232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:49.195547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-238b3dca-46df-4b65-86de-2b523defb3f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1389 microversion: 2.1 time: 0.446477 Aug 03 05:03:49.200858 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2967/5904] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:48 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1389 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:49.220245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:49.224666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:49.247533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:49.248017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:49.252223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:49.255299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:49.796732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:49.806605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b3ecc1c-248b-4509-a8d2-36743d901042 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1389 microversion: 2.1 time: 0.591160 Aug 03 05:03:49.807209 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2938/5905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:49 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1389 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:49.836949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:49.836949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:49.850801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:49.854966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:49.860263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:49.862986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:49.944610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:03:50.616740 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b558b19-2d01-4640-95ee-c36bbe4242ee tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 204 len: 0 microversion: 2.1 time: 0.789657 Aug 03 05:03:50.617771 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2968/5906] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:03:49 2022] DELETE /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:03:50.633016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:50.633721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:50.645861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:50.651935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:50.661157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:50.663442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:51.162535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:51.179165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30cd29d9-9721-49bd-8426-2b2bbce1d79f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1395 microversion: 2.1 time: 0.550581 Aug 03 05:03:51.179822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2939/5907] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:50 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1395 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:52.217260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:52.217260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:52.231722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:52.232282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:52.233160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:52.236777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:52.840327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:52.854073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-877abb02-bf1f-49c0-997c-2c4a99c61eb6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1395 microversion: 2.1 time: 0.650812 Aug 03 05:03:52.874920 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2969/5908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:52 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1395 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:53.881773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:53.882409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:53.889194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=33 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:53.902581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:53.906736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:53.906937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:53.909025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:53.919765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=69 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:03:54.087505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:54.102033 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5eb9335-64de-41cb-bd54-97be33fed939 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1353 microversion: 2.1 time: 0.225971 Aug 03 05:03:54.129031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2940/5909] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:53 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:54.410082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-91c9ebcd-5f7e-48b4-9bee-0a1606c5feb0 req-fa07cb05-4659-4cff-8f6a-227b7d8616d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d0e3f5e-8937-409a-989a-73102e307c5f", "name": "network-vif-deleted", "tag": "359003fd-f25d-443d-a696-cad046bc05b6"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:03:54.442110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-91c9ebcd-5f7e-48b4-9bee-0a1606c5feb0 req-fa07cb05-4659-4cff-8f6a-227b7d8616d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:54.444717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-91c9ebcd-5f7e-48b4-9bee-0a1606c5feb0 req-fa07cb05-4659-4cff-8f6a-227b7d8616d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:54.498084 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-91c9ebcd-5f7e-48b4-9bee-0a1606c5feb0 req-fa07cb05-4659-4cff-8f6a-227b7d8616d5 service nova] Creating event network-vif-deleted:359003fd-f25d-443d-a696-cad046bc05b6 for instance 1d0e3f5e-8937-409a-989a-73102e307c5f on n-h1-826756-5 Aug 03 05:03:54.520315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-91c9ebcd-5f7e-48b4-9bee-0a1606c5feb0 req-fa07cb05-4659-4cff-8f6a-227b7d8616d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114466 Aug 03 05:03:54.527514 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2970/5910] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:03:55.125830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:55.126569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:55.148675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:55.153921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:55.157947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:55.161922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:55.621819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:55.642301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc7dcb89-b903-40e6-b5eb-792b0cec4037 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.509965 Aug 03 05:03:55.655404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2941/5911] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:55 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:03:56.675849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:56.676936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:56.709676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.710148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:56.716244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:56.737180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:57.092579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:57.100698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45f8ecbf-276f-41cd-97c5-926b8076fcf8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.437266 Aug 03 05:03:57.103938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2971/5912] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:56 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:58.122657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:58.123995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:58.139272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:58.143132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:58.154605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:58.158222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:58.382751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:58.398451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ec57aac-32ba-484a-87b7-314941f9f8a4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.280545 Aug 03 05:03:58.403535 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2942/5913] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:58 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:03:59.436660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:03:59.438162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:03:59.458459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:59.459271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:59.463629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:03:59.463629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:03:59.909675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:03:59.935848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd67a735-cb00-4c60-9982-a6d90a96f34b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.509050 Aug 03 05:03:59.940116 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2972/5914] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:03:59 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:00.960527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:00.961294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:00.977450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:00.977841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:00.979217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:00.987762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:01.145077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:01.154682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa3800f2-f4f3-4d3a-ac4c-c8176b29db54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.199933 Aug 03 05:04:01.155249 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2943/5915] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:00 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:02.194668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:02.196166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:02.212318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:02.218393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:02.221060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:02.223493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:02.390547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:02.407814 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ef51b5b-5830-4ad5-aed9-5976a5d5d4f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1187 microversion: 2.1 time: 0.234463 Aug 03 05:04:02.419362 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2973/5916] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:02 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1187 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:03.346930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-702860e1-89ed-4a3d-8af6-5e4ac59fb1bd tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2039232460", "availability_zone": "foo_zone"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:03.351452 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:03.351452 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:03.352719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.aggregate [None req-702860e1-89ed-4a3d-8af6-5e4ac59fb1bd tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Generated uuid b8651f9a-f028-4443-b2a2-c79e56729737 for aggregate {{(pid=120832) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 03 05:04:03.450567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:03.451850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:03.475407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:03.475877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:03.486492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:03.487483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:03.535523 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-702860e1-89ed-4a3d-8af6-5e4ac59fb1bd tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.871570 Aug 03 05:04:03.544099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2944/5917] 10.222.0.72 () {60 vars in 1164 bytes} [Wed Aug 3 05:04:02 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:03.554889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d54f6866-298e-4d0c-b9ac-a02ca369de62 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:03.564873 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:03.564873 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:03.589972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:03.590494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:03.592035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid 1d0e3f5e-8937-409a-989a-73102e307c5f {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:04:03.657834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:03.666076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a1591a38-c603-4881-bb75-cd9aeb7b6163 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 200 len: 1192 microversion: 2.1 time: 0.239981 Aug 03 05:04:03.666931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2974/5918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:03 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 1192 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:03.742814 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d54f6866-298e-4d0c-b9ac-a02ca369de62 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.197459 Aug 03 05:04:03.743570 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2945/5919] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 05:04:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:03.755398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:03.758516 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:03.758516 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:04:03.760074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:03.761921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:03.762879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:03.763718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:03.792251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-661dfc88-37c2-4c7a-8051-8c50501b8398 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040610 Aug 03 05:04:03.799418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2975/5920] 10.222.0.72 () {58 vars in 1176 bytes} [Wed Aug 3 05:04:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:03.804861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e3e1d4e5-471a-43b5-ba94-26c8d302d3bf tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:03.805801 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:03.805801 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:03.814150 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e3e1d4e5-471a-43b5-ba94-26c8d302d3bf tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013336 Aug 03 05:04:03.814930 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2946/5921] 10.222.0.72 () {58 vars in 1143 bytes} [Wed Aug 3 05:04:03 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:04:03.829805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-5"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:03.832577 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:03.832577 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:04:03.834979 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 05:04:04.688661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:04.689512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 1d0e3f5e-8937-409a-989a-73102e307c5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:04.703123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:04.703823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:04.704996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:04.705592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:04.721049 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f HTTP/1.1 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1d0e3f5e-8937-409a-989a-73102e307c5f'} Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:04:04.722976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. Aug 03 05:04:04.727723 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:04:04.729063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 1d0e3f5e-8937-409a-989a-73102e307c5f could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:04:04.735573 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fafdcbec-5d09-419a-b6ad-8166ba5e70c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f" status: 404 len: 111 microversion: 2.1 time: 0.046826 Aug 03 05:04:04.735573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2947/5922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:04 2022] GET /compute/v2.1/servers/1d0e3f5e-8937-409a-989a-73102e307c5f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:04:04.852211 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46666. Aug 03 05:04:04.864926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:04.865484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:05.867608 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c2e163c9-0c16-41bf-9c6e-43f0102abb99 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 2.044468 Aug 03 05:04:05.871892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2976/5923] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 05:04:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:05.884449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7680196-f777-4e63-b86f-bde68cbe7947 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:05.896967 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:05.896967 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:05.904622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7680196-f777-4e63-b86f-bde68cbe7947 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.025915 Aug 03 05:04:05.906096 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2948/5924] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 05:04:05 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:05.920800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a83d5cb0-e6be-4fb1-9857-8c69f5dc37ff tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1590718760", "availability_zone": "foo_zone"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:05.924496 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:05.924496 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:04:06.144421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a83d5cb0-e6be-4fb1-9857-8c69f5dc37ff tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.227643 Aug 03 05:04:06.151996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2977/5925] 10.222.0.72 () {60 vars in 1173 bytes} [Wed Aug 3 05:04:05 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:06.157714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b0f043d-c109-4e95-9ede-f47fb568e529 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:06.167106 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:06.167106 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:06.311766 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b0f043d-c109-4e95-9ede-f47fb568e529 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.158801 Aug 03 05:04:06.312804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2949/5926] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 05:04:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:06.325286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f9c779f1-ce61-4c92-9411-1d3bbe9d4806 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:06.326145 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:06.326145 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:04:06.351880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f9c779f1-ce61-4c92-9411-1d3bbe9d4806 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.031273 Aug 03 05:04:06.358189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2978/5927] 10.222.0.72 () {58 vars in 1152 bytes} [Wed Aug 3 05:04:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:06.364872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19fe792f-4fb0-4c83-a46f-74c9ab9be053 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-5"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:06.367722 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:06.367722 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:04:06.406025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fe792f-4fb0-4c83-a46f-74c9ab9be053 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:06.407015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19fe792f-4fb0-4c83-a46f-74c9ab9be053 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:07.777960 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19fe792f-4fb0-4c83-a46f-74c9ab9be053 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 1.415394 Aug 03 05:04:07.788564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2950/5928] 10.222.0.72 () {60 vars in 1194 bytes} [Wed Aug 3 05:04:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:07.801368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d17446b1-6a6a-41f9-ae0a-197a9f5d3186 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:07.802185 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:04:07.802185 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:04:08.102917 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d17446b1-6a6a-41f9-ae0a-197a9f5d3186 tempest-TestAggregatesBasicOps-360029136 tempest-TestAggregatesBasicOps-360029136-project-admin] 10.222.0.72 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.307028 Aug 03 05:04:08.103915 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2979/5929] 10.222.0.72 () {58 vars in 1155 bytes} [Wed Aug 3 05:04:07 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 03 05:04:16.890098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=29 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:16.894812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1377351728", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8850e997-1248-42f6-8c97-41ac029ee2d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:16.988696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:04:17.689265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:04:17.689769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:04:17.690363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:04:17.691092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:04:17.704382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:04:17.740463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:17.740463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:17.740463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:17.740463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:17.783245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:04:17.787220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:04:17.886418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:04:17.888850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8850e997-1248-42f6-8c97-41ac029ee2d3',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:04:18.591031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14248dc9-eaff-4151-a28d-8986b1256619 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.702716 Aug 03 05:04:18.593523 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2951/5930] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:04:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:04:18.611250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dcb452a-a2a6-41b0-90fc-f20f929118b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:18.611250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dcb452a-a2a6-41b0-90fc-f20f929118b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:18.611250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:18.611951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:18.612320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:18.922295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9dcb452a-a2a6-41b0-90fc-f20f929118b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:18.935056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dcb452a-a2a6-41b0-90fc-f20f929118b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1057 microversion: 2.1 time: 0.331626 Aug 03 05:04:18.953446 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2980/5931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:18 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1057 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:19.961538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20babce6-800f-425d-af74-43ebdb72eb14 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:19.964164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-20babce6-800f-425d-af74-43ebdb72eb14 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:20.401674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20babce6-800f-425d-af74-43ebdb72eb14 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:20.412913 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20babce6-800f-425d-af74-43ebdb72eb14 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1057 microversion: 2.1 time: 0.456005 Aug 03 05:04:20.414180 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2952/5932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:19 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1057 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:21.436144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-099a4d3b-cc62-484b-9b36-b486748df190 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:21.436870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-099a4d3b-cc62-484b-9b36-b486748df190 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:21.705081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-099a4d3b-cc62-484b-9b36-b486748df190 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:21.723314 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-099a4d3b-cc62-484b-9b36-b486748df190 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1057 microversion: 2.1 time: 0.292416 Aug 03 05:04:21.726914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2981/5933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:21 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1057 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:22.749622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:22.750869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:22.765351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:22.766148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:22.767219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:22.767936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:23.638225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:23.651734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-549e6850-f6e7-445a-9ea1-d7d5b9b91f3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1107 microversion: 2.1 time: 0.904549 Aug 03 05:04:23.654129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2953/5934] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:22 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1107 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:24.677307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:24.677921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:24.688375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:24.688751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:24.689565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:24.690191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:25.114852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:25.129518 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-baab40d8-2cc4-4ce2-9d8a-d894e53f4de0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1163 microversion: 2.1 time: 0.458010 Aug 03 05:04:25.130220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2982/5935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:24 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1163 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:26.157103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:26.157103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:26.159392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:26.173911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:26.184170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:26.184170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:26.184170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:26.531598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:26.554698 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-043a65f5-530c-448e-a20d-1695840e297c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.403411 Aug 03 05:04:26.558551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2954/5936] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:26 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:27.580582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:27.581319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:27.594747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:27.599728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:27.600963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:27.602893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:27.896860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:27.902642 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-558640aa-c13d-4734-a35a-492a17df4ace tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.326060 Aug 03 05:04:27.910794 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2983/5937] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:27 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:28.095320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-14f7bbb0-7bcd-48b3-b730-f32af5b8f5c3 req-3640b557-3621-4536-bbc2-85fe6ac05234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f701fc72-ccd2-4c78-9051-bde671aa2d5e", "tag": "57f57a55-4437-41ef-897a-191db0f3298d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:28.102010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:28.127569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-14f7bbb0-7bcd-48b3-b730-f32af5b8f5c3 req-3640b557-3621-4536-bbc2-85fe6ac05234 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:28.128004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-14f7bbb0-7bcd-48b3-b730-f32af5b8f5c3 req-3640b557-3621-4536-bbc2-85fe6ac05234 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:28.191158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-14f7bbb0-7bcd-48b3-b730-f32af5b8f5c3 req-3640b557-3621-4536-bbc2-85fe6ac05234 service nova] Creating event network-changed:57f57a55-4437-41ef-897a-191db0f3298d for instance f701fc72-ccd2-4c78-9051-bde671aa2d5e on n-h1-826756-5 Aug 03 05:04:28.216405 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-14f7bbb0-7bcd-48b3-b730-f32af5b8f5c3 req-3640b557-3621-4536-bbc2-85fe6ac05234 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126212 Aug 03 05:04:28.222131 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2955/5938] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:28.944818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:28.960410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:28.968332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:28.973191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:28.975410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:28.976009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:29.645561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:29.660811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-656dfcff-153d-4ca8-aa10-06d7e47a8acd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.735800 Aug 03 05:04:29.662406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2984/5939] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:28 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:30.681214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:30.688560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:30.689511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:30.710872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:30.715777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:30.718050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:30.719518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:31.030460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:31.043163 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eb616fc9-e9ba-4713-9407-801312424022 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.363683 Aug 03 05:04:31.046940 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2956/5940] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:30 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:32.070176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:32.070800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:32.082360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:32.084002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:32.084498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:32.085292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:32.085730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:32.480643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:32.492513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c40a130-d2f8-4c9a-8612-ea5af7d117d5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.426247 Aug 03 05:04:32.494168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2985/5941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:32 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:33.518530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:33.519935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:33.531255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:33.532078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:33.533384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:33.534165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:33.739380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:33.758662 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-62fd6c84-165e-4bd1-893e-035018a5b65e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.244897 Aug 03 05:04:33.759538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2957/5942] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:33 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:34.783968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:34.786160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:34.801319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:34.805930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:34.805930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:34.805930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:35.117962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:35.132586 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7872fa28-170e-42ac-8a47-2945b9f5b749 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1215 microversion: 2.1 time: 0.353843 Aug 03 05:04:35.134172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2986/5943] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:34 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:36.154765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:36.155525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:36.164620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:36.165222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:36.166078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:36.167205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:36.516348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:36.534406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc4500f6-c8ec-4a46-99e4-0269e5e82b00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.383682 Aug 03 05:04:36.536608 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2958/5944] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:36 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:37.560576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:37.563974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:37.583156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:37.583627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:37.584467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:37.586566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:37.874665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:37.885407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d2318bf-d92b-479c-b4a0-777a74c63f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.329941 Aug 03 05:04:37.886319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2987/5945] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:37 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:38.908257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:38.909144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:38.916575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:38.917277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:38.919341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:38.920357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:39.089559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:39.098476 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eac79049-c7e1-4bd3-bd1d-9dd18585ac63 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.193339 Aug 03 05:04:39.098476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2959/5946] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:38 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:40.126049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:40.127127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:40.149553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:40.149553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:40.149553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:40.149553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:40.441130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:40.456881 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00ef2a3a-52ac-4f85-8621-0dd79392e9cd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.340514 Aug 03 05:04:40.460220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2988/5947] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:40 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:41.484165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:41.484819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:41.500863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:41.501375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:41.502516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:41.502668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:41.738561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:41.748206 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f865915-d55a-4d69-a03b-fe665c929aa1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.268562 Aug 03 05:04:41.749315 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2960/5948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:41 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:42.771803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:42.772556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:42.789520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:42.796671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:42.811831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:42.814052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:43.447016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:43.459109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43777263-d68f-4db2-ad09-4cd3c830d982 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.693051 Aug 03 05:04:43.468526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2989/5949] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:42 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:44.507246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:44.508114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:44.546734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:44.547347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:44.548218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:44.548834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:45.100040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:45.115626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-09703778-73a2-4ba3-95b6-2c2137b63ab7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.625654 Aug 03 05:04:45.116739 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2961/5950] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:44 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:46.143301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:46.143920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:46.153417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:46.153883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:46.154757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:46.155208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:47.131110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:47.144499 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c0a011f-c3cc-4030-a473-d3b784a48dc1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 1.005085 Aug 03 05:04:47.149928 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2990/5951] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:46 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:48.169682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:48.170944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:48.184356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:48.185190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:48.193830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:48.194550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:48.400256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:48.402846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=57 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:48.415716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8087c1af-60ac-418e-92ea-7e4847cfd4bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.249511 Aug 03 05:04:48.417264 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2962/5952] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:48 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:48.824086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5c37da4-c92f-4d9d-83d7-d62d0dc126da tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: .version_select at 0x7fdd47866430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1741309522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUqxP1xxkuQuST9ymHOgF4k7mLLIFBTKO2uZbwE4NzvW61xZtmHvQurXFP7d4fLruo2mho31MMoOKD7tQGuEWvp56QefX+zm8Ae+2QC+x4TlIcdUefvomqHa4K/JG/ZMg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:48.853879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b5c37da4-c92f-4d9d-83d7-d62d0dc126da tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:04:48.870209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b5c37da4-c92f-4d9d-83d7-d62d0dc126da tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:04:49.042784 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5c37da4-c92f-4d9d-83d7-d62d0dc126da tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.223120 Aug 03 05:04:49.053189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2991/5953] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:04:48 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:49.398359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f4b006bc-74dc-4587-9e2d-f888e6978d0e req-310612cd-60a3-417f-b653-0c2c1d11d9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f701fc72-ccd2-4c78-9051-bde671aa2d5e", "name": "network-vif-plugged", "status": "completed", "tag": "57f57a55-4437-41ef-897a-191db0f3298d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:49.422949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f4b006bc-74dc-4587-9e2d-f888e6978d0e req-310612cd-60a3-417f-b653-0c2c1d11d9f3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:49.423733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f4b006bc-74dc-4587-9e2d-f888e6978d0e req-310612cd-60a3-417f-b653-0c2c1d11d9f3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:49.454414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:49.455245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:49.457112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f4b006bc-74dc-4587-9e2d-f888e6978d0e req-310612cd-60a3-417f-b653-0c2c1d11d9f3 service nova] Creating event network-vif-plugged:57f57a55-4437-41ef-897a-191db0f3298d for instance f701fc72-ccd2-4c78-9051-bde671aa2d5e on n-h1-826756-5 Aug 03 05:04:49.462248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:49.463215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:49.464322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:49.464957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:49.468877 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f4b006bc-74dc-4587-9e2d-f888e6978d0e req-310612cd-60a3-417f-b653-0c2c1d11d9f3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076781 Aug 03 05:04:49.471515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2963/5954] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:49.961190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:49.976703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f13bf94d-0be2-4f05-8e58-1af529e5becf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.539171 Aug 03 05:04:49.978029 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2992/5955] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:49 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:51.011907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:51.014094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:51.065540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:51.067198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:51.073654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:51.074412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:51.407956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:51.418462 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-41ff9049-c36a-4158-a5b9-31325c1a8180 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1203 microversion: 2.1 time: 0.414464 Aug 03 05:04:51.433852 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2964/5956] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:51 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1203 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:52.444559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:52.445829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:52.458137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:52.461046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:52.461046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:52.461046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:52.906116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:52.914312 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45e88990-e694-43eb-8243-673bc4757810 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1390 microversion: 2.1 time: 0.474747 Aug 03 05:04:52.915422 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2993/5957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:52 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1390 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:52.936519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:52.937149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:52.958322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:52.959931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:52.962512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:52.963231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:53.234820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:53.244187 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-760133f8-4574-48e6-bfd4-2a2b6d9d7b61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1390 microversion: 2.1 time: 0.312479 Aug 03 05:04:53.252467 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2965/5958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:52 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1390 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:53.264527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:53.265227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:53.271713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:53.272238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:53.273225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:53.273676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:53.445037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:53.458225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2510ae7a-cc49-428d-aa84-e8b872506c0e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1390 microversion: 2.1 time: 0.197533 Aug 03 05:04:53.459324 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2994/5959] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:53 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:53.479884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:53.480926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:53.488032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:53.488734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:53.489431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:53.489910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:53.517515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:04:54.059115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1743545727", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "9a4d4cf9-1611-4afb-8d97-447df631dcb1"}], "key_name": "tempest-TestNetworkBasicOps-1741309522", "security_groups": [{"name": "tempest-secgroup-smoke-2048065673"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:54.089142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de635814-cc8a-4989-9715-6d65f7a3581b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 204 len: 0 microversion: 2.1 time: 0.611247 Aug 03 05:04:54.094981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2966/5960] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:04:53 2022] DELETE /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:04:54.102845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:54.114775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:54.160838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:54.164962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:54.165885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:54.169731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:54.358273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] validate_networks() for [('9a4d4cf9-1611-4afb-8d97-447df631dcb1', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:04:54.555887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:54.569828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5fb1b49-04a4-4cfe-91a6-3b3666962e60 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1396 microversion: 2.1 time: 0.471131 Aug 03 05:04:54.572771 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2967/5961] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:54 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1396 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:55.601265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:55.602594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:55.617009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:55.626239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:55.628236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:55.629404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:55.969794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:04:55.969794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:04:55.969794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:04:55.969794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:04:55.969794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:04:55.978732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:55.979561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:55.980423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:55.980876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:55.999789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:04:56.005443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:04:56.018721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:04:56.021568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:04:56.158284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:56.169296 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce135275-5155-41c2-8c6f-174d7d312793 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1396 microversion: 2.1 time: 0.572642 Aug 03 05:04:56.173312 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2968/5962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:55 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1396 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:56.739249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64bf1ade-aac2-4a6a-841e-476bccdaa3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.681741 Aug 03 05:04:56.745743 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2995/5963] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:04:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:04:56.752296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc76c007-00cc-4289-a98e-a08980229dbe tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:56.753176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc76c007-00cc-4289-a98e-a08980229dbe tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:56.950007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc76c007-00cc-4289-a98e-a08980229dbe tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:56.972188 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc76c007-00cc-4289-a98e-a08980229dbe tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1249 microversion: 2.1 time: 0.224590 Aug 03 05:04:56.972844 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2969/5964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:56 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1249 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:56.996874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-606795d5-bfea-42cb-ac8e-0a8e34aeeb70 req-5203c623-2c28-45c5-b840-b67509f76935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f701fc72-ccd2-4c78-9051-bde671aa2d5e", "name": "network-vif-deleted", "tag": "57f57a55-4437-41ef-897a-191db0f3298d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:04:57.024123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-606795d5-bfea-42cb-ac8e-0a8e34aeeb70 req-5203c623-2c28-45c5-b840-b67509f76935 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:57.024609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-606795d5-bfea-42cb-ac8e-0a8e34aeeb70 req-5203c623-2c28-45c5-b840-b67509f76935 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:57.073680 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-606795d5-bfea-42cb-ac8e-0a8e34aeeb70 req-5203c623-2c28-45c5-b840-b67509f76935 service nova] Creating event network-vif-deleted:57f57a55-4437-41ef-897a-191db0f3298d for instance f701fc72-ccd2-4c78-9051-bde671aa2d5e on n-h1-826756-5 Aug 03 05:04:57.081852 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-606795d5-bfea-42cb-ac8e-0a8e34aeeb70 req-5203c623-2c28-45c5-b840-b67509f76935 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089362 Aug 03 05:04:57.082557 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2996/5965] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:04:57.198547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:57.199410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:57.207584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:57.208234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:57.209123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:57.209682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:57.369661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:57.393580 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f86494f-983a-424a-9bf6-a6cba146c5a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1354 microversion: 2.1 time: 0.197897 Aug 03 05:04:57.395899 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2970/5966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:57 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:57.999832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35f10642-4b4d-4142-b51d-81d9b57550f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:58.000588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35f10642-4b4d-4142-b51d-81d9b57550f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:58.105248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35f10642-4b4d-4142-b51d-81d9b57550f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:58.116207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35f10642-4b4d-4142-b51d-81d9b57550f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1249 microversion: 2.1 time: 0.122992 Aug 03 05:04:58.116903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2997/5967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:57 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1249 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:58.415145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:58.415814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:58.430826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:58.431287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:58.432084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:58.437364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:58.601114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:58.621541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43e41ce7-533b-4d0b-b6e9-908c9b4a01a6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.210091 Aug 03 05:04:58.626380 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2971/5968] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:58 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:59.141271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:59.141905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:59.156349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:59.156820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:59.157630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:59.158078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:59.175975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=77 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:04:59.300836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:59.316922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-215a76ed-3f33-474e-8b2a-e2721ef4c9ee tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1253 microversion: 2.1 time: 0.180289 Aug 03 05:04:59.317751 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2998/5969] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:59 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1253 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:04:59.644494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:04:59.645123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:04:59.660609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:59.661159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:59.663559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:04:59.665760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:04:59.771355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:04:59.781179 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a037a07-e970-47ed-bb49-10c0be14945e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.141247 Aug 03 05:04:59.782458 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2972/5970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:04:59 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:00.338467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:00.339381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:00.350939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:00.356537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:00.357335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:00.374499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:00.375489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:00.538685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:00.552073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b1e394f-d9a8-4c1f-ab67-e003b4d8dc93 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1301 microversion: 2.1 time: 0.217897 Aug 03 05:05:00.559531 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 2999/5971] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:00 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1301 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:00.806117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:00.809194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:00.892399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:00.894200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:00.897972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:00.912554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:01.109399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:01.120724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3903cf82-aee6-4ef1-b34b-d327aaff99c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.321988 Aug 03 05:05:01.122705 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2973/5972] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:00 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:01.589103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:01.590360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:01.604642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:01.606413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:01.611210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:01.611788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:01.719656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:01.733460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a9d2578a-4fc9-4485-ad5a-c067a1a2b01c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1319 microversion: 2.1 time: 0.151728 Aug 03 05:05:01.749469 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3000/5973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:01 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:02.143725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:02.147832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:02.159613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:02.162059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:02.163160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:02.164843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:02.343021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:02.352480 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a14dd9a-4bb5-4a7b-82d3-d87f834f9fe0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.213019 Aug 03 05:05:02.357169 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2974/5974] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:02 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:02.759795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:02.761426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:02.775851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:02.777525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:02.778708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:02.780021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:02.987601 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:02.998906 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb21c382-8212-4d5e-aa29-e50a5822da89 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1307 microversion: 2.1 time: 0.244269 Aug 03 05:05:03.007838 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3001/5975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:02 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:03.380021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:03.381523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:03.401690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:03.403113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:03.406360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:03.407012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:03.614115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:03.625515 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5478760-07b4-44d5-a980-1746539a136e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.248177 Aug 03 05:05:03.663684 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2975/5976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:03 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:04.023237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:04.025221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:04.053223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:04.053797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:04.057317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:04.057780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:04.164503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:04.185655 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-513bfa7b-b7b3-454e-bd41-b8bbd9e2177f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1307 microversion: 2.1 time: 0.167356 Aug 03 05:05:04.197958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3002/5977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:04 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:04.651285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:04.652959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:04.655167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:04.677217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:04.678722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:04.681640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:04.682667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:04.840675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:04.850649 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-069c6747-3c1c-451d-9a40-d03dbb0f304d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1188 microversion: 2.1 time: 0.203264 Aug 03 05:05:04.857308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2976/5978] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:04 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1188 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:05.219036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:05.220865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:05.228367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:05.229116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:05.230677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:05.231287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:05.388527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:05.396974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2218ea33-0c54-416e-9c2a-a3c477bdde69 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.186085 Aug 03 05:05:05.397567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3003/5979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:05 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:05.873339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:05.874621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:05.885052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:05.885426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:05.886214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:05.886663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:05.932077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:05.934359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:05.934851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid f701fc72-ccd2-4c78-9051-bde671aa2d5e {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:05:06.026084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:06.040048 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-68d20339-ca61-443c-8516-3d7aac585bb3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 200 len: 1193 microversion: 2.1 time: 0.170313 Aug 03 05:05:06.041933 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2977/5980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:05 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 1193 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:06.418527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:06.418527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:06.422344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:06.427107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:06.427540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:06.428310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:06.428880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:06.600174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:06.608616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c195d0a8-eead-4e6d-8345-3978ae104574 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.194270 Aug 03 05:05:06.609405 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3004/5981] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:06 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:07.077327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:07.077327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: f701fc72-ccd2-4c78-9051-bde671aa2d5e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:07.089241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:07.095912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:07.096492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:07.097189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:07.097640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e HTTP/1.1 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f701fc72-ccd2-4c78-9051-bde671aa2d5e'} Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:05:07.118547 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance f701fc72-ccd2-4c78-9051-bde671aa2d5e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4676c9d-9a4d-4973-b770-2989525a9bb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e" status: 404 len: 111 microversion: 2.1 time: 0.052850 Aug 03 05:05:07.123818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2978/5982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:07 2022] GET /compute/v2.1/servers/f701fc72-ccd2-4c78-9051-bde671aa2d5e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:05:07.535083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e7775781-d665-4fb9-afcc-0d25c0faed84 req-1dad781b-ab50-41dc-bf7d-0c67ad3ff1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e0bde-532b-43d5-9d6e-58bc38c06fe3", "tag": "43607f77-bedb-4ebc-8bed-864f6576a883"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:07.547154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e7775781-d665-4fb9-afcc-0d25c0faed84 req-1dad781b-ab50-41dc-bf7d-0c67ad3ff1d3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:07.548823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e7775781-d665-4fb9-afcc-0d25c0faed84 req-1dad781b-ab50-41dc-bf7d-0c67ad3ff1d3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:07.566295 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e7775781-d665-4fb9-afcc-0d25c0faed84 req-1dad781b-ab50-41dc-bf7d-0c67ad3ff1d3 service nova] Creating event network-changed:43607f77-bedb-4ebc-8bed-864f6576a883 for instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 on n-h2-826756-5 Aug 03 05:05:07.574971 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e7775781-d665-4fb9-afcc-0d25c0faed84 req-1dad781b-ab50-41dc-bf7d-0c67ad3ff1d3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244920 Aug 03 05:05:07.578078 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3005/5983] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:07.637221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:07.648603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:07.652312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:07.652786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:07.653736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:07.654188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:07.904843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:07.907427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:07.934245 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2699ccb8-005a-43ef-83b1-6281a5fb1a1d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.306962 Aug 03 05:05:07.934843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2979/5984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:07 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:08.959061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:08.959774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:08.961911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:08.974118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:08.974840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:08.975868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:08.976572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:09.279959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:09.290695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a258c107-8978-4f1f-a791-79f5366341a9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.335059 Aug 03 05:05:09.306160 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3006/5985] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:08 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:10.332658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:10.335428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:10.374556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:10.382364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:10.383473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:10.390454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:10.995299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:11.001012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-916cf783-6ee1-48c5-9e99-faafafd82112 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.687800 Aug 03 05:05:11.007193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2980/5986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:10 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:12.028174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:12.029850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:12.076001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:12.077016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:12.078067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:12.081201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:12.354911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:12.364591 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ec91ea0-0531-41f1-b53b-8b359a240c83 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.341141 Aug 03 05:05:12.365490 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3007/5987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:12 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:13.389860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:13.390721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:13.405048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:13.406051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:13.406855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:13.407294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:13.698779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:13.729716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa6bfa90-c34f-486c-9449-890a5cfd5e01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.344215 Aug 03 05:05:13.732568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2981/5988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:13 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:14.163188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4d310a05-637c-43cf-88f9-e9fe65cc37a7 req-8b34208f-1785-4324-a6e7-e87a9c299292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6e0bde-532b-43d5-9d6e-58bc38c06fe3", "name": "network-vif-plugged", "status": "completed", "tag": "43607f77-bedb-4ebc-8bed-864f6576a883"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:14.202105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4d310a05-637c-43cf-88f9-e9fe65cc37a7 req-8b34208f-1785-4324-a6e7-e87a9c299292 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:14.202818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4d310a05-637c-43cf-88f9-e9fe65cc37a7 req-8b34208f-1785-4324-a6e7-e87a9c299292 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:14.226221 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4d310a05-637c-43cf-88f9-e9fe65cc37a7 req-8b34208f-1785-4324-a6e7-e87a9c299292 service nova] Creating event network-vif-plugged:43607f77-bedb-4ebc-8bed-864f6576a883 for instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 on n-h2-826756-5 Aug 03 05:05:14.233158 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4d310a05-637c-43cf-88f9-e9fe65cc37a7 req-8b34208f-1785-4324-a6e7-e87a9c299292 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073822 Aug 03 05:05:14.238475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3008/5989] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:14.753033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:14.753662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:14.775467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:14.776318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:14.777106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:14.789535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:15.211294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:15.236899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7fad0cd5-c65c-4277-8ef8-7b007ba0729c tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1375 microversion: 2.1 time: 0.483597 Aug 03 05:05:15.239256 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2982/5990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:14 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1375 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:16.268029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:16.271138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:16.286512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:16.287001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:16.287785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:16.288227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:16.645642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:16.654413 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b550acf-df9f-47cd-961b-ea528c43b5ec tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1547 microversion: 2.1 time: 0.398450 Aug 03 05:05:16.658309 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3009/5991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:16 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1547 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:16.687479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:05:16.688694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:16.698563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:16.699307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:16.700292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:16.701063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:17.181116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:05:17.192113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-217529fe-21a4-4f68-957e-c16b01bf841e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1547 microversion: 2.1 time: 0.509798 Aug 03 05:05:17.205551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2983/5992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:05:16 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1547 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:05:22.876412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b2fe7430-f762-4a6c-98ac-f9dac05b8019 req-b4435bc9-2d59-45fd-8615-28440ea7427e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e0bde-532b-43d5-9d6e-58bc38c06fe3", "tag": "43607f77-bedb-4ebc-8bed-864f6576a883"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:22.898929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b2fe7430-f762-4a6c-98ac-f9dac05b8019 req-b4435bc9-2d59-45fd-8615-28440ea7427e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:22.899683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b2fe7430-f762-4a6c-98ac-f9dac05b8019 req-b4435bc9-2d59-45fd-8615-28440ea7427e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:22.927192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b2fe7430-f762-4a6c-98ac-f9dac05b8019 req-b4435bc9-2d59-45fd-8615-28440ea7427e service nova] Creating event network-changed:43607f77-bedb-4ebc-8bed-864f6576a883 for instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 on n-h2-826756-5 Aug 03 05:05:22.933969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b2fe7430-f762-4a6c-98ac-f9dac05b8019 req-b4435bc9-2d59-45fd-8615-28440ea7427e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063214 Aug 03 05:05:22.940481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3010/5993] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:05:42.107520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:05:42.120539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:05:42.120539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=17 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:42.120539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=25 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:05:42.131775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:42.132186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:42.133714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:05:42.134165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:05:42.225124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-588f1041-a566-4b6c-a009-f4ae4d8fcce2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3/action" status: 200 len: 24559 microversion: 2.1 time: 0.120001 Aug 03 05:05:42.225124 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2984/5994] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:05:42 2022] POST /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3/action => generated 24559 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:06:00.097183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-078d6f18-25f5-4282-b2fe-85e091048eb7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: .version_select at 0x7fdd54809820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1979961086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi7au31He1yWCWWqnYCXzH8WzUDO12rDnyJBPiAlHE7aozTxbs0fbtnpXuDcUJ2YnXsiwhK4/EgWdzCcq+EsRZwsLilkgq5hDAVP2VV09Khth9wyaU5ot1aQ0SVageq0g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:00.125484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=23 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:00.126589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=65 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:00.137067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-078d6f18-25f5-4282-b2fe-85e091048eb7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:06:00.146573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-078d6f18-25f5-4282-b2fe-85e091048eb7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:06:00.381631 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-078d6f18-25f5-4282-b2fe-85e091048eb7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.286195 Aug 03 05:06:00.381631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3011/5995] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:06:00 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:08.249446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1912166434", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "871421f4-4c51-4261-b66a-acaf67bcfd59"}], "key_name": "tempest-TestNetworkBasicOps-1979961086", "security_groups": [{"name": "tempest-secgroup-smoke-366626989"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:08.580303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] validate_networks() for [('871421f4-4c51-4261-b66a-acaf67bcfd59', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:06:10.893792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:06:10.895418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:06:10.896092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:06:10.896545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:06:10.897183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:06:10.918491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:10.919317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:10.920157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:10.921068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:10.968341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:06:10.981656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:06:11.016996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:06:11.020394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:06:11.238479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77c5e6a3-a363-4c39-9e9e-e002cf55c17a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.993097 Aug 03 05:06:11.245977 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2985/5996] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:06:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:06:11.249280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:11.258869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-95180165-4541-4c62-b430-a14293996f48 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:11.259721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-95180165-4541-4c62-b430-a14293996f48 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:11.431427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-95180165-4541-4c62-b430-a14293996f48 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:11.444524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-95180165-4541-4c62-b430-a14293996f48 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1249 microversion: 2.1 time: 0.197096 Aug 03 05:06:11.449734 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3012/5997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:11 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1249 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:12.472032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b7c54f6-9c31-47b2-b038-f7f94bd1f372 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:12.473312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b7c54f6-9c31-47b2-b038-f7f94bd1f372 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:12.573388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b7c54f6-9c31-47b2-b038-f7f94bd1f372 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:12.586426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b7c54f6-9c31-47b2-b038-f7f94bd1f372 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1249 microversion: 2.1 time: 0.116786 Aug 03 05:06:12.586426 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2986/5998] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:12 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:13.617226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:13.618866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:13.655543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:13.657242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:13.659145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:13.659484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:13.732657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1629699920", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a78f76ff-ccf8-4cce-9296-059ad8ee6061", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:14.015693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:06:14.124251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:14.134381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8479caab-fc33-4f95-8200-c0f637be5ab0 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1245 microversion: 2.1 time: 0.524963 Aug 03 05:06:14.134981 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3013/5999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:13 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1245 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:14.842650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:06:14.843227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:06:14.843651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:06:14.844321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:06:14.844917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:06:14.856825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:14.859418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:14.859418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:14.859418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:14.914986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:06:14.924517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:06:14.939011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:06:14.942740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a78f76ff-ccf8-4cce-9296-059ad8ee6061',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:06:15.164419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:15.164419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:15.171938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:15.172377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:15.173126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:15.173570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:15.260784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5f7c8a6-bd4b-44df-9643-6ac7e1a52d9e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532933 Aug 03 05:06:15.261983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2987/6000] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:06:15.278682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a581bbe-788f-4c18-8ceb-9c42093b7108 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:15.280930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a581bbe-788f-4c18-8ceb-9c42093b7108 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:15.333586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:15.344516 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75cf8b8b-638f-49d0-b7ee-0f723f081ed9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1309 microversion: 2.1 time: 0.191868 Aug 03 05:06:15.345892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3014/6001] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:15 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:15.438532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a581bbe-788f-4c18-8ceb-9c42093b7108 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:15.450767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a581bbe-788f-4c18-8ceb-9c42093b7108 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1057 microversion: 2.1 time: 0.177883 Aug 03 05:06:15.451458 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2988/6002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:15 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1057 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:16.375033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.377552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:16.407978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:16.407978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:16.407978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:16.407978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:16.484306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-537a8525-a0e1-4405-92bd-10bc3bf129c8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:16.486445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-537a8525-a0e1-4405-92bd-10bc3bf129c8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:16.547513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:16.562008 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7c7f02b-214b-49cc-96cb-b8334e32e2b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1307 microversion: 2.1 time: 0.197950 Aug 03 05:06:16.563247 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3015/6003] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:16 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:17.036876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-537a8525-a0e1-4405-92bd-10bc3bf129c8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:17.053194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-537a8525-a0e1-4405-92bd-10bc3bf129c8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1057 microversion: 2.1 time: 0.564828 Aug 03 05:06:17.055662 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2989/6004] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:16 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1057 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:17.589005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:17.589817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:17.614391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:17.620676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:17.624483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:17.627579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:18.075713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:18.077074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:18.094073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:18.098224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:18.099568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:18.102374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:18.580188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:18.602502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64ef88a6-ef8a-4c21-9fd5-a4e6d1bf6008 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1053 microversion: 2.1 time: 0.531164 Aug 03 05:06:18.616403 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2990/6005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:18 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1053 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:18.743900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:18.761174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc5da651-e3b3-4776-90e4-67ec9641a0d4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 1.177043 Aug 03 05:06:18.776437 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3016/6006] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:17 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:19.429483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e2d97933-00ab-41f8-827b-0faeb1d72a34 req-9e634db0-a718-40a1-b463-a0a63c408f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a9e750-e58e-47cd-8103-416612c0f099", "tag": "9009d6f2-e76a-4a15-a903-0ad6994f814f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:19.447138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2d97933-00ab-41f8-827b-0faeb1d72a34 req-9e634db0-a718-40a1-b463-a0a63c408f60 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:19.448048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2d97933-00ab-41f8-827b-0faeb1d72a34 req-9e634db0-a718-40a1-b463-a0a63c408f60 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:19.461864 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e2d97933-00ab-41f8-827b-0faeb1d72a34 req-9e634db0-a718-40a1-b463-a0a63c408f60 service nova] Creating event network-changed:9009d6f2-e76a-4a15-a903-0ad6994f814f for instance 79a9e750-e58e-47cd-8103-416612c0f099 on n-h1-826756-5 Aug 03 05:06:19.468342 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e2d97933-00ab-41f8-827b-0faeb1d72a34 req-9e634db0-a718-40a1-b463-a0a63c408f60 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043252 Aug 03 05:06:19.469520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2991/6007] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:06:19.638598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:19.639918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:19.663202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:19.663664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:19.667694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:19.667889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:19.790277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:19.792298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:19.804709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:19.805351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:19.808171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:19.808659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:20.000580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:20.012510 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e8fdbee-5346-4bdf-a331-e7f9a96343b6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1117 microversion: 2.1 time: 0.381617 Aug 03 05:06:20.031641 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3017/6008] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:19 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1117 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:20.244257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:20.253121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a16b76db-e01d-4821-a9ed-4f694134bfd2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.469825 Aug 03 05:06:20.253121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2992/6009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:19 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:21.039867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:21.040745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:21.053001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:21.053781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:21.054845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:21.055343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:21.277545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:21.277545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:21.290869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:21.291246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:21.293537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:21.300465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:21.473222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:21.489862 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55fc9b35-6c01-42e3-90c2-cdb7415dee1d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1127 microversion: 2.1 time: 0.452425 Aug 03 05:06:21.493142 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3018/6010] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:21 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1127 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:21.728973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:21.746942 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ade19cd2-e2bd-48b9-990d-3a77a907a1ca tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.464920 Aug 03 05:06:21.746942 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2993/6011] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:21 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:22.527802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:22.527802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:22.550360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:22.551112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:22.553283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:22.553904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:22.763674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:22.764720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:22.772497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:22.772918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:22.773900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:22.774511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:23.026692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:23.045271 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1acf0ef0-19ca-4419-9e0f-56fd6e184e83 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.517208 Aug 03 05:06:23.046563 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3019/6012] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:22 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:23.187110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:23.202834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-990c7924-32a5-449b-b154-49e0b05a03b7 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.443050 Aug 03 05:06:23.218549 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2994/6013] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:22 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:24.072610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:24.074494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:24.086549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:24.090698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:24.091553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:24.108671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:24.109306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:24.226364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:24.229028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:24.251633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:24.252519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:24.253604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:24.254287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:24.902823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:24.999007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:25.017800 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fa51550-04a1-4f01-aa38-2c981431b4d1 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.796047 Aug 03 05:06:25.019727 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2995/6014] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:24 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:25.044130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e51e01d3-bf05-4c4f-8a08-33a1f093bf68 req-2eb6a6da-ef39-4eb8-aa02-a84af8aa23af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc3968b-2a51-4160-aae5-a5128e3d01f5", "tag": "73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:25.075385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e51e01d3-bf05-4c4f-8a08-33a1f093bf68 req-2eb6a6da-ef39-4eb8-aa02-a84af8aa23af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:25.077443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e51e01d3-bf05-4c4f-8a08-33a1f093bf68 req-2eb6a6da-ef39-4eb8-aa02-a84af8aa23af service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:25.093720 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e51e01d3-bf05-4c4f-8a08-33a1f093bf68 req-2eb6a6da-ef39-4eb8-aa02-a84af8aa23af service nova] Creating event network-changed:73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3 for instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 on n-h2-826756-5 Aug 03 05:06:25.103077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e51e01d3-bf05-4c4f-8a08-33a1f093bf68 req-2eb6a6da-ef39-4eb8-aa02-a84af8aa23af service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079830 Aug 03 05:06:25.104704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2996/6015] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:25.199478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:25.216193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cb6d3d27-f74c-4cd9-8883-fd9f4ed4f7b9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 1.150852 Aug 03 05:06:25.221307 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3020/6016] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:24 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:26.050641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:26.052526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:26.065507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:26.071876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:26.074965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:26.077307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:26.238265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:26.239553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:26.255860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:26.259067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:26.259928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:26.262423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:26.818085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:26.843511 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3328924c-f2d5-4b91-8435-0ddd92f2b3ba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.610082 Aug 03 05:06:26.844038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:26.860544 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3021/6017] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:26 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:26.863514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8375780f-ec21-4e48-8e02-172e2cc10a4f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.816763 Aug 03 05:06:26.876230 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2997/6018] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:26 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:27.649627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4b1943c1-0a92-4432-8312-c0822a17c7f9 req-b575fd29-2cdc-4dea-bb23-8b27757d5e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a9e750-e58e-47cd-8103-416612c0f099", "name": "network-vif-plugged", "status": "completed", "tag": "9009d6f2-e76a-4a15-a903-0ad6994f814f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:06:27.719061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4b1943c1-0a92-4432-8312-c0822a17c7f9 req-b575fd29-2cdc-4dea-bb23-8b27757d5e6e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:27.719061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4b1943c1-0a92-4432-8312-c0822a17c7f9 req-b575fd29-2cdc-4dea-bb23-8b27757d5e6e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:27.742758 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4b1943c1-0a92-4432-8312-c0822a17c7f9 req-b575fd29-2cdc-4dea-bb23-8b27757d5e6e service nova] Creating event network-vif-plugged:9009d6f2-e76a-4a15-a903-0ad6994f814f for instance 79a9e750-e58e-47cd-8103-416612c0f099 on n-h1-826756-5 Aug 03 05:06:27.753968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4b1943c1-0a92-4432-8312-c0822a17c7f9 req-b575fd29-2cdc-4dea-bb23-8b27757d5e6e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109500 Aug 03 05:06:27.756640 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3022/6019] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:06:27.867866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:27.868554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:27.870806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:27.887558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:27.890983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:27.893308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:27.893436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:27.893548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:27.893655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:27.908206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:27.908776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:27.912103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:27.914491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:28.521051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:28.528570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6e76f27-16d6-4b99-8f02-525920d493b2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.641309 Aug 03 05:06:28.529735 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3023/6020] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:27 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:28.581002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:28.593402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2849776-d815-47ff-8084-e380b8c3503d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.729742 Aug 03 05:06:28.594497 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2998/6021] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:27 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:29.557880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:29.562324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:29.576157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:29.580008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:29.580008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:29.580008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:29.617769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:29.619061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:29.642556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:29.645793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:29.653726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:29.654298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:30.426565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:30.440192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c691219-b9f2-493d-9714-c0216ca84324 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1374 microversion: 2.1 time: 0.892159 Aug 03 05:06:30.441167 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3024/6022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:29 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1374 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:30.543121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:30.557180 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8ce778f-a257-4e35-8fbf-68e69da65f10 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.944131 Aug 03 05:06:30.559016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 2999/6023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:29 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:31.464413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:31.465185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:31.477687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.478244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:31.484156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.484791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:31.593376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:31.594992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:31.609566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.609566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:31.611280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.611939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:31.718930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:31.728582 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f202ac16-7f22-4b7f-9af9-22682b541255 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1546 microversion: 2.1 time: 0.268541 Aug 03 05:06:31.730486 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3025/6024] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:31 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:31.753789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:31.754910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:31.763362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.764125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:31.765270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:31.766065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:32.128716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:32.147595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23d9b3dc-eb25-491d-a170-f68ba82eed7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.558712 Aug 03 05:06:32.148890 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3000/6025] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:31 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:32.404348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:32.417055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-018de7b3-512c-46a7-9dec-fe7e1e7e0e12 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1546 microversion: 2.1 time: 0.670887 Aug 03 05:06:32.417679 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3026/6026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:31 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1546 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:06:33.171268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:33.171892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:33.187725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:33.187725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:33.187725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:33.187725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:33.472158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:33.491334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d09c909-c791-450b-ba7b-6c4547787838 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.324252 Aug 03 05:06:33.492759 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3001/6027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:33 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:34.515812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:34.516572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:34.532882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:34.533710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:34.537697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:34.537697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:35.291371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:35.305647 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dbe46992-226c-4cc5-a4a3-6539439bc96a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.795471 Aug 03 05:06:35.306814 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3027/6028] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:34 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:36.327195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:36.327814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:36.356834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:36.356834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:36.356834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:36.356834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:36.923740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:36.937217 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3837319e-7ff3-401e-8bf9-322180ff899a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.613928 Aug 03 05:06:36.939986 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3002/6029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:36 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:37.967857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:37.969180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:37.980587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:37.981365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:37.982385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:37.983335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:38.606428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:38.617956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d2f2f1f-01b4-4e39-93a4-e37a3ce4cc74 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.654382 Aug 03 05:06:38.619411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3028/6030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:37 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:39.642042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:39.643951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:39.651187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:39.666709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:39.667774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:39.675657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:39.675657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:39.678787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=79 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:39.920552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:39.940148 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5dec1c7-b448-4847-8791-8448317b67ec tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.302235 Aug 03 05:06:39.950987 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3003/6031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:39 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:40.976260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:40.977704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:40.996026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:40.996517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:40.997298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:40.997732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:41.267697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:41.282667 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2fd5304-d2b7-4884-87eb-1bf07a4d38b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.307836 Aug 03 05:06:41.284754 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3029/6032] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:40 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:42.318626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:42.319346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:42.331107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:42.331557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:42.332372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:42.332807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:42.518127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:42.527316 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dd832304-4903-40f1-a752-043b1bb9a5a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.220796 Aug 03 05:06:42.528079 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3004/6033] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:42 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:43.550067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:43.552115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:43.566125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:43.568155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:43.577594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:43.578572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:43.579016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:43.603161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:06:43.833067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:43.842718 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-efb10658-5593-4e3a-a501-944386d485fe tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.298006 Aug 03 05:06:43.844178 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3030/6034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:43 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:44.868801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:44.869568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:44.879398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:44.880132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:44.881724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:44.882225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:45.279492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:45.291435 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5abaf113-6c2f-4346-b5f6-2a1507bcde22 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.430850 Aug 03 05:06:45.292047 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3005/6035] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:44 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:46.313981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:46.315275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:46.328883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:46.328883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:46.328883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:46.328883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:47.010084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:47.020477 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4056e683-694d-4572-bb2f-34f2d277a18a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.709736 Aug 03 05:06:47.034283 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3031/6036] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:46 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:48.042756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:48.047947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:48.055709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:48.059735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:48.060843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:48.061679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:48.735969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:48.753398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b1c6cb5-23b0-475d-80b1-775d80756597 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.714818 Aug 03 05:06:48.775756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3006/6037] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:48 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:49.779930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:49.780659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:49.795272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:49.795730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:49.797084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:49.797697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:50.158034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:50.159007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7086c678-ef3f-465f-89aa-03200e7fd848 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.383431 Aug 03 05:06:50.176690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3032/6038] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:49 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:51.183993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:51.185401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:51.208929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:51.208929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:51.208929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:51.208929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:51.714601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:51.723877 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26bf8696-c356-4409-be4d-19c610dc55e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.544168 Aug 03 05:06:51.728053 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3007/6039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:51 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:52.755513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:52.756156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:52.778884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:52.779346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:52.788567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:52.789302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:53.105444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:53.113492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe46ecba-3116-4928-9c96-d443922e3947 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.362227 Aug 03 05:06:53.114355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3033/6040] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:52 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:54.152407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:54.154520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:54.167497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:54.168245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:54.170988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:54.177403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:54.895691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:54.971574 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-503c9938-d239-4bcc-b02c-77722dc37250 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.807431 Aug 03 05:06:54.971574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3008/6041] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:54 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:55.990540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:55.992046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:56.008871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:56.011584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:56.014872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:56.015371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:56.652708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:56.661472 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-10d2809c-d467-426a-8334-edb275f1c159 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.675275 Aug 03 05:06:56.673039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3034/6042] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:55 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:57.704592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:57.705889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:57.725139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:57.728620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:57.729674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:57.733375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:58.079906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:58.096583 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9414d720-3510-4768-b7d9-519c1410ac79 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.398875 Aug 03 05:06:58.098701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3009/6043] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:57 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:06:59.121409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:06:59.122031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:06:59.150719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:59.151484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:59.152605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:06:59.152763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:06:59.600624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:06:59.611558 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d127bd18-6703-4974-b5c9-50e13e2d791b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.494911 Aug 03 05:06:59.618083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3035/6044] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:06:59 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:00.646849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:00.648610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:00.699623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:00.700190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:00.707004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:00.707004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:01.225454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:01.238584 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4737ead6-1b78-4333-9c00-9f197d2142a8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.595556 Aug 03 05:07:01.239201 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3010/6045] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:00 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:01.633788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:01.635211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:01.652393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:01.653215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:01.654401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:01.655060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:01.736745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:07:02.261550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:02.262173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:02.277991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:02.278376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:02.285600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:02.287317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:02.312816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aabead81-5ddd-4e54-850b-c7e6767b2953 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 204 len: 0 microversion: 2.1 time: 0.683191 Aug 03 05:07:02.317444 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3036/6046] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:07:01 2022] DELETE /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:07:02.327981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:02.329083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:02.360125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:02.360125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:02.360125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:02.360125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:02.803514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:02.840880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c752d6c4-d1e1-4368-ba1d-6730708259b4 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1552 microversion: 2.1 time: 0.517131 Aug 03 05:07:02.852156 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3037/6047] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:02 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1552 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:02.888926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:02.901176 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7a3030b4-f0f3-413a-a961-74656c1f3124 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.643737 Aug 03 05:07:02.905440 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3011/6048] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:02 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:03.876880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:03.878255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:03.897274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:03.898440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:03.899591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:03.900377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:03.931593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:03.932977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:03.963555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:03.964051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:03.964908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:03.965358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:04.771525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:04.780749 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-842d16c4-42e3-4dc7-a681-2bfe64e325d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.853482 Aug 03 05:07:04.793520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3012/6049] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:03 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:04.847546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:04.855521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e3df2f06-eab4-4287-857c-547f1f4bdc6d tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1552 microversion: 2.1 time: 0.986455 Aug 03 05:07:04.856114 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3038/6050] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:03 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1552 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:05.450921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-37c4a61a-98be-4011-bd49-0db5fca86525 req-f6be395f-4356-40ee-81f5-a691266f774d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a9e750-e58e-47cd-8103-416612c0f099", "name": "network-vif-deleted", "tag": "9009d6f2-e76a-4a15-a903-0ad6994f814f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:05.467218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-37c4a61a-98be-4011-bd49-0db5fca86525 req-f6be395f-4356-40ee-81f5-a691266f774d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.469638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-37c4a61a-98be-4011-bd49-0db5fca86525 req-f6be395f-4356-40ee-81f5-a691266f774d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.480303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-37c4a61a-98be-4011-bd49-0db5fca86525 req-f6be395f-4356-40ee-81f5-a691266f774d service nova] Creating event network-vif-deleted:9009d6f2-e76a-4a15-a903-0ad6994f814f for instance 79a9e750-e58e-47cd-8103-416612c0f099 on n-h1-826756-5 Aug 03 05:07:05.486290 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-37c4a61a-98be-4011-bd49-0db5fca86525 req-f6be395f-4356-40ee-81f5-a691266f774d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039013 Aug 03 05:07:05.487419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3013/6051] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:05.817022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:05.817022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:05.825746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.826258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.827428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.830642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.883856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:05.885093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:05.912080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.918148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.922821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.925443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.989089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:05.990927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:05.991983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lazy-loading 'fault' on Instance uuid 79a9e750-e58e-47cd-8103-416612c0f099 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:07:06.155710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:06.165380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a0b768d-bd16-4e96-bf42-294d4892a10f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 200 len: 1339 microversion: 2.1 time: 0.290483 Aug 03 05:07:06.166687 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3014/6052] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:05 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 1339 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:06.331114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:06.341884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15e51d62-18f8-4ad1-9090-0c057d977c61 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1169 microversion: 2.1 time: 0.538416 Aug 03 05:07:06.342483 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3039/6053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:05 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1169 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:07.189194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:07.191487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: 79a9e750-e58e-47cd-8103-416612c0f099] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:07.198250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:07.198706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:07.199498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:07.199929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] HTTP exception thrown: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Request method failure captured: Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 HTTP/1.1 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gHgRtDYIYfOCwYRftQrRaeZ00Hc2Tn6NTi_Y94Td131SKEgr9gHCCQ7uucqPlGNiDw-SNP8rz7Ih-7biRuK4h07QVLYl7DpLyBxIDXgsAXBmJS33-EJ45zF7gjRZ6_E_DizRcj6_7GZI5ZMI791u-C40sgchmzCbnLpNQEszzpFQbU Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: b549dbdf777b4a30be461c9cb69812d3 Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '79a9e750-e58e-47cd-8103-416612c0f099'} Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:07:07.254452 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Returning 404 to user: Instance 79a9e750-e58e-47cd-8103-416612c0f099 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9fd8e2e2-a262-4c1c-9fe6-4207ff73296f tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099" status: 404 len: 111 microversion: 2.1 time: 0.050395 Aug 03 05:07:07.265392 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3015/6054] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:07 2022] GET /compute/v2.1/servers/79a9e750-e58e-47cd-8103-416612c0f099 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:07:07.363182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:07.364483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:07.384227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:07.391118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:07.391118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:07.391118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:07.891226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-993567ae-3098-4a75-b64a-731ea33f553a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '.version_select at 0x7fdd47c12940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:07.966305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:07.982698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-992304e5-bb9c-4a92-8b97-d975cd8e853a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.623382 Aug 03 05:07:07.992710 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3040/6055] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:07 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:08.032447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-993567ae-3098-4a75-b64a-731ea33f553a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1979961086" status: 202 len: 0 microversion: 2.1 time: 0.146040 Aug 03 05:07:08.039493 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3016/6056] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 05:07:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1979961086 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:07:09.006980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:09.007623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:09.049274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:09.049274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:09.051028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:09.051785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:09.642308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:09.657885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f095232-7eb3-4ac0-98c0-0eb1c9c3a8df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.652903 Aug 03 05:07:09.676519 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3041/6057] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:08 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:10.715915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:10.716597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:10.729165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:10.729626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:10.730429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:10.731338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:11.440660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:11.454261 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be3e77c0-bb27-47d3-9793-a328b6a523b2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.763637 Aug 03 05:07:11.493614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3017/6058] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:10 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:12.497197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:12.498436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:12.512619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:12.513406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:12.514586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:12.515190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:12.667973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:12.669305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:12.681680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:12.682178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:12.689372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:12.690070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:12.704250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=78 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:12.747266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:07:13.057288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:13.091966 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f17cccc-78e0-4214-8383-cd98beeb8df3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.599214 Aug 03 05:07:13.109823 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3042/6059] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:12 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:13.125266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1886ec33-43a0-450b-9216-6f8a28b00499 req-de3413f5-1dbd-422b-bed4-40cc297d9bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6e0bde-532b-43d5-9d6e-58bc38c06fe3", "tag": "43607f77-bedb-4ebc-8bed-864f6576a883"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:13.151149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1886ec33-43a0-450b-9216-6f8a28b00499 req-de3413f5-1dbd-422b-bed4-40cc297d9bde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:13.152511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1886ec33-43a0-450b-9216-6f8a28b00499 req-de3413f5-1dbd-422b-bed4-40cc297d9bde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:13.180998 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1886ec33-43a0-450b-9216-6f8a28b00499 req-de3413f5-1dbd-422b-bed4-40cc297d9bde service nova] Creating event network-changed:43607f77-bedb-4ebc-8bed-864f6576a883 for instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 on n-h2-826756-5 Aug 03 05:07:13.188933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1886ec33-43a0-450b-9216-6f8a28b00499 req-de3413f5-1dbd-422b-bed4-40cc297d9bde service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076508 Aug 03 05:07:13.188933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3043/6060] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:13.479446 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a743f19-e613-4326-a794-54a468ecac01 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 204 len: 0 microversion: 2.1 time: 0.815575 Aug 03 05:07:13.482092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3018/6061] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:07:12 2022] DELETE /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:07:13.498352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:13.499083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:13.520913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:13.521400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:13.530632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:13.531434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:14.066362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:14.078677 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-42f72740-9b3d-4caf-921b-0f836c8ee055 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1672 microversion: 2.1 time: 0.585682 Aug 03 05:07:14.080592 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3044/6062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:13 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1672 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:14.122075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:14.122824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:14.137551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:14.138023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:14.138821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:14.139269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:14.775254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:14.787285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1196fd3b-4d31-4ee5-a16e-92282601d9d6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.670757 Aug 03 05:07:14.832397 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3019/6063] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:14 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:15.104384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:15.105621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:15.117331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:15.120988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:15.122575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:15.125446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:15.832891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:15.835705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:15.839974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:15.840632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:15.846230 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b79e3466-0c23-4344-b955-2a32ea1bdfb9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1672 microversion: 2.1 time: 0.747289 Aug 03 05:07:15.858597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3045/6064] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:15 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1672 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:15.878170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:15.889535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:15.894591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:15.895512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:15.895977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:16.880595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:16.881398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:16.899060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:16.901137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:16.909901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:16.911208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:17.159671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:17.169712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5df78c9-57eb-4146-b2ac-cdc27061eaa2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1604 microversion: 2.1 time: 0.291928 Aug 03 05:07:17.174553 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3046/6065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:16 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1604 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:17.182898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0a9213c4-857e-4577-884b-86d1c88fc2c3 req-a840b40a-37cb-492a-9ae5-8a09a44afec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6e0bde-532b-43d5-9d6e-58bc38c06fe3", "name": "network-vif-deleted", "tag": "43607f77-bedb-4ebc-8bed-864f6576a883"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:17.221634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0a9213c4-857e-4577-884b-86d1c88fc2c3 req-a840b40a-37cb-492a-9ae5-8a09a44afec3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:17.225544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0a9213c4-857e-4577-884b-86d1c88fc2c3 req-a840b40a-37cb-492a-9ae5-8a09a44afec3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:17.275616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0a9213c4-857e-4577-884b-86d1c88fc2c3 req-a840b40a-37cb-492a-9ae5-8a09a44afec3 service nova] Creating event network-vif-deleted:43607f77-bedb-4ebc-8bed-864f6576a883 for instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 on n-h2-826756-5 Aug 03 05:07:17.285711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0a9213c4-857e-4577-884b-86d1c88fc2c3 req-a840b40a-37cb-492a-9ae5-8a09a44afec3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109625 Aug 03 05:07:17.297526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3047/6066] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:17.301942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:17.319429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2be09311-4dd7-4b40-b75b-bf05c4e5ce87 req-c98c19aa-3612-434b-bd81-e2fa6cdb21e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc3968b-2a51-4160-aae5-a5128e3d01f5", "name": "network-vif-plugged", "status": "completed", "tag": "73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:17.329751 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-786cd7b4-0b5f-4633-a016-7818df40b6ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 1.495117 Aug 03 05:07:17.339922 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3020/6067] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:15 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:17.362693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2be09311-4dd7-4b40-b75b-bf05c4e5ce87 req-c98c19aa-3612-434b-bd81-e2fa6cdb21e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:17.363140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2be09311-4dd7-4b40-b75b-bf05c4e5ce87 req-c98c19aa-3612-434b-bd81-e2fa6cdb21e4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:17.416014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2be09311-4dd7-4b40-b75b-bf05c4e5ce87 req-c98c19aa-3612-434b-bd81-e2fa6cdb21e4 service nova] Creating event network-vif-plugged:73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3 for instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 on n-h2-826756-5 Aug 03 05:07:17.449113 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2be09311-4dd7-4b40-b75b-bf05c4e5ce87 req-c98c19aa-3612-434b-bd81-e2fa6cdb21e4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150007 Aug 03 05:07:17.452991 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3048/6068] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:18.203849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:18.204465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:18.220954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:18.225189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:18.228634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:18.233907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:18.303405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:18.303405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:18.303405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lazy-loading 'fault' on Instance uuid cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:07:18.368575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:18.369907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:18.392984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:18.393633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:18.399588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:18.400516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:18.514754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:18.540597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ceb8f4eb-5779-4584-834a-033fee2eabcb tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 200 len: 1490 microversion: 2.1 time: 0.335396 Aug 03 05:07:18.540597 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3021/6069] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:18 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 1490 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:18.666513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:18.676889 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50e40e96-f558-48ce-87c4-b9aa9f66299a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1203 microversion: 2.1 time: 0.317386 Aug 03 05:07:18.679545 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3049/6070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:18 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1203 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:19.562392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:19.563823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: cd6e0bde-532b-43d5-9d6e-58bc38c06fe3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:19.581174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:19.583012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:19.589297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:19.589781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:19.628582 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] HTTP exception thrown: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Request method failure captured: Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 HTTP/1.1 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gHgRtDYIYfOCwYRftQrRaeZ00Hc2Tn6NTi_Y94Td131SKEgr9gHCCQ7uucqPlGNiDw-SNP8rz7Ih-7biRuK4h07QVLYl7DpLyBxIDXgsAXBmJS33-EJ45zF7gjRZ6_E_DizRcj6_7GZI5ZMI791u-C40sgchmzCbnLpNQEszzpFQbU Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: b549dbdf777b4a30be461c9cb69812d3 Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'cd6e0bde-532b-43d5-9d6e-58bc38c06fe3'} Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:19.633370 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Returning 404 to user: Instance cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:07:19.638431 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8b17433-00db-4673-bfb3-8b5cdf4efb9a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3" status: 404 len: 111 microversion: 2.1 time: 0.079247 Aug 03 05:07:19.641766 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3022/6071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:19 2022] GET /compute/v2.1/servers/cd6e0bde-532b-43d5-9d6e-58bc38c06fe3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:07:19.700211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:19.701860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:19.715956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:19.722409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:19.723266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:19.735766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:20.103809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:20.112389 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a4ab966-7df5-4a8d-afd4-70e7abc1caa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1390 microversion: 2.1 time: 0.418171 Aug 03 05:07:20.114026 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3050/6072] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:19 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1390 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:20.149768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:20.150528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:20.163348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:20.165991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:20.173559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:20.174275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:20.269913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ac3cc8ab-fa59-4324-875c-8a2c5e0ba649 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '.version_select at 0x7fdd59c0adc0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:20.283820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:20.425902 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ac3cc8ab-fa59-4324-875c-8a2c5e0ba649 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1741309522" status: 202 len: 0 microversion: 2.1 time: 0.163419 Aug 03 05:07:20.427564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3051/6073] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 05:07:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1741309522 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:07:20.511358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:20.520728 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89c6cb07-03de-4b1e-9436-cbc1a66a9765 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1390 microversion: 2.1 time: 0.387199 Aug 03 05:07:20.522557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3023/6074] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:20 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:20.544990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:20.546122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:20.556853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:20.557910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:20.559215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:20.559837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:20.940992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:20.952905 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-90c94778-185a-43ea-b261-8c988bbaf870 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1390 microversion: 2.1 time: 0.413670 Aug 03 05:07:20.960401 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3052/6075] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:20 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:21.100789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:21.101374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:21.124360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:21.128870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:21.128870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:21.128870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:21.257126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:07:21.889056 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1e2422e-0c3d-4833-9ff8-63697aa40a01 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 204 len: 0 microversion: 2.1 time: 0.792782 Aug 03 05:07:21.889689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3024/6076] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:07:21 2022] DELETE /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:07:21.903181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:21.903806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:21.925580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:21.928029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:21.932397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:21.933051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:22.246450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:22.255959 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5f31ad3-6335-454c-945e-39d51e5ec39f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1396 microversion: 2.1 time: 0.358338 Aug 03 05:07:22.256596 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3053/6077] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:21 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1396 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:23.282855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:23.284293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:23.293674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:23.294555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:23.296017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:23.296774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:23.634774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:23.645682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aacdd083-5f4f-4407-a437-6de4eb1e9e11 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1396 microversion: 2.1 time: 0.367586 Aug 03 05:07:23.661256 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3025/6078] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:23 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1396 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:24.490646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b917b38e-76f7-41ed-9e8a-c252846c99f1 req-d16e9707-2954-4745-9488-2991791ff4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc3968b-2a51-4160-aae5-a5128e3d01f5", "name": "network-vif-deleted", "tag": "73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:24.569772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b917b38e-76f7-41ed-9e8a-c252846c99f1 req-d16e9707-2954-4745-9488-2991791ff4c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:24.570244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b917b38e-76f7-41ed-9e8a-c252846c99f1 req-d16e9707-2954-4745-9488-2991791ff4c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:24.645440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b917b38e-76f7-41ed-9e8a-c252846c99f1 req-d16e9707-2954-4745-9488-2991791ff4c5 service nova] Creating event network-vif-deleted:73c07189-8d5e-4ae3-8d94-e1f2ea76cdd3 for instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 on n-h2-826756-5 Aug 03 05:07:24.658433 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b917b38e-76f7-41ed-9e8a-c252846c99f1 req-d16e9707-2954-4745-9488-2991791ff4c5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172718 Aug 03 05:07:24.666561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3054/6079] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:24.680335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:24.689183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:24.717156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:24.718954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:24.723129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:24.726147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:24.885479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:24.897195 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e417f5f-b477-495a-9030-ad496c2c1225 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.226219 Aug 03 05:07:24.907017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3026/6080] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:24 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:25.933202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:25.941749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:25.990710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:25.994387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:25.995521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:25.998525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:26.270786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:26.270786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c44f4ce1-21a9-440a-8f90-b0e7bb8653c9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.303061 Aug 03 05:07:26.270786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3055/6081] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:25 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:27.323416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:27.324753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:27.337612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:27.343237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:27.346335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:27.347275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:27.547997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:27.584701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b0d1576-e6f7-4279-9629-bee583d9568c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.256906 Aug 03 05:07:27.585789 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3027/6082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:27 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:28.607433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:28.608983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:28.626426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:28.631179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:28.631179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:28.631179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:29.045206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:29.061145 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3848624-1202-4526-8937-25dff5667e38 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.458910 Aug 03 05:07:29.069942 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3056/6083] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:28 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:30.091168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:30.096000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:30.106969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:30.107440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:30.108241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:30.108719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:30.194006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:30.203834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1bfecccb-56a8-4232-b41e-db84695f7ca9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.117532 Aug 03 05:07:30.204889 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3028/6084] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:30 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:31.229694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:31.230270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:31.237277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:31.237764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:31.245526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:31.252442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:31.445243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:31.462082 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9080dab0-7397-4f25-b6a5-16ca962a87c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.240037 Aug 03 05:07:31.478853 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3057/6085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:31 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:32.490927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:32.491551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:32.512371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:32.522810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:32.522810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:32.522810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:32.687986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:32.729598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d7641d14-8dd2-4b9e-aed5-88383ac7c3e4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.242430 Aug 03 05:07:32.731653 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3029/6086] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:32 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:33.759877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:33.759877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:33.777667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:33.778018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:33.801238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:33.802488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:34.029922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:34.041099 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94b844bf-c825-4544-82fb-88272766bdba tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1188 microversion: 2.1 time: 0.293837 Aug 03 05:07:34.058632 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3058/6087] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:33 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:35.063138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:35.064235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:35.078028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:35.078951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:35.082804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:35.083572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:35.175129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:35.175593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:35.178908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid 4cc3968b-2a51-4160-aae5-a5128e3d01f5 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:07:35.294399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:35.302166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24201004-a6d6-4d8e-9734-b97bacf8dd48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 200 len: 1147 microversion: 2.1 time: 0.243078 Aug 03 05:07:35.303786 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3030/6088] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:35 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 1147 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:36.331533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:36.331533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:36.342388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:36.353377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:36.354551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:36.356039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:36.410316 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 HTTP/1.1 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4cc3968b-2a51-4160-aae5-a5128e3d01f5'} Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:36.412042 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:07:36.418820 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5992556f-e98d-4778-8908-05d3e9f0e707 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 404 len: 111 microversion: 2.1 time: 0.091701 Aug 03 05:07:36.421297 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3059/6089] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:36 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:07:42.288132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:42.288690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:42.300780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:42.301062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:42.317559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:42.318040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:42.397263 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 HTTP/1.1 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '4cc3968b-2a51-4160-aae5-a5128e3d01f5'} Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:07:42.399284 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.405523 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.419940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:07:42.421075 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff733c42-6373-4640-aaa6-d832cc5d5fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 404 len: 111 microversion: 2.1 time: 0.137143 Aug 03 05:07:42.425058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3031/6090] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:07:42 2022] DELETE /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:07:42.433900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:42.437741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4cc3968b-2a51-4160-aae5-a5128e3d01f5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:42.442634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:42.461844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:42.463239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:42.463696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:42.540203 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 HTTP/1.1 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4cc3968b-2a51-4160-aae5-a5128e3d01f5'} Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:07:42.543363 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:07:42.549512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4cc3968b-2a51-4160-aae5-a5128e3d01f5 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:07:42.564594 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d17760c3-6e5c-4d77-9dc3-1d6cc0fee451 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5" status: 404 len: 111 microversion: 2.1 time: 0.134966 Aug 03 05:07:42.576652 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3060/6091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:42 2022] GET /compute/v2.1/servers/4cc3968b-2a51-4160-aae5-a5128e3d01f5 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:07:47.573067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af6994f6-a64f-4994-8fd2-2af5370385ef tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: .version_select at 0x7fdd47c12ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2013759322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGq3wAxqaDzZ7nd3z3qo/fPEqXIJHkzdwQewemqKFcQ9dAstv1L7myf12qkKY0IwNyARCzqwpNZw9BZBHtF+VDnFQhJ6pvyK2zuJhtGOv/nnqYjxgUwM72MHzuexrSM+xw=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:47.621996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-af6994f6-a64f-4994-8fd2-2af5370385ef tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:07:47.633304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-af6994f6-a64f-4994-8fd2-2af5370385ef tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:07:47.950024 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af6994f6-a64f-4994-8fd2-2af5370385ef tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.379859 Aug 03 05:07:47.950024 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3032/6092] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:07:47 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:07:49.140378 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:07:49.140971 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:07:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:07:54.689697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-894670784", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "2f142cbd-c581-4fb6-b4e0-6bb594005ff8"}], "key_name": "tempest-TestNetworkBasicOps-2013759322", "security_groups": [{"name": "tempest-secgroup-smoke-827191967"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:07:54.711045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:54.712109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=65 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:54.925860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] validate_networks() for [('2f142cbd-c581-4fb6-b4e0-6bb594005ff8', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:07:55.737086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:07:55.738349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:07:55.739021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:07:55.740864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:07:55.742047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:07:55.757635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:55.762028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:55.763266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:55.764075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:55.804425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:07:55.811095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Getting quotas for user b549dbdf777b4a30be461c9cb69812d3 and project b0b40bcbdbc34be698c26ebc8207239d. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:07:55.826297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:07:55.828910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:07:55.999007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8ebf614-7b3f-4ad5-82ac-1a3d9e5dca0e tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.318878 Aug 03 05:07:56.000349 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3061/6093] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:07:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:07:56.011628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d26ccc4-8656-42aa-96cf-191a8a1ce635 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:56.012292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d26ccc4-8656-42aa-96cf-191a8a1ce635 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:56.026304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:56.032789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:07:56.153456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d26ccc4-8656-42aa-96cf-191a8a1ce635 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:56.164547 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d26ccc4-8656-42aa-96cf-191a8a1ce635 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1248 microversion: 2.1 time: 0.154158 Aug 03 05:07:56.183732 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3033/6094] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:56 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1248 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:57.191748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-323c8598-1df0-45d0-b7f7-6e16f85e1a65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:57.193166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-323c8598-1df0-45d0-b7f7-6e16f85e1a65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:57.297367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-323c8598-1df0-45d0-b7f7-6e16f85e1a65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:57.316754 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-323c8598-1df0-45d0-b7f7-6e16f85e1a65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1248 microversion: 2.1 time: 0.121859 Aug 03 05:07:57.316754 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3062/6095] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:57 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1248 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:07:58.340191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:58.340917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:58.367701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:58.370043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:58.375101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:58.377946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:58.595546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:58.609035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2091dff-a97b-4246-a60a-1ea0b8223319 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1252 microversion: 2.1 time: 0.274461 Aug 03 05:07:58.610281 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3034/6096] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:58 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1252 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:07:59.632411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:07:59.634052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:07:59.642512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:59.642957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:59.643749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:07:59.644204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:07:59.722081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:07:59.731259 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb6e39d0-b440-456d-a237-1a63167c3c02 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1300 microversion: 2.1 time: 0.103195 Aug 03 05:07:59.748263 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3063/6097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:07:59 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:00.763636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:00.765042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:00.774721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:00.780917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:00.781882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:00.782386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:00.939057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:00.946669 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64b6c9a8-cccd-4dcb-82d9-62dcb85a2dd6 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1318 microversion: 2.1 time: 0.192466 Aug 03 05:08:00.947253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3035/6098] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:00 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:01.972790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:01.973999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:02.001511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:02.002532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:02.003608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:02.005623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:02.427451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:02.434825 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae23fd3e-4f6a-4fe6-8451-107c6097a3c2 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.468552 Aug 03 05:08:02.435418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3064/6099] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:01 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:03.466331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:03.466959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:03.496382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:03.503039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:03.503039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:03.503039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:04.029022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:04.047938 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f2b0159e-1e49-4ace-bbe5-aea21a06a235 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.586348 Aug 03 05:08:04.060343 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3036/6100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:03 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:04.266954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2285f829-8a88-4f98-af57-6a786a0d3c54 req-7bcd4e85-d5f9-4d6b-adc5-7b1359c81de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7b0447-b8bc-4a1f-889b-8b5498ee07e6", "tag": "27c06358-7062-49ce-a8a7-899b777ace6e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:04.289905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2285f829-8a88-4f98-af57-6a786a0d3c54 req-7bcd4e85-d5f9-4d6b-adc5-7b1359c81de6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:04.293145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2285f829-8a88-4f98-af57-6a786a0d3c54 req-7bcd4e85-d5f9-4d6b-adc5-7b1359c81de6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:04.311938 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2285f829-8a88-4f98-af57-6a786a0d3c54 req-7bcd4e85-d5f9-4d6b-adc5-7b1359c81de6 service nova] Creating event network-changed:27c06358-7062-49ce-a8a7-899b777ace6e for instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 on n-h1-826756-5 Aug 03 05:08:04.320621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2285f829-8a88-4f98-af57-6a786a0d3c54 req-7bcd4e85-d5f9-4d6b-adc5-7b1359c81de6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058190 Aug 03 05:08:04.324249 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3065/6101] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:08:05.074180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:05.075046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:05.085859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:05.088408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:05.090149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:05.091179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:05.370403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:05.384106 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdd19a23-2918-49fe-8c4f-1b8afcf7e7ba tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.315199 Aug 03 05:08:05.388401 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3037/6102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:05 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:06.409557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:06.410882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:06.414352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:06.436413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:06.437072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:06.437931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:06.438378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:06.797365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:06.807366 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b5d1388-613e-425c-9875-02ee729b1d54 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.402534 Aug 03 05:08:06.809371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3066/6103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:06 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:07.828892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:07.830204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:07.840004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:07.846705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:07.848723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:07.855259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:07.855899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:08.854526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:08.864507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-695868c8-9c03-4ecf-b224-e2a243d32b08 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 1.039827 Aug 03 05:08:08.866170 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3038/6104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:07 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:09.890730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:09.891788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:09.893827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:09.933285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:09.935652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:09.958841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:09.959567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:10.315126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:10.324549 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c70bf11f-0c1f-41c4-8f74-7acc1058e93b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.441119 Aug 03 05:08:10.330339 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3067/6105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:09 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:11.600406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:11.630690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:11.644244 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d6c1358-21ad-45c2-84cd-1614ae92905b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.296669 Aug 03 05:08:11.646429 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3039/6106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:11 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:12.235455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-970b0531-f410-4515-ad66-c2e4d04159cb req-a744f039-b9d8-4ca3-80eb-1a9dd90f15a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7b0447-b8bc-4a1f-889b-8b5498ee07e6", "name": "network-vif-plugged", "status": "completed", "tag": "27c06358-7062-49ce-a8a7-899b777ace6e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:12.259692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-970b0531-f410-4515-ad66-c2e4d04159cb req-a744f039-b9d8-4ca3-80eb-1a9dd90f15a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:12.260578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-970b0531-f410-4515-ad66-c2e4d04159cb req-a744f039-b9d8-4ca3-80eb-1a9dd90f15a7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:12.286159 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-970b0531-f410-4515-ad66-c2e4d04159cb req-a744f039-b9d8-4ca3-80eb-1a9dd90f15a7 service nova] Creating event network-vif-plugged:27c06358-7062-49ce-a8a7-899b777ace6e for instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 on n-h1-826756-5 Aug 03 05:08:12.299284 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-970b0531-f410-4515-ad66-c2e4d04159cb req-a744f039-b9d8-4ca3-80eb-1a9dd90f15a7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067600 Aug 03 05:08:12.300607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3068/6107] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:08:12.680016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:12.681018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:12.717263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:12.727199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:12.732481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:12.732481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:13.216634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:13.222509 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a080bb8-9926-49ec-961d-3b154ef63420 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1373 microversion: 2.1 time: 0.549886 Aug 03 05:08:13.225188 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3040/6108] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:12 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1373 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:14.249750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:14.250301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:14.267545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:14.267993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:14.269018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:14.269829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:14.670381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:14.687131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b34c928-ea0c-43ec-9ee6-c3748c8cb8f9 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1544 microversion: 2.1 time: 0.441883 Aug 03 05:08:14.688791 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3069/6109] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:14 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1544 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:14.716082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:14.716785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:14.730116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:14.730882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:14.731876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:14.733895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:15.047347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:15.056844 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e780d2e-2085-41af-baa3-b7e60664731b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1544 microversion: 2.1 time: 0.346675 Aug 03 05:08:15.069309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3041/6110] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:14 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1544 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:19.337413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b6aa377c-fa3b-480d-a3f4-588f26a8cfa8 req-b4df2914-6c9b-41ed-bc51-2d77c0278695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7b0447-b8bc-4a1f-889b-8b5498ee07e6", "tag": "27c06358-7062-49ce-a8a7-899b777ace6e"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:19.350427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b6aa377c-fa3b-480d-a3f4-588f26a8cfa8 req-b4df2914-6c9b-41ed-bc51-2d77c0278695 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:19.351521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b6aa377c-fa3b-480d-a3f4-588f26a8cfa8 req-b4df2914-6c9b-41ed-bc51-2d77c0278695 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:19.367463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b6aa377c-fa3b-480d-a3f4-588f26a8cfa8 req-b4df2914-6c9b-41ed-bc51-2d77c0278695 service nova] Creating event network-changed:27c06358-7062-49ce-a8a7-899b777ace6e for instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 on n-h1-826756-5 Aug 03 05:08:19.377739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b6aa377c-fa3b-480d-a3f4-588f26a8cfa8 req-b4df2914-6c9b-41ed-bc51-2d77c0278695 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044030 Aug 03 05:08:19.381321 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3070/6111] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:08:35.209760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=19 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:35.210500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=48 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:35.407315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-de163b79-d3fe-46f3-9843-a34ae60c014f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Action: 'create', calling method: .version_select at 0x7fdd47d8fb80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2085114800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZL41isjnZ6FUxBGmP0CrMH8WpYhcZq2kUbuo2eV8f1SZ91I2sSbIPaY2Uirp+VxLoxBKt+mOjk32mZ7bjUKLuGyWnvpnlBhjt1vZ6wq6C/ZQ9FW4ZGALu1v2C/eNemFA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:35.437552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-de163b79-d3fe-46f3-9843-a34ae60c014f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:08:35.443111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-de163b79-d3fe-46f3-9843-a34ae60c014f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for user fe65f20a4a894f2ab7765c9ce63a4d89 and project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:08:35.647146 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-de163b79-d3fe-46f3-9843-a34ae60c014f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.442486 Aug 03 05:08:35.653584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3042/6112] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:08:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:08:39.130051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-753128860", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c67fd4f7-c7f7-4411-a9b6-9474fc15165d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:39.141297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:39.146300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=38 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:39.201952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:08:39.596377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:39.598759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:39.607965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:39.608474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:39.609273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:39.609727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:39.641533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:08:39.641533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:08:39.641533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:08:39.641533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:08:39.641533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:08:39.650529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:39.651139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:39.652069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:39.652798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:39.681079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:08:39.681315 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77f4b458-6c2c-4f2c-9299-2dae0d027d65 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6/action" status: 200 len: 24566 microversion: 2.1 time: 0.093037 Aug 03 05:08:39.682311 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3043/6113] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:08:39 2022] POST /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6/action => generated 24566 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:08:39.690657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:08:39.776063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:08:39.779571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c67fd4f7-c7f7-4411-a9b6-9474fc15165d',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:08:40.378427 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6fb8d0f-f9e0-451a-8f41-67fec8e3d980 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253123 Aug 03 05:08:40.391728 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3071/6114] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:08:40.405018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-87af85b2-9914-420b-a45b-4bce81e4c62c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:40.406018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-87af85b2-9914-420b-a45b-4bce81e4c62c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:40.516318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-87af85b2-9914-420b-a45b-4bce81e4c62c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:40.529112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-87af85b2-9914-420b-a45b-4bce81e4c62c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1070 microversion: 2.1 time: 0.128379 Aug 03 05:08:40.534951 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3044/6115] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:40 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1070 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:41.556404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2c6683a4-6def-4282-999c-a193d91cfe3f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:41.557238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2c6683a4-6def-4282-999c-a193d91cfe3f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:41.654631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2c6683a4-6def-4282-999c-a193d91cfe3f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:41.666790 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2c6683a4-6def-4282-999c-a193d91cfe3f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1070 microversion: 2.1 time: 0.115111 Aug 03 05:08:41.670013 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3072/6116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:41 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1070 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:42.699307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:42.707492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:42.726173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:42.726965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:42.732927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:42.733952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:43.111385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:43.125210 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6bf5bcdd-2e8e-4e2b-8c2c-6f9c416bf9e7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1112 microversion: 2.1 time: 0.432513 Aug 03 05:08:43.136504 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3045/6117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:42 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1112 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:44.165118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:44.171483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:44.198629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:44.201154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:44.202093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:44.202531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:44.363691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:44.380355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a6edab3f-0067-4c9a-a20b-7ace4926a174 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1186 microversion: 2.1 time: 0.228090 Aug 03 05:08:44.384575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3073/6118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:44 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1186 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:45.421368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:45.421368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:45.441754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:45.447169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:45.451625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:45.454266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:46.277782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:46.290273 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7fe412cd-a2d4-40f2-8ed0-a5553566c97a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1228 microversion: 2.1 time: 0.880100 Aug 03 05:08:46.294867 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3046/6119] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:45 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1228 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:46.371009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:46.374927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:46.399145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:46.399884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:46.402069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:46.402719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:46.489005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8043da66-8e5f-4099-ab1d-b2d1c98de804 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "POST /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6/action" status: 200 len: 32635 microversion: 2.1 time: 0.123250 Aug 03 05:08:46.501615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3074/6120] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:08:46 2022] POST /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6/action => generated 32635 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:08:47.317981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:47.318821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:47.329796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:47.335489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:47.337704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:47.339293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:48.090426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:48.100781 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-69e9df53-2fb1-432c-b706-45044c60ccf6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1228 microversion: 2.1 time: 0.786958 Aug 03 05:08:48.116421 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3047/6121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:47 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1228 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:49.131240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:49.132086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:49.149414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:49.149912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:49.157908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:49.159527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:49.636986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2296a7ef-3272-4db2-9d7b-c6cd3b977e43 req-728a3754-0118-4dfb-ad7b-13b715aec81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfe23ea-e600-47a9-b396-6cce8f9010ed", "tag": "ecee22ab-a00f-4b38-81e1-b212a9f85a73"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:49.649364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:49.658108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8de3fb79-83bd-4e29-8107-8f9b80dd9e54 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1228 microversion: 2.1 time: 0.531506 Aug 03 05:08:49.661189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3075/6122] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:49 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1228 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:49.678459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2296a7ef-3272-4db2-9d7b-c6cd3b977e43 req-728a3754-0118-4dfb-ad7b-13b715aec81c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:49.680575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2296a7ef-3272-4db2-9d7b-c6cd3b977e43 req-728a3754-0118-4dfb-ad7b-13b715aec81c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:49.714209 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2296a7ef-3272-4db2-9d7b-c6cd3b977e43 req-728a3754-0118-4dfb-ad7b-13b715aec81c service nova] Creating event network-changed:ecee22ab-a00f-4b38-81e1-b212a9f85a73 for instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed on n-h2-826756-5 Aug 03 05:08:49.736249 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2296a7ef-3272-4db2-9d7b-c6cd3b977e43 req-728a3754-0118-4dfb-ad7b-13b715aec81c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372230 Aug 03 05:08:49.738204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3048/6123] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:08:49.961545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:49.961996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:49.964133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:50.009988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-22e84ff0-2153-46c7-96bc-ff6c42721b79 req-6cf38de5-eba3-4e30-9c13-a112cfa31100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae7b0447-b8bc-4a1f-889b-8b5498ee07e6", "tag": "27c06358-7062-49ce-a8a7-899b777ace6e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:50.010528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.010528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.010528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.010528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.011136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-22e84ff0-2153-46c7-96bc-ff6c42721b79 req-6cf38de5-eba3-4e30-9c13-a112cfa31100 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.011136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-22e84ff0-2153-46c7-96bc-ff6c42721b79 req-6cf38de5-eba3-4e30-9c13-a112cfa31100 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.054169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-22e84ff0-2153-46c7-96bc-ff6c42721b79 req-6cf38de5-eba3-4e30-9c13-a112cfa31100 service nova] Creating event network-changed:27c06358-7062-49ce-a8a7-899b777ace6e for instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 on n-h1-826756-5 Aug 03 05:08:50.071821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-22e84ff0-2153-46c7-96bc-ff6c42721b79 req-6cf38de5-eba3-4e30-9c13-a112cfa31100 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094022 Aug 03 05:08:50.075553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:08:50.080559 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3049/6124] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:08:50.686573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:50.688393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:50.698697 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93658ced-6d67-4a91-8cc8-4d52361bce5b tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 204 len: 0 microversion: 2.1 time: 0.741121 Aug 03 05:08:50.701886 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3076/6125] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:08:49 2022] DELETE /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:08:50.703389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:50.713738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:50.715386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:50.726057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.728534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.736179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.742044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.745695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.747353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:50.753447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:50.756630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:51.486281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:51.494690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a1acca4-c0df-43d8-9d6a-789ea2b86c3a tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1668 microversion: 2.1 time: 0.788689 Aug 03 05:08:51.508970 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3077/6126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:50 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1668 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:51.548963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:51.564936 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e4c68ce-af69-49ac-a4e4-cfa2521ac77d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1228 microversion: 2.1 time: 0.884112 Aug 03 05:08:51.576068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3050/6127] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:50 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1228 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:52.069602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-272685722-access_point-1386667140", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "48333297-7e49-4b3e-a99f-8307970df1a5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2085114800", "security_groups": [{"name": "tempest-secgroup_access--136440520"}, {"name": "tempest-secgroup_general--2017469450"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:52.083059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:08:52.536346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:52.537119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:52.563259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:52.573143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:52.578498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:52.580925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:53.179236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] validate_networks() for [('48333297-7e49-4b3e-a99f-8307970df1a5', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:08:54.472500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:54.486716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f4845d9-4620-493a-8463-2826e22b2c03 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1668 microversion: 2.1 time: 1.965377 Aug 03 05:08:54.488142 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3051/6128] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:52 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1668 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:54.505537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:54.506398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:54.516767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:54.517478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:54.518574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:54.519188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.114993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:55.128838 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-674511a1-c80a-4b9f-b440-5173952d4136 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1228 microversion: 2.1 time: 0.639044 Aug 03 05:08:55.129613 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3052/6129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:54 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1228 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:55.396959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-26b52750-b6ce-4619-af84-e598c7115c46 req-9862ab43-64ee-4582-b44e-39ea43bd99c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae7b0447-b8bc-4a1f-889b-8b5498ee07e6", "name": "network-vif-deleted", "tag": "27c06358-7062-49ce-a8a7-899b777ace6e"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:55.406856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-26b52750-b6ce-4619-af84-e598c7115c46 req-9862ab43-64ee-4582-b44e-39ea43bd99c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:55.407604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-26b52750-b6ce-4619-af84-e598c7115c46 req-9862ab43-64ee-4582-b44e-39ea43bd99c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.424676 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-26b52750-b6ce-4619-af84-e598c7115c46 req-9862ab43-64ee-4582-b44e-39ea43bd99c3 service nova] Creating event network-vif-deleted:27c06358-7062-49ce-a8a7-899b777ace6e for instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 on n-h1-826756-5 Aug 03 05:08:55.425169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:08:55.426692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:08:55.427903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:08:55.428353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:08:55.428776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:08:55.432919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-26b52750-b6ce-4619-af84-e598c7115c46 req-9862ab43-64ee-4582-b44e-39ea43bd99c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039434 Aug 03 05:08:55.434071 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3053/6130] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:08:55.457966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:55.459075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.460481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:55.466427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.483280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:08:55.493188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for user fe65f20a4a894f2ab7765c9ce63a4d89 and project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:08:55.509745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:55.510453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:55.517744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:55.519129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.519549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:08:55.520327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:55.521416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:55.522142 n-d-826756-5 devstack@n-api.service[120831]: WARNING nova.utils [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-272685722-access_point-1386667140 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-272685722-acc Aug 03 05:08:55.523227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:08:55.603441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:55.615192 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-742da035-696f-4b74-b312-ee15d54fded5 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1483 microversion: 2.1 time: 0.109821 Aug 03 05:08:55.621584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3054/6131] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:55 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1483 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:55.691576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6dee05ae-8c47-4c5f-b376-6d41fbf864e6 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 3.621510 Aug 03 05:08:55.695683 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3078/6132] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:08:52 2022] POST /compute/v2.1/servers => generated 457 bytes in 3631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:08:55.711960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aae8e8e4-3ea6-4c46-936b-7189c1dd2e73 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:55.712625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aae8e8e4-3ea6-4c46-936b-7189c1dd2e73 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:55.846619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aae8e8e4-3ea6-4c46-936b-7189c1dd2e73 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:55.856883 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aae8e8e4-3ea6-4c46-936b-7189c1dd2e73 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1294 microversion: 2.1 time: 0.148759 Aug 03 05:08:55.858862 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3055/6133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:55 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:56.072008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1336838422", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:08:56.130927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:08:56.151661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:56.158663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:56.181850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.187973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.187973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.187973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.661845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:56.684084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8bdc5244-3655-4f1f-b1e9-3484b48e612c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.526613 Aug 03 05:08:56.686048 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3056/6134] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:56 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:56.695658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:56.696586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:56.709641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.710101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.710991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.711791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.748224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:08:56.749237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:08:56.749911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:08:56.750341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:08:56.750800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:08:56.758804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.759273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.759740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lazy-loading 'fault' on Instance uuid ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:08:56.761892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.762540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.764507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:56.767389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:56.792391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Getting quotas for project 21d4d61aeeac48a08345c789d36f8769. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:08:56.799566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Getting quotas for user 3235a1bb0e5b416e8bbbfccd50e700f4 and project 21d4d61aeeac48a08345c789d36f8769. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:08:56.805996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b549dbdf777b4a30be461c9cb69812d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b40bcbdbc34be698c26ebc8207239d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:56.814457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:08:56.815449 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da0b40aa-5b54-49b6-9e0c-461c52483bf8 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 200 len: 1338 microversion: 2.1 time: 0.127963 Aug 03 05:08:56.820317 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3057/6135] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:56 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 1338 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:56.820487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:08:56.882202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4adfdc6f-37e0-487c-829c-859062d7bf14 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:56.886050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4adfdc6f-37e0-487c-829c-859062d7bf14 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:56.998947 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7f7e109-90e1-424b-8ee3-ee8a05c7b74c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930764 Aug 03 05:08:57.002866 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3079/6136] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:08:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:08:57.011577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0190658f-34ff-4c13-b9c4-ef8d9f9fd676 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:57.012201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0190658f-34ff-4c13-b9c4-ef8d9f9fd676 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:57.029713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4adfdc6f-37e0-487c-829c-859062d7bf14 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:57.041666 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4adfdc6f-37e0-487c-829c-859062d7bf14 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1294 microversion: 2.1 time: 0.163293 Aug 03 05:08:57.042251 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3058/6137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:56 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:57.094001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0190658f-34ff-4c13-b9c4-ef8d9f9fd676 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:57.111568 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0190658f-34ff-4c13-b9c4-ef8d9f9fd676 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1214 microversion: 2.1 time: 0.104094 Aug 03 05:08:57.126348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3080/6138] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:57 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:08:57.698624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:57.699613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:57.707758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:57.708312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:57.709135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:57.709577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:57.836874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:57.837697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] [instance: ae7b0447-b8bc-4a1f-889b-8b5498ee07e6] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:57.844134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:57.846483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:57.847018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:57.847808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:57.848326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:57.852319 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d768e272-4db9-4358-be01-f64bbfd9b33f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.157616 Aug 03 05:08:57.852917 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3059/6139] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:57 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:57.863219 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] HTTP exception thrown: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Request method failure captured: Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 HTTP/1.1 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gHgRtDYIYfOCwYRftQrRaeZ00Hc2Tn6NTi_Y94Td131SKEgr9gHCCQ7uucqPlGNiDw-SNP8rz7Ih-7biRuK4h07QVLYl7DpLyBxIDXgsAXBmJS33-EJ45zF7gjRZ6_E_DizRcj6_7GZI5ZMI791u-C40sgchmzCbnLpNQEszzpFQbU Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b0b40bcbdbc34be698c26ebc8207239d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: b0b40bcbdbc34be698c26ebc8207239d Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkBasicOps-1796267198 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: b549dbdf777b4a30be461c9cb69812d3 Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkBasicOps-1796267198-project Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'ae7b0447-b8bc-4a1f-889b-8b5498ee07e6'} Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:08:57.864944 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Returning 404 to user: Instance ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-684befcb-2391-4833-8474-85a50c3408fc tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6" status: 404 len: 111 microversion: 2.1 time: 0.033583 Aug 03 05:08:57.872083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3081/6140] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:57 2022] GET /compute/v2.1/servers/ae7b0447-b8bc-4a1f-889b-8b5498ee07e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:08:58.063925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:58.064583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:58.071058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:58.071518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:58.072359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:58.072805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:58.135957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fe2d340b-896e-4f8b-a614-ec5fe71d7643 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:58.137082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fe2d340b-896e-4f8b-a614-ec5fe71d7643 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:58.160909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:58.195538 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47c07abb-140b-42b2-a64a-bd354c3e7457 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1298 microversion: 2.1 time: 0.114645 Aug 03 05:08:58.195538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3060/6141] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:58 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1298 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:58.223963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fe2d340b-896e-4f8b-a614-ec5fe71d7643 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:58.231492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fe2d340b-896e-4f8b-a614-ec5fe71d7643 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1214 microversion: 2.1 time: 0.101390 Aug 03 05:08:58.232577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3082/6142] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:58 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:58.338345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99b87421-c8b9-44e6-a20c-9a8638165f40 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] Calling method '.version_select at 0x7fdd47dedca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:58.568262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99b87421-c8b9-44e6-a20c-9a8638165f40 tempest-TestNetworkBasicOps-1796267198 tempest-TestNetworkBasicOps-1796267198-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2013759322" status: 202 len: 0 microversion: 2.1 time: 0.234101 Aug 03 05:08:58.569165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3061/6143] 10.222.0.72 () {58 vars in 1257 bytes} [Wed Aug 3 05:08:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2013759322 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:08:58.879967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:58.880731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:58.890403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:58.890974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:58.893330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:58.893943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:59.209946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:59.211478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:59.215812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:59.220898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f37e16c-e4fd-4522-ac77-8356b7884555 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.350127 Aug 03 05:08:59.230136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:59.230136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:59.233811 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3083/6144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:58 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:59.255656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:59.258237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:59.260396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:08:59.261272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:08:59.281764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:59.283312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:59.286982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:08:59.293292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:08:59.426358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:59.438098 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2898ee81-482c-45ac-8aab-196bc9f54a44 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1346 microversion: 2.1 time: 0.229362 Aug 03 05:08:59.444333 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3062/6145] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:59 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1346 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:08:59.462081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:08:59.470374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f38d891-aa43-4ba4-a862-aa205f2af55c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1218 microversion: 2.1 time: 0.219539 Aug 03 05:08:59.486420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3084/6146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:08:59 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:00.254247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:00.255076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:00.263605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.264077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.267601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.272059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.462669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:00.463305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:00.474583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.475293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.477053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.481125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.627170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb6f34e1-954e-41fc-9921-143e702a0c7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1352 microversion: 2.1 time: 0.182682 Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3085/6147] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:00 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af984117-a3c0-4bd0-b974-d84ed313aeb6 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1274 microversion: 2.1 time: 0.228039 Aug 03 05:09:00.981248 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3086/6148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:00 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:01.134757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:01.155286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d26c5311-0446-4e34-bc8d-ef438dbfcc42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.901296 Aug 03 05:09:01.159668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3063/6149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:00 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:01.661693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:01.667462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:01.671341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:01.671806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:01.672654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:01.673253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:01.895075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:01.900465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:01.916876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:01.917547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:01.918487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:01.919067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:01.983133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:01.994480 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99288b4a-465c-4296-8baa-da9c9d2fd345 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1352 microversion: 2.1 time: 0.336856 Aug 03 05:09:01.999374 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3087/6150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:01 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1352 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:02.141968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:02.151543 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0628ebdf-878b-46f5-ab57-83f36e18d15c tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1272 microversion: 2.1 time: 0.261476 Aug 03 05:09:02.152874 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3064/6151] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:01 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:02.187678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:02.189710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:02.201617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:02.203702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:02.204763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:02.206326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:02.857481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:02.869138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-32ce8bf1-ab5f-4d4e-9ade-8f51c3da3de8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.692283 Aug 03 05:09:02.873621 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3088/6152] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:02 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:03.020653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:03.021279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:03.041187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.041187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.041187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.043805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.093665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:03.174492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:03.175328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:03.188404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.189077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.193284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.195041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.352735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:03.360877 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6fb5a263-d0a8-4014-a89c-36ea723d5dd2 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1272 microversion: 2.1 time: 0.190310 Aug 03 05:09:03.361510 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3089/6153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:03 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:03.899578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:03.914202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:03.924448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.925278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.926962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:03.929353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:03.965270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:03.988581 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5575ed2-394d-4aa7-b1de-f7861d3decca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.969576 Aug 03 05:09:03.989500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3065/6154] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:03 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:04.364378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:04.376306 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5670d315-8c77-4871-b988-fe243d011fcb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.488685 Aug 03 05:09:04.377528 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3090/6155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:03 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:04.384259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:04.385519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:04.394396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:04.395112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:04.396103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:04.396808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:04.488298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:04.507009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-524cfab1-f659-43a0-b4e9-a816d21f65fd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1272 microversion: 2.1 time: 0.127536 Aug 03 05:09:04.507606 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3066/6156] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:04 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1272 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:05.010605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:05.011689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:05.025283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.025750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.035637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.036112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.398808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:05.400059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:05.412614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.416579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.417652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.419640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.729551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:05.744779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:05.747347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:05.754908 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa8dfb8d-7274-489d-aaf1-5592cbbfaf3c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.360046 Aug 03 05:09:05.770379 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3067/6157] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:05 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:05.770886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7abc3a83-9f92-4369-8a64-2a781ab4b06d tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.750245 Aug 03 05:09:05.775946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3091/6158] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:05 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:05.782133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:05.783346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:05.797452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6c1a9329-6bae-4027-9c58-537b1048ffc3 req-e6b719d9-df48-425e-b2f2-380bd16d5627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6fb279-1853-46bc-a1c7-c50e0de60e8c", "tag": "af3084c3-dd22-4dc6-a954-b4db1742e976"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:05.809228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.809855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.810019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:05.811661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.812514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.814080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6c1a9329-6bae-4027-9c58-537b1048ffc3 req-e6b719d9-df48-425e-b2f2-380bd16d5627 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:05.814800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6c1a9329-6bae-4027-9c58-537b1048ffc3 req-e6b719d9-df48-425e-b2f2-380bd16d5627 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:05.834222 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6c1a9329-6bae-4027-9c58-537b1048ffc3 req-e6b719d9-df48-425e-b2f2-380bd16d5627 service nova] Creating event network-changed:af3084c3-dd22-4dc6-a954-b4db1742e976 for instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c on n-h1-826756-5 Aug 03 05:09:05.844954 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6c1a9329-6bae-4027-9c58-537b1048ffc3 req-e6b719d9-df48-425e-b2f2-380bd16d5627 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052307 Aug 03 05:09:05.846311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3092/6159] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:09:06.230689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:06.245111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96435d23-8a20-471e-b302-406c35f93a1a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.472804 Aug 03 05:09:06.247456 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3068/6160] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:05 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:06.780090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:06.785943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:06.786944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:06.796183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:06.802148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:06.803557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:06.808725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:06.811572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:06.812246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:06.818268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:06.819142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:06.820180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:06.822842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:07.037510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:07.509164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:07.536226 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93462a01-18bc-4429-9ac2-52d6bb8747c3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.758008 Aug 03 05:09:07.557226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:07.563658 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3093/6161] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:06 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:07.583292 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9e9881e-36fd-4f08-8a26-3f96806bda7e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.785114 Aug 03 05:09:07.585924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:07.586832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:07.590416 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3069/6162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:06 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:07.615256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:07.616079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:07.617939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:07.622280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.120443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d7f26b06-ef1c-4684-8db0-09f8edc05e42 req-fe9d0898-3962-4db9-ad82-cd1f0cc24806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfe23ea-e600-47a9-b396-6cce8f9010ed", "name": "network-vif-plugged", "status": "completed", "tag": "ecee22ab-a00f-4b38-81e1-b212a9f85a73"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:08.134147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d7f26b06-ef1c-4684-8db0-09f8edc05e42 req-fe9d0898-3962-4db9-ad82-cd1f0cc24806 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.139410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d7f26b06-ef1c-4684-8db0-09f8edc05e42 req-fe9d0898-3962-4db9-ad82-cd1f0cc24806 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.150064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d7f26b06-ef1c-4684-8db0-09f8edc05e42 req-fe9d0898-3962-4db9-ad82-cd1f0cc24806 service nova] Creating event network-vif-plugged:ecee22ab-a00f-4b38-81e1-b212a9f85a73 for instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed on n-h2-826756-5 Aug 03 05:09:08.156052 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d7f26b06-ef1c-4684-8db0-09f8edc05e42 req-fe9d0898-3962-4db9-ad82-cd1f0cc24806 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.563498 Aug 03 05:09:08.156979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3070/6163] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:08.162553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c14900b2-ca97-4d0b-a5bc-87bfc17b046d req-7e9182dc-9520-4775-b845-42ae3855fe92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cec51088-3983-4725-a744-bcbdf2f2ec6c", "tag": "934319b8-dd79-40af-9b14-d9aa156f0b56"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:08.174325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c14900b2-ca97-4d0b-a5bc-87bfc17b046d req-7e9182dc-9520-4775-b845-42ae3855fe92 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.175040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c14900b2-ca97-4d0b-a5bc-87bfc17b046d req-7e9182dc-9520-4775-b845-42ae3855fe92 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.220245 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c14900b2-ca97-4d0b-a5bc-87bfc17b046d req-7e9182dc-9520-4775-b845-42ae3855fe92 service nova] Creating event network-changed:934319b8-dd79-40af-9b14-d9aa156f0b56 for instance cec51088-3983-4725-a744-bcbdf2f2ec6c on n-h1-826756-5 Aug 03 05:09:08.226412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c14900b2-ca97-4d0b-a5bc-87bfc17b046d req-7e9182dc-9520-4775-b845-42ae3855fe92 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066907 Aug 03 05:09:08.227581 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3071/6164] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:08.228094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:08.293892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:08.306186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59a63a73-922e-42fe-932d-615e1213e24e tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.741021 Aug 03 05:09:08.307231 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3094/6165] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:07 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:08.562881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:08.563822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:08.571266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.572162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.573170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.574024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.616987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:08.617606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:08.626318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.627115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.627550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:08.632260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:08.941703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:08.954859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a838c32d-3910-4c1f-aaa7-0c52a479325a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.397022 Aug 03 05:09:08.955754 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3072/6166] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:08 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:08.958786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:08.972711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad303fd6-66a5-4e6d-a991-4c29c291a3cc tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.359369 Aug 03 05:09:08.973421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3095/6167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:08 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:09.329649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:09.330324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:09.336516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:09.336971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:09.337736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:09.338175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:09.554968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:09.569691 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4aaf4761-6934-4007-b431-4ed780f88e79 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.243346 Aug 03 05:09:09.569691 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3073/6168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:09 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:09.976972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:09.977771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:09.987394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:09.988192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:09.989012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:09.989620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:10.000135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:10.003029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:10.004209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:10.011271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:10.011736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:10.012551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:10.012994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:10.320080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:10.327993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76ce08a3-ccf7-4aca-accd-4bf491ab6c09 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.355239 Aug 03 05:09:10.328602 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3096/6169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:09 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:10.362707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:10.370303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3d718df-cbe2-4a1b-bc27-31a5d669fb84 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.375048 Aug 03 05:09:10.371061 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3074/6170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:09 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:10.590415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:10.591061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:10.598237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:10.598778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:10.599590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:10.600069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:11.032814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:11.041245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c38cbc7f-83ea-4975-a23d-f0722bc4f00f tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.454929 Aug 03 05:09:11.041798 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3097/6171] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:10 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:11.350098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:11.350663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:11.358114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:11.358722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:11.359822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:11.360765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:11.391950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:11.392600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:11.398791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:11.399247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:11.400022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:11.400503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:11.671971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:11.680061 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a795b1d8-d583-4f87-a161-7111d0385da5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1216 microversion: 2.1 time: 0.334017 Aug 03 05:09:11.686912 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3075/6172] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:11 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1216 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:11.719125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:11.727004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6447c64-d7da-4cf7-90ed-f69a966ada48 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.339003 Aug 03 05:09:11.727578 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3098/6173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:11 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:12.063314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:12.063930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:12.070077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.070529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.071481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.071922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.313204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:12.328617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-293d3c57-ff53-44c0-a2ca-740f46977b12 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.268127 Aug 03 05:09:12.330809 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3076/6174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:12 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:12.500515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6d837bd1-ef8e-41b5-8825-7d9ef39513b2 req-b6c73b78-8030-4ec0-8c1e-e6b9772b64c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6fb279-1853-46bc-a1c7-c50e0de60e8c", "name": "network-vif-plugged", "status": "completed", "tag": "af3084c3-dd22-4dc6-a954-b4db1742e976"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:12.512056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6d837bd1-ef8e-41b5-8825-7d9ef39513b2 req-b6c73b78-8030-4ec0-8c1e-e6b9772b64c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.516659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6d837bd1-ef8e-41b5-8825-7d9ef39513b2 req-b6c73b78-8030-4ec0-8c1e-e6b9772b64c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.524331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6d837bd1-ef8e-41b5-8825-7d9ef39513b2 req-b6c73b78-8030-4ec0-8c1e-e6b9772b64c7 service nova] Creating event network-vif-plugged:af3084c3-dd22-4dc6-a954-b4db1742e976 for instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c on n-h1-826756-5 Aug 03 05:09:12.529749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6d837bd1-ef8e-41b5-8825-7d9ef39513b2 req-b6c73b78-8030-4ec0-8c1e-e6b9772b64c7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034152 Aug 03 05:09:12.530670 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3099/6175] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:12.710726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:12.711351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:12.723931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.724429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.725218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.725653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.750539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:12.751251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:12.760814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.761267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:12.764164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:12.764164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.068197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:13.076834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88bb6e27-4bb3-4986-84b9-e19383fe6e03 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1404 microversion: 2.1 time: 0.375473 Aug 03 05:09:13.077636 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3077/6176] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:12 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1404 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:13.104306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:13.105581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:13.113997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.114691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.115639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.116409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.274101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:13.284211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5847c9a4-5f95-43df-bc86-0b37aed8597f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1471 microversion: 2.1 time: 0.537933 Aug 03 05:09:13.284912 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3100/6177] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:12 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:13.351168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:13.351905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:13.359500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.360307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.361298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.361744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:13.362202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.373013 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f6744aae-b77a-4d85-9c33-1fa2e00c078d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1404 microversion: 2.1 time: 0.277958 Aug 03 05:09:13.373857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3078/6178] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:13 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1404 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:13.395960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1705622322"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:13.398682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:13.406387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.407058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.407968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:13.408561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:13.548867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Attempting to quiesce instance before volume snapshot. Aug 03 05:09:13.565104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:13.573850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a6c42a1-6d6e-4d94-9bac-58a158637da8 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.226499 Aug 03 05:09:13.577597 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3101/6179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:13 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:13.606454 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 03 05:09:13.905380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Creating snapshot from volume c67fd4f7-c7f7-4411-a9b6-9474fc15165d. {{(pid=120832) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 03 05:09:14.306990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:14.307266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:14.315327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:14.315920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:14.316804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:14.317307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:14.569275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:14.577073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78c1afe3-fe33-4831-9e91-e4ab3f5ab4e9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1644 microversion: 2.1 time: 0.274601 Aug 03 05:09:14.577653 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3102/6180] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:14 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1644 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:14.582600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-51cf516d-aae3-4173-9f87-23a90a0d4757 req-fd3b2764-e98f-43f9-91b1-79a1ba618337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec51088-3983-4725-a744-bcbdf2f2ec6c", "name": "network-vif-plugged", "status": "completed", "tag": "934319b8-dd79-40af-9b14-d9aa156f0b56"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:14.593095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-51cf516d-aae3-4173-9f87-23a90a0d4757 req-fd3b2764-e98f-43f9-91b1-79a1ba618337 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:14.593563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-51cf516d-aae3-4173-9f87-23a90a0d4757 req-fd3b2764-e98f-43f9-91b1-79a1ba618337 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:14.605587 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-51cf516d-aae3-4173-9f87-23a90a0d4757 req-fd3b2764-e98f-43f9-91b1-79a1ba618337 service nova] Creating event network-vif-plugged:934319b8-dd79-40af-9b14-d9aa156f0b56 for instance cec51088-3983-4725-a744-bcbdf2f2ec6c on n-h1-826756-5 Aug 03 05:09:14.611873 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-51cf516d-aae3-4173-9f87-23a90a0d4757 req-fd3b2764-e98f-43f9-91b1-79a1ba618337 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033023 Aug 03 05:09:14.612744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3103/6181] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:14.618190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:14.618917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:14.651702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:14.652900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:14.655375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:14.656035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:14.972888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:14.981690 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c8cba117-f023-45cb-a3e2-7f0d0a3c36dd tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.367577 Aug 03 05:09:14.983103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3104/6182] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:14 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:14.997742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:15.001137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:15.011334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:15.011998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:15.013166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:15.013883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:15.332413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:15.340648 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ddc52f3d-31dd-4bc0-a830-85a6cc860e88 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1644 microversion: 2.1 time: 0.351075 Aug 03 05:09:15.341199 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3105/6183] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:14 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1644 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:15.362215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:15.362839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:15.368924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:15.369573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:15.370736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:15.371189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:15.818401 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9514c2e2-d431-49da-919a-6ab2d77380c7 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1795 microversion: 2.1 time: 0.460264 Aug 03 05:09:15.822919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3106/6184] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:15 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1795 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:16.006691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:16.008971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:16.021047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:16.021822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:16.023111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:16.023808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:16.352700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:16.369548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb73d3f0-04ea-4041-8154-9add4bb5303a tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1314 microversion: 2.1 time: 0.367942 Aug 03 05:09:16.380023 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3107/6185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:16 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:16.547303 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdd94190-216f-4eeb-b091-293800583e86 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed/action" status: 202 len: 0 microversion: 2.1 time: 3.121770 Aug 03 05:09:16.548087 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3079/6186] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:09:13 2022] POST /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed/action => generated 0 bytes in 3157 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 03 05:09:17.399227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:17.399853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:17.408841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:17.409292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:17.410886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:17.411498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:17.826811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-773820283", "imageRef": "fc1621b0-b35a-4f4b-bdb1-95c838fb4692", "flavorRef": "452", "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:17.896079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:09:17.955701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:17.963670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77ae0e64-5fc9-4eca-b0ab-08cb4000e314 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1464 microversion: 2.1 time: 0.568318 Aug 03 05:09:17.964250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3108/6187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:17 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1464 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:17.986914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "942e8b2d-bcc0-428b-90c3-5840dd914c1b", "device": "/dev/sdb"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:17.992479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:17.997406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:17.997523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:17.999120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:17.999859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:18.653046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:09:18.653046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:09:18.653046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:09:18.653046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:09:18.653046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:09:18.681301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:18.684154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:18.689280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:18.690165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:18.740444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:09:18.757039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:09:18.788933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:09:18.797102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cbb5fc69-0b0d-4ab2-bc73-3e0a4ff51d48',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:09:18.838174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:19.046192 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [6e4df73f-999b-4219-a698-15d77c5be4ba] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 05:09:19.088545 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-725c9917-9129-406d-8065-6f9d2a3dec06 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "POST /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.106624 Aug 03 05:09:19.097805 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3109/6188] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:09:17 2022] POST /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:09:19.850616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-086d6c49-9a0e-4f84-a8cf-39cbf11e7dba req-671939d1-bf3d-4199-99d6-d114d0f7e33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6fb279-1853-46bc-a1c7-c50e0de60e8c", "tag": "af3084c3-dd22-4dc6-a954-b4db1742e976"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:19.884370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-086d6c49-9a0e-4f84-a8cf-39cbf11e7dba req-671939d1-bf3d-4199-99d6-d114d0f7e33d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:19.885319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-086d6c49-9a0e-4f84-a8cf-39cbf11e7dba req-671939d1-bf3d-4199-99d6-d114d0f7e33d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:19.931816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-086d6c49-9a0e-4f84-a8cf-39cbf11e7dba req-671939d1-bf3d-4199-99d6-d114d0f7e33d service nova] Creating event network-changed:af3084c3-dd22-4dc6-a954-b4db1742e976 for instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c on n-h1-826756-5 Aug 03 05:09:19.948202 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-086d6c49-9a0e-4f84-a8cf-39cbf11e7dba req-671939d1-bf3d-4199-99d6-d114d0f7e33d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100148 Aug 03 05:09:19.954656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3110/6189] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:09:20.056565 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [6e4df73f-999b-4219-a698-15d77c5be4ba] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 55106. Aug 03 05:09:20.062814 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc886d4c-af05-41d2-96e8-d6321b385e90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.241955 Aug 03 05:09:20.064381 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3080/6190] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:09:20.076023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82ef41ce-524f-431c-8bc3-35395d895c48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:20.077935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82ef41ce-524f-431c-8bc3-35395d895c48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:20.205898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82ef41ce-524f-431c-8bc3-35395d895c48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:20.217183 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82ef41ce-524f-431c-8bc3-35395d895c48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1229 microversion: 2.1 time: 0.145366 Aug 03 05:09:20.217785 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3111/6191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:20 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1229 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:21.245846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8661275f-2089-4ea2-821f-09f9739cccdf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:21.246519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8661275f-2089-4ea2-821f-09f9739cccdf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:21.421261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8661275f-2089-4ea2-821f-09f9739cccdf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:21.432388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8661275f-2089-4ea2-821f-09f9739cccdf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1229 microversion: 2.1 time: 0.196717 Aug 03 05:09:21.433979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3081/6192] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:21 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1229 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:22.460489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:22.461911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:22.494980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:22.495446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:22.496251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:22.496717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:22.625580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:22.633301 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e8a3b387-54e7-4c9a-b668-c11848c4ba6a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1225 microversion: 2.1 time: 0.177932 Aug 03 05:09:22.634552 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3112/6193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:22 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:23.659464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:23.660697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:23.677486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:23.678114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:23.680252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:23.681449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:23.919192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:23.929935 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44f79072-dd92-401b-b649-9206cae52917 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1299 microversion: 2.1 time: 0.276697 Aug 03 05:09:23.942147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3082/6194] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:23 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:24.973504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:24.975095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:24.999558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:25.000470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:25.002931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:25.004028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:25.190391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:25.201155 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-360d99e3-fb8b-4cd9-9478-9be8657fa6f5 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1299 microversion: 2.1 time: 0.243009 Aug 03 05:09:25.202363 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3113/6195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:24 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:26.226153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:26.227647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:26.252933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:26.255602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:26.260470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:26.267407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:26.330779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:26.567761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:26.593111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c3a7b7c-be65-4a6e-9ad1-27bc603a9b28 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.362775 Aug 03 05:09:26.608977 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3083/6196] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:26 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:27.620820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:27.622343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:27.629406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-419fb2f9-1f1e-46d9-b431-21d1206b0040 req-a7ab7e58-59e1-4463-8173-bc9ef185795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97451540-f110-42aa-b0ab-cdd7cc40a93c", "tag": "550b1606-c979-484b-a191-dbf9985b76bd"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:27.646965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:27.647675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:27.649176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:27.649855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:27.664351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-419fb2f9-1f1e-46d9-b431-21d1206b0040 req-a7ab7e58-59e1-4463-8173-bc9ef185795f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:27.669458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-419fb2f9-1f1e-46d9-b431-21d1206b0040 req-a7ab7e58-59e1-4463-8173-bc9ef185795f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:27.684880 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-419fb2f9-1f1e-46d9-b431-21d1206b0040 req-a7ab7e58-59e1-4463-8173-bc9ef185795f service nova] Creating event network-changed:550b1606-c979-484b-a191-dbf9985b76bd for instance 97451540-f110-42aa-b0ab-cdd7cc40a93c on n-h2-826756-5 Aug 03 05:09:27.690488 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-419fb2f9-1f1e-46d9-b431-21d1206b0040 req-a7ab7e58-59e1-4463-8173-bc9ef185795f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065847 Aug 03 05:09:27.691704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3084/6197] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:28.036194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:28.047664 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f1920a0-c198-4579-bf24-907e77d4d1df tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.432884 Aug 03 05:09:28.048549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3114/6198] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:27 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:28.805886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:29.060447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1448794639", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "91e92707-447d-44eb-b815-15026d48446a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:29.070344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:29.070976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:29.079269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:29.081755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:29.081755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:29.081755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:29.188886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] validate_networks() for [('91e92707-447d-44eb-b815-15026d48446a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:09:29.808090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:29.819646 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c1fdfc5-84ad-40d4-9b62-65516137df80 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.753292 Aug 03 05:09:29.821071 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3115/6199] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:29 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:30.164969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:09:30.165423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:09:30.165884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:09:30.166310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:09:30.166849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:09:30.176795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:30.177261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:30.178077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:30.178527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:30.196081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Getting quotas for project 686fc64a5de541fc8a54d0bb3e77ad1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:09:30.201438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Getting quotas for user e1d6add744c540ac9b30f9e4d76fbc31 and project 686fc64a5de541fc8a54d0bb3e77ad1c. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:09:30.218232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:09:30.218232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:09:30.397032 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc52e042-e8ab-46f3-939d-1941a6ae3f86 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.594013 Aug 03 05:09:30.398177 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3085/6200] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:09:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:09:30.410071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5380876d-044c-42f8-905b-abd38bfba8e4 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:30.410884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5380876d-044c-42f8-905b-abd38bfba8e4 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:30.414328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:30.497224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5380876d-044c-42f8-905b-abd38bfba8e4 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:30.505318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5380876d-044c-42f8-905b-abd38bfba8e4 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1215 microversion: 2.1 time: 0.099484 Aug 03 05:09:30.518889 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3116/6201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:30 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:30.856756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:30.857838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:30.867412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:30.867883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:30.868860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:30.872132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:31.033834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:31.041465 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49758c62-81c8-485c-939e-4f7cff51eb6f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.190650 Aug 03 05:09:31.042037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3086/6202] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:30 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:31.535268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e71364cd-26f5-4e3e-8d2b-1534db9366f7 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:31.536041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e71364cd-26f5-4e3e-8d2b-1534db9366f7 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:31.619433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e71364cd-26f5-4e3e-8d2b-1534db9366f7 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:31.627791 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e71364cd-26f5-4e3e-8d2b-1534db9366f7 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1215 microversion: 2.1 time: 0.096400 Aug 03 05:09:31.630300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3117/6203] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:31 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:32.069055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:32.072217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:32.077939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:32.078525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:32.079321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:32.079776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:32.237039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:32.244817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cba20235-a104-452c-a038-ec22e8774669 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.183568 Aug 03 05:09:32.245406 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3087/6204] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:32 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:32.657506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:32.657997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:32.664058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:32.664756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:32.667095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:32.667542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:32.816670 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:32.824986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-45c26259-60b6-44d0-9601-a6125ef99c9b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1219 microversion: 2.1 time: 0.173808 Aug 03 05:09:32.825669 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3118/6205] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:32 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:33.267873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:33.268610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:33.276165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:33.277341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:33.278147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:33.278682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:33.521307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:33.528851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b59b7538-b87d-4927-a381-4eccfebef27e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.266947 Aug 03 05:09:33.529424 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3088/6206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:33 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:33.849506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:33.850659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:33.860990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:33.861767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:33.862899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:33.863465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:33.950015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:33.958420 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-765921f4-270f-44db-a744-435327a3df29 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1267 microversion: 2.1 time: 0.115130 Aug 03 05:09:33.959020 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3119/6207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:33 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:34.558490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:34.562519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:34.581920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:34.583063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:34.584158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:34.585118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:34.986834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:34.986834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:35.001247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:35.002045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:35.003070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:35.003828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:35.168389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:35.179168 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f6aa3c1e-7c8e-43d9-9677-9d9080499a77 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1285 microversion: 2.1 time: 0.202932 Aug 03 05:09:35.180604 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3120/6208] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:34 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:35.338825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:35.347604 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-242fee19-7253-4ff4-b71a-0feaa560cd32 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.796951 Aug 03 05:09:35.348745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3089/6209] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:34 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:36.203826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:36.204639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:36.211888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:36.212710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:36.213568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:36.214099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:36.369857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:36.370603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:36.380004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:36.390827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:36.390827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:36.390827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:36.425466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:36.434539 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3963c0f1-ceb6-4c37-baea-c72e6609acef tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.235140 Aug 03 05:09:36.435279 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3121/6210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:36 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:36.768796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:36.806445 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d3ea199-f8a2-4c07-9367-bdc2645ab58d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.440600 Aug 03 05:09:36.807948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3090/6211] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:36 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:37.459256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:37.461384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:37.474299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:37.479066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:37.480761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:37.481092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:37.831925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:37.832584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:37.844669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:37.845313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:37.846267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:37.846862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:37.989951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:38.002855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cde92b27-22d4-4a60-98c0-260845a3566b tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.547156 Aug 03 05:09:38.004123 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3122/6212] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:37 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:38.142604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:38.151568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-38d0e951-b4e8-4f92-add4-f807110dc12c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.324385 Aug 03 05:09:38.152500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3091/6213] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:37 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:38.671969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a0c541be-4d66-46d6-845b-632deef6fa93 req-c1cdd106-7e3f-40c2-8e6a-8713eb88e204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ce14b6c-8be2-4ba9-b27e-5ea5be408204", "tag": "554df3a9-4972-491f-96af-d329ae02a3e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:38.693150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0c541be-4d66-46d6-845b-632deef6fa93 req-c1cdd106-7e3f-40c2-8e6a-8713eb88e204 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:38.694020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0c541be-4d66-46d6-845b-632deef6fa93 req-c1cdd106-7e3f-40c2-8e6a-8713eb88e204 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:38.732939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a0c541be-4d66-46d6-845b-632deef6fa93 req-c1cdd106-7e3f-40c2-8e6a-8713eb88e204 service nova] Creating event network-changed:554df3a9-4972-491f-96af-d329ae02a3e4 for instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 on n-h1-826756-5 Aug 03 05:09:38.750105 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a0c541be-4d66-46d6-845b-632deef6fa93 req-c1cdd106-7e3f-40c2-8e6a-8713eb88e204 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083122 Aug 03 05:09:38.751989 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3123/6214] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:39.026139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:39.028643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:39.041765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:39.046273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:39.046273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:39.046273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:39.178566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:39.179532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:39.199588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:39.201014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:39.201292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:39.201752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:39.611476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:39.619637 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5318bbd7-b708-4a17-a914-31d7d8651e89 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.598406 Aug 03 05:09:39.620337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3092/6215] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:39 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:39.647393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:39.647980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0448864c-9f2a-4640-a8bc-7d7d8c659d1b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.473849 Aug 03 05:09:39.648607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3124/6216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:39 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:40.642036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:40.642835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:40.645783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:40.646910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:40.651962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:40.652630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:40.653522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:40.654076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:40.670271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:40.671675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:40.684091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=71 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:40.704771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:40.707434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:40.708398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:40.708944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:40.911036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:40.925118 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4fbf3942-7340-4913-908c-65bda01f4efa tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.287467 Aug 03 05:09:40.926266 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3093/6217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:40 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:40.941462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:40.950776 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7f7e4f0-22db-4af8-a518-464f6f95efa4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.285805 Aug 03 05:09:40.957179 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3125/6218] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:40 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:41.947551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:41.950680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:41.959118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:41.959807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:41.960813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:41.961416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:41.980140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:41.981453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:41.989615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:41.990281 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:41.991094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:41.991551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:42.241244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:42.250653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-979eaaa8-1785-4ce2-8e90-55b12df77679 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.307272 Aug 03 05:09:42.265365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:42.266309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3094/6219] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:41 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:42.285573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-692ff809-5e86-4d86-8863-c716f07296f8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.298491 Aug 03 05:09:42.286336 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3126/6220] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:41 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:43.272693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:43.273961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:43.282650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:43.283126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:43.283937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:43.285077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:43.309955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:43.313500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:43.313500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:43.321740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:43.322199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:43.322991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:43.323435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:43.692698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:43.701889 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9227a7a2-2c22-4b99-b92a-8ff2d7da78e1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.433125 Aug 03 05:09:43.703204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3095/6221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:43 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:43.736478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:43.744560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81410a28-6f3e-4ab3-8646-9aa2f32394eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.438129 Aug 03 05:09:43.750056 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3127/6222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:43 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:44.723900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:44.725171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:44.732852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:44.733511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:44.739884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:44.740623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:44.767954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:44.769634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:44.790405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:44.807716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:44.807716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:44.807716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:45.117149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:45.125155 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0415d8f2-d9f4-41bf-8db6-fb4c6bae714c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.405132 Aug 03 05:09:45.125745 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3096/6223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:44 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:45.133959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:45.146547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b7a78ac-9978-45a5-bc40-8a37d3c2eabb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.384755 Aug 03 05:09:45.147416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3128/6224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:44 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:46.147270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:46.147913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:46.156993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:46.162307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:46.162307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:46.162307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:46.170539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:46.172092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:46.180071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:46.181382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:46.181495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:46.181871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:46.467520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:46.475855 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-719eab6f-faae-4304-b491-d05a9a7bbaeb tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.333420 Aug 03 05:09:46.486338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:46.489108 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3097/6225] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:46 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:46.497376 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e35f5a7-4461-4d14-8d0c-28742399f182 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.330731 Aug 03 05:09:46.501758 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3129/6226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:46 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:46.959013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-30dec183-7696-421e-bade-2b3e3e931d0e req-11416776-9f96-4ce8-a799-cd0b0246356b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce14b6c-8be2-4ba9-b27e-5ea5be408204", "name": "network-vif-plugged", "status": "completed", "tag": "554df3a9-4972-491f-96af-d329ae02a3e4"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:46.979549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-30dec183-7696-421e-bade-2b3e3e931d0e req-11416776-9f96-4ce8-a799-cd0b0246356b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:46.980565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-30dec183-7696-421e-bade-2b3e3e931d0e req-11416776-9f96-4ce8-a799-cd0b0246356b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:47.000100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-30dec183-7696-421e-bade-2b3e3e931d0e req-11416776-9f96-4ce8-a799-cd0b0246356b service nova] Creating event network-vif-plugged:554df3a9-4972-491f-96af-d329ae02a3e4 for instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 on n-h1-826756-5 Aug 03 05:09:47.005607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-30dec183-7696-421e-bade-2b3e3e931d0e req-11416776-9f96-4ce8-a799-cd0b0246356b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050323 Aug 03 05:09:47.006587 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3098/6227] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:09:47.498724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:47.499380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:47.506387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:47.506846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:47.507619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:47.508067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:47.512069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:47.523070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:47.523957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:47.530939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:47.531494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:47.532538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:47.533064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:47.730762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:47.734548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:47.739146 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c680bb76-8e62-40c3-a2cf-3605bc8d5834 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.244385 Aug 03 05:09:47.745358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9eebac21-ad73-4f0a-a62e-d71e0a70a563 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.227811 Aug 03 05:09:47.745951 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3099/6228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:47 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:47.752800 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3130/6229] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:47 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:48.762646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:48.763317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:48.768373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:48.768900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:48.773969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:48.777189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:48.777753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:48.782265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:48.782784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:48.787156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:48.787273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:48.787273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:48.787273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:49.169587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:49.179453 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b74fad3-5bd9-4385-b952-edd0d1cf0a33 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1315 microversion: 2.1 time: 0.422006 Aug 03 05:09:49.180427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3100/6230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:48 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:49.189438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:49.198212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b669c1e2-8718-4d26-a50e-c0956850d4fd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.435111 Aug 03 05:09:49.198806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3131/6231] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:48 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:50.199908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:50.200626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:50.208568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.209045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.209883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.210358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.219995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:50.220779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:50.227673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.228132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.228971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.229416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.400442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:50.403049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:09:50.411805 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-feacac31-eab6-426b-adcf-fc940a162435 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1502 microversion: 2.1 time: 0.215861 Aug 03 05:09:50.412769 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3101/6232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:50 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:50.432557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:50.433516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:50.440568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.441583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.442461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.443074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.537100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:50.548705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-560d448e-a131-430b-abe2-168a97afde36 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.333356 Aug 03 05:09:50.552564 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3132/6233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:50 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:50.684908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:50.694097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b548440-0981-40f7-be5d-4f89ef1a2cc9 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1502 microversion: 2.1 time: 0.265429 Aug 03 05:09:50.694867 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3102/6234] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:50 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:09:50.723899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:50.732772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:50.746448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.748318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.749106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:50.750183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:50.775585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lazy-loading 'flavor' on Instance uuid 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:09:51.242603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c093894-14de-4b2c-b86f-080eb9098ade tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action" status: 202 len: 0 microversion: 2.1 time: 0.531009 Aug 03 05:09:51.256681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:51.258069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:51.260345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3133/6235] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:09:50 2022] POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:09:51.269147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:51.269906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:51.270744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:51.271210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:51.418508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:51.426756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07a7e187-3042-476a-8f39-b389901aeba8 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1510 microversion: 2.1 time: 0.178177 Aug 03 05:09:51.427719 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3103/6236] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:51 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:51.577917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:51.579325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:51.603099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:51.603561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:51.606206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:51.606879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:51.778346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:51.789693 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6be71126-d0cf-4250-a766-859450687caf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.219780 Aug 03 05:09:51.798289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3134/6237] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:51 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:52.449808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:52.450705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:52.459828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.460560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:52.461450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.461989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:52.661469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:52.670556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6131d281-e0c8-4ba7-b17d-391f8158e371 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1493 microversion: 2.1 time: 0.224884 Aug 03 05:09:52.680979 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3104/6238] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:52 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1493 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:52.694993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:52.695540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:52.704073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.705041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:52.706040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.707090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:52.817498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:52.818168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:52.824347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.824855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:52.826060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:52.826693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:53.083500 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b314409a-db85-4ee1-8576-66e577dcfec5 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action" status: 202 len: 0 microversion: 2.1 time: 0.392435 Aug 03 05:09:53.084420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3135/6239] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:09:52 2022] POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:09:53.098240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:53.099642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:53.111943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:53.112919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:53.114395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:53.121485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:53.134174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:53.137364 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ab30e48-bba3-428a-9af7-8ca3e22c99f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.328944 Aug 03 05:09:53.138121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3105/6240] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:52 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:53.466173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:53.474914 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-66d5a88f-5e17-4c58-b0c8-75c951d84031 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1499 microversion: 2.1 time: 0.385525 Aug 03 05:09:53.475576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3136/6241] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:53 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1499 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:54.159595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:54.160365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:54.175695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:54.176181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:54.177029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:54.177638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:54.458447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:54.469768 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-845dc9b0-d6f2-474f-aaf5-857a4b262adf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.314368 Aug 03 05:09:54.481414 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3106/6242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:54 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:54.497730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:54.498556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:54.507938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:54.508428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:54.518141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:54.518141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:54.786047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:54.793775 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff280ee1-88ff-4811-9bb9-12e15db9a37c tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1499 microversion: 2.1 time: 0.301198 Aug 03 05:09:54.794876 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3137/6243] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:54 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1499 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:55.492049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:55.492727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:55.499680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:55.500158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:55.501022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:55.501489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:55.643472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:55.651277 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24354a51-c041-436d-b4ae-6aef6c92c30a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.163096 Aug 03 05:09:55.651959 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3107/6244] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:55 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:55.818596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:55.819425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:55.827050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:55.827585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:55.829053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:55.829531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.324991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:56.334986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a7c1e06-4e67-4e61-bae3-df8b3ced32ba tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1502 microversion: 2.1 time: 0.520313 Aug 03 05:09:56.336155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3138/6245] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:55 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1502 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:56.360696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:56.361794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:56.369787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.370456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.371679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.372306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.399344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lazy-loading 'flavor' on Instance uuid 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:09:56.675125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:56.676184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:56.683071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.683899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.684834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.685571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.889641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-66bedb95-29ce-4471-9907-e57eab2efcbc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action" status: 202 len: 0 microversion: 2.1 time: 0.533594 Aug 03 05:09:56.895136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3108/6246] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:09:56 2022] POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:09:56.901554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:56.902602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:56.910481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.911312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:56.912314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:56.912953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:57.045632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:57.065262 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-73253977-1d64-464e-bab4-45b68cde63d1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.395423 Aug 03 05:09:57.067323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3139/6247] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:56 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:57.146013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:57.154242 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-782cf0ea-b6eb-4a5b-abc0-7d2cd6034cd3 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1510 microversion: 2.1 time: 0.257528 Aug 03 05:09:57.163601 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3109/6248] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:56 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:58.091149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:58.091786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:58.104620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.107561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.107561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.107561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.179668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:58.181107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:58.190034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.190742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.191790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.192569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.376536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:58.384004 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51939dbf-3ab9-4df5-be60-2e40ee914eb8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.296892 Aug 03 05:09:58.384616 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3140/6249] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:58 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:58.483765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:58.492514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f784f0c-cdfd-4d9f-82cf-b694fa4b61f1 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1493 microversion: 2.1 time: 0.317854 Aug 03 05:09:58.493328 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3110/6250] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:58 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:58.513971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:09:58.514528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:58.522012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.522491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.523313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.524048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.889789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7f46fdb-633b-494c-9bc1-14c320efaf30 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action" status: 202 len: 0 microversion: 2.1 time: 0.379765 Aug 03 05:09:58.893893 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3141/6251] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:09:58 2022] POST /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:09:58.900103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:58.901505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:58.912860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.915756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:58.918408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:58.919110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:59.270737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:09:59.278641 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25283c48-a436-4513-b0f9-1c9a39db2c2d tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1499 microversion: 2.1 time: 0.382654 Aug 03 05:09:59.293807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3111/6252] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:58 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1499 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:09:59.408375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:09:59.414321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:09:59.428217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:59.428703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:09:59.429485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:09:59.429928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:00.189203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:00.198106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f025485b-e174-4a6a-a3a6-e9669ca23fd0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.795104 Aug 03 05:10:00.199348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3142/6253] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:09:59 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:00.302588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:00.304299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:00.316504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:00.317443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:00.318561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:00.319316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:00.636757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:00.646301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3ff89b6c-a21f-4ee2-bc51-00bfb7bec135 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1499 microversion: 2.1 time: 0.348554 Aug 03 05:10:00.647032 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3112/6254] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:00 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1499 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:01.221620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:01.222247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:01.239525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:01.239991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:01.245937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:01.246410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:01.293835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:01.572496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:01.584074 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d2d05a0-8c91-42eb-9075-bfe79046ce1a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.365502 Aug 03 05:10:01.586549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3143/6255] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:01 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:01.668460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:01.669791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:01.686610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:01.688843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:01.690141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:01.692555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:01.980131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:02.001282 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33d54595-219a-4178-a2f9-4371abcab148 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1499 microversion: 2.1 time: 0.336602 Aug 03 05:10:02.006948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3113/6256] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:01 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:02.607322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:02.608237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:02.619952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:02.620643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:02.621608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:02.622354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:02.997534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:03.008984 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-def2f2d8-8f25-40cc-91a6-c6d82a58685f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.405623 Aug 03 05:10:03.010044 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3144/6257] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:02 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:03.026483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:03.027128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:03.035636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.036109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:03.036952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.038306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:03.271036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:03.283417 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53aea0e0-e07d-4fbf-844c-33a889a18fb0 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1502 microversion: 2.1 time: 0.258734 Aug 03 05:10:03.284480 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3114/6258] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:03 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1502 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:03.305471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:03.305964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:03.319053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.320861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:03.321682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.323672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:03.356826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:10:03.909292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9684539c-ca05-43d1-95a7-72d88c647727 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 204 len: 0 microversion: 2.1 time: 0.607811 Aug 03 05:10:03.910625 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3145/6259] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:10:03 2022] DELETE /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:10:03.928416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:03.929347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:03.938825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.939596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:03.944195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:03.947248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:04.035095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:04.035893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:04.051222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:04.052061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:04.053732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:04.054414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:04.415976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:04.418331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:04.425294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e4f8961-e394-4ca8-aedc-bbff1bd4b8da tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1508 microversion: 2.1 time: 0.509394 Aug 03 05:10:04.437346 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3115/6260] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:03 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:04.439894 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f5fe6656-fa5c-426d-9562-fdf32a342cd8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.409972 Aug 03 05:10:04.440881 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3146/6261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:04 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:04.876493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-725207599", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "99527b5f-47dc-4647-8ccd-815d5151a77f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2085114800", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ff6fb279-1853-46bc-a1c7-c50e0de60e8c"]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:04.967342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] validate_networks() for [('99527b5f-47dc-4647-8ccd-815d5151a77f', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:10:05.447846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:05.449199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:05.471147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.471622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.473071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.473685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.581696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:10:05.582820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:10:05.583504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:10:05.584354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:10:05.585014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:10:05.603741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.604528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.605555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.606174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.644544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:10:05.651548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Getting quotas for user fe65f20a4a894f2ab7765c9ce63a4d89 and project a70bbfbc677a44ccbe25d893254b5e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:10:05.678484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:10:05.683728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:10:05.811329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:05.819973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75d38609-b791-4fcb-ae1b-c964b5b39f3a tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1508 microversion: 2.1 time: 0.376597 Aug 03 05:10:05.825660 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3147/6262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:05 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:05.834214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:05.840156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:05.853840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.854880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.856089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:05.857140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:05.913532 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a31f37d6-eba6-40e0-a55c-2041c8ec4006 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.042002 Aug 03 05:10:05.917369 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3116/6263] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:10:04 2022] POST /compute/v2.1/servers => generated 361 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:10:05.933479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec45ebda-a328-41f8-a8fb-1f673cbd54c4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:05.939208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec45ebda-a328-41f8-a8fb-1f673cbd54c4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:06.176789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec45ebda-a328-41f8-a8fb-1f673cbd54c4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:06.182069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec45ebda-a328-41f8-a8fb-1f673cbd54c4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1241 microversion: 2.1 time: 0.255617 Aug 03 05:10:06.182685 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3117/6264] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:05 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1241 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:06.743187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:06.769544 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a569a0db-332f-4b09-bd83-acc1a5a5f5f2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.942486 Aug 03 05:10:06.774214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3148/6265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:05 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:06.843183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:06.845157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:06.863195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:06.863660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:06.864489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:06.865106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:06.936564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:07.213965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d873168f-16a3-40f0-88e4-749b461af4a4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:07.214871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d873168f-16a3-40f0-88e4-749b461af4a4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:07.363958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d873168f-16a3-40f0-88e4-749b461af4a4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:07.376214 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d873168f-16a3-40f0-88e4-749b461af4a4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1241 microversion: 2.1 time: 0.166154 Aug 03 05:10:07.392637 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3149/6266] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:07 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:07.403243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:07.417710 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db42871e-8012-43f0-8812-ad8fff104cec tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1508 microversion: 2.1 time: 0.578353 Aug 03 05:10:07.418322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3118/6267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:06 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1508 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:07.716467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bf6de19f-25cf-4cfe-b6d7-c4e87ed32987 req-4711af9e-191b-45a5-8124-0b6a83e49154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ce14b6c-8be2-4ba9-b27e-5ea5be408204", "name": "network-vif-deleted", "tag": "554df3a9-4972-491f-96af-d329ae02a3e4"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:07.748073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bf6de19f-25cf-4cfe-b6d7-c4e87ed32987 req-4711af9e-191b-45a5-8124-0b6a83e49154 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:07.748848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bf6de19f-25cf-4cfe-b6d7-c4e87ed32987 req-4711af9e-191b-45a5-8124-0b6a83e49154 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:07.768163 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bf6de19f-25cf-4cfe-b6d7-c4e87ed32987 req-4711af9e-191b-45a5-8124-0b6a83e49154 service nova] Creating event network-vif-deleted:554df3a9-4972-491f-96af-d329ae02a3e4 for instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 on n-h1-826756-5 Aug 03 05:10:07.775131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bf6de19f-25cf-4cfe-b6d7-c4e87ed32987 req-4711af9e-191b-45a5-8124-0b6a83e49154 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063081 Aug 03 05:10:07.776508 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3150/6268] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:07.796118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:07.796445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:07.804154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:07.804672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:07.805503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:07.805962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:07.992865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:08.004227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0802827d-691e-49e8-bd94-d753433ea07d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.212662 Aug 03 05:10:08.005379 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3119/6269] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:07 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:08.399565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:08.400620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:08.409476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:08.410310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:08.411348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:08.411997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:08.443692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:08.444358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:08.462293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:08.462770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:08.463593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:08.464542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:08.535165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:08.535831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:08.536493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lazy-loading 'fault' on Instance uuid 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:10:08.572389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:08.588000 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d8cb1fb-a407-40ce-9aa0-7c7e4da31fb0 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1245 microversion: 2.1 time: 0.191875 Aug 03 05:10:08.591191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3151/6270] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:08 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1245 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:08.662601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d6add744c540ac9b30f9e4d76fbc31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686fc64a5de541fc8a54d0bb3e77ad1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:08.677122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1be7e658-e975-41e1-9810-b7a0aac29ddc tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 200 len: 1305 microversion: 2.1 time: 0.237211 Aug 03 05:10:08.678052 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3120/6271] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:08 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 1305 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:09.026931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:09.027488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:09.035985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.036548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.037336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.037957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.310244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:09.340138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d0aba85-8020-435c-a337-b7ce393a5dc7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.317600 Aug 03 05:10:09.356926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3152/6272] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:09 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:09.622425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:09.623107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:09.635198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.635674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.636509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.637132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.723895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:09.724563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] [instance: 9ce14b6c-8be2-4ba9-b27e-5ea5be408204] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:09.737437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.738268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.739057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:09.739662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:09.785498 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] HTTP exception thrown: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Request method failure captured: Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 HTTP/1.1 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gME8faX79chBV4xP9-6sYjI05KFrWvh3pxRpcmJDfItyoBAyzPWKpXISh_kBrA4-ddi0zumrfceL3uxCwyrgH3ypWEDvqX_6OBo9begu9n_TvtN1Lpu02504TvE01obaSfFZzwlbIODRgYpx0O0JcL0M2ArWyD9aj9Nq1BhWEK0CH8 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 686fc64a5de541fc8a54d0bb3e77ad1c Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestServerAdvancedOps-18794038 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/686fc64a5de541fc8a54d0bb3e77ad1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/686fc64a5de541fc8a54d0bb3e77ad1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_686fc64a5de541fc8a54d0bb3e77ad1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/686fc64a5de541fc8a54d0bb3e77ad1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestServerAdvancedOps-18794038 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 686fc64a5de541fc8a54d0bb3e77ad1c Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestServerAdvancedOps-18794038 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestServerAdvancedOps-18794038-project Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e1d6add744c540ac9b30f9e4d76fbc31 Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestServerAdvancedOps-18794038-project Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9ce14b6c-8be2-4ba9-b27e-5ea5be408204'} Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:09.790007 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] Returning 404 to user: Instance 9ce14b6c-8be2-4ba9-b27e-5ea5be408204 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9862add-a691-49dc-892f-0dab8f0e3649 tempest-TestServerAdvancedOps-18794038 tempest-TestServerAdvancedOps-18794038-project] 10.222.0.72 "GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204" status: 404 len: 111 microversion: 2.1 time: 0.079018 Aug 03 05:10:09.805795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3153/6273] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:09 2022] GET /compute/v2.1/servers/9ce14b6c-8be2-4ba9-b27e-5ea5be408204 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:10:09.852310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:09.867773 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44bf536f-f9fb-498f-a98f-d5c5645ac672 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1293 microversion: 2.1 time: 0.253501 Aug 03 05:10:09.868529 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3121/6274] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:09 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:10.364495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:10.364495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:10.382367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:10.383101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:10.384078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:10.384704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:10.896098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:10.901943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:10.905086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:10.911921 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc1cb1e0-6bc7-4559-ade5-261f173d29d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.554117 Aug 03 05:10:10.932423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:10.932823 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3154/6275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:10 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:10.933245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:10.935238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:10.936195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:11.036294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:11.048175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f52979d5-b3ee-4937-8d37-c0d9854513c1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.154536 Aug 03 05:10:11.049589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3122/6276] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:10 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:11.954067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:11.954823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:11.962318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:11.962777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:11.963740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:11.964244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:12.074219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:12.074219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:12.083440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:12.083993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:12.084885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:12.085439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:12.286403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:12.295517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-56b388bd-af9f-4be4-8d68-844b439557c7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.227968 Aug 03 05:10:12.308466 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3123/6277] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:12 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:12.452589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:12.452589 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9596feac-c119-4577-8165-081547fd5734 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.498611 Aug 03 05:10:12.452589 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3155/6278] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:11 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:13.320199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:13.321524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:13.332188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:13.333100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:13.334364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:13.334987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:13.473891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:13.474516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:13.478566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:13.484220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:13.485393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:13.487827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:13.487827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:13.489680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:13.499717 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-969134b6-829b-443e-8427-43e225abdb9e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.184611 Aug 03 05:10:13.500551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3124/6279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:13 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:13.726430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:13.744329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-580ffe8a-c7db-4fbe-9962-42578f041887 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.277160 Aug 03 05:10:13.761096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3156/6280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:13 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:14.451350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-46ddf34f-0eec-4c9b-95d2-438a9d7ecc03 req-a5087b21-ee2b-4dd3-8437-befad1f73fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd56badd-bbd8-4f68-987f-571204b42b48", "tag": "29d40a6f-e8be-4f14-9cfa-c495f199e55d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:14.466403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-46ddf34f-0eec-4c9b-95d2-438a9d7ecc03 req-a5087b21-ee2b-4dd3-8437-befad1f73fa5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:14.467057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-46ddf34f-0eec-4c9b-95d2-438a9d7ecc03 req-a5087b21-ee2b-4dd3-8437-befad1f73fa5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:14.494296 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-46ddf34f-0eec-4c9b-95d2-438a9d7ecc03 req-a5087b21-ee2b-4dd3-8437-befad1f73fa5 service nova] Creating event network-changed:29d40a6f-e8be-4f14-9cfa-c495f199e55d for instance dd56badd-bbd8-4f68-987f-571204b42b48 on n-h2-826756-5 Aug 03 05:10:14.501779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-46ddf34f-0eec-4c9b-95d2-438a9d7ecc03 req-a5087b21-ee2b-4dd3-8437-befad1f73fa5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054530 Aug 03 05:10:14.503247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3125/6281] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:14.522442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:14.523111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:14.530276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:14.531099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:14.532706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:14.533321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:14.778476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:14.779813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:14.786152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:14.794704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:14.795282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13557ccc-0593-42c6-8c09-92bb69385515 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.276924 Aug 03 05:10:14.795502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:14.798402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3157/6282] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:14 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:14.802836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:14.802836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:15.445503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:15.462229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfab338a-9f95-4af8-a93c-1c2968ec7ad7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.695989 Aug 03 05:10:15.463206 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3126/6283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:14 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:15.818526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:15.819278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:15.827231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:15.827818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:15.829245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:15.829916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:15.974241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:15.981852 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-62415001-18dd-4030-8de9-274d830cb9dd tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.167744 Aug 03 05:10:15.982443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3158/6284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:15 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:16.484220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:16.486045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:16.490695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:16.491631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:16.495551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:16.496019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:16.496881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:16.497405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:16.668379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:16.678116 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbc9034d-7435-40df-924f-22b82ad80e95 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.197915 Aug 03 05:10:16.678928 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3127/6285] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:16 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:17.005792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:17.013932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:17.015240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:17.016619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:17.017850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:17.018527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:17.151123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:17.162930 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-234b4923-85f5-470b-83a3-84aae141277a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.161513 Aug 03 05:10:17.164047 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3159/6286] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:16 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:17.705953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:17.705953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:17.710013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:17.711612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:17.712641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:17.713099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:17.902257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:17.909957 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec1e23bf-db85-4823-b6c5-b5dcb0eb390a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.212798 Aug 03 05:10:17.910539 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3128/6287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:17 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:18.189369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:18.190133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:18.197104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:18.200004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:18.200531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:18.201401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:18.202086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:18.225424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:18.294472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:18.302199 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-925add93-f03d-4ea2-9f13-47c32552872e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.118123 Aug 03 05:10:18.302799 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3160/6288] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:18 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:18.931551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:18.932188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:18.940839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:18.941308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:18.942215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:18.942678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:19.222857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:19.234373 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab4aa1f5-5a28-4e16-8dc8-b6ac3fac3ff8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.306308 Aug 03 05:10:19.237862 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3129/6289] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:18 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:19.328090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:19.329543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:19.337743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:19.338471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:19.339458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:19.339983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:19.425035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:19.435411 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7f5861b4-bd6a-4c64-87ee-d422850f4e30 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.113677 Aug 03 05:10:19.436001 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3161/6290] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:19 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:20.258119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:20.259424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:20.267060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:20.267546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:20.268370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:20.268828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:20.442471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:20.460207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:20.465155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:20.465615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5addc075-d885-40f9-a1d5-2fbae61882b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.197565 Aug 03 05:10:20.467981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3130/6291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:20 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:20.471974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:20.472703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:20.473915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:20.475291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:20.621230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:20.631625 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1d86f16-6f9a-462a-8746-d9824a8b3e46 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.176833 Aug 03 05:10:20.632347 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3162/6292] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:20 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:21.491458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:21.493026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:21.501214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:21.501927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:21.503107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:21.503780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:21.661479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:21.663013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:21.675502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:21.675502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:21.677353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:21.678031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:22.212436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:22.230726 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b4bd1bf-687b-4916-b569-9d80b9a68119 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.743589 Aug 03 05:10:22.248612 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3131/6293] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:21 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:22.258582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ba861dbf-832b-4eaf-8922-7b1aee350fd6 req-a08daadb-563d-465b-99e7-d925eb5f891b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd56badd-bbd8-4f68-987f-571204b42b48", "name": "network-vif-plugged", "status": "completed", "tag": "29d40a6f-e8be-4f14-9cfa-c495f199e55d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:22.272591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:22.273623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ba861dbf-832b-4eaf-8922-7b1aee350fd6 req-a08daadb-563d-465b-99e7-d925eb5f891b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:22.274310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ba861dbf-832b-4eaf-8922-7b1aee350fd6 req-a08daadb-563d-465b-99e7-d925eb5f891b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:22.284190 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03316a6f-c0fd-4602-bad9-388ee06b1b31 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.633267 Aug 03 05:10:22.284841 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3163/6294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:21 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:22.293008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ba861dbf-832b-4eaf-8922-7b1aee350fd6 req-a08daadb-563d-465b-99e7-d925eb5f891b service nova] Creating event network-vif-plugged:29d40a6f-e8be-4f14-9cfa-c495f199e55d for instance dd56badd-bbd8-4f68-987f-571204b42b48 on n-h2-826756-5 Aug 03 05:10:22.304009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ba861dbf-832b-4eaf-8922-7b1aee350fd6 req-a08daadb-563d-465b-99e7-d925eb5f891b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053517 Aug 03 05:10:22.305269 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3132/6295] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:23.255882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:23.256440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:23.264115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:23.264634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:23.265488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:23.266459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:23.318509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:23.319298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:23.321834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:23.327871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:23.329194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:23.330248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:23.330879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:23.491042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:23.500130 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8381593-0d46-490b-be72-123ab0d916b4 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1299 microversion: 2.1 time: 0.188961 Aug 03 05:10:23.514314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3133/6296] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:23 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:23.596402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:23.604318 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61f6e3c7-e9a7-4df5-9117-1a4102d034c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.352781 Aug 03 05:10:23.607549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3164/6297] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:23 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:24.523245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:24.525137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:24.536897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.539154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:24.541243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.542296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:24.632070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:24.633532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:24.650540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.653219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:24.654301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.657735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:24.801874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:24.813344 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3382ef8b-6d2e-4b0a-9554-85df4403cc13 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1471 microversion: 2.1 time: 0.294579 Aug 03 05:10:24.821440 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3134/6298] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:24 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:24.842462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:24.843448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:24.855649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.856559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:24.857568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:24.858214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.131468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:25.146115 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-be36b211-d55c-4982-b701-7dd234cec620 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1471 microversion: 2.1 time: 0.307429 Aug 03 05:10:25.156450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3135/6299] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:24 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:25.169540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:25.170294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:25.182520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.183288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.184363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.184823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.192843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:25.264149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:25.282869 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-80ff7cda-1d94-422e-8973-f097e9ed7864 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.656502 Aug 03 05:10:25.283774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3165/6300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:24 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:25.409493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2bb236a-b94e-4dfa-9aca-f4d2e62b686f tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1622 microversion: 2.1 time: 0.243401 Aug 03 05:10:25.410472 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3136/6301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:25 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1622 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:25.431721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:25.432887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:25.439546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.440342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.441306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.586995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.711092 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd36d7a3-2840-4b37-bd1f-2b83412051d8 tempest-TestSecurityGroupsBasicOps-108187892 tempest-TestSecurityGroupsBasicOps-108187892-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1913 microversion: 2.1 time: 0.283023 Aug 03 05:10:25.712032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3166/6302] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:25 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1913 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:25.775626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:25.776337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:25.784045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.784775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.785689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:25.786245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:25.813907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:10:26.290675 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-061b4923-0062-4a0f-9522-4f1800029256 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "DELETE /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 204 len: 0 microversion: 2.1 time: 0.516825 Aug 03 05:10:26.292309 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3137/6303] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:10:25 2022] DELETE /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:10:26.308217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:26.308960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:26.312493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:26.313363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:26.338655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:26.340508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:26.342622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:26.343060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:26.343941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:26.344904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:26.349428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:26.349895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:26.487606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:26.505239 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6af23bc6-8e30-4968-9a2b-cacafd2b5305 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1477 microversion: 2.1 time: 0.206477 Aug 03 05:10:26.506223 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3167/6304] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:26 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:26.713556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:26.732930 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb20b5ad-7001-438f-89c1-5464ebe9ebdd tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.428679 Aug 03 05:10:26.734042 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3138/6305] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:26 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:27.531462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:27.533362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:27.560410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:27.570852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:27.571865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:27.572358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:27.760461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:27.761097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:27.777066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:27.780029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:27.784060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:27.787437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:28.555369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:28.565660 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4aa47d8-5f77-4337-8636-b7422120ded1 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1477 microversion: 2.1 time: 1.038044 Aug 03 05:10:28.568172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3168/6306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:27 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1477 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:28.711893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:28.721417 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e43b450a-badc-46b5-bb5d-8eb86385aa4d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.965282 Aug 03 05:10:28.722036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3139/6307] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:27 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:29.335429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bcd2f045-14cb-49ba-b28f-71f5f02d043e req-79f73407-39bb-4b89-af0d-d8f1a689576a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd56badd-bbd8-4f68-987f-571204b42b48", "name": "network-vif-deleted", "tag": "29d40a6f-e8be-4f14-9cfa-c495f199e55d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:29.354473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bcd2f045-14cb-49ba-b28f-71f5f02d043e req-79f73407-39bb-4b89-af0d-d8f1a689576a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:29.354946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bcd2f045-14cb-49ba-b28f-71f5f02d043e req-79f73407-39bb-4b89-af0d-d8f1a689576a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:29.371336 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bcd2f045-14cb-49ba-b28f-71f5f02d043e req-79f73407-39bb-4b89-af0d-d8f1a689576a service nova] Creating event network-vif-deleted:29d40a6f-e8be-4f14-9cfa-c495f199e55d for instance dd56badd-bbd8-4f68-987f-571204b42b48 on n-h2-826756-5 Aug 03 05:10:29.378231 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bcd2f045-14cb-49ba-b28f-71f5f02d043e req-79f73407-39bb-4b89-af0d-d8f1a689576a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052024 Aug 03 05:10:29.383948 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3169/6308] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:29.589721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:29.590512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:29.606831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:29.610753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:29.611796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:29.614806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:29.720220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:29.728828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3c1d240e-5f5a-45b3-aa84-99dcf6d8ca3a tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1326 microversion: 2.1 time: 0.143381 Aug 03 05:10:29.729931 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3140/6309] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:29 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:29.749722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:29.754544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:29.762703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:29.763297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:29.764095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:29.764899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:29.977899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:29.995005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e40bf879-5e04-41fa-9d0d-6a09e30f687f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.254078 Aug 03 05:10:29.996551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3170/6310] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:29 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:30.755706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:30.757036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:30.765511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:30.768504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:30.770519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:30.773933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:30.850196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:30.850989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:30.851646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lazy-loading 'fault' on Instance uuid dd56badd-bbd8-4f68-987f-571204b42b48 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:10:30.931217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:30.952376 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe3351d7-5b4a-4207-805c-edfb122a9869 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 200 len: 1331 microversion: 2.1 time: 0.187662 Aug 03 05:10:30.952376 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3141/6311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:30 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 1331 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:31.018637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:31.020008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:31.027833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:31.033375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:31.033375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:31.033375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:31.455903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:31.468028 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92ec4fdd-76ce-4edb-8d7d-df3cfe07dc73 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.454114 Aug 03 05:10:31.471582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3171/6312] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:31 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:31.962303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:31.963185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: dd56badd-bbd8-4f68-987f-571204b42b48] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:31.971633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:31.972487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:31.973635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:31.974091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:32.002306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] HTTP exception thrown: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Request method failure captured: Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 HTTP/1.1 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gLQJG_MQ9-COxli7R6fnVh94uH6J1hQXKWBAC6GnmI5zULZjqhb5HvOyVfC7eyVGepnPNCJdXvCPby4RZGMbBHmCe9fLpshL2cW2nibQuBb2VLr5RvMj-NVNdekHEOCH3qVFHz-OAUMIbwKhLK6sd3WlX3i7LoqNskcX3yxMwoBFgI Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a70bbfbc677a44ccbe25d893254b5e3e Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a70bbfbc677a44ccbe25d893254b5e3e Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestSecurityGroupsBasicOps-272685722-project Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: fe65f20a4a894f2ab7765c9ce63a4d89 Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestSecurityGroupsBasicOps-272685722-project Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'dd56badd-bbd8-4f68-987f-571204b42b48'} Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:32.004293 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. Aug 03 05:10:32.008388 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:32.009697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Returning 404 to user: Instance dd56badd-bbd8-4f68-987f-571204b42b48 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:10:32.010747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b454cf43-3277-454d-8632-0b074c6cbdca tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48" status: 404 len: 111 microversion: 2.1 time: 0.053435 Aug 03 05:10:32.011362 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3142/6313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:31 2022] GET /compute/v2.1/servers/dd56badd-bbd8-4f68-987f-571204b42b48 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:10:32.493692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:32.496221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:32.507525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:32.508163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:32.521941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:32.522416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:33.310390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:33.322793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ad4a4f24-335f-4096-aa7c-a2ea0ad0f5eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.834894 Aug 03 05:10:33.323395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3172/6314] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:32 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:34.343583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:34.349822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:34.360443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:34.361346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:34.362515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:34.363150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:35.612016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:35.619964 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9b9494c-5dcf-4935-9b1f-f508815ef4ab tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 1.280497 Aug 03 05:10:35.633642 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3143/6315] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:34 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:36.643546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:36.644789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:36.656825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:36.657411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:36.664563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:36.667192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:37.023534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:37.066633 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-199570cc-1498-455a-9e65-5877352978bc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.426813 Aug 03 05:10:37.074653 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3173/6316] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:36 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:38.097483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:38.098864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:38.108677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:38.113028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:38.129093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:38.130554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:38.520443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:38.534395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df05a290-d694-413a-b8d7-320d5e2479ef tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 0.443200 Aug 03 05:10:38.553390 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3144/6317] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:38 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:39.573226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:39.574865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:39.585620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:39.586353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:39.587454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:39.588056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:40.851736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:40.904409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93ba2412-5185-41a7-b59d-471daeedf98e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 1.347721 Aug 03 05:10:40.928954 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3174/6318] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:39 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:41.934834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:41.945586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:41.963293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:41.966580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:41.967869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:41.974975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:42.889040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db7aa6bc-a427-43da-9d38-1df04d6da9b8 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Action: 'create', calling method: .version_select at 0x7fdd47833310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-475023955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTLhKKu9H/fZBEJ7doYmkLZmBxig70l1mwaIvTn1L8zdOKU8zqnbP/6kY8RKbNOcv2OEOfSitYwphtz0Fwoe36P25S1a7FN1QFB9sxwbEOVHwH4Xzm2iHai4QjrPt/o7Q=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:42.913318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-db7aa6bc-a427-43da-9d38-1df04d6da9b8 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for project 55144e334ce14b51b1fdfaae634a8da3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:10:42.921041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-db7aa6bc-a427-43da-9d38-1df04d6da9b8 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for user 23b72214cec54bb2abbc9b34a4908502 and project 55144e334ce14b51b1fdfaae634a8da3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:10:43.087480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:43.096454 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e3fa311-d4d4-4758-a9a6-d3f24c87c7b8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1341 microversion: 2.1 time: 1.165686 Aug 03 05:10:43.109142 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3145/6319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:41 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1341 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:43.157383 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db7aa6bc-a427-43da-9d38-1df04d6da9b8 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.677991 Aug 03 05:10:43.157383 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3175/6320] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:10:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:43.618142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:43.619253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:43.630269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-10d43d28-8d8b-490a-b07c-5df442274eea req-a4dcdf56-eb3c-403d-a107-3c3871acaf1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff6fb279-1853-46bc-a1c7-c50e0de60e8c", "tag": "af3084c3-dd22-4dc6-a954-b4db1742e976"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:43.646368 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:43.651388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:43.652456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:43.653480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:43.654356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-10d43d28-8d8b-490a-b07c-5df442274eea req-a4dcdf56-eb3c-403d-a107-3c3871acaf1f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:43.654819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-10d43d28-8d8b-490a-b07c-5df442274eea req-a4dcdf56-eb3c-403d-a107-3c3871acaf1f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:43.701393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-10d43d28-8d8b-490a-b07c-5df442274eea req-a4dcdf56-eb3c-403d-a107-3c3871acaf1f service nova] Creating event network-changed:af3084c3-dd22-4dc6-a954-b4db1742e976 for instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c on n-h1-826756-5 Aug 03 05:10:43.711284 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-10d43d28-8d8b-490a-b07c-5df442274eea req-a4dcdf56-eb3c-403d-a107-3c3871acaf1f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086105 Aug 03 05:10:43.712601 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3176/6321] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:10:43.740489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:10:44.144226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:44.145575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:44.170631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:44.171098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:44.171901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:44.172401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:44.328873 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-69bcce5b-126d-43e7-b42d-ad6eecfcf16e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "DELETE /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 204 len: 0 microversion: 2.1 time: 0.715708 Aug 03 05:10:44.330154 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3146/6322] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:10:43 2022] DELETE /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:10:44.341703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:44.348749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:44.394836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:44.394836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:44.417409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:44.421634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:44.929453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:44.950425 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-974c8a4c-ccbe-4864-bdbd-84aae82160ad tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1387 microversion: 2.1 time: 0.802593 Aug 03 05:10:44.981136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3177/6323] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:44 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1387 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:45.039977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:45.052805 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-58d63027-0dfc-4481-abe0-8f3c32f5df71 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1768 microversion: 2.1 time: 0.717539 Aug 03 05:10:45.055099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3147/6324] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:44 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1768 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:45.987198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:45.987850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:45.998799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:45.998799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:45.999308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:45.999757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:46.078778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:46.080895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:46.096161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:46.101225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:46.101225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:46.101225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:46.770620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:46.786655 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39a42ca2-d2ff-4f62-a72e-11c0dfe24ba9 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1768 microversion: 2.1 time: 0.711334 Aug 03 05:10:46.803188 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3148/6325] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:46 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1768 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:46.902801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:46.911371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0a9f1964-6629-4b81-b49b-c71be9a6de97 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.928032 Aug 03 05:10:46.912001 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3178/6326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:45 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:47.811159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:47.812457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:47.826976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.827662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.828674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.835852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.933701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:47.934943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:47.969496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.971278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.971278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:47.972652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:47.995695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:48.489168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:48.494691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:48.496321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:48.504304 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-af2bd5f8-d415-4597-a6a0-6d577b05b411 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.574463 Aug 03 05:10:48.518884 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4579a72-c895-4bf8-9df5-8fb74e08600e tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1650 microversion: 2.1 time: 0.709522 Aug 03 05:10:48.520724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3149/6327] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:47 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1650 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:48.526028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-dbf82da3-a29b-462b-bd41-7ad0d5903e61 req-13c82fb8-c0c5-4ac3-8201-e4e57cfa2342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff6fb279-1853-46bc-a1c7-c50e0de60e8c", "name": "network-vif-deleted", "tag": "af3084c3-dd22-4dc6-a954-b4db1742e976"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:48.528318 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3179/6328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:47 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:48.584050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dbf82da3-a29b-462b-bd41-7ad0d5903e61 req-13c82fb8-c0c5-4ac3-8201-e4e57cfa2342 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:48.585616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-dbf82da3-a29b-462b-bd41-7ad0d5903e61 req-13c82fb8-c0c5-4ac3-8201-e4e57cfa2342 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:48.612927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-dbf82da3-a29b-462b-bd41-7ad0d5903e61 req-13c82fb8-c0c5-4ac3-8201-e4e57cfa2342 service nova] Creating event network-vif-deleted:af3084c3-dd22-4dc6-a954-b4db1742e976 for instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c on n-h1-826756-5 Aug 03 05:10:48.627994 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-dbf82da3-a29b-462b-bd41-7ad0d5903e61 req-13c82fb8-c0c5-4ac3-8201-e4e57cfa2342 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105580 Aug 03 05:10:48.646450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3150/6329] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:10:49.557908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:49.558633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:49.561856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:49.567289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:49.569109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:49.582225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:49.583649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:49.586026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:49.586698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:49.591734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:49.592297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:49.593159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:49.593702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:49.693800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:49.696373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:49.700572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lazy-loading 'fault' on Instance uuid ff6fb279-1853-46bc-a1c7-c50e0de60e8c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:10:49.790788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe65f20a4a894f2ab7765c9ce63a4d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70bbfbc677a44ccbe25d893254b5e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:49.817208 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a0b367c4-b293-4ae6-9774-d28263afaff7 tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 200 len: 1384 microversion: 2.1 time: 0.263874 Aug 03 05:10:49.828654 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3180/6330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:49 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 1384 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:49.943022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:49.974221 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0aaeb243-a30e-4a85-a92a-6bc23ec834f0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.406400 Aug 03 05:10:49.988669 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3151/6331] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:49 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:50.197690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1255679477", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-475023955", "security_groups": [{"name": "tempest-secgroup-smoke-1750238050"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9bf128fd-fc54-491b-a681-41deee28e429"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:50.417305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] validate_networks() for [('9bf128fd-fc54-491b-a681-41deee28e429', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:10:50.853216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:50.856127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] [instance: ff6fb279-1853-46bc-a1c7-c50e0de60e8c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:50.874193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:50.881247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:50.881247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:50.881247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:51.042989 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] HTTP exception thrown: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Request method failure captured: Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c HTTP/1.1 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gLQJG_MQ9-COxli7R6fnVh94uH6J1hQXKWBAC6GnmI5zULZjqhb5HvOyVfC7eyVGepnPNCJdXvCPby4RZGMbBHmCe9fLpshL2cW2nibQuBb2VLr5RvMj-NVNdekHEOCH3qVFHz-OAUMIbwKhLK6sd3WlX3i7LoqNskcX3yxMwoBFgI Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: a70bbfbc677a44ccbe25d893254b5e3e Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a70bbfbc677a44ccbe25d893254b5e3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: a70bbfbc677a44ccbe25d893254b5e3e Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-272685722 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestSecurityGroupsBasicOps-272685722-project Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: fe65f20a4a894f2ab7765c9ce63a4d89 Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestSecurityGroupsBasicOps-272685722-project Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'ff6fb279-1853-46bc-a1c7-c50e0de60e8c'} Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:10:51.055051 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. Aug 03 05:10:51.058804 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:10:51.061830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Returning 404 to user: Instance ff6fb279-1853-46bc-a1c7-c50e0de60e8c could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:10:51.062981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b53f1be4-27ad-469d-8540-db262ce35d0c tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c" status: 404 len: 111 microversion: 2.1 time: 0.219631 Aug 03 05:10:51.068363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3152/6332] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:50 2022] GET /compute/v2.1/servers/ff6fb279-1853-46bc-a1c7-c50e0de60e8c => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:10:51.087824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:51.089194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:51.119598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:51.122251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:51.127768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:51.133824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:51.680484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:51.691716 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e56784d5-9b61-4217-aa5c-3dffd7a5915f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.619992 Aug 03 05:10:51.695016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3153/6333] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:51 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:51.780867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for project 55144e334ce14b51b1fdfaae634a8da3. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:10:51.787567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for user 23b72214cec54bb2abbc9b34a4908502 and project 55144e334ce14b51b1fdfaae634a8da3. Resources: dict_keys(['metadata_items']) {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:10:51.802215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:10:51.802644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:10:51.803130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:10:51.803548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:10:51.803974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:10:51.813054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:51.813414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:51.815081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:51.815576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:51.835320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for project 55144e334ce14b51b1fdfaae634a8da3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:10:51.841140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Getting quotas for user 23b72214cec54bb2abbc9b34a4908502 and project 55144e334ce14b51b1fdfaae634a8da3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:10:51.856086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:10:51.868648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:10:52.138509 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1d8bbd6-ecf2-4840-bacc-441a65ef4608 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.941715 Aug 03 05:10:52.145623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3181/6334] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:10:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:10:52.192229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0167f0f2-5d89-4e52-b70d-5652fd14fa42 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:52.193137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0167f0f2-5d89-4e52-b70d-5652fd14fa42 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:52.319820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0167f0f2-5d89-4e52-b70d-5652fd14fa42 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:52.328126 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0167f0f2-5d89-4e52-b70d-5652fd14fa42 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1302 microversion: 2.1 time: 0.175114 Aug 03 05:10:52.330584 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3154/6335] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:52 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1302 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:52.720902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:52.721677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:52.758298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:52.758772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:52.763492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:52.764076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:53.352652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b81964a6-c62b-4cb0-8c96-2eb53b87100f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:53.354846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b81964a6-c62b-4cb0-8c96-2eb53b87100f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:53.357912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:53.369979 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-734cce34-5713-4ce2-985c-20b97f716d5c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.656282 Aug 03 05:10:53.373144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3182/6336] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:52 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:53.478156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b81964a6-c62b-4cb0-8c96-2eb53b87100f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:53.486827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b81964a6-c62b-4cb0-8c96-2eb53b87100f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1302 microversion: 2.1 time: 0.141577 Aug 03 05:10:53.489350 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3155/6337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:53 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1302 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:54.401642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:54.403596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:54.415198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:54.415921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:54.417728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:54.418530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:54.530356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bdcaf380-4e83-4551-afda-9bd2430cc95d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:54.531344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bdcaf380-4e83-4551-afda-9bd2430cc95d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:54.936595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bdcaf380-4e83-4551-afda-9bd2430cc95d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:54.948076 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bdcaf380-4e83-4551-afda-9bd2430cc95d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1302 microversion: 2.1 time: 0.437300 Aug 03 05:10:54.949613 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3156/6338] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:54 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1302 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:55.640382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:55.651670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6a2dd59-46e0-462e-ba5e-0d45241b6911 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 1.261115 Aug 03 05:10:55.654134 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3183/6339] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:54 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:55.971713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:55.973084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:55.985143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:10:55.991357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:55.992116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:55.993149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:55.995495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:56.168654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:56.186218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef56ae82-d911-4f3b-ae52-1f80afebd875 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1354 microversion: 2.1 time: 0.219824 Aug 03 05:10:56.188075 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3157/6340] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:55 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:56.675806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:56.676300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:56.685523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:56.690986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:56.692252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:56.692741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:57.015009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:57.026107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea2ba878-47aa-44b6-afdc-19649f23ea1e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.354430 Aug 03 05:10:57.039720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3184/6341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:56 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:57.225940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:57.227359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:57.238345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:57.247474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:57.250470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:57.252134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:57.483524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:57.498310 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c8cccdf-6bf9-4cb3-97a4-f2487ee2086b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1362 microversion: 2.1 time: 0.276724 Aug 03 05:10:57.499245 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3158/6342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:57 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:10:58.047583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:58.048236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:58.060070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:58.062108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:58.064546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:58.066813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:58.448884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5f276d44-d410-42c4-8bb1-9c1d58c64a60 req-8b86257b-df57-496c-8976-011e4d613855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97451540-f110-42aa-b0ab-cdd7cc40a93c", "name": "network-vif-plugged", "status": "completed", "tag": "550b1606-c979-484b-a191-dbf9985b76bd"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:10:58.472806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5f276d44-d410-42c4-8bb1-9c1d58c64a60 req-8b86257b-df57-496c-8976-011e4d613855 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:58.483255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5f276d44-d410-42c4-8bb1-9c1d58c64a60 req-8b86257b-df57-496c-8976-011e4d613855 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:58.522948 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5f276d44-d410-42c4-8bb1-9c1d58c64a60 req-8b86257b-df57-496c-8976-011e4d613855 service nova] Creating event network-vif-plugged:550b1606-c979-484b-a191-dbf9985b76bd for instance 97451540-f110-42aa-b0ab-cdd7cc40a93c on n-h2-826756-5 Aug 03 05:10:58.538099 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5f276d44-d410-42c4-8bb1-9c1d58c64a60 req-8b86257b-df57-496c-8976-011e4d613855 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093106 Aug 03 05:10:58.539030 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3159/6343] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:10:58.551342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:58.552075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:58.564231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:58.566230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:58.582128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:58.582128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:58.896571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:58.908903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce068650-23c1-435e-b003-aef9c4e5e14d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1360 microversion: 2.1 time: 0.368106 Aug 03 05:10:58.913631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3160/6344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:58 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1360 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:59.187078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:10:59.201560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70964709-947e-4488-825f-2f6ff8905fa9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 1.157845 Aug 03 05:10:59.203128 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3185/6345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:58 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:10:59.937606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:10:59.938405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:10:59.971670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:59.972501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:10:59.973544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:10:59.974137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:00.229957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:00.230605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:00.237373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:00.272379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:00.272581 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-73bd7b9a-9afe-4abc-b9df-ad4fc5edecbf tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.324434 Aug 03 05:11:00.272666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:00.272741 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3161/6346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:10:59 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:00.272812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:00.272812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:00.647019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:00.662954 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9e05487-001d-4419-ad76-ab2beafc1f08 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1375 microversion: 2.1 time: 0.439908 Aug 03 05:11:00.668425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3186/6347] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:00 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1375 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:01.232833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ea1b14f1-e415-4ff7-84c3-9044e5e53e6f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] Calling method '.version_select at 0x7fdd47f2f040>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:01.285137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:01.285756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:01.293050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:01.293194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:01.307022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:01.307484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:01.468250 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ea1b14f1-e415-4ff7-84c3-9044e5e53e6f tempest-TestSecurityGroupsBasicOps-272685722 tempest-TestSecurityGroupsBasicOps-272685722-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2085114800" status: 202 len: 0 microversion: 2.1 time: 0.238743 Aug 03 05:11:01.469858 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3162/6348] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 05:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2085114800 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:11:01.691057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:01.692020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:01.706102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:01.707131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:01.712146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:01.712965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:01.822843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:01.831808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:01.844532 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-65d6c691-ecf5-4379-940c-e6ee6a8b293d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.564127 Aug 03 05:11:01.860253 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3187/6349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:01 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:01.953913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ec91f881-bbf9-4724-b54f-cbf89e7f5f62 req-bad9009a-45dd-45fc-ac81-ac9b815975ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e91b73-6786-4a0c-9ef6-9e967d334ea8", "tag": "655a171e-ea9c-4015-b359-e2367f597d84"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:01.959930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:01.965625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ec91f881-bbf9-4724-b54f-cbf89e7f5f62 req-bad9009a-45dd-45fc-ac81-ac9b815975ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:01.966167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ec91f881-bbf9-4724-b54f-cbf89e7f5f62 req-bad9009a-45dd-45fc-ac81-ac9b815975ed service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:02.001133 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ec91f881-bbf9-4724-b54f-cbf89e7f5f62 req-bad9009a-45dd-45fc-ac81-ac9b815975ed service nova] Creating event network-changed:655a171e-ea9c-4015-b359-e2367f597d84 for instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 on n-h1-826756-5 Aug 03 05:11:02.004771 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ec91f881-bbf9-4724-b54f-cbf89e7f5f62 req-bad9009a-45dd-45fc-ac81-ac9b815975ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060028 Aug 03 05:11:02.006016 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3188/6350] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:11:02.819315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:02.857357 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7fa2f081-8628-4a0f-bce8-a6da6ef6e115 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1562 microversion: 2.1 time: 1.167089 Aug 03 05:11:02.867299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3163/6351] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:01 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1562 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:02.872184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:02.879483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:02.887420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:02.895204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:02.895867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:02.896734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:02.897835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:02.902451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:02.908436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:02.909009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:02.911608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:02.912076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:03.396095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:03.412813 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65c7daed-cd6d-4824-a09d-e1773fdbf55a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1562 microversion: 2.1 time: 0.526368 Aug 03 05:11:03.414220 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3164/6352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:02 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1562 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:03.509249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:03.526073 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b3d94c8-bb6c-42ae-8b9b-4bc2bc4782cc tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.661326 Aug 03 05:11:03.540829 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3189/6353] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:02 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:03.541205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:03.545433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:03.556823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:03.558099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:03.559345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:03.559970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:03.603854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:11:04.402077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-850a0da6-df42-4187-88bb-64381b8b5335 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 204 len: 0 microversion: 2.1 time: 0.867052 Aug 03 05:11:04.404226 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3165/6354] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:11:03 2022] DELETE /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:11:04.413350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:04.415434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:04.446005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:04.449009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:04.450098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:04.452568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:04.555803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:04.556559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:04.570495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:04.571935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:04.573057 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:04.573812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:04.895878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:04.907152 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05e4ea14-45bd-407f-bc25-4a915eb3ed8d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1568 microversion: 2.1 time: 0.498058 Aug 03 05:11:04.911281 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3190/6355] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:04 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1568 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:04.940246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:04.942842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:04.949591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86dafb5e-0bf3-4fbc-8934-7815290eabda tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.402795 Aug 03 05:11:04.956633 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3166/6356] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:04 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:05.934099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:05.935066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:05.947482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:05.948384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:05.949350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:05.950705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:05.972689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:05.973328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:05.986619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:05.987338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:05.990080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:05.993263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:06.388162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:06.390649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:06.406969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59cdf505-5cff-40aa-95bc-942f6fc67550 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1568 microversion: 2.1 time: 0.479717 Aug 03 05:11:06.407581 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3191/6357] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:05 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1568 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:06.410114 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2797cbc-b072-4dc3-b6e3-50e5804c09ac tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.442828 Aug 03 05:11:06.427039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3167/6358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:05 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:07.086567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-811e96da-00d3-495b-a640-fbf47ed45d18 req-1154ebe5-b3d3-4f16-b473-6266a8d46025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97451540-f110-42aa-b0ab-cdd7cc40a93c", "name": "network-vif-deleted", "tag": "550b1606-c979-484b-a191-dbf9985b76bd"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:07.116338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-811e96da-00d3-495b-a640-fbf47ed45d18 req-1154ebe5-b3d3-4f16-b473-6266a8d46025 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:07.118531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-811e96da-00d3-495b-a640-fbf47ed45d18 req-1154ebe5-b3d3-4f16-b473-6266a8d46025 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:07.140134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-811e96da-00d3-495b-a640-fbf47ed45d18 req-1154ebe5-b3d3-4f16-b473-6266a8d46025 service nova] Creating event network-vif-deleted:550b1606-c979-484b-a191-dbf9985b76bd for instance 97451540-f110-42aa-b0ab-cdd7cc40a93c on n-h2-826756-5 Aug 03 05:11:07.156835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-811e96da-00d3-495b-a640-fbf47ed45d18 req-1154ebe5-b3d3-4f16-b473-6266a8d46025 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077175 Aug 03 05:11:07.157486 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3192/6359] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:07.443388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:07.444051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:07.445722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:07.446499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:07.460817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:07.461273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:07.467207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:07.469321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:07.471251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:07.473714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:07.474484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:07.480156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:07.737959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:07.748785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71e9c8d6-e9ba-4ce7-af57-62b024d1449f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.320853 Aug 03 05:11:07.749858 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3168/6360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:07 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:07.885186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:07.897105 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56a02287-25f8-42c1-8492-6613c411a7ee tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.463042 Aug 03 05:11:07.910590 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3193/6361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:07 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:08.773614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:08.774259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:08.787938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:08.788449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:08.789301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:08.789788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:08.896072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:08.905619 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5d08e06-666d-4fee-a7ff-e229dfa67ce7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.138096 Aug 03 05:11:08.907191 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3169/6362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:08 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:08.918566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:08.919908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:08.928640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:08.929347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:08.930322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:08.930945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:09.297280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:09.307391 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db758b8a-f79f-461d-aa8b-455d57e19540 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.393159 Aug 03 05:11:09.310664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3194/6363] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:08 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:09.942195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:09.943550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:09.954767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:09.956672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:09.957688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:09.959091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:10.127509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:10.130198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:10.161498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9096c4e7-9df8-4fb2-8f5f-ada9beff648f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.225885 Aug 03 05:11:10.163923 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3170/6364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:09 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:10.341127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:10.348517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:10.365746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:10.366469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:10.370625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:10.372776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:10.685030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:10.695491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b523d09-3779-4681-8f9c-f781fea7b523 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.368058 Aug 03 05:11:10.715319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3195/6365] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:10 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:11.188757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:11.190120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:11.204309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:11.208367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:11.210637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:11.211500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:11.322676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:11.333014 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4578cfe2-1103-42fe-aa9f-0018d3907e1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.148814 Aug 03 05:11:11.334218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3171/6366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:11 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:11.472247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0b6f8f65-4f48-4a9b-8c8b-ab1c8152b117 req-da1cf9de-72b0-4aef-8049-f6a0654151bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e91b73-6786-4a0c-9ef6-9e967d334ea8", "name": "network-vif-plugged", "status": "completed", "tag": "655a171e-ea9c-4015-b359-e2367f597d84"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:11.489898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0b6f8f65-4f48-4a9b-8c8b-ab1c8152b117 req-da1cf9de-72b0-4aef-8049-f6a0654151bc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:11.490689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0b6f8f65-4f48-4a9b-8c8b-ab1c8152b117 req-da1cf9de-72b0-4aef-8049-f6a0654151bc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:11.505757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0b6f8f65-4f48-4a9b-8c8b-ab1c8152b117 req-da1cf9de-72b0-4aef-8049-f6a0654151bc service nova] Creating event network-vif-plugged:655a171e-ea9c-4015-b359-e2367f597d84 for instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 on n-h1-826756-5 Aug 03 05:11:11.528712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0b6f8f65-4f48-4a9b-8c8b-ab1c8152b117 req-da1cf9de-72b0-4aef-8049-f6a0654151bc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062626 Aug 03 05:11:11.530045 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3196/6367] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:11.719528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:11.720177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:11.734446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:11.737448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:11.738543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:11.740257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:12.362934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:12.362934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:12.378714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:12.380837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:12.382470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:12.383113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:12.554126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:12.560761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:12.572796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f467b4fd-66e2-4f57-a235-9bb128a32ba3 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.857345 Aug 03 05:11:12.575830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3172/6368] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:11 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:12.591525 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-47d9f29c-b90b-4e18-b71c-25432ea59061 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.236901 Aug 03 05:11:12.593106 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3197/6369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:12 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:13.599173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:13.599815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:13.615171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:13.617568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:13.626590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:13.655860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:13.660350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:13.660653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:13.664759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:13.666450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:13.667441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:13.667905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:13.751411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:13.995690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:14.008088 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-54fc481b-2ffa-4d72-8981-a2c9cba780fb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.398155 Aug 03 05:11:14.009479 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3198/6370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:13 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:14.085186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:14.094799 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3264bea5-8394-44b5-8245-54160f0e3822 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1428 microversion: 2.1 time: 0.499631 Aug 03 05:11:14.098520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3173/6371] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:13 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1428 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:15.048460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:15.049683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:15.070002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.074929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.076214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.076710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.121276 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:15.122247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:15.135899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.136298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.141382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.141382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.239816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:15.253988 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4782fba8-8c13-4759-a480-4c68ece4262c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1360 microversion: 2.1 time: 0.210502 Aug 03 05:11:15.255489 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3199/6372] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:15 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:15.489034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:15.505879 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a473648-b40a-4e05-a52d-20d91f9fe300 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1607 microversion: 2.1 time: 0.385993 Aug 03 05:11:15.506864 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3174/6373] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:15 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1607 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:15.530883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:15.533779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:15.546400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.546400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.546400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.546400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.763843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:15.774658 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78b6c294-4b38-4b9c-8b9e-3619a650c28a tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1607 microversion: 2.1 time: 0.247568 Aug 03 05:11:15.776019 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3200/6374] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:15 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1607 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:15.802351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:15.803369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:15.818977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.819734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:15.821222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:15.821695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:16.278288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:16.278897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:16.292423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:16.292900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:16.302857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:16.303558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:16.367440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:16.369315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:16.371538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid 97451540-f110-42aa-b0ab-cdd7cc40a93c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:11:16.575615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:16.585420 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7988cfad-2b81-457a-b103-bedae4d57c93 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 200 len: 1319 microversion: 2.1 time: 0.310954 Aug 03 05:11:16.586486 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3201/6375] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:16 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:16.629523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:16.641089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a934b72e-1d92-4563-bee4-43bcb9842b17 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1607 microversion: 2.1 time: 0.844161 Aug 03 05:11:16.643749 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3175/6376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:15 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1607 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:17.611432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:17.612887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:17.631493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:17.631874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:17.632714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:17.633162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:17.658940 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c HTTP/1.1 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '97451540-f110-42aa-b0ab-cdd7cc40a93c'} Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:17.670345 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f30cf519-bd94-4ff6-8fbd-42fa41b3c00c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 404 len: 111 microversion: 2.1 time: 0.064577 Aug 03 05:11:17.674096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3202/6377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:17 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:21.227120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7a99fdf2-1f4b-49ab-baf0-4e4e9e468965 req-47655ed3-b697-4dee-90d9-d2fe5effcc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e91b73-6786-4a0c-9ef6-9e967d334ea8", "tag": "655a171e-ea9c-4015-b359-e2367f597d84"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:21.246464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a99fdf2-1f4b-49ab-baf0-4e4e9e468965 req-47655ed3-b697-4dee-90d9-d2fe5effcc70 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:21.247219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a99fdf2-1f4b-49ab-baf0-4e4e9e468965 req-47655ed3-b697-4dee-90d9-d2fe5effcc70 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:21.296219 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7a99fdf2-1f4b-49ab-baf0-4e4e9e468965 req-47655ed3-b697-4dee-90d9-d2fe5effcc70 service nova] Creating event network-changed:655a171e-ea9c-4015-b359-e2367f597d84 for instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 on n-h1-826756-5 Aug 03 05:11:21.315405 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7a99fdf2-1f4b-49ab-baf0-4e4e9e468965 req-47655ed3-b697-4dee-90d9-d2fe5effcc70 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205705 Aug 03 05:11:21.316217 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3176/6378] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:24.518791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:24.519287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:24.532199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:24.535227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:24.535694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:24.536527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:24.536974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:24.576525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:11:25.041999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5737961f-9f53-4b28-b12d-41ec27831763 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 204 len: 0 microversion: 2.1 time: 0.527629 Aug 03 05:11:25.055319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3203/6379] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:11:24 2022] DELETE /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:11:25.059297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:25.060632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:25.079868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:25.080815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:25.082173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:25.083265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:25.385494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:25.395710 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21ab7246-d216-4589-8fd1-906d35a4634b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1410 microversion: 2.1 time: 0.345191 Aug 03 05:11:25.396488 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3177/6380] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:25 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1410 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:26.418622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:26.420174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:26.428244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:26.428720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:26.429498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:26.430274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:26.743118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:26.760919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b4a964d-ccf6-48fb-84f9-d03a28eb3ce3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1410 microversion: 2.1 time: 0.336040 Aug 03 05:11:26.761623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3204/6381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:26 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1410 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:27.400069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-abb8aa2a-b63f-4168-9ae8-9fdb3d891791 req-b203051c-8bdd-4f1c-afbf-cb2780b15a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfe23ea-e600-47a9-b396-6cce8f9010ed", "name": "network-vif-deleted", "tag": "ecee22ab-a00f-4b38-81e1-b212a9f85a73"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:27.411078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-abb8aa2a-b63f-4168-9ae8-9fdb3d891791 req-b203051c-8bdd-4f1c-afbf-cb2780b15a77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:27.411603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-abb8aa2a-b63f-4168-9ae8-9fdb3d891791 req-b203051c-8bdd-4f1c-afbf-cb2780b15a77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:27.425487 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-abb8aa2a-b63f-4168-9ae8-9fdb3d891791 req-b203051c-8bdd-4f1c-afbf-cb2780b15a77 service nova] Creating event network-vif-deleted:ecee22ab-a00f-4b38-81e1-b212a9f85a73 for instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed on n-h2-826756-5 Aug 03 05:11:27.431065 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-abb8aa2a-b63f-4168-9ae8-9fdb3d891791 req-b203051c-8bdd-4f1c-afbf-cb2780b15a77 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 Aug 03 05:11:27.432218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3178/6382] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:27.783663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:27.787125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:27.800810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:27.801273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:27.802384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:27.802843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:27.915222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:27.926728 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae911580-85f9-4d05-8a15-06010f852da6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.148012 Aug 03 05:11:27.939922 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3205/6383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:27 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:28.949786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:28.951653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:28.968013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:28.970478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:28.974635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:28.975509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:29.085169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:29.094541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d171061b-1cdb-4989-9ef6-d9e706aad9ac tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.149672 Aug 03 05:11:29.120313 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3179/6384] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:28 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:30.134629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:30.135839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:30.151706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:30.152456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:30.153811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:30.154428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:30.295462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:30.318773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d035990b-0c58-4e2f-ae4d-aa86af936a81 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.194237 Aug 03 05:11:30.335429 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3206/6385] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:30 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:31.340664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:31.341409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:31.344495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:31.354103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:31.355021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:31.356195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:31.356823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:31.438792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:31.448129 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d47b4223-714b-417f-aa75-7841a2beac9b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.111696 Aug 03 05:11:31.454491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3180/6386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:31 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:32.469698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:32.471140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:32.479900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:32.480452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:32.481642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:32.482150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:32.582787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:32.599687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-273540d2-a59a-4a22-b0c3-68866ea7db41 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.133610 Aug 03 05:11:32.600888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3207/6387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:32 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:11:33.624838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:33.625487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:33.635487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:33.635640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:33.636654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:33.637127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:33.724701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:33.733226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50b5f6df-ccfd-4f17-b335-41a8a64dd02e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1201 microversion: 2.1 time: 0.113115 Aug 03 05:11:33.733894 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3181/6388] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:33 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1201 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:34.760731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:34.762493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:34.772388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:34.772879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:34.773709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:34.775956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:34.813976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:34.814359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:34.814884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid 4bfe23ea-e600-47a9-b396-6cce8f9010ed {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:11:34.865407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:11:34.879945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-808225c9-ea69-4813-ba8a-918d6e78197f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 200 len: 1206 microversion: 2.1 time: 0.119885 Aug 03 05:11:34.890768 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3208/6389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:34 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 1206 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:11:35.904222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:35.904938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:35.915234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:35.915911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:35.916938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:35.917550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:35.945640 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed HTTP/1.1 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '4bfe23ea-e600-47a9-b396-6cce8f9010ed'} Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:35.947573 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:35.951672 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:35.952724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:35.953908 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6f532e3-7657-4262-9c2d-0d348735fef8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 404 len: 111 microversion: 2.1 time: 0.053990 Aug 03 05:11:35.956193 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3182/6390] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:35 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:38.186759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:38.187306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:38.196346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:38.202188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:38.202188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:38.202188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:38.219120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c HTTP/1.1 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '97451540-f110-42aa-b0ab-cdd7cc40a93c'} Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:38.220890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:38.227052 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e680c777-3ddf-4070-98a0-97ca10fb572f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 404 len: 111 microversion: 2.1 time: 0.044498 Aug 03 05:11:38.232466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3209/6391] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:11:38 2022] DELETE /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:38.233425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:38.234375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 97451540-f110-42aa-b0ab-cdd7cc40a93c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:38.249456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:38.257171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:38.257171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:38.257171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:38.271687 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c HTTP/1.1 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '97451540-f110-42aa-b0ab-cdd7cc40a93c'} Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:38.273301 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. Aug 03 05:11:38.277639 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:38.278946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 97451540-f110-42aa-b0ab-cdd7cc40a93c could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:38.280517 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30cb9d48-8a6a-4102-9788-7d038cef8ff6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c" status: 404 len: 111 microversion: 2.1 time: 0.050462 Aug 03 05:11:38.282811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3183/6392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:38 2022] GET /compute/v2.1/servers/97451540-f110-42aa-b0ab-cdd7cc40a93c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:39.780097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:39.780624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:39.788181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:39.788676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:39.789450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:39.789892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:39.803149 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed HTTP/1.1 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '4bfe23ea-e600-47a9-b396-6cce8f9010ed'} Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:39.804787 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-42e4bc9d-2d46-46c8-9d9d-e2f88753cb94 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 404 len: 111 microversion: 2.1 time: 0.030404 Aug 03 05:11:39.812933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3210/6393] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:11:39 2022] DELETE /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:39.819010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:39.819644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 4bfe23ea-e600-47a9-b396-6cce8f9010ed] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:39.826613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:39.827353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:39.828149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:39.828648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:39.842806 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed HTTP/1.1 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '4bfe23ea-e600-47a9-b396-6cce8f9010ed'} Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:11:39.844392 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 4bfe23ea-e600-47a9-b396-6cce8f9010ed could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98b6a46f-28c3-4fcd-a3a2-730f5f182df9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed" status: 404 len: 111 microversion: 2.1 time: 0.030757 Aug 03 05:11:39.848906 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3184/6394] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:11:39 2022] GET /compute/v2.1/servers/4bfe23ea-e600-47a9-b396-6cce8f9010ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:11:39.939344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc016f96-490e-4c34-abbc-6096f43ca833 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: .version_select at 0x7fdd54a65040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-225511139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe/sX+/mzuewMOca2w4rw5w+KSFT5T/NunF9P0fvIfsn66sO6ltzsi2acX4ezDhJ6+2Dj/8UYuXOya5R5UbHcnJdts/4W86Uytodtg2/YQNuv3fLQ/ohl006bYHa2NR8Q=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:11:39.958750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc016f96-490e-4c34-abbc-6096f43ca833 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:11:39.969002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc016f96-490e-4c34-abbc-6096f43ca833 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:11:40.137864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc016f96-490e-4c34-abbc-6096f43ca833 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.202512 Aug 03 05:11:40.138509 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3211/6395] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:11:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:11:51.074965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:11:51.075475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:11:51.085266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=9 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:51.085959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=65 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:11:51.090167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:51.090653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:51.091463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:11:51.091923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:11:51.121526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9894a4b-a3ff-4b48-ae9b-107ad1e4fe6f tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051252 Aug 03 05:11:51.122587 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3185/6396] 10.222.0.72 () {58 vars in 1293 bytes} [Wed Aug 3 05:11:51 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8/os-server-password => generated 116 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:08.868897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:08.869766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:08.870869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:08.997882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-689194524", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "aee468d1-0e2b-42af-ae55-3b2daf3f20dd"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:09.055910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] validate_networks() for [('aee468d1-0e2b-42af-ae55-3b2daf3f20dd', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:12:09.434635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:12:09.435211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:12:09.435964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:12:09.436412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:12:09.436842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:12:09.448791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:09.449253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:09.450240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:09.450780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:09.470507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Getting quotas for project 2a36fe1d8236442b9033ebc520a79da2. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:12:09.477354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Getting quotas for user 91c69ed13f5b4fdb8f6f8bfa2e04ffb7 and project 2a36fe1d8236442b9033ebc520a79da2. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:12:09.491935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:12:09.494334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:12:09.641238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8cbb3030-d516-49fe-b2aa-0bbef5507d61 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774259 Aug 03 05:12:09.641906 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3212/6397] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:12:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:12:09.653392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5f5a111-4b20-4311-84cf-502a23f158c8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:09.654023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5f5a111-4b20-4311-84cf-502a23f158c8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:09.726480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5f5a111-4b20-4311-84cf-502a23f158c8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:09.734472 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5f5a111-4b20-4311-84cf-502a23f158c8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1213 microversion: 2.1 time: 0.085541 Aug 03 05:12:09.735221 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3186/6398] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:09 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:10.758835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81ae8b64-3897-4909-8c6d-e24991f8e94d tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:10.759375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81ae8b64-3897-4909-8c6d-e24991f8e94d tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:10.841932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81ae8b64-3897-4909-8c6d-e24991f8e94d tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:10.849637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81ae8b64-3897-4909-8c6d-e24991f8e94d tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1213 microversion: 2.1 time: 0.096391 Aug 03 05:12:10.850499 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3213/6399] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:10 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:11.871516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:11.872392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:11.881369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:11.888479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:11.889387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:11.890133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:11.968826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:11.977759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8ff61453-4952-4a27-bad3-24f473c2c3bc tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1217 microversion: 2.1 time: 0.110710 Aug 03 05:12:11.978353 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3187/6400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:11 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:13.002096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:13.003193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:13.019726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:13.021336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:13.031886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:13.031886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:13.123435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:13.126970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4d60845-6383-4bbd-9c4e-414c3f881543 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1265 microversion: 2.1 time: 0.131835 Aug 03 05:12:13.128418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3214/6401] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:12 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:14.149207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:14.149844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:14.173836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:14.173836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:14.173836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:14.173836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:14.444001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:14.455480 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30bf6314-71b2-4fb5-92ae-5339fe1f85f8 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.310114 Aug 03 05:12:14.457744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3188/6402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:14 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:14.556367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-6246108", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225511139", "security_groups": [{"name": "tempest-secgroup-smoke-2135634289"}], "block_device_mapping_v2": [{"uuid": "af7b2b67-f8de-4f1e-9d9f-c63e5e17e5a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:14.723023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:12:15.478240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:15.478902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:15.486139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:15.486673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:15.487752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:15.488301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:15.765852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:15.774423 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1772193-baf9-4538-8faf-5525e169cc51 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.300256 Aug 03 05:12:15.788241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:12:15.788835 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3189/6403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:15 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:15.789020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:12:15.789551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:12:15.789932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:12:15.790393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:12:15.799383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:15.800485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:15.801467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:15.802032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:15.825583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:12:15.830955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:12:15.897306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:12:15.899417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af7b2b67-f8de-4f1e-9d9f-c63e5e17e5a2',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:12:16.201481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d01cb663-5470-463a-951c-df60e618b499 req-67537ae9-d3fb-41cc-ba33-f6a8c3498015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04fd9b68-87d9-4e87-b875-bba3dc9c8a32", "tag": "0e3ff0be-bdb6-44a6-bf46-1e2402bf8288"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:16.215453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d01cb663-5470-463a-951c-df60e618b499 req-67537ae9-d3fb-41cc-ba33-f6a8c3498015 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:16.215928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d01cb663-5470-463a-951c-df60e618b499 req-67537ae9-d3fb-41cc-ba33-f6a8c3498015 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:16.228599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d01cb663-5470-463a-951c-df60e618b499 req-67537ae9-d3fb-41cc-ba33-f6a8c3498015 service nova] Creating event network-changed:0e3ff0be-bdb6-44a6-bf46-1e2402bf8288 for instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 on n-h2-826756-5 Aug 03 05:12:16.234097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d01cb663-5470-463a-951c-df60e618b499 req-67537ae9-d3fb-41cc-ba33-f6a8c3498015 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036221 Aug 03 05:12:16.234746 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3190/6404] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:16.544639 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3124a675-9970-4966-a749-9f97695b9886 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.992218 Aug 03 05:12:16.551059 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3215/6405] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:12:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:12:16.557233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-253a4a9a-269a-4b98-8aa2-c42207f8e6d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:16.558750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-253a4a9a-269a-4b98-8aa2-c42207f8e6d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:16.668163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-253a4a9a-269a-4b98-8aa2-c42207f8e6d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:16.678300 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-253a4a9a-269a-4b98-8aa2-c42207f8e6d2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1091 microversion: 2.1 time: 0.125527 Aug 03 05:12:16.680450 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3191/6406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:16 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1091 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:16.799945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:16.800810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:16.814086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:16.814086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:16.814086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:16.814086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:17.036251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:17.048767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de693c04-cdba-4829-a332-7384fb92a21a tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.254620 Aug 03 05:12:17.049379 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3216/6407] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:16 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:17.702275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:17.703008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:17.713105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:17.713574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:17.714319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:17.714775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:17.781847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:17.793525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94e78afa-2e0a-4f64-847c-3cbdac11fca6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1141 microversion: 2.1 time: 0.095932 Aug 03 05:12:17.794185 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3192/6408] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:17 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1141 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:18.071693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:18.072338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:18.079487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:18.079950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:18.080771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:18.081264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:18.215492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:18.223750 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c22acf9d-9673-425b-ac27-e41564147803 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.156062 Aug 03 05:12:18.224364 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3217/6409] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:18 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:18.815117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:18.817120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:18.825488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:18.825488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:18.825985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:18.826443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:18.861674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1735447677", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:18.897710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:18.905659 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d608b5b8-f954-4190-8dfc-f3b57bd02cca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1189 microversion: 2.1 time: 0.094523 Aug 03 05:12:18.906235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3193/6410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:18 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1189 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:18.915916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:12:19.201558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:12:19.202108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:12:19.202762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:12:19.203254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:12:19.203751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:12:19.213503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.214072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:19.214928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.215382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:19.234339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Getting quotas for project 3ed773f57f014395a688bc5b3df3a42e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:12:19.241220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Getting quotas for user de91d7f8a112428593c1a25e0f3ab7e7 and project 3ed773f57f014395a688bc5b3df3a42e. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:12:19.246614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:19.247240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:19.253998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.254333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:19.255334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:12:19.255619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.256432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:19.257535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:12:19.384619 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-87fe7f84-95bf-4226-9fa4-ca2b7933bb1a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526795 Aug 03 05:12:19.391911 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3218/6411] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:12:19.403124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bae9c468-1697-4f84-b120-a058c5e62bdd tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:19.408128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bae9c468-1697-4f84-b120-a058c5e62bdd tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:19.462891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:19.475046 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ddb80f73-493c-40a8-86e5-8503d51eb151 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.232883 Aug 03 05:12:19.479788 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3194/6412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:19 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:19.534568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bae9c468-1697-4f84-b120-a058c5e62bdd tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:19.544238 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bae9c468-1697-4f84-b120-a058c5e62bdd tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1215 microversion: 2.1 time: 0.146290 Aug 03 05:12:19.548556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3219/6413] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:19 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:19.929298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:19.930538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:19.943879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.944694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:19.945732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:19.946747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:20.023397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:20.031561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7e63ee75-ffda-4aa4-a677-bc96313b16c0 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1207 microversion: 2.1 time: 0.108171 Aug 03 05:12:20.032165 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3195/6414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:19 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:20.509044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:20.509044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:20.522826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:20.523530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:20.525503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:20.528160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:20.569226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e65f8b07-8838-408b-92a7-c3173694a38a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:20.570232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e65f8b07-8838-408b-92a7-c3173694a38a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:20.703472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e65f8b07-8838-408b-92a7-c3173694a38a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:20.714836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e65f8b07-8838-408b-92a7-c3173694a38a tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1215 microversion: 2.1 time: 0.151861 Aug 03 05:12:20.715472 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3196/6415] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:20 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:20.832312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:20.841042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee2e2b13-264d-4a03-9c94-7cc5b1792014 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.343533 Aug 03 05:12:20.841656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3220/6416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:20 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:21.053091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:21.055870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:21.069598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.070407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.071851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.073329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.280452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:21.288654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d25d8bc2-df87-4e44-8ade-fd035977e8bf tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1275 microversion: 2.1 time: 0.239493 Aug 03 05:12:21.289251 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3197/6417] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:21 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:21.363696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a0bdaffb-e009-4340-bd4a-d917183ef425 req-180a8a8c-be38-4d2a-80e6-b006ef0953a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ed0671-2b4d-4219-9016-d9a0fc072f84", "tag": "d6e67c21-d6af-41e3-bdfe-0a2d63c0d862"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:21.374810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0bdaffb-e009-4340-bd4a-d917183ef425 req-180a8a8c-be38-4d2a-80e6-b006ef0953a1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.375267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0bdaffb-e009-4340-bd4a-d917183ef425 req-180a8a8c-be38-4d2a-80e6-b006ef0953a1 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.387840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a0bdaffb-e009-4340-bd4a-d917183ef425 req-180a8a8c-be38-4d2a-80e6-b006ef0953a1 service nova] Creating event network-changed:d6e67c21-d6af-41e3-bdfe-0a2d63c0d862 for instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 on n-h1-826756-5 Aug 03 05:12:21.393513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a0bdaffb-e009-4340-bd4a-d917183ef425 req-180a8a8c-be38-4d2a-80e6-b006ef0953a1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034830 Aug 03 05:12:21.394778 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3221/6418] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:12:21.736746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:21.738470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:21.745314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.746273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.747444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.747891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.822789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:21.824168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:21.834458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.835119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.836016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:21.836556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.856598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.856921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53a0367a-7697-43b3-9e18-c6a69eade3d4 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1211 microversion: 2.1 time: 0.113129 Aug 03 05:12:21.856921 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3198/6419] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:21 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:21.870597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:21.872547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:21.881358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.882301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.883267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:21.883883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:21.989966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lazy-loading 'services' on Instance uuid cec51088-3983-4725-a744-bcbdf2f2ec6c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:12:22.129903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:22.139293 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64b87d4f-0cd6-4ec9-a6bc-1bf7017f1ede tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.272911 Aug 03 05:12:22.141872 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3199/6420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:21 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:22.145857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d39f0be7-0101-4d88-89b6-dd3318d3cd84 req-246b5696-2b4e-48a4-a1a3-88620cf50e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fd9b68-87d9-4e87-b875-bba3dc9c8a32", "name": "network-vif-plugged", "status": "completed", "tag": "0e3ff0be-bdb6-44a6-bf46-1e2402bf8288"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:22.158230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d39f0be7-0101-4d88-89b6-dd3318d3cd84 req-246b5696-2b4e-48a4-a1a3-88620cf50e22 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:22.160316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d39f0be7-0101-4d88-89b6-dd3318d3cd84 req-246b5696-2b4e-48a4-a1a3-88620cf50e22 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:22.173784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d39f0be7-0101-4d88-89b6-dd3318d3cd84 req-246b5696-2b4e-48a4-a1a3-88620cf50e22 service nova] Creating event network-vif-plugged:0e3ff0be-bdb6-44a6-bf46-1e2402bf8288 for instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 on n-h2-826756-5 Aug 03 05:12:22.180302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d39f0be7-0101-4d88-89b6-dd3318d3cd84 req-246b5696-2b4e-48a4-a1a3-88620cf50e22 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038683 Aug 03 05:12:22.184677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3200/6421] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:22.312654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:22.313856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:22.327012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:22.327859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:22.329318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:22.330778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:22.369898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ca793052-08c5-4186-808f-f1fd54f97831 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c/os-volume_attachments/942e8b2d-bcc0-428b-90c3-5840dd914c1b" status: 202 len: 0 microversion: 2.1 time: 0.551492 Aug 03 05:12:22.374746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3222/6422] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:12:21 2022] DELETE /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c/os-volume_attachments/942e8b2d-bcc0-428b-90c3-5840dd914c1b => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:12:22.580723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:22.590390 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d103cc97-8a3a-4ae1-b4ed-d5f35295daed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1275 microversion: 2.1 time: 0.282482 Aug 03 05:12:22.591553 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3201/6423] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:22 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:22.875032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:22.876413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:22.885625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:22.886406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:22.887923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:22.889637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:22.964686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:22.974209 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51065e67-0e6a-433d-9764-9dedc1a58712 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1275 microversion: 2.1 time: 0.106347 Aug 03 05:12:22.975351 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3223/6424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:22 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1275 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:23.165957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:23.166760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:23.173857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:23.174316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:23.175725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:23.176306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:23.317998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:23.326539 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99325922-52b1-42f9-80ce-98bc1017508b tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1313 microversion: 2.1 time: 0.164360 Aug 03 05:12:23.327751 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3202/6425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:23 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:23.614999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:23.615767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:23.625193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:23.625943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:23.627211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:23.627968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:23.807101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:23.815746 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ec866579-616b-4c0d-b558-26b297443613 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1275 microversion: 2.1 time: 0.206698 Aug 03 05:12:23.829329 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3224/6426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:23 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:23.995163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:23.995867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:24.002789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.003793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:24.004997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.005459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:24.074547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:24.083087 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1422e2ac-a7cd-45ab-baab-6cf82977b1a9 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1273 microversion: 2.1 time: 0.091775 Aug 03 05:12:24.083812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3203/6427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:23 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:24.348729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:24.349657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:24.357206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.357835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:24.358718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.359261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:24.518517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:24.527405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-147d9a12-d636-4d81-b9ef-0d9e05854748 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1497 microversion: 2.1 time: 0.183085 Aug 03 05:12:24.528230 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3225/6428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:24 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:24.837205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:24.837769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:24.845235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.845720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:24.849299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:24.849299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:25.026473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:25.040999 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-282198dd-e1a3-4a31-9546-5bd7d29eafc2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1275 microversion: 2.1 time: 0.207624 Aug 03 05:12:25.045257 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3204/6429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:24 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:25.105573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:25.106741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:25.114346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:25.114886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:25.115743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:25.116235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:25.188082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9ea56e04-0bb4-47ba-b048-893545f31f09 req-554ec94a-b0c7-45f5-8e36-d903d207bd13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2251ad6c-d467-4035-8e71-d43cc4afcc66", "tag": "827802d4-00b5-4aa9-b260-163f010c672a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:25.206078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9ea56e04-0bb4-47ba-b048-893545f31f09 req-554ec94a-b0c7-45f5-8e36-d903d207bd13 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:25.210585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9ea56e04-0bb4-47ba-b048-893545f31f09 req-554ec94a-b0c7-45f5-8e36-d903d207bd13 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:25.222600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9ea56e04-0bb4-47ba-b048-893545f31f09 req-554ec94a-b0c7-45f5-8e36-d903d207bd13 service nova] Creating event network-changed:827802d4-00b5-4aa9-b260-163f010c672a for instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 on n-h2-826756-5 Aug 03 05:12:25.229595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9ea56e04-0bb4-47ba-b048-893545f31f09 req-554ec94a-b0c7-45f5-8e36-d903d207bd13 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045522 Aug 03 05:12:25.230473 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3205/6430] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:12:25.364165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:25.374271 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb2b17ec-bbaa-4447-b896-995cfb444e6c tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.272619 Aug 03 05:12:25.375137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3226/6431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:25 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:26.078684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:26.080237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:26.105838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:26.106701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:26.109265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:26.115215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:26.396427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:26.397811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:26.405650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:26.405861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:26.406287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:26.407077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:26.407524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:26.410113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=100 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:26.419169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e512d245-3739-4c8b-9e87-e56d3b909e42 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1275 microversion: 2.1 time: 0.355371 Aug 03 05:12:26.433093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3206/6432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:26 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1275 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:26.559219 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:26.568524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7a66b3e-ab53-4afe-a421-d9d4c3e051b7 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.176850 Aug 03 05:12:26.570976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3227/6433] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:26 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:27.441731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:27.442408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:27.449696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:27.450176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:27.450965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:27.451417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:27.588426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:27.590449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:27.591657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:27.596395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2dccfbd2-eb41-4228-a353-cb27bc253131 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.158994 Aug 03 05:12:27.597744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3207/6434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:27 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:27.599969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:27.600457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:27.601428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:27.602041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:27.739045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:27.748315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da74df7c-f30d-4d5f-bffa-1fce5eb01f98 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.161754 Aug 03 05:12:27.749492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3228/6435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:27 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:28.618889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:28.619605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:28.627750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:28.632591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:28.632591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:28.632591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:28.769898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:28.770593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:28.779810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:28.780304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:28.781297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:28.781972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:28.785563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:28.794127 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13153ca6-2fb9-45c5-a1f5-67fd44d4aef4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.179193 Aug 03 05:12:28.794723 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3208/6436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:28 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:28.955500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:28.974922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b836408b-7c82-4cd4-bc98-4bfe4efb55da tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.209188 Aug 03 05:12:28.975871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3229/6437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:28 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:29.817032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:29.817675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:29.827047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:29.827552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:29.828346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:29.828810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:29.991870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:29.991870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:29.991870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:29.991870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=22 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:29.995192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:29.995654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:29.996506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:29.997268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:29.998385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:30.014785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb502c3e-79df-40a4-a9bd-e2cb21c4f11e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.203444 Aug 03 05:12:30.017364 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3209/6438] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:29 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:30.024251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:30.025822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:30.032294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.032995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.034699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.034699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.044173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:12:30.192293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:30.200853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:30.206645 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6240b1a-95db-40c1-8fcc-903715c43077 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.186322 Aug 03 05:12:30.209181 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3210/6439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:30 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:30.218013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-43d622f4-0f1d-48b8-9eef-779bc2c4dc97 req-790b2d50-e76e-4af6-bb07-69010f631524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2251ad6c-d467-4035-8e71-d43cc4afcc66", "name": "network-vif-plugged", "status": "completed", "tag": "827802d4-00b5-4aa9-b260-163f010c672a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:30.228480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-43d622f4-0f1d-48b8-9eef-779bc2c4dc97 req-790b2d50-e76e-4af6-bb07-69010f631524 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.228882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-43d622f4-0f1d-48b8-9eef-779bc2c4dc97 req-790b2d50-e76e-4af6-bb07-69010f631524 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.241283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-43d622f4-0f1d-48b8-9eef-779bc2c4dc97 req-790b2d50-e76e-4af6-bb07-69010f631524 service nova] Creating event network-vif-plugged:827802d4-00b5-4aa9-b260-163f010c672a for instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 on n-h2-826756-5 Aug 03 05:12:30.247269 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-43d622f4-0f1d-48b8-9eef-779bc2c4dc97 req-790b2d50-e76e-4af6-bb07-69010f631524 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037243 Aug 03 05:12:30.249313 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3211/6440] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:30.253191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:30.254116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:30.260928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.261756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.262907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.263366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.291934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:12:30.434136 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-169f2b26-a2ad-4484-8692-61a7b7e7ff7d tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 204 len: 0 microversion: 2.1 time: 0.456821 Aug 03 05:12:30.434931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3230/6441] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:12:29 2022] DELETE /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:12:30.445436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:30.452810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:30.452810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.453041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.453736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.454176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.591004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:30.599514 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a022564d-c186-4eb7-8558-c2b68e120989 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1470 microversion: 2.1 time: 0.160023 Aug 03 05:12:30.600136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3231/6442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:30 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:30.711063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:30.715023 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89fec9ca-4c4a-434b-8607-a12ab6b09a11 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "DELETE /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 204 len: 0 microversion: 2.1 time: 0.465801 Aug 03 05:12:30.716048 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3212/6443] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:12:30 2022] DELETE /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:12:30.725859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:30.726553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:30.732992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.733451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.734310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:30.734741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:30.867343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:30.875810 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5ce5bfa-b9ae-413c-a2d2-c8691777e6e2 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1503 microversion: 2.1 time: 0.155310 Aug 03 05:12:30.876490 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3232/6444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:30 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:31.039957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:31.040689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:31.047744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.048217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.049032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.049490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.184277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:31.192776 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fcd5d6d8-997f-40b6-9b72-463fc6332a0f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.157220 Aug 03 05:12:31.193360 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3213/6445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:31 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:31.230288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:31.230939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:31.238827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.239292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.247147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.247147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.379825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:31.387360 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15af7bf9-fed3-40f8-88d5-f99b8dc11e58 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.161258 Aug 03 05:12:31.387947 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3233/6446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:31 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:31.621546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:31.622477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:31.629423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.629885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.630668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.631165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.766752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:31.775219 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5b1f6ad-35c6-4d17-9fc6-aa5513695311 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1470 microversion: 2.1 time: 0.157978 Aug 03 05:12:31.777881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3214/6447] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:31 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:31.898075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:31.898695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:31.902009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:31.905944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.906394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:31.907158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:31.907598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.068205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:32.068205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7bb42002-97fc-46af-91f7-9b86c3c71108 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1503 microversion: 2.1 time: 0.172915 Aug 03 05:12:32.068205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3234/6448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:31 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:32.213449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:32.214041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:32.221268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.238263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.238263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.238263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.361235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:32.369533 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2208d8ce-51fb-4e08-8cb5-597436c34f90 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.160077 Aug 03 05:12:32.370110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3215/6449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:32 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:32.408412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:32.409304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:32.418411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.419055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.420302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.422567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.668438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:32.681462 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52b53cbe-f640-46fc-a43d-dd79ba9fa2b3 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1315 microversion: 2.1 time: 0.277290 Aug 03 05:12:32.683111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3235/6450] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:32 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:32.798453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:32.799298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:32.807048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.807632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.808666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:32.809248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:32.951510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:32.959832 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-80ae7d87-e9f9-4a47-b62d-d0e4612a68fe tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1470 microversion: 2.1 time: 0.165864 Aug 03 05:12:32.960477 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3216/6451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:32 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:33.090208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:33.091872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:33.099475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.100333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.101576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.102177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.191548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f21dccb9-6a18-4b29-b696-958be9101772 req-1eaf9f4e-a819-4c53-99bc-5037abd9ff58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04fd9b68-87d9-4e87-b875-bba3dc9c8a32", "name": "network-vif-deleted", "tag": "0e3ff0be-bdb6-44a6-bf46-1e2402bf8288"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:33.203062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f21dccb9-6a18-4b29-b696-958be9101772 req-1eaf9f4e-a819-4c53-99bc-5037abd9ff58 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.203551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f21dccb9-6a18-4b29-b696-958be9101772 req-1eaf9f4e-a819-4c53-99bc-5037abd9ff58 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.213346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:33.217601 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f21dccb9-6a18-4b29-b696-958be9101772 req-1eaf9f4e-a819-4c53-99bc-5037abd9ff58 service nova] Creating event network-vif-deleted:0e3ff0be-bdb6-44a6-bf46-1e2402bf8288 for instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 on n-h2-826756-5 Aug 03 05:12:33.220571 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-13f46606-2078-4d5b-8e18-6ae4f37c9ce4 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1461 microversion: 2.1 time: 0.136251 Aug 03 05:12:33.221957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3236/6452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:33 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1461 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:33.223261 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f21dccb9-6a18-4b29-b696-958be9101772 req-1eaf9f4e-a819-4c53-99bc-5037abd9ff58 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 Aug 03 05:12:33.224082 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3217/6453] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:12:33.227112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-be5d5f54-e09b-4f64-987c-2aec2efda08a req-ec56fee3-c15f-4e2e-ab1f-8dfa734166d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cec51088-3983-4725-a744-bcbdf2f2ec6c", "name": "network-vif-deleted", "tag": "934319b8-dd79-40af-9b14-d9aa156f0b56"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:33.239436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be5d5f54-e09b-4f64-987c-2aec2efda08a req-ec56fee3-c15f-4e2e-ab1f-8dfa734166d9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.239886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be5d5f54-e09b-4f64-987c-2aec2efda08a req-ec56fee3-c15f-4e2e-ab1f-8dfa734166d9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.251885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-be5d5f54-e09b-4f64-987c-2aec2efda08a req-ec56fee3-c15f-4e2e-ab1f-8dfa734166d9 service nova] Creating event network-vif-deleted:934319b8-dd79-40af-9b14-d9aa156f0b56 for instance cec51088-3983-4725-a744-bcbdf2f2ec6c on n-h1-826756-5 Aug 03 05:12:33.257357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-be5d5f54-e09b-4f64-987c-2aec2efda08a req-ec56fee3-c15f-4e2e-ab1f-8dfa734166d9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 Aug 03 05:12:33.257953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3237/6454] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:33.391690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:33.392387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:33.404023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.404566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.405378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.405839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.555402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:33.563521 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ed4647d-9d90-4a6d-94b2-e8723731239e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.176108 Aug 03 05:12:33.564338 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3218/6455] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:33 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:33.704535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:33.705239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:33.712721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.713204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.713975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.714412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.860370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:33.868354 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4a6f3a4-00c6-46bc-867b-e79529b195b0 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1464 microversion: 2.1 time: 0.169014 Aug 03 05:12:33.868943 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3238/6456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:33 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:33.915484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:33.916038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:33.922313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.922857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.923658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.924122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.949853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:12:33.982763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:33.983453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:33.989541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.990017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:33.990767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:33.991225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.023088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.023541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.024244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lazy-loading 'fault' on Instance uuid cec51088-3983-4725-a744-bcbdf2f2ec6c {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:12:34.066972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3235a1bb0e5b416e8bbbfccd50e700f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d4d61aeeac48a08345c789d36f8769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:34.075297 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a42b43f5-c532-4d9a-afed-3bd914f87f8b tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 200 len: 1304 microversion: 2.1 time: 0.096812 Aug 03 05:12:34.079959 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3239/6457] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:33 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:34.243925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:34.244978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:34.252209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.252810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.253803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.254256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.265631 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a0e97570-4e67-4e7c-a183-b91d15cb22ac tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 204 len: 0 microversion: 2.1 time: 0.353712 Aug 03 05:12:34.266237 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3219/6458] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:12:33 2022] DELETE /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:12:34.277362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:34.278117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:34.285361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.285825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.286798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.287244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.293201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.293671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.294141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lazy-loading 'fault' on Instance uuid 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:12:34.345908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c69ed13f5b4fdb8f6f8bfa2e04ffb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a36fe1d8236442b9033ebc520a79da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:34.354280 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-65b7253a-9d3c-4e2d-8e68-109a622856c5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 200 len: 1303 microversion: 2.1 time: 0.115391 Aug 03 05:12:34.354919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3240/6459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:34 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:34.437980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:34.445912 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fad272da-0dea-4cf2-bec1-2856474d9242 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1470 microversion: 2.1 time: 0.174518 Aug 03 05:12:34.447425 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3220/6460] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:34 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:34.586570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:34.587109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:34.593485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.593950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.594728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:34.595176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:34.734496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:34.742065 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ba89326c-31d6-4929-8a02-271f25a3ed5a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.161031 Aug 03 05:12:34.742648 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3241/6461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:34 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:35.104761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:35.105395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] [instance: cec51088-3983-4725-a744-bcbdf2f2ec6c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:35.111529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.111999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.113329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.113800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.129035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] HTTP exception thrown: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Request method failure captured: Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c HTTP/1.1 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gLiyYLwkpcYrf9ZQNuoRO0MdTqLylG-s2wpUJKb6IjOgwKr4Lt56965LJWi8xZ2KPhL7z39sJF9L-udGBhBq1F2LcFXQDUGIQd4KApeORNKi9paEPF7k0MYxWmsN_u0CXj8wdnzAWgw6Et_tLxLTtr2M68YIPmB3brtx7guaQkAFZI Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 21d4d61aeeac48a08345c789d36f8769 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesBackupsTest-1544179557 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/21d4d61aeeac48a08345c789d36f8769"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/21d4d61aeeac48a08345c789d36f8769"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_21d4d61aeeac48a08345c789d36f8769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/21d4d61aeeac48a08345c789d36f8769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesBackupsTest-1544179557 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 21d4d61aeeac48a08345c789d36f8769 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesBackupsTest-1544179557 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesBackupsTest-1544179557-project Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 3235a1bb0e5b416e8bbbfccd50e700f4 Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesBackupsTest-1544179557-project Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'cec51088-3983-4725-a744-bcbdf2f2ec6c'} Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:35.130933 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] Returning 404 to user: Instance cec51088-3983-4725-a744-bcbdf2f2ec6c could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c74ab994-2e04-4492-818d-71ef24d7cb43 tempest-VolumesBackupsTest-1544179557 tempest-VolumesBackupsTest-1544179557-project] 10.222.0.72 "GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c" status: 404 len: 111 microversion: 2.1 time: 0.031674 Aug 03 05:12:35.135229 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3221/6462] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:35 2022] GET /compute/v2.1/servers/cec51088-3983-4725-a744-bcbdf2f2ec6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:12:35.377776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:35.382448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] [instance: 04fd9b68-87d9-4e87-b875-bba3dc9c8a32] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:35.389293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.389820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.390808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.391261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.411305 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] HTTP exception thrown: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Request method failure captured: Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 HTTP/1.1 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gOlZDQdtqeLXOruQ-vu9yLDzJeuVnGLy21NQj8rUyCiViwnFJOD_U5Vct9Q7xNuUnH6BU3Ftf_fwWwhyzTsUCwGVU01W-g16jTHrU-1fpe3jEAIzAgyzl9BqANO29bhHDfeSor4lz_0itMGlVfgDy9SyyVlMhBWagxk3ivNSm3Xn3Y Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 2a36fe1d8236442b9033ebc520a79da2 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesActionsTest-511446467 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a36fe1d8236442b9033ebc520a79da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a36fe1d8236442b9033ebc520a79da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a36fe1d8236442b9033ebc520a79da2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a36fe1d8236442b9033ebc520a79da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesActionsTest-511446467 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 2a36fe1d8236442b9033ebc520a79da2 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesActionsTest-511446467 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesActionsTest-511446467-project Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 91c69ed13f5b4fdb8f6f8bfa2e04ffb7 Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesActionsTest-511446467-project Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '04fd9b68-87d9-4e87-b875-bba3dc9c8a32'} Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:35.413048 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] Returning 404 to user: Instance 04fd9b68-87d9-4e87-b875-bba3dc9c8a32 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:12:35.417193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c01d0804-5b82-4c33-b30a-68b77c63eda5 tempest-VolumesActionsTest-511446467 tempest-VolumesActionsTest-511446467-project] 10.222.0.72 "GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32" status: 404 len: 111 microversion: 2.1 time: 0.044427 Aug 03 05:12:35.420212 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3242/6463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:35 2022] GET /compute/v2.1/servers/04fd9b68-87d9-4e87-b875-bba3dc9c8a32 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:12:35.469051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:35.469690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:35.477556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.478025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.478847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.479305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.484395 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:35.623821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:35.633080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e64003be-24b3-4573-a6df-0c0b9d780c19 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1470 microversion: 2.1 time: 0.169194 Aug 03 05:12:35.634289 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3222/6464] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:35 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:35.765006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:35.772899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:35.773459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.774098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.775049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:35.775644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:35.941427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:35.950388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d6a13f9-8d94-4064-95ad-5dd6f6e3ed77 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.189528 Aug 03 05:12:35.964701 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3243/6465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:35 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:36.651761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5e10991b-e014-454d-a1cd-fbe62dfc8ad2 req-e4f3fdbb-5831-489e-8496-50b6f7f9a1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2251ad6c-d467-4035-8e71-d43cc4afcc66", "name": "network-vif-deleted", "tag": "827802d4-00b5-4aa9-b260-163f010c672a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:36.654939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:36.655562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:36.666244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:36.666700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:36.672226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:36.672717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:36.673519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5e10991b-e014-454d-a1cd-fbe62dfc8ad2 req-e4f3fdbb-5831-489e-8496-50b6f7f9a1db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:36.674437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5e10991b-e014-454d-a1cd-fbe62dfc8ad2 req-e4f3fdbb-5831-489e-8496-50b6f7f9a1db service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:36.713630 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5e10991b-e014-454d-a1cd-fbe62dfc8ad2 req-e4f3fdbb-5831-489e-8496-50b6f7f9a1db service nova] Creating event network-vif-deleted:827802d4-00b5-4aa9-b260-163f010c672a for instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 on n-h2-826756-5 Aug 03 05:12:36.726226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5e10991b-e014-454d-a1cd-fbe62dfc8ad2 req-e4f3fdbb-5831-489e-8496-50b6f7f9a1db service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081003 Aug 03 05:12:36.729643 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3223/6466] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:36.787415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:36.796135 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a4eb85f-b448-4d02-bac7-446e03fe41c5 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1428 microversion: 2.1 time: 0.144832 Aug 03 05:12:36.797482 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3244/6467] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:36 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:12:36.972802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:36.973688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:36.980426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:36.980827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:36.981863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:36.982327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:37.144066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:37.152739 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b46d87de-1d2b-4d87-9976-4835bcbca0cb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.184415 Aug 03 05:12:37.153357 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3224/6468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:36 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:37.376595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-abf64f18-b9b2-4eb2-8e1c-ab1f35801786 req-5167401e-cbda-48a2-97e6-4de351a2b42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ed0671-2b4d-4219-9016-d9a0fc072f84", "name": "network-vif-plugged", "status": "completed", "tag": "d6e67c21-d6af-41e3-bdfe-0a2d63c0d862"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:37.387905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abf64f18-b9b2-4eb2-8e1c-ab1f35801786 req-5167401e-cbda-48a2-97e6-4de351a2b42a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:37.388644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-abf64f18-b9b2-4eb2-8e1c-ab1f35801786 req-5167401e-cbda-48a2-97e6-4de351a2b42a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:37.416014 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-abf64f18-b9b2-4eb2-8e1c-ab1f35801786 req-5167401e-cbda-48a2-97e6-4de351a2b42a service nova] Creating event network-vif-plugged:d6e67c21-d6af-41e3-bdfe-0a2d63c0d862 for instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 on n-h1-826756-5 Aug 03 05:12:37.438214 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-abf64f18-b9b2-4eb2-8e1c-ab1f35801786 req-5167401e-cbda-48a2-97e6-4de351a2b42a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061300 Aug 03 05:12:37.438214 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3245/6469] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:37.819850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:37.821475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:37.826490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:37.830140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:37.830608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:37.832095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:37.832746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:37.864633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:37.865095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:37.865654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lazy-loading 'fault' on Instance uuid 2251ad6c-d467-4035-8e71-d43cc4afcc66 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:12:37.911186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de91d7f8a112428593c1a25e0f3ab7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed773f57f014395a688bc5b3df3a42e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:37.920869 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8bbf0e70-0693-4634-aa7d-2136181547cc tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 200 len: 1305 microversion: 2.1 time: 0.106306 Aug 03 05:12:37.921431 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3225/6470] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:37 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:38.176115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:38.177053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:38.183566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:38.184117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:38.184996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:38.185430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:38.328434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:38.337369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d0249616-4c8d-41c0-a2d0-8dc5f3b2a6f6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1263 microversion: 2.1 time: 0.166703 Aug 03 05:12:38.338285 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3246/6471] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:38 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:38.942289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:38.947523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] [instance: 2251ad6c-d467-4035-8e71-d43cc4afcc66] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:38.952789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:38.953263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:38.954063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:38.954567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:38.985981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] HTTP exception thrown: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Request method failure captured: Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 HTTP/1.1 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gOvHg2ZFgsjtW1lGtOCTXXrJpM_groG30vQhGVqyX2YsAXA9BLQfAPBF-LaFr3QSF6J8rc6jsrq-kXIQ3UkkNJ0EsBTNFsLbxpH4in7o9_LwP-wqpchp1J_n4T2XHwO-7p60wTDbGK2ln8KcutBhhvgDZPq8wOtkv_XAAIqDC-RcMU Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 3ed773f57f014395a688bc5b3df3a42e Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesNegativeTest-567943965 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3ed773f57f014395a688bc5b3df3a42e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3ed773f57f014395a688bc5b3df3a42e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3ed773f57f014395a688bc5b3df3a42e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3ed773f57f014395a688bc5b3df3a42e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesNegativeTest-567943965 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 3ed773f57f014395a688bc5b3df3a42e Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesNegativeTest-567943965 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesNegativeTest-567943965-project Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: de91d7f8a112428593c1a25e0f3ab7e7 Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesNegativeTest-567943965-project Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2251ad6c-d467-4035-8e71-d43cc4afcc66'} Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:12:38.993323 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] Returning 404 to user: Instance 2251ad6c-d467-4035-8e71-d43cc4afcc66 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e874ba8-a3d2-49a8-b63a-80aa9abb97a1 tempest-VolumesNegativeTest-567943965 tempest-VolumesNegativeTest-567943965-project] 10.222.0.72 "GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66" status: 404 len: 111 microversion: 2.1 time: 0.051012 Aug 03 05:12:38.998881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3226/6472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:38 2022] GET /compute/v2.1/servers/2251ad6c-d467-4035-8e71-d43cc4afcc66 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:12:39.359336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:39.360729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:39.368229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:39.368841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:39.369641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:39.370084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:39.523881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:39.532590 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-293ad406-0a5b-4807-8b7e-6db9516986d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1451 microversion: 2.1 time: 0.177026 Aug 03 05:12:39.533169 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3247/6473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:39 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:39.554094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:12:39.555007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:12:39.580746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:39.581448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:39.582665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:39.583327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:39.913842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:12:39.933120 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ca7cca56-8947-4e56-9f29-625d26c0dc67 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1451 microversion: 2.1 time: 0.383678 Aug 03 05:12:39.933624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3227/6474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:12:39 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1451 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:12:42.712168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-09097a1b-7d11-48ac-bdc3-5a3946f6fb9a req-954f378e-9d2f-452e-bbb1-be471f814bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ed0671-2b4d-4219-9016-d9a0fc072f84", "tag": "d6e67c21-d6af-41e3-bdfe-0a2d63c0d862"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:42.758825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-09097a1b-7d11-48ac-bdc3-5a3946f6fb9a req-954f378e-9d2f-452e-bbb1-be471f814bef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:12:42.759321 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-09097a1b-7d11-48ac-bdc3-5a3946f6fb9a req-954f378e-9d2f-452e-bbb1-be471f814bef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:12:42.783839 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-09097a1b-7d11-48ac-bdc3-5a3946f6fb9a req-954f378e-9d2f-452e-bbb1-be471f814bef service nova] Creating event network-changed:d6e67c21-d6af-41e3-bdfe-0a2d63c0d862 for instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 on n-h1-826756-5 Aug 03 05:12:42.799167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-09097a1b-7d11-48ac-bdc3-5a3946f6fb9a req-954f378e-9d2f-452e-bbb1-be471f814bef service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095219 Aug 03 05:12:42.799810 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3248/6475] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:12:48.746058 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:12:48.746607 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:12:51.741385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:51.742554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:12:51.947062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa0879d9-e6e0-46dc-b1a4-7cc6bc6cb95c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: .version_select at 0x7fdd548fdc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1848315953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEkwqjDwWjMRT5gCpNPm3avWuzkofjHx8ffJF63SvN2qdkvDIOnfNNy9B+jidvQ95wCq+oy1yAs3Vzxe3NR+gkSFgimg3qJpgeWrW5JWxo38+reKXoDOFnrgPsxqlc1Fg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:12:51.964465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-aa0879d9-e6e0-46dc-b1a4-7cc6bc6cb95c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:12:51.970261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-aa0879d9-e6e0-46dc-b1a4-7cc6bc6cb95c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:12:52.449503 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa0879d9-e6e0-46dc-b1a4-7cc6bc6cb95c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.711818 Aug 03 05:12:52.449503 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3228/6476] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:12:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:04.107776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1278491865", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "0113fb26-533b-4e8c-a085-6af11280b499"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1848315953", "security_groups": [{"name": "tempest-secgroup-smoke-1622128923"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:04.132701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=32 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:04.133930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:04.276950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] validate_networks() for [('0113fb26-533b-4e8c-a085-6af11280b499', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:13:04.921177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:13:04.922925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:13:04.922925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:13:04.923442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:13:04.925069 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:13:04.935776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:04.936580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:04.937484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:04.937936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:04.958216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:13:04.963797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:13:04.978318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:13:04.980890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:13:05.214599 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d532498-54b9-4246-aeca-081a03c168ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.111101 Aug 03 05:13:05.215985 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3249/6477] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:13:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:13:05.224236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:05.228988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-699883e3-f6c7-4c3b-9e7b-a74c88668be9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:05.229624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-699883e3-f6c7-4c3b-9e7b-a74c88668be9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:05.348750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-699883e3-f6c7-4c3b-9e7b-a74c88668be9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:05.356402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-699883e3-f6c7-4c3b-9e7b-a74c88668be9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1267 microversion: 2.1 time: 0.133766 Aug 03 05:13:05.357667 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3229/6478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:05 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:06.382284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68f03099-30c8-4fd9-9e6d-8af98400b5bb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:06.383088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-68f03099-30c8-4fd9-9e6d-8af98400b5bb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:06.467215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68f03099-30c8-4fd9-9e6d-8af98400b5bb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:06.476687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68f03099-30c8-4fd9-9e6d-8af98400b5bb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1267 microversion: 2.1 time: 0.099972 Aug 03 05:13:06.479181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3250/6479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:06 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:07.507064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:07.507930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:07.521911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:07.522389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:07.523204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:07.523670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:07.590404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:07.599383 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d070fa59-cfc3-43ae-b527-62ec9bcc1a1d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1271 microversion: 2.1 time: 0.098264 Aug 03 05:13:07.599983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3230/6480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:07 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:08.624602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:08.625386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:08.633203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:08.633711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:08.634637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:08.635153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:08.709222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:08.717444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-687645f3-c07d-43f7-a9fd-4475c594599f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1319 microversion: 2.1 time: 0.097197 Aug 03 05:13:08.718038 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3251/6481] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:08 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:09.741607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:09.742266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:09.752235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.753416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:09.755488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:09.756041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:09.833290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:09.841879 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee259ab8-2b8a-4e81-970b-1231eb68c4c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1337 microversion: 2.1 time: 0.105713 Aug 03 05:13:09.842661 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3231/6482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:09 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1337 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:10.864453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:10.865077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:10.872384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:10.872850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:10.873631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:10.874325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6840a1b4-b04c-42bf-babd-469dfabc7b0b req-5be7293b-8764-4823-a0b6-806797bbd373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6840a1b4-b04c-42bf-babd-469dfabc7b0b req-5be7293b-8764-4823-a0b6-806797bbd373 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6840a1b4-b04c-42bf-babd-469dfabc7b0b req-5be7293b-8764-4823-a0b6-806797bbd373 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6840a1b4-b04c-42bf-babd-469dfabc7b0b req-5be7293b-8764-4823-a0b6-806797bbd373 service nova] Creating event network-changed:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h2-826756-5 Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6840a1b4-b04c-42bf-babd-469dfabc7b0b req-5be7293b-8764-4823-a0b6-806797bbd373 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068731 Aug 03 05:13:11.582752 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3232/6483] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:11.584777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:11.584777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb182f00-e1c4-4fd5-b340-85436cebb1f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.604600 Aug 03 05:13:11.584777 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3252/6484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:10 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:12.487297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:12.488021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:12.495249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:12.495718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:12.496553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:12.497038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:12.638536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:12.647600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-beb9acad-5e54-4706-bb9e-b5bd80165267 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.165270 Aug 03 05:13:12.648142 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3233/6485] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:12 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:13.669943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:13.672460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:13.680137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.680627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.681418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:13.681885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:13.830695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:13.837206 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9eee237e-c1d7-47e9-830b-99ce704b344f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.171366 Aug 03 05:13:13.837931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3253/6486] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:13 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:14.864030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:14.865789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:14.875268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.875789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:14.876996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:14.877545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:15.109061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:15.116979 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-513ad0fa-2d47-4145-8fbc-4ead471691d9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.261597 Aug 03 05:13:15.117567 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3234/6487] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:14 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:16.143323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:16.143881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:16.146899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:16.151900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:16.152432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:16.153183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:16.153627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:16.247051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1c060e3c-66c1-4569-a27d-396086dbc80d req-49f0c748-26d4-49c4-b523-07fca48725c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "name": "network-vif-plugged", "status": "completed", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:16.258346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1c060e3c-66c1-4569-a27d-396086dbc80d req-49f0c748-26d4-49c4-b523-07fca48725c8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:16.258809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1c060e3c-66c1-4569-a27d-396086dbc80d req-49f0c748-26d4-49c4-b523-07fca48725c8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:16.271051 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1c060e3c-66c1-4569-a27d-396086dbc80d req-49f0c748-26d4-49c4-b523-07fca48725c8 service nova] Creating event network-vif-plugged:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h2-826756-5 Aug 03 05:13:16.276465 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1c060e3c-66c1-4569-a27d-396086dbc80d req-49f0c748-26d4-49c4-b523-07fca48725c8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Aug 03 05:13:16.277952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3235/6488] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:13:16.300784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:16.309095 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-074f92d9-6444-403c-b6ec-f4a7b5d402d2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.169793 Aug 03 05:13:16.320311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3254/6489] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:16 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:17.333036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:17.333742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:17.340134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:17.340744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:17.341520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:17.342060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:17.486718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:17.495283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d824234-c54d-4c26-a1d9-53a2ff78000a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1393 microversion: 2.1 time: 0.167848 Aug 03 05:13:17.496125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3236/6490] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:17 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:18.517344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:18.518056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:18.521395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:18.527204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.527667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.528495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.528970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.669214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.678078 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7337791e-2884-4871-9751-25ea978259c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1564 microversion: 2.1 time: 0.165028 Aug 03 05:13:18.679101 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3255/6491] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:18 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:18.700425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:18.701069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:18.703218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:18.709248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.709631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.710447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:18.710893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:18.876286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:18.886211 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6d185074-f262-4d35-972b-d21a89b27d80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1564 microversion: 2.1 time: 0.189705 Aug 03 05:13:18.886830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3237/6492] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:18 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:21.037289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e13507b8-cb02-4ef8-ac6e-4bbe1e370791 req-14722eb4-1a50-4eab-b5e1-9a5a2227a5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:21.038233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:21.038866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:21.057073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.057898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.059061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.059711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.059827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e13507b8-cb02-4ef8-ac6e-4bbe1e370791 req-14722eb4-1a50-4eab-b5e1-9a5a2227a5dd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:21.060331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e13507b8-cb02-4ef8-ac6e-4bbe1e370791 req-14722eb4-1a50-4eab-b5e1-9a5a2227a5dd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:21.077359 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e13507b8-cb02-4ef8-ac6e-4bbe1e370791 req-14722eb4-1a50-4eab-b5e1-9a5a2227a5dd service nova] Creating event network-changed:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h2-826756-5 Aug 03 05:13:21.084851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e13507b8-cb02-4ef8-ac6e-4bbe1e370791 req-14722eb4-1a50-4eab-b5e1-9a5a2227a5dd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056424 Aug 03 05:13:21.085908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3238/6493] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:13:21.236351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:21.247288 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ea5865b-c18c-40b5-8ac4-a3fce5aee501 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1564 microversion: 2.1 time: 0.221565 Aug 03 05:13:21.248864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3256/6494] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:21 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:44.522380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:44.523322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=42 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:44.527899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:44.530451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:44.538098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:44.538690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:44.539552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:44.540079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:44.601793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-157c6e6c-45c1-4b52-94aa-987793dca090 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action" status: 200 len: 24570 microversion: 2.1 time: 0.081523 Aug 03 05:13:44.602967 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3239/6495] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:13:44 2022] POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action => generated 24570 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:13:55.799243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:55.799853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:55.802042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:55.802742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=38 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:13:55.807764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:55.808215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:55.809010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:55.809450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.158193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-386c12df-c7a6-4012-bad9-9bbb5e05169b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1832 microversion: 2.1 time: 0.363292 Aug 03 05:13:56.158788 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3257/6496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:55 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1832 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:56.179831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:56.180577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:56.189531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.190001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.193621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.193621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.336683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:56.344657 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d13f95be-425e-4011-8854-311e4034db80 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1681 microversion: 2.1 time: 0.169114 Aug 03 05:13:56.353929 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3240/6497] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:56 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:56.447013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:56.449413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:56.456968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.458239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.459055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.459508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.511051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-beec9a6c-0475-4cba-838c-25e756a69bcd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action" status: 200 len: 32643 microversion: 2.1 time: 0.067974 Aug 03 05:13:56.511869 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3258/6498] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:13:56 2022] POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action => generated 32643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:13:56.701350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:13:56.702813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:56.710145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.710639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.711428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:56.711883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:56.854272 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ff7d21fcfa0444a3abbb6648a4aaa0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123e5d3a64543b2873f7d97a255d73b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:56.863256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] flavor_id is None. Assuming migration. {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 05:13:56.863256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:13:57.362695 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-412ac48e-070f-4d84-b340-12ba3dfa9504 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action" status: 202 len: 0 microversion: 2.1 time: 0.665782 Aug 03 05:13:57.368822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3241/6499] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:13:56 2022] POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:13:57.377155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:57.378573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:57.386894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:57.387495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:57.388486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:57.388925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:57.540048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:57.547849 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-33cb2cb0-c771-4445-9435-747e8807afef tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.177824 Aug 03 05:13:57.548452 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3259/6500] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:57 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:58.571861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:58.572521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:58.579576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.580044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.580871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:58.581326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:58.736662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:58.744797 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf4191b6-8fb2-42c9-8a5b-ae211944729d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.177955 Aug 03 05:13:58.745380 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3242/6501] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:58 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:13:59.768064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:13:59.768727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:13:59.776848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.777298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.778126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:13:59.778565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:13:59.918059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:13:59.927052 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-516bd99c-e2f4-4459-b7b5-c46f8bb0ab87 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.163096 Aug 03 05:13:59.927629 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3260/6502] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:13:59 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:00.950007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:00.950978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:00.957935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.958489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:00.959341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:00.959937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:01.095642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:01.104548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb5c10db-373b-4ae0-a346-d54d3fdfd84f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1690 microversion: 2.1 time: 0.159399 Aug 03 05:14:01.105135 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3243/6503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:00 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:02.128158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:02.128737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:02.136380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.136846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.137629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:02.138077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:02.284077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:02.293048 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-089634b7-0cde-4d5f-98ba-24e15a75fe96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.169501 Aug 03 05:14:02.296008 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3261/6504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:02 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:03.316860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:03.318070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:03.325528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.327682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.327682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:03.327682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:03.471025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:03.479872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b9b2beeb-ce3b-4a6a-a98e-dbca4e2676d4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.167172 Aug 03 05:14:03.491362 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3244/6505] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:03 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:04.503731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:04.504409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:04.512136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.512633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.513418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:04.513888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:04.653936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:04.662101 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d42a269d-930f-4f8e-b269-92f8c02b21dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.162391 Aug 03 05:14:04.676300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3262/6506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:04 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:05.684536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:05.685208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:05.692566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.696262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.696262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:05.696262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:05.833931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:05.841821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48929b87-f1aa-4fb2-bfdb-59a97229dfa9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.161391 Aug 03 05:14:05.842395 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3245/6507] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:05 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:06.864217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:06.865034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:06.872178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.872673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:06.873449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:06.873893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:07.021485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:07.029139 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e90cc16-c43a-482b-84d8-f8e16279b7be tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.169255 Aug 03 05:14:07.029715 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3263/6508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:06 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:08.051028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:08.051742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:08.059164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:08.062099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:08.062099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:08.062099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:08.196158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:08.203784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e05ee486-27c8-4cc0-811a-93efabd798e0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.156717 Aug 03 05:14:08.204384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3246/6509] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:08 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:09.226904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:09.227521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:09.234776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:09.235227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:09.239239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:09.239239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:09.378813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:09.387458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51a573a8-9773-4cf2-a717-a35fcd9abe8b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.165220 Aug 03 05:14:09.388422 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3264/6510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:09 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:10.410443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:10.411108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:10.419016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.419488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:10.420297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:10.420826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:10.562024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:10.570541 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a4a1bc1-d02b-40a2-a199-2841de797cde tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.164082 Aug 03 05:14:10.571475 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3247/6511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:10 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:11.592944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:11.593555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:11.601170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:11.601620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:11.602386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:11.602824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:11.736646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:11.745184 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a26c9ba2-484e-40c5-bc71-f5f473c27ebb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.156132 Aug 03 05:14:11.745760 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3265/6512] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:11 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:12.767148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:12.767814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:12.775120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.775593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.776489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:12.777014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:12.924294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:12.933755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-32a9981c-f72f-4a38-9528-d0de034fdefb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1695 microversion: 2.1 time: 0.170513 Aug 03 05:14:12.934348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3248/6513] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:12 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:13.955777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:13.956523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:13.963655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.964114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:13.964920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:13.965366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:14.105621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:14.113930 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de424ef0-1e46-424d-8044-5804e4623d2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1694 microversion: 2.1 time: 0.162177 Aug 03 05:14:14.114905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3266/6514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:13 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:14.751705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:14.763735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:14.763735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:14.777164 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] Creating event network-vif-unplugged:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h1-826756-5 Aug 03 05:14:14.783589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:14:14.797069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c6fcf615-9e98-4600-9bbd-62e0ed1975c0 req-80af029c-44a8-45fb-b9a9-f4228baaeed2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119571 Aug 03 05:14:14.798345 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3249/6515] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:15.137610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:15.138240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:15.145434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:15.145952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.147018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:15.147471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:15.427684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:15.437416 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5880e3f5-d3b2-4224-b22b-849d70ec673c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1694 microversion: 2.1 time: 0.303713 Aug 03 05:14:15.438005 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3267/6516] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:15 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1694 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:16.461414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:16.462371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:16.469109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.469580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:16.470442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:16.470900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:16.631760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:16.639323 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0754012e-79f2-4a64-b324-4492b731aa5f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1694 microversion: 2.1 time: 0.183957 Aug 03 05:14:16.639905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3250/6517] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:16 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:17.148099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:17.158482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:17.158930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.171691 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] Creating event network-changed:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h1-826756-5 Aug 03 05:14:17.177431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:14:17.189042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e07a7fd6-3c3a-45a5-913e-6182f313e88b req-0dc49629-0a9e-4cb2-9358-ed47da879071 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044997 Aug 03 05:14:17.189626 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3268/6518] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:17.663735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:17.664476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:17.671854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:17.672361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.673288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:17.673758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:17.823672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:17.831525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c0e090e-4fcb-4f91-9471-6e4638a83c92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1692 microversion: 2.1 time: 0.172462 Aug 03 05:14:17.832100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3251/6519] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:17 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:18.863993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:18.864855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:18.871395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.871854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:18.872653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:18.873106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.015367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:19.030264 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cece707d-f0eb-406a-85ff-c9c7c4056038 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1689 microversion: 2.1 time: 0.164881 Aug 03 05:14:19.030264 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3269/6520] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:18 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:19.049098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:19.049661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:19.057169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.057645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.058437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.058897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.386483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3fd77038-7800-4364-925f-daafcd174c4a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action" status: 204 len: 0 microversion: 2.1 time: 0.341243 Aug 03 05:14:19.387252 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3252/6521] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:14:19 2022] POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:14:19.396925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:19.397568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:19.406464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.406929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.407722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:19.408167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:19.567518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:19.576940 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-09e9a0cd-33e7-43cd-9566-ada92a010db4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1689 microversion: 2.1 time: 0.185419 Aug 03 05:14:19.577624 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3270/6522] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:19 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:20.600982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:20.603855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:20.608079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.608594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.609399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:20.609849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:20.625874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:20.753304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:20.758447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-12db66b0-499f-44d9-b443-6ef6b9f84b7a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1689 microversion: 2.1 time: 0.163074 Aug 03 05:14:20.758991 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3253/6523] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:20 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:21.780634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:21.781257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:21.789457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:21.789920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:21.790703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:21.791147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:21.952258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:21.952258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dcf02a12-b61e-4b38-866c-737362260347 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1681 microversion: 2.1 time: 0.165350 Aug 03 05:14:21.952258 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3271/6524] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:21 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:22.042447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f899930f-cc09-47a3-8c56-7b3f61d8ab24 req-37ddaed5-aac9-4e04-81ef-e684cc888919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "name": "network-vif-plugged", "status": "completed", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:22.052230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f899930f-cc09-47a3-8c56-7b3f61d8ab24 req-37ddaed5-aac9-4e04-81ef-e684cc888919 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:22.052717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f899930f-cc09-47a3-8c56-7b3f61d8ab24 req-37ddaed5-aac9-4e04-81ef-e684cc888919 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:22.063735 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f899930f-cc09-47a3-8c56-7b3f61d8ab24 req-37ddaed5-aac9-4e04-81ef-e684cc888919 service nova] Creating event network-vif-plugged:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h1-826756-5 Aug 03 05:14:22.069377 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f899930f-cc09-47a3-8c56-7b3f61d8ab24 req-37ddaed5-aac9-4e04-81ef-e684cc888919 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105138 Aug 03 05:14:22.069960 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3254/6525] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:28.983271 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:14:28.983882 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:14:42.177242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:42.179833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:42.182597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=30 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:42.183293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=86 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:42.188235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.188943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.189916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:42.190546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:42.245245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c5e62c96-33f5-427e-81d2-0fb2c7d4652d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action" status: 200 len: 24577 microversion: 2.1 time: 0.071850 Aug 03 05:14:42.245898 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3272/6526] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:14:42 2022] POST /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:14:48.644547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:14:48.649055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:48.649778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:48.656386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.656849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.657633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:48.658083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:48.799236 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3db7e1a7-125c-4e33-9f6f-8f8726d89a63 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1832 microversion: 2.1 time: 0.156852 Aug 03 05:14:48.799829 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3255/6527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:48 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1832 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:49.926796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:49.928023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:49.929778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-bed9da88-cd01-4279-b2e2-4422652b2d35 req-1c0edf4f-64a2-4f08-8ff1-c17467526652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:49.942634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bed9da88-cd01-4279-b2e2-4422652b2d35 req-1c0edf4f-64a2-4f08-8ff1-c17467526652 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.943261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bed9da88-cd01-4279-b2e2-4422652b2d35 req-1c0edf4f-64a2-4f08-8ff1-c17467526652 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.950858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.951314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.952107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:49.952576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:49.958140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-bed9da88-cd01-4279-b2e2-4422652b2d35 req-1c0edf4f-64a2-4f08-8ff1-c17467526652 service nova] Creating event network-changed:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h1-826756-5 Aug 03 05:14:49.964598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-bed9da88-cd01-4279-b2e2-4422652b2d35 req-1c0edf4f-64a2-4f08-8ff1-c17467526652 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039885 Aug 03 05:14:49.965878 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3256/6528] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:49.984225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:14:50.409211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f093475-73bc-4731-9a48-44842539d746 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 204 len: 0 microversion: 2.1 time: 0.486466 Aug 03 05:14:50.411351 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3273/6529] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:14:49 2022] DELETE /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:14:50.421258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:50.422314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:50.429838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.430688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.431734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:50.432310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:50.587145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:50.595137 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a39c25a8-02fc-4567-b91f-dd0c30d3a6ee tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1687 microversion: 2.1 time: 0.178401 Aug 03 05:14:50.595722 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3257/6530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:50 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:51.622574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:51.623506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:51.633144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.635966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.635966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:51.635966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:51.866076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:51.866076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-178b2be2-1f3b-4cc0-af9f-0f761738db38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1687 microversion: 2.1 time: 0.244333 Aug 03 05:14:51.866076 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3274/6531] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:51 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1687 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:52.319600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f3fc7967-de0c-4179-8658-afa22a471946 req-c38c6aed-5f3b-41bf-9a5b-8c0d37d78969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e844044a-fe30-4578-b284-d5cf0db2b0b2", "name": "network-vif-deleted", "tag": "5a527829-1750-4b52-b6c7-fd5b5a911ace"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:52.329938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3fc7967-de0c-4179-8658-afa22a471946 req-c38c6aed-5f3b-41bf-9a5b-8c0d37d78969 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.330399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3fc7967-de0c-4179-8658-afa22a471946 req-c38c6aed-5f3b-41bf-9a5b-8c0d37d78969 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.342240 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f3fc7967-de0c-4179-8658-afa22a471946 req-c38c6aed-5f3b-41bf-9a5b-8c0d37d78969 service nova] Creating event network-vif-deleted:5a527829-1750-4b52-b6c7-fd5b5a911ace for instance e844044a-fe30-4578-b284-d5cf0db2b0b2 on n-h1-826756-5 Aug 03 05:14:52.347376 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f3fc7967-de0c-4179-8658-afa22a471946 req-c38c6aed-5f3b-41bf-9a5b-8c0d37d78969 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031640 Aug 03 05:14:52.347973 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3258/6532] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:14:52.882157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:52.882742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:52.890255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.890714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.891741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.892183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.926509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:52.926959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:52.927413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lazy-loading 'fault' on Instance uuid e844044a-fe30-4578-b284-d5cf0db2b0b2 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:14:52.978674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:14:52.981505 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6c5e820-0035-4916-959a-eeef9fba9f61 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 200 len: 1357 microversion: 2.1 time: 0.103813 Aug 03 05:14:52.982088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3275/6533] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:52 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:14:54.005321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:54.006107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: e844044a-fe30-4578-b284-d5cf0db2b0b2] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:14:54.013059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.013535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.014533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:14:54.014823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:14:54.028753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] HTTP exception thrown: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Request method failure captured: Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 HTTP/1.1 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gPSTOtKiEXI_0NhisuynIBgN3s9eIkJ4LOfMKZgfi8uuS0yHI6qv24sjXrt_mJKc9qAw84fXtYPf-GK00vLFYdm2R0BfsvDeulbFSI7bpg7-my27HxSo6JO6EBXgu9n2R-XgWZdIH_KzvGSzAALiQ4thkSQEVHAyIPryj-TiY9c24M Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 08a9665f1cb6470fb2be1b081f6feeb6 Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'e844044a-fe30-4578-b284-d5cf0db2b0b2'} Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.030484 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Returning 404 to user: Instance e844044a-fe30-4578-b284-d5cf0db2b0b2 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f949e206-7bb6-4edb-be5f-76fe80d583f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2" status: 404 len: 111 microversion: 2.1 time: 0.032195 Aug 03 05:14:54.035983 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3259/6534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:14:53 2022] GET /compute/v2.1/servers/e844044a-fe30-4578-b284-d5cf0db2b0b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:14:58.141888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-43f3442d-7e8c-4d91-bfdc-fde004320994 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '.version_select at 0x7fdd47833310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:14:58.256784 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-43f3442d-7e8c-4d91-bfdc-fde004320994 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1848315953" status: 202 len: 0 microversion: 2.1 time: 0.118928 Aug 03 05:14:58.257500 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3276/6535] 10.222.0.72 () {58 vars in 1284 bytes} [Wed Aug 3 05:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1848315953 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:14:58.293587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4211f40c-595d-437d-8739-bf9afdee6ec6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: .version_select at 0x7fdd47f2fd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1619784275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZcBQBoblK52MMg4n6fzqWeAJuSdrmFrTrcYI4zBOIgd+wO9bvRfjlQJWRMyHkihAk2B36WtJ9+S6LRqz93+ZNwCRNtg0RNJL76jyVXqo06k4GlqnId/dRY9A2rRRMEVg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:14:58.311401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4211f40c-595d-437d-8739-bf9afdee6ec6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:14:58.317510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4211f40c-595d-437d-8739-bf9afdee6ec6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:14:58.405391 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4211f40c-595d-437d-8739-bf9afdee6ec6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.117959 Aug 03 05:14:58.406006 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3260/6536] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:14:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:09.417665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:09.418456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:09.426926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-63531399", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "a3be8320-f19d-4772-b4ea-fef4d91865d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1619784275", "security_groups": [{"name": "tempest-secgroup-smoke-1945956662"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:09.542509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] validate_networks() for [('a3be8320-f19d-4772-b4ea-fef4d91865d2', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:15:10.018665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:15:10.019205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:15:10.019833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:15:10.020374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:15:10.021030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:15:10.030960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.031421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.032259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:10.032730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:10.056819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:10.063039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:10.076767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:15:10.079228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:15:10.248929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3d97084-7d11-42df-abc9-59c92554e9c7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832403 Aug 03 05:15:10.250860 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3277/6537] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:15:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:15:10.262987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-baceb52b-bd14-4d12-b13a-92106b75b907 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:10.264542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-baceb52b-bd14-4d12-b13a-92106b75b907 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:10.275339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=23 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:10.276194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:10.277046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:10.330178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-baceb52b-bd14-4d12-b13a-92106b75b907 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:10.337498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-baceb52b-bd14-4d12-b13a-92106b75b907 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1265 microversion: 2.1 time: 0.079269 Aug 03 05:15:10.338162 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3261/6538] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:10 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:11.360739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6666b803-fc2a-4adb-bdd3-e511551aabd8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:11.361384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6666b803-fc2a-4adb-bdd3-e511551aabd8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:11.446806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6666b803-fc2a-4adb-bdd3-e511551aabd8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:11.459345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6666b803-fc2a-4adb-bdd3-e511551aabd8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1265 microversion: 2.1 time: 0.103722 Aug 03 05:15:11.460153 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3278/6539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:11 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:12.486748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:12.498199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:12.502324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.502798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.503767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:12.504288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:12.577893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:12.585868 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25d9d001-1b47-4f2c-bab7-0c77d9915872 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1317 microversion: 2.1 time: 0.105836 Aug 03 05:15:12.586449 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3262/6540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:12 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1317 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:13.615225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:13.615857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:13.625350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.625998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:13.626878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:13.627371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:13.728630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:13.737537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c728183e-b652-44d1-8e32-1b05177c387d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1335 microversion: 2.1 time: 0.126817 Aug 03 05:15:13.752420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3279/6541] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:13 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1335 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:14.759468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:14.760093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:14.767582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:14.768062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:14.768881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:14.769327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:14.920740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:14.929165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a295089-b19f-4884-86cb-2c937154ecf2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.173754 Aug 03 05:15:14.929764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3263/6542] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:14 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:15.781965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ce04ac6f-715b-4298-bc13-5ec61b221175 req-4f392829-74d8-440e-aa58-4a28d9fdd9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:15.793451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ce04ac6f-715b-4298-bc13-5ec61b221175 req-4f392829-74d8-440e-aa58-4a28d9fdd9f9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.793899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ce04ac6f-715b-4298-bc13-5ec61b221175 req-4f392829-74d8-440e-aa58-4a28d9fdd9f9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.813791 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ce04ac6f-715b-4298-bc13-5ec61b221175 req-4f392829-74d8-440e-aa58-4a28d9fdd9f9 service nova] Creating event network-changed:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:15:15.813791 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ce04ac6f-715b-4298-bc13-5ec61b221175 req-4f392829-74d8-440e-aa58-4a28d9fdd9f9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032601 Aug 03 05:15:15.813791 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3280/6543] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:15.951307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:15.952132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:15.959531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.962940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:15.962940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:15.962940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:16.114597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:16.122463 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a69970fe-26b4-4ef8-83a9-e19d1c342d3a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.175039 Aug 03 05:15:16.123233 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3264/6544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:15 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:17.145280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:17.145983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:17.152370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:17.152827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:17.153595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:17.154037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:17.296298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:17.305407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30756a4c-b5b6-4b38-8459-c0d454be3cf7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.164876 Aug 03 05:15:17.306022 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3281/6545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:17 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:18.334545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:18.334545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:18.334545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.335251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.336078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:18.336563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:18.479558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:18.488174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6227c7b8-f886-4d08-a0c0-96e055fe19d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.164909 Aug 03 05:15:18.488803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3265/6546] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:18 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:19.511157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:19.511775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:19.518851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:19.522362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:19.522362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:19.522362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:19.727425 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:19.727425 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4605ddbe-06ed-4fea-93f2-ad1226bfc035 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.177759 Aug 03 05:15:19.727425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3282/6547] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:19 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:20.709506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:20.713140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:20.723431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.724449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.725851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.726499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.859693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0ba38a3a-f7e3-4f00-a728-eedce4687a7d req-1811e371-91d0-49b4-9b84-fd395eeed6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-plugged", "status": "completed", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:20.868058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:20.872044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:20.873692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0ba38a3a-f7e3-4f00-a728-eedce4687a7d req-1811e371-91d0-49b4-9b84-fd395eeed6b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:20.874220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0ba38a3a-f7e3-4f00-a728-eedce4687a7d req-1811e371-91d0-49b4-9b84-fd395eeed6b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:20.881373 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-403ac8da-fcfa-4370-a1f8-b52e697fb00a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.177839 Aug 03 05:15:20.882704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3266/6548] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:20 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:20.887993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0ba38a3a-f7e3-4f00-a728-eedce4687a7d req-1811e371-91d0-49b4-9b84-fd395eeed6b5 service nova] Creating event network-vif-plugged:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:15:20.893463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0ba38a3a-f7e3-4f00-a728-eedce4687a7d req-1811e371-91d0-49b4-9b84-fd395eeed6b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037600 Aug 03 05:15:20.894252 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3283/6549] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:15:21.903727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:21.904378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:21.911385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.911848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:21.912665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:21.913152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:22.052248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:22.062117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe7061e5-5363-4e6e-9289-a71ef82f36f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1391 microversion: 2.1 time: 0.162274 Aug 03 05:15:22.063915 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3267/6550] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:21 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:22.371874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:22.534092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:22.534744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:22.542233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:22.547169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:22.547169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:22.547169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:22.581669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:15:22.987421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1b4c4192-26f0-497e-bfd5-4f8123b9dd3b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 204 len: 0 microversion: 2.1 time: 0.621605 Aug 03 05:15:22.988042 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3284/6551] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:15:22 2022] DELETE /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:15:22.996603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:22.997231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:22.999164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:23.005085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.005550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.006587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.007231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.083697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:23.084552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:23.092765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.093294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.094066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.094684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.167608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.178151 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a078121-dfa3-4c1f-a976-bdfce81fb97d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1576 microversion: 2.1 time: 0.185598 Aug 03 05:15:23.192781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3268/6552] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:22 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:23.269351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.278194 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-52435dbb-26fe-477e-939b-313473a4d75d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1563 microversion: 2.1 time: 0.198770 Aug 03 05:15:23.278799 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3285/6553] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:23 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:23.299991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:23.300688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:23.307510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.308378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.308827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:23.309310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:23.450788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:23.458767 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a87a0cb5-da11-462c-8313-9dc7efcab896 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1563 microversion: 2.1 time: 0.162646 Aug 03 05:15:23.459573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3269/6554] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:23 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:24.201154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:24.201804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:24.209189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.213586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.213586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:24.213586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:24.453154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:24.462454 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c5f319b-ebef-4cdf-b208-1513c43c1356 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1576 microversion: 2.1 time: 0.265651 Aug 03 05:15:24.463438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3286/6555] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:24 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:25.498826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:25.499510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:25.506882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.507378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.508183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:25.509599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:25.625334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:25.634395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e2b5400-57b0-4c3a-8b10-7770924cc2a3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1508 microversion: 2.1 time: 0.153488 Aug 03 05:15:25.635058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3270/6556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:25 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:26.470014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7558a91a-02bf-4025-90ef-738c9aa003db req-a2242ba5-60b7-4e53-8cbf-d2121de225c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ed0671-2b4d-4219-9016-d9a0fc072f84", "name": "network-vif-deleted", "tag": "d6e67c21-d6af-41e3-bdfe-0a2d63c0d862"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:26.493395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7558a91a-02bf-4025-90ef-738c9aa003db req-a2242ba5-60b7-4e53-8cbf-d2121de225c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.498314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7558a91a-02bf-4025-90ef-738c9aa003db req-a2242ba5-60b7-4e53-8cbf-d2121de225c7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.524808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7558a91a-02bf-4025-90ef-738c9aa003db req-a2242ba5-60b7-4e53-8cbf-d2121de225c7 service nova] Creating event network-vif-deleted:d6e67c21-d6af-41e3-bdfe-0a2d63c0d862 for instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 on n-h1-826756-5 Aug 03 05:15:26.534837 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7558a91a-02bf-4025-90ef-738c9aa003db req-a2242ba5-60b7-4e53-8cbf-d2121de225c7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067818 Aug 03 05:15:26.536227 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3287/6557] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:26.656960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:26.657815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:26.665728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.666791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.667190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.667766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.787756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:26.800168 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4069d116-5618-4388-a693-c27ff0f1d7b7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1222 microversion: 2.1 time: 0.147114 Aug 03 05:15:26.806403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:26.806680 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3271/6558] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:26 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:26.808134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:26.827624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.828906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:26.830187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:26.830803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.045974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:27.058384 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fea835ab-cb59-4450-93f6-30eb37e423b3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1563 microversion: 2.1 time: 0.259445 Aug 03 05:15:27.064101 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3288/6559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:26 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:27.827043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:27.827701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:27.837564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.840697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.840697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:27.840697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:27.997155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:28.010951 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-448bfccf-9e41-4629-9931-eae798a6d688 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1222 microversion: 2.1 time: 0.187724 Aug 03 05:15:28.012754 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3272/6560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:27 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:28.554673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-62b26b56-de69-4358-b828-05a1ca074a95 req-0b037eda-eac5-4fa5-95b6-54a322a7ea6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:28.565391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-62b26b56-de69-4358-b828-05a1ca074a95 req-0b037eda-eac5-4fa5-95b6-54a322a7ea6f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:28.565907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-62b26b56-de69-4358-b828-05a1ca074a95 req-0b037eda-eac5-4fa5-95b6-54a322a7ea6f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:28.578054 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-62b26b56-de69-4358-b828-05a1ca074a95 req-0b037eda-eac5-4fa5-95b6-54a322a7ea6f service nova] Creating event network-changed:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:15:28.582899 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-62b26b56-de69-4358-b828-05a1ca074a95 req-0b037eda-eac5-4fa5-95b6-54a322a7ea6f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Aug 03 05:15:28.583491 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3289/6561] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:29.034532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:29.037620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:29.048144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.049013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:29.049917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:29.050431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:29.124756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:29.138687 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e6efdc91-8b83-49ef-a9d9-0f9597300f1c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1222 microversion: 2.1 time: 0.108221 Aug 03 05:15:29.140031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3273/6562] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:29 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:30.162920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:30.164415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:30.171420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:30.171952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:30.172823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:30.173274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:30.253066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:30.261847 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-220b02e3-5e1d-4d28-a05b-5a153bc6bf00 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1222 microversion: 2.1 time: 0.104366 Aug 03 05:15:30.262526 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3290/6563] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:30 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:31.283241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:31.284151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:31.291990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.292593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:31.293556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:31.294026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:31.368445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:31.376742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-562a4748-9eb7-4cda-bb44-f3bd1336ec26 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1222 microversion: 2.1 time: 0.097411 Aug 03 05:15:31.377425 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3274/6564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:31 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:32.398690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:32.399338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:32.406473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:32.406928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.407706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:32.408148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.444688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:32.445451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:32.445920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid c5ed0671-2b4d-4219-9016-d9a0fc072f84 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:15:32.489418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:32.506263 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ccc6c7a-6075-4524-8a3e-6d7dbe602ae6 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 200 len: 1227 microversion: 2.1 time: 0.111584 Aug 03 05:15:32.507779 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3291/6565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:32 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 1227 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:33.529715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:33.530356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:33.537884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.539295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:33.540402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:33.541060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:33.555297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 HTTP/1.1 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c5ed0671-2b4d-4219-9016-d9a0fc072f84'} Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:15:33.556960 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-279ecf0b-c794-4968-a683-cba3d00bc854 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 404 len: 111 microversion: 2.1 time: 0.032735 Aug 03 05:15:33.562615 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3275/6566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:33 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:15:33.618726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-12703877", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225511139", "security_groups": [{"name": "tempest-secgroup-smoke-2135634289"}], "block_device_mapping_v2": [{"uuid": "af7b2b67-f8de-4f1e-9d9f-c63e5e17e5a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:33.738801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:15:34.133337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:15:34.133762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:15:34.134235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:15:34.134642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:15:34.135157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:15:34.144582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:34.149994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:34.149994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:34.149994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:34.164279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:15:34.169897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:15:34.231818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:15:34.233945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af7b2b67-f8de-4f1e-9d9f-c63e5e17e5a2',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:15:34.768138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2eb8c286-bbfa-42f6-9f32-5993bd8f6f48 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.153291 Aug 03 05:15:34.774891 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3292/6567] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:15:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:15:34.780274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19cceb53-1d33-46d0-88d2-203126bbe7eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:34.780990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19cceb53-1d33-46d0-88d2-203126bbe7eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:34.842021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19cceb53-1d33-46d0-88d2-203126bbe7eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:34.858462 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19cceb53-1d33-46d0-88d2-203126bbe7eb tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1092 microversion: 2.1 time: 0.077952 Aug 03 05:15:34.858462 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3276/6568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:34 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1092 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:35.877924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:35.878451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:35.887205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.887669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:35.888511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:35.888963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:35.953465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:35.961672 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1590b81e-e46d-4d1e-9834-cdc174079862 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1142 microversion: 2.1 time: 0.087960 Aug 03 05:15:35.962266 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3293/6569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:35 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:36.983264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:36.983929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:36.990901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:36.991986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:36.992914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:36.993375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:37.055256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:37.062747 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f101732-6737-42f8-9dcf-6367e6eb554f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1190 microversion: 2.1 time: 0.083435 Aug 03 05:15:37.063316 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3277/6570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:36 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1190 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:38.085808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:38.087048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:38.099126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:38.099126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:38.100171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:38.101625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:38.323037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:38.331142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d0f1108-a75a-4fd3-a074-812622b3a714 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1276 microversion: 2.1 time: 0.251778 Aug 03 05:15:38.331786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3294/6571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:38 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1276 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:39.076931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8a807778-1695-4ce2-9aea-a7848ae8ea94 req-de63bbba-cbdc-4613-9462-08c9ad12fe57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ab6d7-ce13-4f9e-8176-0c2b7ffba708", "tag": "59705293-b71e-41dd-899a-8f9fced7f056"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:39.096798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8a807778-1695-4ce2-9aea-a7848ae8ea94 req-de63bbba-cbdc-4613-9462-08c9ad12fe57 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:39.097568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8a807778-1695-4ce2-9aea-a7848ae8ea94 req-de63bbba-cbdc-4613-9462-08c9ad12fe57 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:39.116418 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8a807778-1695-4ce2-9aea-a7848ae8ea94 req-de63bbba-cbdc-4613-9462-08c9ad12fe57 service nova] Creating event network-changed:59705293-b71e-41dd-899a-8f9fced7f056 for instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 on n-h1-826756-5 Aug 03 05:15:39.123623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8a807778-1695-4ce2-9aea-a7848ae8ea94 req-de63bbba-cbdc-4613-9462-08c9ad12fe57 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059078 Aug 03 05:15:39.124253 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3278/6572] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:39.357026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:39.358308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:39.366081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:39.367166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:39.368314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:39.374007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:39.579422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:39.594848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f71fe0e-2a86-4eaa-8857-d85520493f75 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1276 microversion: 2.1 time: 0.235311 Aug 03 05:15:39.610000 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3295/6573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:39 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:40.620679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:40.621624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:40.630061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.630518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.631303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:40.631750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:40.904196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:40.912388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f36ff26c-d084-4fb7-9d16-d51dfc163244 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1276 microversion: 2.1 time: 0.297461 Aug 03 05:15:40.912986 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3279/6574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:40 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:41.933273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:41.933902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:41.944729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:41.946439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:41.948412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:41.949086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:41.974260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:42.128047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:42.139704 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f61e6825-21fe-4830-97e8-6b8666e7c478 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1276 microversion: 2.1 time: 0.210215 Aug 03 05:15:42.152939 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3296/6575] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:41 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:43.161148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:43.161786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:43.169440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.169794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:43.170582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:43.171041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:43.173852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:43.310252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:43.318141 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd33c193-373b-4977-9018-68d48c47d40d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1276 microversion: 2.1 time: 0.161048 Aug 03 05:15:43.320352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3280/6576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:43 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:44.343217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:44.343872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:44.346758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:44.347442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:44.348096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:44.354553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:44.355063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:44.355831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:44.356296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:44.501081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:44.509269 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-976a9468-af66-4451-baa0-0f5da9caedcc tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.170409 Aug 03 05:15:44.509938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3297/6577] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:44 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:45.531788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:45.532542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:45.535880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:45.536660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=45 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:15:45.543264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.587151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:45.587151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:45.587151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:45.683407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:45.691936 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c40ee02-2f20-44a0-9d9a-c887a5db28a7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.164529 Aug 03 05:15:45.692578 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3281/6578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:45 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:46.712669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:46.713325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:46.722991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.727337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.727337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:46.727337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:46.866129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:46.874372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a312dc3-df86-4948-9d15-d70403505719 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.165712 Aug 03 05:15:46.874958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3298/6579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:46 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:47.896314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:47.896880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:47.904090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:47.904594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:47.905503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:47.905986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:48.041441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:48.049367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b719429-ff3e-4c3d-b019-0c22ae30c873 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.158206 Aug 03 05:15:48.049945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3282/6580] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:47 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:49.071487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:49.072120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:49.080317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.080783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.081559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.082015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.222183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:49.230487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fad0b03a-eda0-4a00-910f-a73b09b4f058 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.163375 Aug 03 05:15:49.231104 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3299/6581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:49 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:49.426913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:49.429552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:49.436909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.437301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.438085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:49.438526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:49.490497 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e651436d-0922-4141-9a3b-8c137aaa582c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action" status: 200 len: 24573 microversion: 2.1 time: 0.067286 Aug 03 05:15:49.491184 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3283/6582] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:15:49 2022] POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action => generated 24573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:15:50.251270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:50.251888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:50.259747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:50.260371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:50.261142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:50.261579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:50.399816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:50.407357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71d403ce-0a27-40d3-bb49-e168e9c0b26b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.160506 Aug 03 05:15:50.407972 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3300/6583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:50 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:51.429345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:51.430177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:51.437873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:51.438348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:51.446744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:51.446744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:51.576064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:51.583707 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28a2861b-6996-4e12-b946-6922918197ea tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.158827 Aug 03 05:15:51.584297 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3284/6584] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:51 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:52.607291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:52.608116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:52.615702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.626254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.626254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:52.626254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:52.767090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:52.774600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ffde96f-bfa5-43cd-a057-1e270ca54523 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.172883 Aug 03 05:15:52.775170 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3301/6585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:52 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:53.795213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:53.795854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:53.804318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:53.805095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:53.805935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:53.806398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:53.955296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:53.955296 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-282f2cad-d95e-407f-93e3-2a130889d4e3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.162796 Aug 03 05:15:53.955296 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3285/6586] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:53 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:54.091052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e190bee6-b839-426f-a61e-8153d90dccae req-d55644e1-e66d-41f7-aceb-06499673c00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ab6d7-ce13-4f9e-8176-0c2b7ffba708", "name": "network-vif-plugged", "status": "completed", "tag": "59705293-b71e-41dd-899a-8f9fced7f056"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:54.101604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e190bee6-b839-426f-a61e-8153d90dccae req-d55644e1-e66d-41f7-aceb-06499673c00b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.102053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e190bee6-b839-426f-a61e-8153d90dccae req-d55644e1-e66d-41f7-aceb-06499673c00b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.112978 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e190bee6-b839-426f-a61e-8153d90dccae req-d55644e1-e66d-41f7-aceb-06499673c00b service nova] Creating event network-vif-plugged:59705293-b71e-41dd-899a-8f9fced7f056 for instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 on n-h1-826756-5 Aug 03 05:15:54.118186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e190bee6-b839-426f-a61e-8153d90dccae req-d55644e1-e66d-41f7-aceb-06499673c00b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030977 Aug 03 05:15:54.118791 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3302/6587] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:54.905456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:54.905978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:54.912032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.912531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.913398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.913763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.939535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:15:54.974776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:54.975508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:54.981978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.982916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:54.983395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:54.983846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:55.120772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.128372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3adf1595-f99c-47ed-a3f0-795ba7f9a206 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.157991 Aug 03 05:15:55.128945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3303/6588] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:54 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:55.240004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b84bda8-91cc-4bca-acac-36f75360be2d tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "DELETE /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 204 len: 0 microversion: 2.1 time: 0.458755 Aug 03 05:15:55.240858 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3286/6589] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:15:54 2022] DELETE /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:15:55.249786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:55.250407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:55.256637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:55.258066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:55.258848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:55.259292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:55.393647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:55.401327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-58fc7b18-2e02-4fbf-aa8f-3ac5ea092360 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1731 microversion: 2.1 time: 0.155453 Aug 03 05:15:55.401914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3304/6590] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:55 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:56.151092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:56.151827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:56.159082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.159559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.160375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.160838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.299958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.307433 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-155ca58e-972f-4719-adb0-68c19d435d62 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1264 microversion: 2.1 time: 0.161349 Aug 03 05:15:56.307997 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3287/6591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:56 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:56.422362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:56.422979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:56.430078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.430546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.431418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:56.431870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:56.572672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:56.580786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a0dde3a4-9834-44e5-a6a1-51cdc6b23a6b tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1731 microversion: 2.1 time: 0.162276 Aug 03 05:15:56.582000 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3305/6592] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:56 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:57.332682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:57.332682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:57.337473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.337941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.338740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.339195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.547214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:57.555765 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba57053c-a9c3-4d90-9fe2-bca5d3a61f92 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1451 microversion: 2.1 time: 0.230627 Aug 03 05:15:57.556490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3288/6593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:57 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:57.576365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:57.577035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:57.584361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.584905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.585928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.586542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.603682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:57.604346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:57.611069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.611536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.612379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:57.612873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:57.803857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:57.811867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3568c14b-a80d-4d92-87b3-9dfea0b47333 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1451 microversion: 2.1 time: 0.239614 Aug 03 05:15:57.814860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:57.823007 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fa580ca4-7510-41ba-805f-457271eb77c1 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1731 microversion: 2.1 time: 0.223860 Aug 03 05:15:57.823776 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3289/6594] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:57 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:15:57.824749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3306/6595] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:57 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1451 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:58.126781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7ff25cf1-6960-4000-8ce0-e026906349a7 req-c501b5e2-fcf1-4488-9fd6-0cc98f94e8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e91b73-6786-4a0c-9ef6-9e967d334ea8", "name": "network-vif-deleted", "tag": "655a171e-ea9c-4015-b359-e2367f597d84"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:58.139629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7ff25cf1-6960-4000-8ce0-e026906349a7 req-c501b5e2-fcf1-4488-9fd6-0cc98f94e8c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.140183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7ff25cf1-6960-4000-8ce0-e026906349a7 req-c501b5e2-fcf1-4488-9fd6-0cc98f94e8c2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.151752 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7ff25cf1-6960-4000-8ce0-e026906349a7 req-c501b5e2-fcf1-4488-9fd6-0cc98f94e8c2 service nova] Creating event network-vif-deleted:655a171e-ea9c-4015-b359-e2367f597d84 for instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 on n-h1-826756-5 Aug 03 05:15:58.157622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7ff25cf1-6960-4000-8ce0-e026906349a7 req-c501b5e2-fcf1-4488-9fd6-0cc98f94e8c2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040434 Aug 03 05:15:58.158695 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3290/6596] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:15:58.846282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:58.846902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:58.854759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.855222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.856034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.856503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.892847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:58.893310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:58.893938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lazy-loading 'fault' on Instance uuid 45e91b73-6786-4a0c-9ef6-9e967d334ea8 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:15:58.948383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23b72214cec54bb2abbc9b34a4908502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55144e334ce14b51b1fdfaae634a8da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:15:58.956376 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d09c6e1-4986-4237-95fe-8050f0a276ae tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 200 len: 1388 microversion: 2.1 time: 0.113952 Aug 03 05:15:58.956977 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3307/6597] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:58 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 1388 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:15:59.971808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e3486381-adac-4597-8b38-3945924db135 req-16b612e5-4d0e-4c2c-a4dd-52186293f358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ab6d7-ce13-4f9e-8176-0c2b7ffba708", "tag": "59705293-b71e-41dd-899a-8f9fced7f056"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:15:59.979074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:15:59.979992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:15:59.986497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e3486381-adac-4597-8b38-3945924db135 req-16b612e5-4d0e-4c2c-a4dd-52186293f358 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.987066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e3486381-adac-4597-8b38-3945924db135 req-16b612e5-4d0e-4c2c-a4dd-52186293f358 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.988996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.989567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:15:59.990491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:15:59.991011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:00.001031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e3486381-adac-4597-8b38-3945924db135 req-16b612e5-4d0e-4c2c-a4dd-52186293f358 service nova] Creating event network-changed:59705293-b71e-41dd-899a-8f9fced7f056 for instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 on n-h1-826756-5 Aug 03 05:16:00.006285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e3486381-adac-4597-8b38-3945924db135 req-16b612e5-4d0e-4c2c-a4dd-52186293f358 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038686 Aug 03 05:16:00.006703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] HTTP exception thrown: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:00.007302 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3291/6598] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Request method failure captured: Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 HTTP/1.1 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gNEVsUlhUrBrIHt3T_gO_3daFjIJnIv8JHcVHb_1HeKJD0yi3va4ga3ANT1vGKGh2gS7v74q55ovscBMkgGUgjk6OOy1LsM_LrhfUr51PqwGN-N7CZjcjsJGoZ1OQU2v3vXqGdngDqRUEHtX5G7qhTQqtm8D94GE3hr_UJYPg1Qe-4 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestServerBasicOps-24513665 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 23b72214cec54bb2abbc9b34a4908502 Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '45e91b73-6786-4a0c-9ef6-9e967d334ea8'} Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:00.009067 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:00.013838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:16:00.015781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Returning 404 to user: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:16:00.016957 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c02c819a-7f94-482f-9e19-be1f2e471bb2 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 404 len: 111 microversion: 2.1 time: 0.042889 Aug 03 05:16:00.017625 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3308/6599] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:15:59 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:16:00.577985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:00.578966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:00.591288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:00.595217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:00.599217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:00.599930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:00.828026 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2968580d-882b-4f07-8f9f-3d400fbad58b tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1833 microversion: 2.1 time: 0.254019 Aug 03 05:16:00.829466 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3292/6600] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:00 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1833 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:00.852529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:00.853589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:00.861487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:00.949476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:00.949476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:00.949476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.020645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:01.029932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08700ca1-dd08-4349-9fa4-0ef9de97959c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1682 microversion: 2.1 time: 0.182392 Aug 03 05:16:01.030697 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3309/6601] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:00 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:01.184053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:01.186454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:01.193605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.194070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.195466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.195929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.255551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48a83cb7-6da4-4ead-85bf-ea991e489358 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action" status: 200 len: 32637 microversion: 2.1 time: 0.075743 Aug 03 05:16:01.256466 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3293/6602] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:01 2022] POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action => generated 32637 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:16:01.436767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:01.441657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:01.445943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.446705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.447930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.448663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.497867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:01.498716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:01.507650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.508671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.509683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.510341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.528854 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] HTTP exception thrown: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Request method failure captured: Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 HTTP/1.1 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gNEVsUlhUrBrIHt3T_gO_3daFjIJnIv8JHcVHb_1HeKJD0yi3va4ga3ANT1vGKGh2gS7v74q55ovscBMkgGUgjk6OOy1LsM_LrhfUr51PqwGN-N7CZjcjsJGoZ1OQU2v3vXqGdngDqRUEHtX5G7qhTQqtm8D94GE3hr_UJYPg1Qe-4 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 23b72214cec54bb2abbc9b34a4908502 Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '45e91b73-6786-4a0c-9ef6-9e967d334ea8'} Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:16:01.530682 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Returning 404 to user: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:16:01.535489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae7180c4-2ad0-4c98-b153-262e7f263955 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "DELETE /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 404 len: 111 microversion: 2.1 time: 0.041303 Aug 03 05:16:01.537454 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3294/6603] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:16:01 2022] DELETE /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:16:01.544778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:01.545489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] [instance: 45e91b73-6786-4a0c-9ef6-9e967d334ea8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:01.552640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.553871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.555597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:01.556248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:01.571085 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] HTTP exception thrown: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Request method failure captured: Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 HTTP/1.1 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gNEVsUlhUrBrIHt3T_gO_3daFjIJnIv8JHcVHb_1HeKJD0yi3va4ga3ANT1vGKGh2gS7v74q55ovscBMkgGUgjk6OOy1LsM_LrhfUr51PqwGN-N7CZjcjsJGoZ1OQU2v3vXqGdngDqRUEHtX5G7qhTQqtm8D94GE3hr_UJYPg1Qe-4 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/55144e334ce14b51b1fdfaae634a8da3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 55144e334ce14b51b1fdfaae634a8da3 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestServerBasicOps-24513665 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 23b72214cec54bb2abbc9b34a4908502 Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestServerBasicOps-24513665-project Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '45e91b73-6786-4a0c-9ef6-9e967d334ea8'} Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:16:01.573056 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Returning 404 to user: Instance 45e91b73-6786-4a0c-9ef6-9e967d334ea8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:16:01.577579 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-288c4dd3-c72f-48b4-ac81-0bc9150e6526 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8" status: 404 len: 111 microversion: 2.1 time: 0.034900 Aug 03 05:16:01.578994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3295/6604] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:01 2022] GET /compute/v2.1/servers/45e91b73-6786-4a0c-9ef6-9e967d334ea8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:16:01.621417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ff7d21fcfa0444a3abbb6648a4aaa0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b123e5d3a64543b2873f7d97a255d73b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:01.625684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] flavor_id is None. Assuming migration. {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 03 05:16:01.625684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:16:01.839300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3175095-5cf4-46dd-9d5e-c47ace2a31f4 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] Calling method '.version_select at 0x7fdd473a6940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:01.954892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3175095-5cf4-46dd-9d5e-c47ace2a31f4 tempest-TestServerBasicOps-24513665 tempest-TestServerBasicOps-24513665-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-475023955" status: 202 len: 0 microversion: 2.1 time: 0.120168 Aug 03 05:16:01.963555 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3296/6605] 10.222.0.72 () {58 vars in 1251 bytes} [Wed Aug 3 05:16:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-475023955 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:02.206269 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4bb955a-5ac3-4070-ae84-6ef514ffa15f tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action" status: 202 len: 0 microversion: 2.1 time: 0.775214 Aug 03 05:16:02.208251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3310/6606] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:01 2022] POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:02.216714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:02.217916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:02.238089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:02.238755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:02.240014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:02.240684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:02.449931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:02.463408 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e109d32e-da2a-4bff-ad70-3e761f13d149 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1691 microversion: 2.1 time: 0.250274 Aug 03 05:16:02.476614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3297/6607] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:02 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:03.489851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:03.491312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:03.500388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.500844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.502013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:03.502460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:03.737897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:03.770291 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f69a070-5686-4bfc-a39b-68a774d63942 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1691 microversion: 2.1 time: 0.285003 Aug 03 05:16:03.789801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3311/6608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:03 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1691 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:04.798414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:04.799064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:04.817185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.821126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:04.823043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:04.823702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:05.037953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:05.046343 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b983411c-15b6-40f3-a26d-30cea040ec79 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1691 microversion: 2.1 time: 0.254147 Aug 03 05:16:05.047465 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3298/6609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:04 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:06.069064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:06.069740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:06.077809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.078279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.079057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:06.079509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:06.114471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:06.393776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:06.402770 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6e8e653-b620-4661-9b4d-d01bc790538e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.337528 Aug 03 05:16:06.403626 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3312/6610] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:06 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:07.434848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:07.435477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:07.443543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.444013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.444962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:07.445467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:07.463211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:07.606828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:07.622888 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c854ac82-4917-49a1-a630-213d43389952 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.193332 Aug 03 05:16:07.624785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3299/6611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:07 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:08.646242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:08.647579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:08.655242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:08.656056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:08.657098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:08.657788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:08.822429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:08.829977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3462749d-5418-46f4-8adc-009d7183f3dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.187613 Aug 03 05:16:08.830557 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3313/6612] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:08 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:09.852718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:09.853441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:09.861956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:09.862463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:09.863339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:09.863996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:10.017021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:10.025694 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-66b5a8e7-67c1-42bf-838d-ec95de8c6dba tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.177526 Aug 03 05:16:10.026270 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3300/6613] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:09 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:11.048491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:11.049135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:11.058493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.058965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.059817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:11.060346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:11.199490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:11.208434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-11542dd1-f6b1-418c-9a57-8aa1570ce0cd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.163927 Aug 03 05:16:11.209902 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3314/6614] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:11 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:12.231622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:12.232358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:12.239572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.239978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.240800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:12.241263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:12.409140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:12.417653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8df8a23a-2aca-44d3-b2e9-c833bf7f74cc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.191491 Aug 03 05:16:12.424634 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3301/6615] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:12 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:13.439663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:13.450627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:13.450627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.450627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.450627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:13.450627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:13.597681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:13.607835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1e0e52b-a695-4c20-9aec-f968a5446fdd tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.172056 Aug 03 05:16:13.622439 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3315/6616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:13 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:14.630984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:14.631683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:14.639724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.640139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.640963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:14.641432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:14.794909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:14.803672 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c84419f1-03c9-470f-999e-17e31a2b08c4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.176501 Aug 03 05:16:14.804600 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3302/6617] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:14 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:15.827758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:15.828442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:15.835578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.836398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.837220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:15.837716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:15.981886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:15.989616 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f32b1af0-945c-4357-b3a4-f71e493b6ea9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.166365 Aug 03 05:16:15.990212 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3316/6618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:15 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:17.012808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:17.013440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:17.020601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.021067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.021849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:17.022304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:17.422261 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:17.430398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a38fe72f-aa59-48ca-b96e-e779b8d478ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1696 microversion: 2.1 time: 0.421857 Aug 03 05:16:17.431015 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3303/6619] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:17 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1696 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:18.452768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:18.453402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:18.459973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.460499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.461353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:18.461797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:18.647989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:18.657148 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3300956a-f561-4bab-b087-8b92d9f0a5b5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1695 microversion: 2.1 time: 0.208409 Aug 03 05:16:18.657847 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3317/6620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:18 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1695 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:19.035673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-unplugged", "status": "completed", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:19.042266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:19.048703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.048947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.071375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] Creating event network-vif-unplugged:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h1-826756-5 Aug 03 05:16:19.076738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] Instance 231d69c1-d500-4079-a139-c24ff2afef67 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:16:19.088492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e145763f-8c06-4f91-b038-c29a9e1d8732 req-0d575bf6-44ed-472b-a90a-34357329aa52 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056915 Aug 03 05:16:19.089328 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3304/6621] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:19.679612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:19.680374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:19.687463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.687920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.688728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:19.690144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:19.918971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:19.927974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61d312a8-7b75-4901-8fd4-db01608d0791 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1695 microversion: 2.1 time: 0.252747 Aug 03 05:16:19.936181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3318/6622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:19 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1695 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:20.952654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:20.953401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:20.960165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.961288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:20.962066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:20.962516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.104881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:21.107763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:21.115361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=48 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:21.115807 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3550017-9ba0-4216-ba98-aac68644a345 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1693 microversion: 2.1 time: 0.168229 Aug 03 05:16:21.120575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:21.121151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:21.126839 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3305/6623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:20 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:21.138040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] Creating event network-changed:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h1-826756-5 Aug 03 05:16:21.143636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] Instance 231d69c1-d500-4079-a139-c24ff2afef67 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:16:21.154783 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-583b7a9f-5a9d-40a4-94ad-af4d0b03756c req-dc376be2-ee2e-4323-a8b4-e1a713a164c5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054773 Aug 03 05:16:21.155393 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3319/6624] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:22.146757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:22.147387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:22.177417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.179995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.179995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:22.179995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:22.395405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:22.405246 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f966346f-5344-4ae0-9372-d50ca83f4648 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1693 microversion: 2.1 time: 0.262830 Aug 03 05:16:22.406056 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3306/6625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:22 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1693 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:23.428700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:23.430058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.436980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.437464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.438305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.438754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.573917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:23.581929 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1005b2dd-7a56-41be-ba3e-1f60ba844e0d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1690 microversion: 2.1 time: 0.158555 Aug 03 05:16:23.582680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3320/6626] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:23.606725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:23.608241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:23.614162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.614632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.615428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:23.615877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:23.990775 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8e633d77-60f3-4865-aa7e-71562066f8a7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action" status: 202 len: 0 microversion: 2.1 time: 0.387530 Aug 03 05:16:23.992031 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3307/6627] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:23 2022] POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:16:24.002004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:24.003009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:24.013979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.015115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.016722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.017460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.250906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-plugged", "status": "completed", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:24.263266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:24.263734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:24.276139 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] Creating event network-vif-plugged:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h1-826756-5 Aug 03 05:16:24.281879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] Instance 231d69c1-d500-4079-a139-c24ff2afef67 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:16:24.294552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b45e5e51-1bc7-44e4-aeb3-607b95cc2908 req-48c3ecfd-74d0-442e-a470-45f6bd96791f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048120 Aug 03 05:16:24.295204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3308/6628] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:24.299719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:24.309095 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-feb86f92-7f65-4d6a-9cf6-411edb750fc2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.312068 Aug 03 05:16:24.314853 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3321/6629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:23 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:16:25.332484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:25.333205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:25.340543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.341013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.341798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:25.342251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:25.486255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:25.495239 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24b8cab2-4468-4e7e-a71f-8e8240670f5e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.167087 Aug 03 05:16:25.498177 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3309/6630] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:25 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:26.516721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:26.517343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:26.525259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.525717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.526569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:26.527023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:26.741019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:26.748893 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fd560e1-b863-4b13-91bc-28bb840cdaeb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.236108 Aug 03 05:16:26.749484 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3322/6631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:26 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:27.771321 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:27.771994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:27.780464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.780937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:27.781813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:27.782270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.287366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:28.297047 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00467785-5345-4955-a7a5-921d79f853f6 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.529624 Aug 03 05:16:28.313817 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3310/6632] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:27 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:28.394145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-unplugged", "status": "completed", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:28.405523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:28.405982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:28.419809 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] Creating event network-vif-unplugged:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:16:28.427016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] Instance 231d69c1-d500-4079-a139-c24ff2afef67 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:16:28.440991 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-35e739a7-727a-4d1d-9f19-45f04a027a07 req-2f29b84c-cd6d-43a9-9db7-d3efa94e8c08 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128147 Aug 03 05:16:28.442007 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3323/6633] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:16:29.321040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:29.322364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:29.329842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.330341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.331196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:29.331641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:29.479779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:29.487841 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da3eb44e-e46d-4383-9225-4330b07376ec tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.171190 Aug 03 05:16:29.488801 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3311/6634] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:29 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:30.457562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:30.470750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.471210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.484682 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] Creating event network-changed:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:16:30.490154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] Instance 231d69c1-d500-4079-a139-c24ff2afef67 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:16:30.504375 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-413c1afb-cd37-4ef2-9faf-f5362d032a6b req-529c88e5-5a2b-4f08-8da0-160bebda16cc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049818 Aug 03 05:16:30.504375 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3324/6635] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:30.512603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:30.513609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:30.522112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.523517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.524581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:30.525112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:30.744238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:30.751836 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93bac0f2-a7bc-453e-96f3-ee14ebcd74ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.246131 Aug 03 05:16:30.752654 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3312/6636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:30 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:31.774954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:31.775731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:31.783367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.783846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.784657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:31.785265 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:31.952357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:31.960605 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e134295b-c9c7-494f-8b7d-dac7e30eedb4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1689 microversion: 2.1 time: 0.191588 Aug 03 05:16:31.961309 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3325/6637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:31 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:32.983292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:16:32.983926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:32.991305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.991815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:32.992714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:32.993174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.138453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:16:33.146158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93128317-2e43-4351-beee-4e9efae7b80c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1682 microversion: 2.1 time: 0.166870 Aug 03 05:16:33.146725 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3313/6638] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:16:32 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:16:33.311116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-005de0f0-a10e-4b9d-bfeb-803c5998de10 req-a9733ccd-9a22-4da2-baad-913c166749a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-plugged", "status": "completed", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:33.322638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-005de0f0-a10e-4b9d-bfeb-803c5998de10 req-a9733ccd-9a22-4da2-baad-913c166749a4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:33.323098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-005de0f0-a10e-4b9d-bfeb-803c5998de10 req-a9733ccd-9a22-4da2-baad-913c166749a4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:33.334049 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-005de0f0-a10e-4b9d-bfeb-803c5998de10 req-a9733ccd-9a22-4da2-baad-913c166749a4 service nova] Creating event network-vif-plugged:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:16:33.339758 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-005de0f0-a10e-4b9d-bfeb-803c5998de10 req-a9733ccd-9a22-4da2-baad-913c166749a4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034366 Aug 03 05:16:33.340960 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3326/6639] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:16:57.410923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:16:57.413182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:16:57.415476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=23 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:57.416166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:16:57.420988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:57.427348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:57.427348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:16:57.427348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:16:57.479300 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76ec2cd9-d069-4d74-a982-5bb1fe8409ac tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action" status: 200 len: 63232 microversion: 2.1 time: 0.072452 Aug 03 05:16:57.479948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3314/6640] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:16:57 2022] POST /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67/action => generated 63232 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:17:03.676072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=15 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:03.676891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=76 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:03.681073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:03.681862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:03.688018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:03.688503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:03.689298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:03.689781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:03.826662 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81db7ac4-2d2f-49ae-b161-6c70c8f8f572 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1833 microversion: 2.1 time: 0.152662 Aug 03 05:17:03.827257 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3327/6641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:03 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1833 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:04.953861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:04.953861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:04.955232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-d8b44163-66f9-4a75-a180-c274d4069b2f req-f7e029ac-835d-487c-ade9-c18f817c2fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:04.956455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:04.956787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8b44163-66f9-4a75-a180-c274d4069b2f req-f7e029ac-835d-487c-ade9-c18f817c2fbb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:04.957096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:04.957317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-d8b44163-66f9-4a75-a180-c274d4069b2f req-f7e029ac-835d-487c-ade9-c18f817c2fbb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:04.957523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:04.957523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:04.958053 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-d8b44163-66f9-4a75-a180-c274d4069b2f req-f7e029ac-835d-487c-ade9-c18f817c2fbb service nova] Creating event network-changed:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:17:04.958053 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-d8b44163-66f9-4a75-a180-c274d4069b2f req-f7e029ac-835d-487c-ade9-c18f817c2fbb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040468 Aug 03 05:17:04.958053 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3328/6642] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:04.958448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:17:05.259914 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14053b0a-2053-4a9e-96d1-049f488e6484 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 204 len: 0 microversion: 2.1 time: 0.438204 Aug 03 05:17:05.260577 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3315/6643] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:17:04 2022] DELETE /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:17:05.269859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:05.270563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:05.277125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:05.277580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:05.278531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:05.278969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:05.426146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:05.438249 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1964dfbc-877e-4c6f-a25d-d72e35c99c03 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1688 microversion: 2.1 time: 0.172664 Aug 03 05:17:05.439034 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3329/6644] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:05 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:06.461839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:06.462576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:06.470863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:06.471400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:06.472232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:06.472725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:06.633930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:06.643862 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84c0a6bb-88b4-4254-b665-5427e44c6f72 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1688 microversion: 2.1 time: 0.187027 Aug 03 05:17:06.656756 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3316/6645] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:06 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:07.477317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4cfac670-2471-45ed-abca-111f0bb91656 req-097cd7e5-5def-4e65-803a-b694036b4d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231d69c1-d500-4079-a139-c24ff2afef67", "name": "network-vif-deleted", "tag": "d9dad7d5-428d-47bd-a51d-cd6b126bb4ac"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:07.487738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4cfac670-2471-45ed-abca-111f0bb91656 req-097cd7e5-5def-4e65-803a-b694036b4d5c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:07.488385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4cfac670-2471-45ed-abca-111f0bb91656 req-097cd7e5-5def-4e65-803a-b694036b4d5c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:07.501343 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4cfac670-2471-45ed-abca-111f0bb91656 req-097cd7e5-5def-4e65-803a-b694036b4d5c service nova] Creating event network-vif-deleted:d9dad7d5-428d-47bd-a51d-cd6b126bb4ac for instance 231d69c1-d500-4079-a139-c24ff2afef67 on n-h2-826756-5 Aug 03 05:17:07.513692 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4cfac670-2471-45ed-abca-111f0bb91656 req-097cd7e5-5def-4e65-803a-b694036b4d5c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040396 Aug 03 05:17:07.514394 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3330/6646] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:07.667770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:07.668536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:07.675773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:07.681494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:07.681494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:07.681494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:07.750254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:07.750903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a4debf1-4a44-4dda-ad4d-d94dcd960f73 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1350 microversion: 2.1 time: 0.087555 Aug 03 05:17:07.751511 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3317/6647] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:07 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:08.778355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:08.779217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:08.786563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:08.787264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:08.788320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:08.788948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:08.823082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:08.823543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:08.824012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lazy-loading 'fault' on Instance uuid 231d69c1-d500-4079-a139-c24ff2afef67 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:17:08.867976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:08.875218 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-deb857c4-6b83-4e41-8dd4-62ba321a4159 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 200 len: 1355 microversion: 2.1 time: 0.105541 Aug 03 05:17:08.875806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3331/6648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:08 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:09.898848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:09.899524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 231d69c1-d500-4079-a139-c24ff2afef67] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:09.910622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:09.911336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:09.912320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:09.912859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:09.928648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] HTTP exception thrown: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Request method failure captured: Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 HTTP/1.1 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gPSTOtKiEXI_0NhisuynIBgN3s9eIkJ4LOfMKZgfi8uuS0yHI6qv24sjXrt_mJKc9qAw84fXtYPf-GK00vLFYdm2R0BfsvDeulbFSI7bpg7-my27HxSo6JO6EBXgu9n2R-XgWZdIH_KzvGSzAALiQ4thkSQEVHAyIPryj-TiY9c24M Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 08a9665f1cb6470fb2be1b081f6feeb6 Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '231d69c1-d500-4079-a139-c24ff2afef67'} Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:17:09.930926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Returning 404 to user: Instance 231d69c1-d500-4079-a139-c24ff2afef67 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ffba86f4-0b03-448b-be1e-5742c9335e88 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67" status: 404 len: 111 microversion: 2.1 time: 0.038393 Aug 03 05:17:09.940314 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3318/6649] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:09 2022] GET /compute/v2.1/servers/231d69c1-d500-4079-a139-c24ff2afef67 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:17:14.686784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55022b92-758e-4555-bed7-933e4de521c2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '.version_select at 0x7fdd5473e4c0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:14.802703 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55022b92-758e-4555-bed7-933e4de521c2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619784275" status: 202 len: 0 microversion: 2.1 time: 0.119632 Aug 03 05:17:14.803178 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3332/6650] 10.222.0.72 () {58 vars in 1284 bytes} [Wed Aug 3 05:17:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1619784275 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:17:14.844779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c20b8bc1-1997-4239-898d-783f5d5c8194 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: .version_select at 0x7fdd47f2fc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-157848050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOASA9cXus5KZB7b6oLAawMYc8qho82tfUX9Rszle36BPdWWRqle/UKyiZTBu94tw5l7g7wNZNZrjflgyBxMTTCa000sOun9F3WRmSNHvAruqt1D7tJxyu6udAViH6IZ8A=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:14.863737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c20b8bc1-1997-4239-898d-783f5d5c8194 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:14.870631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c20b8bc1-1997-4239-898d-783f5d5c8194 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:14.986111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c20b8bc1-1997-4239-898d-783f5d5c8194 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.145845 Aug 03 05:17:14.986737 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3319/6651] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:17:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:25.100182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=24 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:25.101386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:25.106083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-73604819", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "567da013-720e-4d6a-94ab-6e40882d7845"}], "key_name": "tempest-TestNetworkAdvancedServerOps-157848050", "security_groups": [{"name": "tempest-secgroup-smoke-1268791578"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:25.245163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] validate_networks() for [('567da013-720e-4d6a-94ab-6e40882d7845', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:17:25.867245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:17:25.867958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:17:25.868709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:17:25.869496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:17:25.870156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:17:25.887879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:25.888784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:25.896928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:25.896928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:25.934374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:17:25.941705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:17:25.966381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:17:25.969555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:17:26.135220 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-800fef8e-2f12-4d87-a48c-96a396b7a815 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.034499 Aug 03 05:17:26.135955 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3333/6652] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:17:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:17:26.151454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20c2b5db-d35d-4cd2-8e16-963848e52b8d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:26.154590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-20c2b5db-d35d-4cd2-8e16-963848e52b8d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:26.161254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:26.163642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:26.165755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:26.252968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20c2b5db-d35d-4cd2-8e16-963848e52b8d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:26.265505 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20c2b5db-d35d-4cd2-8e16-963848e52b8d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1264 microversion: 2.1 time: 0.121999 Aug 03 05:17:26.266823 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3320/6653] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:26 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1264 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:27.287322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:27.290671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:27.302545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.303002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.303990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:27.304298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:27.373988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:27.384399 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26d823f8-4564-4904-9edd-2543dea0c27d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1268 microversion: 2.1 time: 0.100510 Aug 03 05:17:27.388925 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3334/6654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:27 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1268 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:28.409438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:28.410340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:28.419775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:28.420239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:28.421108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:28.421606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:28.488471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:28.498135 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8eb6024-ad09-4540-9995-e0c38f690593 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.092865 Aug 03 05:17:28.500689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3321/6655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:28 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1316 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:29.532251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:29.532947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:29.545928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:29.546666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:29.548159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:29.548926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:29.778616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:29.793395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-929363ad-605b-4ee0-b621-f3651528e8ff tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.269256 Aug 03 05:17:29.807865 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3335/6656] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:29 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:30.661087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b405c407-e346-4ed7-9da4-9844e41bd7d8 req-53b53a34-56db-4085-befd-0ecfee49258e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:30.675785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b405c407-e346-4ed7-9da4-9844e41bd7d8 req-53b53a34-56db-4085-befd-0ecfee49258e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:30.676808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b405c407-e346-4ed7-9da4-9844e41bd7d8 req-53b53a34-56db-4085-befd-0ecfee49258e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:30.694262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b405c407-e346-4ed7-9da4-9844e41bd7d8 req-53b53a34-56db-4085-befd-0ecfee49258e service nova] Creating event network-changed:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h2-826756-5 Aug 03 05:17:30.702060 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b405c407-e346-4ed7-9da4-9844e41bd7d8 req-53b53a34-56db-4085-befd-0ecfee49258e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047626 Aug 03 05:17:30.703242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3322/6657] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:30.817217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:30.818574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:30.825644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:30.826220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:30.826998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:30.827653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:30.979450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:30.990933 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b42e9396-0fd3-4980-8891-67e4ef0a5489 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.178163 Aug 03 05:17:30.993870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3336/6658] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:30 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:32.016152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:32.017052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:32.024754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:32.025225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:32.026013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:32.026469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:32.168976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:32.176877 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd91b8b1-f722-4182-b309-9c7cfb7fbf91 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.165830 Aug 03 05:17:32.177475 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3323/6659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:32 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:33.199277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:33.200035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:33.207375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:33.211350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:33.211350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:33.211350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:33.351936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:33.359901 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ae43368-9ee2-454b-a568-d4743bdda81c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.165308 Aug 03 05:17:33.360530 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3337/6660] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:33 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:34.381109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:34.382293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:34.390558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:34.390907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:34.391707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:34.392164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:34.527700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:34.537963 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3d99945-3db7-4518-92f0-165fccafcd50 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.160781 Aug 03 05:17:34.538589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3324/6661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:34 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:35.559949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:35.560626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:35.568599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:35.569055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:35.570168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:35.570718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:35.720490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d64799c4-b494-465d-99e5-2b5da0ad2b84 req-c148e638-b6dd-4aac-be4b-52f5ac9a1cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "name": "network-vif-plugged", "status": "completed", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:35.732206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d64799c4-b494-465d-99e5-2b5da0ad2b84 req-c148e638-b6dd-4aac-be4b-52f5ac9a1cab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:35.732206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d64799c4-b494-465d-99e5-2b5da0ad2b84 req-c148e638-b6dd-4aac-be4b-52f5ac9a1cab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:35.741785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:35.747490 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d64799c4-b494-465d-99e5-2b5da0ad2b84 req-c148e638-b6dd-4aac-be4b-52f5ac9a1cab service nova] Creating event network-vif-plugged:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h2-826756-5 Aug 03 05:17:35.752788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d64799c4-b494-465d-99e5-2b5da0ad2b84 req-c148e638-b6dd-4aac-be4b-52f5ac9a1cab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049398 Aug 03 05:17:35.753599 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6878c177-c909-432b-b949-1756b81434ed tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.196506 Aug 03 05:17:35.753806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3325/6662] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:35.754195 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3338/6663] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:35 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:36.778329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:36.779055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:36.785415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.785884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:36.786661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:36.787122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:36.930147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:36.939422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-26fbacfa-9b4d-4bd4-a04e-e22df6c2ec46 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1390 microversion: 2.1 time: 0.167084 Aug 03 05:17:36.940092 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3326/6664] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:36 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:37.966780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:37.967497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:37.969554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:37.970192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:37.975780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:37.976684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:37.977423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:37.977960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:38.118730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:38.119696 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-543e315b-9b85-4dc7-a8d1-6598a168f023 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1562 microversion: 2.1 time: 0.156846 Aug 03 05:17:38.120294 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3339/6665] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:37 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:38.141041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:38.141772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:38.149786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:38.150250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:38.151024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:38.151477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:38.292946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:38.300468 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ad880ab6-e284-4557-bae8-e923a15c4bdc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1562 microversion: 2.1 time: 0.163528 Aug 03 05:17:38.301037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3327/6666] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:38 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:17:40.745719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:17:40.746784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:17:40.754528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f581baf2-115c-478f-944e-c460ca010c23 req-35b1651d-6fca-42a0-9a03-2be14836ebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:17:40.762119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:17:40.768738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.773492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f581baf2-115c-478f-944e-c460ca010c23 req-35b1651d-6fca-42a0-9a03-2be14836ebd4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.774385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.775363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:17:40.776064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.779690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f581baf2-115c-478f-944e-c460ca010c23 req-35b1651d-6fca-42a0-9a03-2be14836ebd4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:17:40.804756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f581baf2-115c-478f-944e-c460ca010c23 req-35b1651d-6fca-42a0-9a03-2be14836ebd4 service nova] Creating event network-changed:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h2-826756-5 Aug 03 05:17:40.810293 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f581baf2-115c-478f-944e-c460ca010c23 req-35b1651d-6fca-42a0-9a03-2be14836ebd4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059587 Aug 03 05:17:40.810933 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3328/6667] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:17:40.929185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:17:40.937536 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08a11c69-227b-4a8c-9bff-cc6933ca87dc tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1562 microversion: 2.1 time: 0.199007 Aug 03 05:17:40.941918 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3340/6668] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:17:40 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1562 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:04.246165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=20 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:04.246898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=36 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:04.425044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:04.427412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:04.435524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:04.436101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:04.437287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:04.437829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:04.495460 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bfcc7e53-de1a-4e56-8f26-232cdd98ed74 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action" status: 200 len: 24562 microversion: 2.1 time: 0.251239 Aug 03 05:18:04.496591 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3329/6669] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:18:04 2022] POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action => generated 24562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:18:15.519612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:15.521136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:15.529057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:15.530355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=44 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:15.532043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.532765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:15.537835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.537835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:15.693340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:15.702780 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ce8e7a1-abc0-47c4-81b0-c8147b2004e7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1681 microversion: 2.1 time: 0.187382 Aug 03 05:18:15.709161 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3341/6670] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:15 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:15.825032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:15.828387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:15.831526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:15.832811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:15.841290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.842632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:15.842925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:15.843686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:15.896816 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64045dff-65ab-4883-abdd-c8c950ee8611 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action" status: 200 len: 32630 microversion: 2.1 time: 0.077711 Aug 03 05:18:15.898577 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3330/6671] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:18:15 2022] POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action => generated 32630 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:18:16.165597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:16.166714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:16.174714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.176383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.176383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.178873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.318508 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-992ca6a0-2735-48d3-b8bf-f4345d2c80a4 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1832 microversion: 2.1 time: 0.289030 Aug 03 05:18:16.319959 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3342/6672] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:16 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1832 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:16.348800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:16.351510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:16.359807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.360298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.361092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:16.361547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:16.394833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lazy-loading 'flavor' on Instance uuid 879bf51c-df23-470b-91b1-32812580dd5f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:18:16.411713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Going to try to live migrate instance to another host {{(pid=120832) live_migrate /opt/stack/nova/nova/compute/api.py:5430}} Aug 03 05:18:19.588240 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bcad88ab-0228-4293-a3dc-ff132ccaf330 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action" status: 202 len: 0 microversion: 2.1 time: 3.243556 Aug 03 05:18:19.593383 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3331/6673] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:18:16 2022] POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action => generated 0 bytes in 3249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:19.599230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:19.600232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:19.613101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.613719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.619514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:19.622892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:19.847056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:19.858324 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a09745f-ada1-4920-aefc-08b58d4cf04f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.263515 Aug 03 05:18:19.859688 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3343/6674] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:19 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:20.883260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:20.884551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:20.892650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.893348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:20.894329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:20.894962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:21.139226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:21.148401 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec115ce0-e208-487c-99f8-ffb32a3c90fe tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.269516 Aug 03 05:18:21.150175 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3332/6675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:20 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:21.363072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1b3c4941-12fc-459f-b092-c60cf86f63b5 req-fabeb4db-0dd1-4765-9f79-de9f89452056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "name": "network-vif-unplugged", "status": "completed", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:21.375103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1b3c4941-12fc-459f-b092-c60cf86f63b5 req-fabeb4db-0dd1-4765-9f79-de9f89452056 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:21.375499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1b3c4941-12fc-459f-b092-c60cf86f63b5 req-fabeb4db-0dd1-4765-9f79-de9f89452056 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:21.388474 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1b3c4941-12fc-459f-b092-c60cf86f63b5 req-fabeb4db-0dd1-4765-9f79-de9f89452056 service nova] Creating event network-vif-unplugged:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h2-826756-5 Aug 03 05:18:21.394040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1b3c4941-12fc-459f-b092-c60cf86f63b5 req-fabeb4db-0dd1-4765-9f79-de9f89452056 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034979 Aug 03 05:18:21.395016 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3344/6676] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:22.170666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:22.171930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:22.186706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.187863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.188798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:22.189369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:22.334133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:22.343244 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e92bcb0-081e-48d3-bf85-1b8f3a9755f2 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.176430 Aug 03 05:18:22.343843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3333/6677] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:22 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:23.367106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:23.367712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:23.374155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.374615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.375409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.375887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.409279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d18f4a49-f779-45df-b292-5b5e06cb3c28 req-f7d41066-7537-46ed-a6bd-08470c1f433e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:23.420834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d18f4a49-f779-45df-b292-5b5e06cb3c28 req-f7d41066-7537-46ed-a6bd-08470c1f433e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:23.421382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d18f4a49-f779-45df-b292-5b5e06cb3c28 req-f7d41066-7537-46ed-a6bd-08470c1f433e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:23.435341 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d18f4a49-f779-45df-b292-5b5e06cb3c28 req-f7d41066-7537-46ed-a6bd-08470c1f433e service nova] Creating event network-changed:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h2-826756-5 Aug 03 05:18:23.440451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d18f4a49-f779-45df-b292-5b5e06cb3c28 req-f7d41066-7537-46ed-a6bd-08470c1f433e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 Aug 03 05:18:23.441243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3334/6678] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:23.531903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:23.539630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c7feee0-4010-4a91-aea9-10bf97dc9100 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.178483 Aug 03 05:18:23.541795 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3345/6679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:23 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:24.566006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:24.566760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:24.574435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:24.574907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:24.575712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:24.576169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:24.717911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:24.730070 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8640669-10b0-4f86-929e-85117e509706 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.165651 Aug 03 05:18:24.730070 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3335/6680] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:24 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:25.750387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:25.755500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:25.758735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:25.759186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:25.759969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:25.760443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:25.895770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:25.903445 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cc0be68a-f163-41de-9419-5cfb266ac812 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.156983 Aug 03 05:18:25.904020 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3346/6681] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:25 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:26.925628 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:26.926163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:26.933429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:26.933900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:26.934777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:26.935236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:27.091024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:27.098931 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc38ca7f-e09b-4941-a4a9-b0061f6c2deb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.177224 Aug 03 05:18:27.099538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3336/6682] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:26 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:28.121097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:28.121774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:28.128723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:28.129173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:28.129938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:28.130374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:28.297094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:28.304885 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e1fdcd2-27b6-4726-bd02-ccda9f6bb492 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.187576 Aug 03 05:18:28.305667 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3347/6683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:28 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:29.326283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:29.327333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:29.333840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:29.334480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:29.335074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:29.335526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:29.481798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:29.489433 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb211942-22fd-41d2-bb6a-5fa2b78fe1e4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1691 microversion: 2.1 time: 0.166977 Aug 03 05:18:29.490003 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3337/6684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:29 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:30.511735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:30.512385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:30.520375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.520375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.520910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.521318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.675945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:30.684948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fd7c3862-696a-4d88-86fb-f9746a31f105 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1681 microversion: 2.1 time: 0.177144 Aug 03 05:18:30.685547 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3348/6685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:30 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:30.706829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:30.707291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:30.717593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.717814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.718584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.719036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.854742 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b93d83e1-3ad9-424a-8e20-017b6c266473 tempest-TestNetworkAdvancedServerOps-230054115 tempest-TestNetworkAdvancedServerOps-230054115-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1832 microversion: 2.1 time: 0.152282 Aug 03 05:18:30.855322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3338/6686] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:30 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:30.875985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:30.876630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:30.882735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.883182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:30.883946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:30.884409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:31.049951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:31.059924 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c33b860-61f7-4cac-bc51-10288d82b28f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1681 microversion: 2.1 time: 0.187547 Aug 03 05:18:31.060733 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3349/6687] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:30 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:33.168309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:33.170515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:33.177616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:33.178077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:33.179703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:33.180156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:33.236848 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19dbc5d9-bbbe-410b-85cb-323841dba3f3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action" status: 200 len: 38589 microversion: 2.1 time: 0.071994 Aug 03 05:18:33.237882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3339/6688] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:18:33 2022] POST /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f/action => generated 38589 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:18:34.408794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:34.409303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:34.415217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-771a0262-771b-45af-acd3-6625f198565b req-6a303b3a-ca14-49d6-b73f-2cf3e9338a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:34.417206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.420408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.421602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.427268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-771a0262-771b-45af-acd3-6625f198565b req-6a303b3a-ca14-49d6-b73f-2cf3e9338a1d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.427600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.429675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-771a0262-771b-45af-acd3-6625f198565b req-6a303b3a-ca14-49d6-b73f-2cf3e9338a1d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.447412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-771a0262-771b-45af-acd3-6625f198565b req-6a303b3a-ca14-49d6-b73f-2cf3e9338a1d service nova] Creating event network-changed:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h1-826756-5 Aug 03 05:18:34.453545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-771a0262-771b-45af-acd3-6625f198565b req-6a303b3a-ca14-49d6-b73f-2cf3e9338a1d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Aug 03 05:18:34.459470 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3340/6689] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:34.467061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:18:34.956900 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c7a770a6-1157-4a01-8e7d-4bcc252ff5a4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 204 len: 0 microversion: 2.1 time: 0.551595 Aug 03 05:18:34.957503 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3350/6690] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:18:34 2022] DELETE /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:18:34.967001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:34.967734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:34.974181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.974578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:34.975940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:34.976431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:35.145843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:35.155053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdfb5ee2-5b12-469d-adc2-ec45fe7368f0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1687 microversion: 2.1 time: 0.191925 Aug 03 05:18:35.155834 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3341/6691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:34 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:36.158059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f1d94a9c-9830-45ce-92bc-23003dc92754 req-1e94cf5a-b2cb-4667-b5ed-79e0d119e3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879bf51c-df23-470b-91b1-32812580dd5f", "name": "network-vif-deleted", "tag": "768c188b-0506-428a-8a8a-a96c55ea646f"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:36.170000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f1d94a9c-9830-45ce-92bc-23003dc92754 req-1e94cf5a-b2cb-4667-b5ed-79e0d119e3d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:36.170555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f1d94a9c-9830-45ce-92bc-23003dc92754 req-1e94cf5a-b2cb-4667-b5ed-79e0d119e3d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:36.183747 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f1d94a9c-9830-45ce-92bc-23003dc92754 req-1e94cf5a-b2cb-4667-b5ed-79e0d119e3d0 service nova] Creating event network-vif-deleted:768c188b-0506-428a-8a8a-a96c55ea646f for instance 879bf51c-df23-470b-91b1-32812580dd5f on n-h1-826756-5 Aug 03 05:18:36.186598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:36.187049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:36.190176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f1d94a9c-9830-45ce-92bc-23003dc92754 req-1e94cf5a-b2cb-4667-b5ed-79e0d119e3d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036707 Aug 03 05:18:36.191055 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3351/6692] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:36.195645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:36.196140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:36.197084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:36.197539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:36.263533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:36.271966 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce1a21cc-7e84-489a-8a76-3a0b08c8cd38 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 200 len: 1500 microversion: 2.1 time: 0.090516 Aug 03 05:18:36.272727 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3342/6693] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:36 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 1500 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:18:37.299099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:37.308340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: 879bf51c-df23-470b-91b1-32812580dd5f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:37.315697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:37.316561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:37.317935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:37.318660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:37.334442 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] HTTP exception thrown: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Request method failure captured: Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f HTTP/1.1 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gPSTOtKiEXI_0NhisuynIBgN3s9eIkJ4LOfMKZgfi8uuS0yHI6qv24sjXrt_mJKc9qAw84fXtYPf-GK00vLFYdm2R0BfsvDeulbFSI7bpg7-my27HxSo6JO6EBXgu9n2R-XgWZdIH_KzvGSzAALiQ4thkSQEVHAyIPryj-TiY9c24M Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 08a9665f1cb6470fb2be1b081f6feeb6 Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '879bf51c-df23-470b-91b1-32812580dd5f'} Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:18:37.337118 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Returning 404 to user: Instance 879bf51c-df23-470b-91b1-32812580dd5f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-15970b06-54a3-4f63-85b1-9eb0de63a59d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f" status: 404 len: 111 microversion: 2.1 time: 0.046106 Aug 03 05:18:37.342083 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3352/6694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:37 2022] GET /compute/v2.1/servers/879bf51c-df23-470b-91b1-32812580dd5f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:18:41.537488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cbc1292-7d44-419f-b8cb-fa5c2559a79d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '.version_select at 0x7fdd474c6430>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:41.660941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cbc1292-7d44-419f-b8cb-fa5c2559a79d tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157848050" status: 202 len: 0 microversion: 2.1 time: 0.128392 Aug 03 05:18:41.667836 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3343/6695] 10.222.0.72 () {58 vars in 1281 bytes} [Wed Aug 3 05:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157848050 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:18:41.697811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc8385c3-d856-4388-b0a1-ed0cf5128c2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: .version_select at 0x7fdd548485e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-577041883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILYPhz/whgrKCn3OZZASbItJeBV6xyhbkyke2OaInQRz+k+SCcGB6n0gnTfeV2Qq7wKmchZarH2E3KPveBOzUgUhgmLW5WTB9nTxVKcVqNX9bGodw0QR9Ru5jBNL+6G3g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:41.711427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc8385c3-d856-4388-b0a1-ed0cf5128c2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:18:41.717623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-fc8385c3-d856-4388-b0a1-ed0cf5128c2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:18:41.837596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc8385c3-d856-4388-b0a1-ed0cf5128c2c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.148656 Aug 03 05:18:41.838242 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3353/6696] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:18:41 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:18:53.590372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:53.591564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:53.595763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-9627800", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "40721fff-f565-46c2-80a7-9d05b5115550"}], "key_name": "tempest-TestNetworkAdvancedServerOps-577041883", "security_groups": [{"name": "tempest-secgroup-smoke-1031071475"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:53.721318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] validate_networks() for [('40721fff-f565-46c2-80a7-9d05b5115550', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:18:54.164957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:18:54.165396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:18:54.166182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:18:54.166781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:18:54.170251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:18:54.178225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:54.178996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:54.180444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:54.180901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:54.213355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:18:54.221071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Getting quotas for user 08a9665f1cb6470fb2be1b081f6feeb6 and project 95fd507c073f40229445bb5c8a6fffcc. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:18:54.234711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:18:54.237242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:18:54.464977 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3de4a46b-16d7-44e3-895f-3190d799b461 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876098 Aug 03 05:18:54.476699 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3344/6697] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:18:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:18:54.480972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ebbff8a-6a80-4230-8fe5-0fa1d89928e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:54.482811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ebbff8a-6a80-4230-8fe5-0fa1d89928e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:54.492517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:54.494298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:54.495312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:18:54.556487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ebbff8a-6a80-4230-8fe5-0fa1d89928e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:54.564162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ebbff8a-6a80-4230-8fe5-0fa1d89928e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1263 microversion: 2.1 time: 0.087017 Aug 03 05:18:54.564809 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3354/6698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:54 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:55.586160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7162f599-b02f-471d-a4c7-26251c0a7990 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:55.587585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7162f599-b02f-471d-a4c7-26251c0a7990 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:55.666617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7162f599-b02f-471d-a4c7-26251c0a7990 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:55.675519 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7162f599-b02f-471d-a4c7-26251c0a7990 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1263 microversion: 2.1 time: 0.093557 Aug 03 05:18:55.676366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3345/6699] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:55 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:56.701860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:56.703203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:56.713693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:56.714510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:56.717172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:56.719514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:56.789027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:56.797026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d68e7f60-e91a-40b1-897e-364ef1021ec4 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1259 microversion: 2.1 time: 0.101988 Aug 03 05:18:56.797558 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3355/6700] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:56 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1259 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:57.819958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:57.821614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:57.828748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:57.829239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:57.830401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:57.830511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:57.897076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:57.906731 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-774d716d-671f-4b35-a998-91d2ae9a501b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1323 microversion: 2.1 time: 0.091164 Aug 03 05:18:57.907856 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3346/6701] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:57 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:58.931441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:18:58.932370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:18:58.941089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:58.941541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:58.942773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:58.943454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:59.093385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:18:59.105257 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c95bdffa-9a4b-42b4-81c6-98c2ad7d542b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.178608 Aug 03 05:18:59.119454 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3356/6702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:18:58 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:18:59.307199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1630072926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-225511139", "security_groups": [{"name": "tempest-secgroup-smoke-2135634289"}], "block_device_mapping_v2": [{"uuid": "471e544d-c8f7-4e18-84fd-c224d5b8e046", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a8cc13f0-408e-4564-a35e-be63480e005b"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:59.455962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] validate_networks() for [('a8cc13f0-408e-4564-a35e-be63480e005b', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:18:59.580062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-eb6ff476-4d42-4428-b9f1-8550358c9418 req-1fd0bf88-9a86-440f-95de-07a3d118ab02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:18:59.596220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb6ff476-4d42-4428-b9f1-8550358c9418 req-1fd0bf88-9a86-440f-95de-07a3d118ab02 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:18:59.602490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb6ff476-4d42-4428-b9f1-8550358c9418 req-1fd0bf88-9a86-440f-95de-07a3d118ab02 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:18:59.625370 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-eb6ff476-4d42-4428-b9f1-8550358c9418 req-1fd0bf88-9a86-440f-95de-07a3d118ab02 service nova] Creating event network-changed:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:18:59.631115 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-eb6ff476-4d42-4428-b9f1-8550358c9418 req-1fd0bf88-9a86-440f-95de-07a3d118ab02 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054620 Aug 03 05:18:59.632781 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3357/6703] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:18:59.993076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:18:59.993588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:18:59.994313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:18:59.994735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:18:59.995171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:19:00.007858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.008362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.009505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.009972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.032254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:19:00.041903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Getting quotas for user 51371cd223cb46519727685d4a0f7c50 and project 97672237e83943e29394199375ce1e97. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:19:00.107888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:19:00.110071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='471e544d-c8f7-4e18-84fd-c224d5b8e046',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:19:00.128327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:00.129109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:00.136436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.137473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.138984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:00.139972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:00.291320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:00.299209 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07e533bc-b4b6-4826-a01e-3ab503b900d7 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.176016 Aug 03 05:19:00.299974 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3358/6704] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:00 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:00.615828 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7410572f-af4a-4439-8c50-80b81377203d tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.313456 Aug 03 05:19:00.616616 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3347/6705] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:18:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:19:00.627756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1873ff1-00b5-4313-bcd8-1bfa11d71747 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:00.628556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1873ff1-00b5-4313-bcd8-1bfa11d71747 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:00.683243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1873ff1-00b5-4313-bcd8-1bfa11d71747 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:00.690512 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1873ff1-00b5-4313-bcd8-1bfa11d71747 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1094 microversion: 2.1 time: 0.066857 Aug 03 05:19:00.691627 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3359/6706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:00 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:01.324164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:01.324826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:01.331062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.332927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.341370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.341370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.482310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:01.488900 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22c8a6fc-850b-41f3-9ecd-7bd449f1227e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.170515 Aug 03 05:19:01.489487 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3348/6707] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:01 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:01.713162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:01.713789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:01.723016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.723537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.724403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:01.725630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:01.794844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:01.802777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91629fd9-0539-4216-b794-e374b71db90c tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1144 microversion: 2.1 time: 0.094388 Aug 03 05:19:01.804314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3360/6708] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:01 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:02.518275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:02.520194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:02.526510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.526973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.527755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.528206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.669128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:02.677149 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ee1f7a3-a7c6-4a29-a803-97ded2c515d0 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.163216 Aug 03 05:19:02.677900 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3349/6709] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:02 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:02.824953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:02.825580 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:02.832685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.833142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.833920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:02.835039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:02.901687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:02.909588 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7bea998f-3607-4c3e-97d9-372216aa62f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1192 microversion: 2.1 time: 0.088593 Aug 03 05:19:02.910172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3361/6710] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:02 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:03.704061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:03.711417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:03.720743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.722040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.723191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.723822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.932562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:03.933188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:03.948184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.949072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.949784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:03.950404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:03.974128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:03.982854 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f76b4ee8-c661-40f6-b998-470c18b82f7f tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.287930 Aug 03 05:19:03.984009 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3350/6711] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:03 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:04.025564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:04.033966 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04a20028-b2b7-45dc-8a31-1ed50e58c0f7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1210 microversion: 2.1 time: 0.106596 Aug 03 05:19:04.035406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3362/6712] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:03 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:05.005509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:05.006621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:05.034608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:05.035065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.035860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:05.036525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.058943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:05.061230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:05.074290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:05.078142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.079203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:05.079822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.328700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.337819 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b6fd6031-f6ec-44a0-8a6d-f9413ec835c3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.336011 Aug 03 05:19:05.338731 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3351/6713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:05 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:05.379383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:05.388492 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74f26421-be5c-4133-a7c8-a22dd0beba6e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1278 microversion: 2.1 time: 0.334671 Aug 03 05:19:05.389111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3363/6714] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:05 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:05.509389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b30d358e-0743-43e9-9730-1f6974300ff5 req-24c469b5-6e3c-4f05-9aa8-254ce1d1e0ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deaa7ba-454b-4f11-80c2-af7a1485c454", "tag": "efab8c2d-0002-4142-b6ad-c12cfb298d7d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:05.545520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b30d358e-0743-43e9-9730-1f6974300ff5 req-24c469b5-6e3c-4f05-9aa8-254ce1d1e0ea service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:05.546937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b30d358e-0743-43e9-9730-1f6974300ff5 req-24c469b5-6e3c-4f05-9aa8-254ce1d1e0ea service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:05.568600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b30d358e-0743-43e9-9730-1f6974300ff5 req-24c469b5-6e3c-4f05-9aa8-254ce1d1e0ea service nova] Creating event network-changed:efab8c2d-0002-4142-b6ad-c12cfb298d7d for instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 on n-h1-826756-5 Aug 03 05:19:05.575919 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b30d358e-0743-43e9-9730-1f6974300ff5 req-24c469b5-6e3c-4f05-9aa8-254ce1d1e0ea service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071987 Aug 03 05:19:05.584430 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3352/6715] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:06.056808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-66159cd6-61e1-49fe-8aa2-d886c4cb801b req-007f5fbb-8166-4d64-9551-67037e19efee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "name": "network-vif-plugged", "status": "completed", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:06.070825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-66159cd6-61e1-49fe-8aa2-d886c4cb801b req-007f5fbb-8166-4d64-9551-67037e19efee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.071942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-66159cd6-61e1-49fe-8aa2-d886c4cb801b req-007f5fbb-8166-4d64-9551-67037e19efee service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.098829 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-66159cd6-61e1-49fe-8aa2-d886c4cb801b req-007f5fbb-8166-4d64-9551-67037e19efee service nova] Creating event network-vif-plugged:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:19:06.106843 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-66159cd6-61e1-49fe-8aa2-d886c4cb801b req-007f5fbb-8166-4d64-9551-67037e19efee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056259 Aug 03 05:19:06.108378 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3364/6716] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:06.360669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:06.361473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:06.373922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.374416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.375215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.375666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.410958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:06.411662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:06.422103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.422729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.423804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:06.424655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:06.686730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.699192 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f807e229-fe76-4cc1-99a9-eb10bf87d390 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1389 microversion: 2.1 time: 0.342848 Aug 03 05:19:06.714507 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3353/6717] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:06 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1389 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:06.722564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:06.727804 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5be5c1fb-3d71-44ca-ba38-a5fb70a8d290 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1278 microversion: 2.1 time: 0.320881 Aug 03 05:19:06.728706 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3365/6718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:06 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1278 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:07.733413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:07.734045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:07.744804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.748655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.748655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.748655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.755922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:07.757277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:07.769993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.770737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.771810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:07.772909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:07.964947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.972856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96d0599f-98aa-49b4-8fa6-9db58db9d4c5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1561 microversion: 2.1 time: 0.243493 Aug 03 05:19:07.973447 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3354/6719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:07 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:07.986430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:07.993860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:07.994710 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b6d8412-acb9-457a-81d7-bc7b544329d4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1278 microversion: 2.1 time: 0.245772 Aug 03 05:19:07.994852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:07.995406 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3366/6720] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:07 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:08.001489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.001960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.002853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:08.003312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:08.161003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:08.169542 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a65bd8ab-fda3-4e25-8dc9-780dac91e228 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1561 microversion: 2.1 time: 0.179795 Aug 03 05:19:08.170132 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3355/6721] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:07 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:09.017018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:09.017669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:09.025813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.026271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:09.027060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:09.027506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:09.185992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:09.193924 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82f7646f-62c8-453f-b39b-f9a3c507f19b tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1278 microversion: 2.1 time: 0.181148 Aug 03 05:19:09.213571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3367/6722] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:09 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:10.222382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:10.223015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:10.230220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:10.231277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:10.233219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:10.233695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.234512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:10.235147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.393792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:10.394456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:10.402113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.404877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:10.405346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.406189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:10.406992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.411730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b79dc25c-cee1-44c6-ac96-bab055748117 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.194075 Aug 03 05:19:10.413113 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3356/6723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:10 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:10.429909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b8ea975e-4de3-42e0-8d0e-a52efa4eb965 req-bfc8c4bb-76b8-4477-ac16-9c773754943b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:10.440399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b8ea975e-4de3-42e0-8d0e-a52efa4eb965 req-bfc8c4bb-76b8-4477-ac16-9c773754943b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:10.440868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b8ea975e-4de3-42e0-8d0e-a52efa4eb965 req-bfc8c4bb-76b8-4477-ac16-9c773754943b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:10.462808 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b8ea975e-4de3-42e0-8d0e-a52efa4eb965 req-bfc8c4bb-76b8-4477-ac16-9c773754943b service nova] Creating event network-changed:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:19:10.467761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b8ea975e-4de3-42e0-8d0e-a52efa4eb965 req-bfc8c4bb-76b8-4477-ac16-9c773754943b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052584 Aug 03 05:19:10.469945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3357/6724] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:10.575101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:10.596046 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9249257-4403-4ef8-b3b0-016bc6752b92 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1561 microversion: 2.1 time: 0.195299 Aug 03 05:19:10.611462 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3368/6725] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:10 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1561 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:11.436153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:11.437973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:11.454908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.454908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.454908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:11.454908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:11.616008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:11.618052 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10bd0247-860f-4cfa-af34-51d4c9881a4a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.186346 Aug 03 05:19:11.618621 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3358/6726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:11 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:12.639308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:12.639936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:12.642269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:12.648632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.649109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.649887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:12.650334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:12.792636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:12.800458 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-faa8f3d9-3675-4e65-9ad2-bc34a7361f17 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.165175 Aug 03 05:19:12.801099 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3369/6727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:12 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:13.822684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:13.824141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:13.831227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.831699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.832522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:13.832975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:13.979972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:13.987984 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9157a023-21c9-4764-9914-e11a894f8383 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.169835 Aug 03 05:19:13.988699 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3359/6728] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:13 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:15.009792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:15.010403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:15.017683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:15.018131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.018893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:15.019330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:15.156447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:15.165076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c60552f-184b-4d89-96c0-9333623a1ec7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.159168 Aug 03 05:19:15.165704 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3370/6729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:15 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:16.187391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:16.188863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:16.197963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.198449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.199437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:16.199978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:16.337480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:16.345881 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-696aec36-bfe1-4791-8b87-065b4ab05ff3 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.163070 Aug 03 05:19:16.346465 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3360/6730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:16 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:17.366476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:17.367152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:17.374412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.374866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.375633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:17.376072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:17.519324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:17.527610 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d4ddb88-8532-448b-aa00-3b5c050e36e9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.165154 Aug 03 05:19:17.528206 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3371/6731] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:17 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:18.554043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:18.555107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:18.565881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.565881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:18.565881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:18.565881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:18.710759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:18.719507 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84e31234-a202-448b-9b4d-a70395ab0568 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.170889 Aug 03 05:19:18.720335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3361/6732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:18 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:19.010289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-18451ab1-7859-4420-837d-46fda7b137f4 req-c606c5f3-48d5-45b0-9e64-691a93a904e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deaa7ba-454b-4f11-80c2-af7a1485c454", "name": "network-vif-plugged", "status": "completed", "tag": "efab8c2d-0002-4142-b6ad-c12cfb298d7d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:19.020549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18451ab1-7859-4420-837d-46fda7b137f4 req-c606c5f3-48d5-45b0-9e64-691a93a904e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:19.021027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18451ab1-7859-4420-837d-46fda7b137f4 req-c606c5f3-48d5-45b0-9e64-691a93a904e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.033282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-18451ab1-7859-4420-837d-46fda7b137f4 req-c606c5f3-48d5-45b0-9e64-691a93a904e8 service nova] Creating event network-vif-plugged:efab8c2d-0002-4142-b6ad-c12cfb298d7d for instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 on n-h1-826756-5 Aug 03 05:19:19.039414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-18451ab1-7859-4420-837d-46fda7b137f4 req-c606c5f3-48d5-45b0-9e64-691a93a904e8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Aug 03 05:19:19.040021 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3372/6733] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:19.751116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:19.751780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:19.759084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:19.759548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.760456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:19.760905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:19.914204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:19.918837 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07564b9d-bcdc-401b-a3dc-17c5669159f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1266 microversion: 2.1 time: 0.171542 Aug 03 05:19:19.919444 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3362/6734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:19 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:20.941772 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:20.942500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:20.949838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:20.950290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:20.951071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:20.951514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.098224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.106091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59e320a6-235d-4ae9-86fa-0364c719b7ed tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1454 microversion: 2.1 time: 0.169732 Aug 03 05:19:21.106676 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3373/6735] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:20 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:21.139205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:21.139843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:21.147522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.147985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.148806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:21.149262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:21.289877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:21.297610 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a8fd9d5a-7cc0-41ef-b33e-0d5b1a3ec9f9 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1454 microversion: 2.1 time: 0.162276 Aug 03 05:19:21.298197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3363/6736] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:21 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:23.801313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-bb5f92b1-1c00-4a2c-84d2-71dcfd7e535d req-1c09bfae-5a77-4ebc-a4ca-fdd1abb7bc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deaa7ba-454b-4f11-80c2-af7a1485c454", "tag": "efab8c2d-0002-4142-b6ad-c12cfb298d7d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:23.811560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bb5f92b1-1c00-4a2c-84d2-71dcfd7e535d req-1c09bfae-5a77-4ebc-a4ca-fdd1abb7bc51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:23.812427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-bb5f92b1-1c00-4a2c-84d2-71dcfd7e535d req-1c09bfae-5a77-4ebc-a4ca-fdd1abb7bc51 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:23.831925 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-bb5f92b1-1c00-4a2c-84d2-71dcfd7e535d req-1c09bfae-5a77-4ebc-a4ca-fdd1abb7bc51 service nova] Creating event network-changed:efab8c2d-0002-4142-b6ad-c12cfb298d7d for instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 on n-h1-826756-5 Aug 03 05:19:23.838130 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-bb5f92b1-1c00-4a2c-84d2-71dcfd7e535d req-1c09bfae-5a77-4ebc-a4ca-fdd1abb7bc51 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116234 Aug 03 05:19:23.839130 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3374/6737] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:33.876489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:33.878737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:33.881907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:33.882535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:33.887528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.887991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.888888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:33.889409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:33.947124 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0589aba0-cb9f-40b4-8d14-442fe5286bf1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action" status: 200 len: 24562 microversion: 2.1 time: 0.074436 Aug 03 05:19:33.947781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3364/6738] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:19:33 2022] POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action => generated 24562 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:19:36.793383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-214943221", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "10a92dd4-b0f8-4335-a9c9-43a5bce8c477"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:36.802247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=46 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:36.802918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:36.848503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] validate_networks() for [('10a92dd4-b0f8-4335-a9c9-43a5bce8c477', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:19:37.207516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:19:37.207949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:19:37.208470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:19:37.208891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:19:37.209314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:19:37.219021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.219415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.220224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:37.220699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:37.238021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Getting quotas for project 4422873adc4e4b728508657d099907d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:19:37.243421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Getting quotas for user 5d0ddb1df0f141b2a765c4c4c8f5a0d2 and project 4422873adc4e4b728508657d099907d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:19:37.255761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:19:37.260177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:19:37.393886 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b05edc2-4a82-44c7-91b2-86469fc46991 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604740 Aug 03 05:19:37.394545 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3375/6739] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:19:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:19:37.407614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-833d3501-0b5b-47bf-b6c4-96d0573ab9e5 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:37.408373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-833d3501-0b5b-47bf-b6c4-96d0573ab9e5 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:37.468464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-833d3501-0b5b-47bf-b6c4-96d0573ab9e5 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:37.476137 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-833d3501-0b5b-47bf-b6c4-96d0573ab9e5 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1218 microversion: 2.1 time: 0.072958 Aug 03 05:19:37.476673 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3365/6740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:37 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:38.498629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dcd8ae7a-dffd-4dfc-b12b-d9509c4102c1 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:38.499248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dcd8ae7a-dffd-4dfc-b12b-d9509c4102c1 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:38.556653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dcd8ae7a-dffd-4dfc-b12b-d9509c4102c1 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:38.563461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dcd8ae7a-dffd-4dfc-b12b-d9509c4102c1 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1218 microversion: 2.1 time: 0.070256 Aug 03 05:19:38.564062 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3376/6741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:38 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:39.585198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:39.585836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:39.593146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.593621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.594433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:39.594891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:39.658570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:39.666648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-66c06b49-36b8-4903-b96c-80f24af9f5e4 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1270 microversion: 2.1 time: 0.085650 Aug 03 05:19:39.667229 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3366/6742] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:39 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:40.689266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:40.689865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:40.698556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.699019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.699802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:40.700246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:40.765150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:40.773493 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89973dc4-f892-4281-aef7-77ba0375ad56 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1276 microversion: 2.1 time: 0.088225 Aug 03 05:19:40.774120 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3377/6743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:40 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:41.795108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:41.795670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:41.803251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.803895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.804715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:41.805177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:41.950173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:41.957700 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1b8b652-6b9a-4506-a2b0-0be648c145c3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.166777 Aug 03 05:19:41.958328 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3367/6744] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:41 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:42.147950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-07fd9ab3-cc8f-4c80-9f57-5ea8912c2d35 req-a5a55b97-d913-49e8-be07-a92508e63ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b11813-55ee-4a10-b043-d3fb7c72b0fd", "tag": "490f0046-b5f2-4c19-bb15-cf63d07cebc3"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:42.159159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-07fd9ab3-cc8f-4c80-9f57-5ea8912c2d35 req-a5a55b97-d913-49e8-be07-a92508e63ec3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.159616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-07fd9ab3-cc8f-4c80-9f57-5ea8912c2d35 req-a5a55b97-d913-49e8-be07-a92508e63ec3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.171563 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-07fd9ab3-cc8f-4c80-9f57-5ea8912c2d35 req-a5a55b97-d913-49e8-be07-a92508e63ec3 service nova] Creating event network-changed:490f0046-b5f2-4c19-bb15-cf63d07cebc3 for instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd on n-h2-826756-5 Aug 03 05:19:42.176521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-07fd9ab3-cc8f-4c80-9f57-5ea8912c2d35 req-a5a55b97-d913-49e8-be07-a92508e63ec3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032551 Aug 03 05:19:42.177143 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3378/6745] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:19:42.980637 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:42.981279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:42.988252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.988738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:42.989557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:42.989991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:43.132636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:43.140342 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-226d6555-1d1c-4d25-b25d-b9312b721993 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.164684 Aug 03 05:19:43.140934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3368/6746] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:42 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:44.164562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:44.165272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:44.171817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.172304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.173068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.173558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.308055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:44.315817 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-877c89ba-7d82-4fb0-a994-77da40dc2513 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.157230 Aug 03 05:19:44.316414 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3379/6747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:44 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:44.960859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:44.963653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:44.970703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.971170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:44.971999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:44.972483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.050526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:19:45.050969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:19:45.051462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:19:45.051889 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:19:45.052340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:19:45.302806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:45.310515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.310971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.311872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.312386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.338448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:45.339111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:45.340628 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b9cede5-066a-4505-9a60-7a54981cae51 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action" status: 202 len: 1134 microversion: 2.1 time: 0.384467 Aug 03 05:19:45.341287 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3369/6748] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:19:44 2022] POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action => generated 1134 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 03 05:19:45.346260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.346720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.349377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.349377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.359240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:45.360007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:45.366444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.367031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.367826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:45.368334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:45.550752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.559027 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61162e6a-4ad7-43ed-adc9-48c0d6927681 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.225197 Aug 03 05:19:45.559749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3380/6749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:45 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:45.570705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:45.579374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfbc85d5-8d8d-4b5e-b564-6f0b1d330426 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.223037 Aug 03 05:19:45.579374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3370/6750] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:45 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:46.581448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:46.582052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:46.589576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.590038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.590810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.591299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.602172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:46.603097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:46.610958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.614001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.614001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:46.614001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:46.824158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:46.831768 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-090475df-30d2-48d3-a16e-98f025d27256 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.254220 Aug 03 05:19:46.832381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3381/6751] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:46 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:46.832578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:46.840699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88015fc9-727f-4512-ab08-a01d5d4b471a tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.242452 Aug 03 05:19:46.841273 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3371/6752] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:46 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:47.862783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:47.862783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:47.862783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:47.864516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:47.864516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:47.864992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.864992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.864992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.864992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.866966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:47.869562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.870017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:47.870846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:47.871287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:48.118665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.121567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:48.126755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c50342ef-47e4-4b50-a346-994d6dd688c9 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.269676 Aug 03 05:19:48.128109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3372/6753] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:47 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:48.128976 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-337ebc69-374c-42c9-9aa1-f1ea695340ef tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.278701 Aug 03 05:19:48.129535 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3382/6754] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:47 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:49.150264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:49.150892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:49.158071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:49.158545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.158753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.158875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:49.159549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.160067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.160869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:19:49.167647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.170211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.170211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:49.170211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:49.357960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.360993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:49.365585 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-43e56898-b923-417d-8c77-f9b953cc40c1 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.220001 Aug 03 05:19:49.366174 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3373/6755] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:49 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:49.368909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5cbb19de-7eb3-4b41-a421-4dd1dcb9fa28 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.214658 Aug 03 05:19:49.369483 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3383/6756] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:49 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:50.199558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-892e0088-178b-41a4-8929-9dcbea59fb50 req-4c542c1c-c0dd-4683-974c-555ce782af7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b11813-55ee-4a10-b043-d3fb7c72b0fd", "name": "network-vif-plugged", "status": "completed", "tag": "490f0046-b5f2-4c19-bb15-cf63d07cebc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:19:50.208922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-892e0088-178b-41a4-8929-9dcbea59fb50 req-4c542c1c-c0dd-4683-974c-555ce782af7b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.209400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-892e0088-178b-41a4-8929-9dcbea59fb50 req-4c542c1c-c0dd-4683-974c-555ce782af7b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.220348 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-892e0088-178b-41a4-8929-9dcbea59fb50 req-4c542c1c-c0dd-4683-974c-555ce782af7b service nova] Creating event network-vif-plugged:490f0046-b5f2-4c19-bb15-cf63d07cebc3 for instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd on n-h2-826756-5 Aug 03 05:19:50.225721 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-892e0088-178b-41a4-8929-9dcbea59fb50 req-4c542c1c-c0dd-4683-974c-555ce782af7b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092606 Aug 03 05:19:50.226297 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3374/6757] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:19:50.387083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:50.387696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:50.391027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:50.392038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:50.395195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.395646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.396635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.397589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.399381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.400040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.400845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:50.401294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:50.605835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.609486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:50.613739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-53c4900f-c15e-4b50-8a53-82795f6ec747 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.230652 Aug 03 05:19:50.614333 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3384/6758] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:50 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:50.619273 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8344d895-682b-4542-9fcb-c3507edc514b tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.232144 Aug 03 05:19:50.620343 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3375/6759] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:50 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:51.635193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:51.635898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:51.642774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:51.643274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.643414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:51.643728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.644537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.644980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.650854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.651481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.652452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:51.653006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:51.856288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:51.864559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0a82341-1735-44ea-baf4-90bdd1db4869 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.233283 Aug 03 05:19:51.864937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:51.865346 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3385/6760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:51 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:51.873973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0039af7-9218-4dcc-a3f9-6747e42617f0 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1318 microversion: 2.1 time: 0.235166 Aug 03 05:19:51.874427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3376/6761] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:51 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:52.887033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:52.887681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:52.895002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:52.895467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.895595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.895815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:52.896325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.896773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.903443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.904450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:52.905610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:52.906200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:53.118483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.122502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:53.126137 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-30767922-4c57-4468-9929-cd2203d2074b tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.243169 Aug 03 05:19:53.126729 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3386/6762] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:52 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:53.130911 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98c9bec9-3933-47ce-802b-254cde5cf238 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1507 microversion: 2.1 time: 0.239954 Aug 03 05:19:53.131542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3377/6763] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:52 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:19:54.148130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:54.148769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:54.155537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:54.155990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:54.156783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:54.157222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:54.293204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:54.300781 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b791394-2e07-4bfd-873e-cbd253224517 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.156749 Aug 03 05:19:54.301347 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3387/6764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:54 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:55.322099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:55.322738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:55.330556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:55.331020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:55.331926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:55.332406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:55.476752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:55.484483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e572a35f-c8d1-46e9-ae6f-3f5c736fa2af tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.166404 Aug 03 05:19:55.485106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3378/6765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:55 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:56.506010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:56.506751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:56.513806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.514260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.515040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:56.517656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:56.661342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:56.669943 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f6bb0fc-63bf-4454-ba36-8f574408a525 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.167994 Aug 03 05:19:56.672547 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3388/6766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:56 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:57.694170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:57.694833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:57.702881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:57.703532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:57.704567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:57.705566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:57.848657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:57.856760 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a77b0f07-019d-4646-ab8c-943e01e67b96 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.166675 Aug 03 05:19:57.857413 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3379/6767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:57 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:19:58.879031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:19:58.879648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:19:58.887413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.887867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:58.888672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:19:58.889114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:19:59.031972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:19:59.040525 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-337b7ed7-0376-431b-8b76-1be96d379dc3 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.165306 Aug 03 05:19:59.041137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3389/6768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:19:58 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:00.063232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:00.063831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:00.070999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:00.071469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:00.072260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:00.072745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:00.092028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:00.210386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:00.218193 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88809b24-7577-4dff-b119-87b5203a2694 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.158894 Aug 03 05:20:00.218783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3380/6769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:00 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:01.241760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:01.242365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:01.249445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:01.250004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:01.250816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:01.251261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:01.397730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:01.405768 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1694c5e3-3199-4c62-9a26-40d99de5cd1c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.168913 Aug 03 05:20:01.406638 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3390/6770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:01 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:02.429301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:02.430049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:02.437092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:02.437832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:02.438633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:02.439097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:02.589441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:02.598674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b0e496a-22d7-4cac-8b49-b7a40fa675e8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.173368 Aug 03 05:20:02.599182 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3381/6771] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:02 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:20:03.625966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:03.626582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:03.634358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:03.634862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:03.635716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:03.636170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:03.781770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:03.790798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-38204625-0f06-494c-af8e-8cf840f0f07c tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1688 microversion: 2.1 time: 0.169885 Aug 03 05:20:03.791400 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3391/6772] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:03 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:04.813865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:04.814534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:04.822699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:04.823208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:04.824091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:04.824598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:04.968427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:04.977952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63573b55-4613-4aa9-85f9-10a7f3958ecb tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1694 microversion: 2.1 time: 0.168221 Aug 03 05:20:04.978703 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3382/6773] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:04 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:20:06.002476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:06.003019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:06.011397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:06.011931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:06.012865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:06.013307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:06.159325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:06.166826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f5f6a8c-d43b-46ea-b113-bc8a46789a35 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1694 microversion: 2.1 time: 0.168408 Aug 03 05:20:06.167421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3392/6774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:05 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:07.189735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:07.190367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:07.197586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:07.198285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:07.198912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:07.199366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:07.346117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:07.354941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28daf1a6-686a-49ba-a216-79ab0feaf7d5 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1679 microversion: 2.1 time: 0.169325 Aug 03 05:20:07.453296 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3383/6775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:07 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:20:08.187878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-16a1f615-16e8-49e3-a840-15cb72e60b38 req-c0093843-a1ac-4da7-a4f9-a96b208134e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "name": "network-vif-unplugged", "status": "completed", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:08.196260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.200899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-16a1f615-16e8-49e3-a840-15cb72e60b38 req-c0093843-a1ac-4da7-a4f9-a96b208134e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:08.201419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-16a1f615-16e8-49e3-a840-15cb72e60b38 req-c0093843-a1ac-4da7-a4f9-a96b208134e6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:08.204243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:08.214919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-16a1f615-16e8-49e3-a840-15cb72e60b38 req-c0093843-a1ac-4da7-a4f9-a96b208134e6 service nova] Creating event network-vif-unplugged:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:20:08.220459 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-16a1f615-16e8-49e3-a840-15cb72e60b38 req-c0093843-a1ac-4da7-a4f9-a96b208134e6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036362 Aug 03 05:20:08.221269 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3393/6776] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:20:10.235913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0fbd0ad2-8e29-4567-8f47-82550f97b4ef req-979a4bc0-197d-4876-aeae-300974fc4359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "name": "network-vif-plugged", "status": "completed", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:10.242477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=47 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:10.248333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0fbd0ad2-8e29-4567-8f47-82550f97b4ef req-979a4bc0-197d-4876-aeae-300974fc4359 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:10.248816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0fbd0ad2-8e29-4567-8f47-82550f97b4ef req-979a4bc0-197d-4876-aeae-300974fc4359 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:10.259938 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0fbd0ad2-8e29-4567-8f47-82550f97b4ef req-979a4bc0-197d-4876-aeae-300974fc4359 service nova] Creating event network-vif-plugged:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:20:10.265525 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0fbd0ad2-8e29-4567-8f47-82550f97b4ef req-979a4bc0-197d-4876-aeae-300974fc4359 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033205 Aug 03 05:20:10.266137 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3384/6777] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:22.449707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25f745d7-cb6c-4dae-a9bf-2b073d83a721", "device": "/dev/sdb"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:22.452140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:22.459869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:22.460352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:22.461106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:22.461544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:23.212806 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d344ddc-4c57-404e-b175-f6d4a76a8662 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "POST /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768028 Aug 03 05:20:23.213436 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3394/6778] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:20:22 2022] POST /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:33.704213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:33.706791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:33.709983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:33.717455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:33.717455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:33.717455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:33.717455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:33.868210 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6fa1499-9929-418c-9522-7a66d2fdc1a8 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action" status: 200 len: 24534 microversion: 2.1 time: 0.168039 Aug 03 05:20:33.869099 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3385/6779] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:20:33 2022] POST /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e/action => generated 24534 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 05:20:45.884453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:45.886639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:45.889023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-fa289cdf-a87c-4704-8447-d5eb9e96ae66 req-72ff1e90-f03f-43d1-8098-3f594ba26c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:45.898713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:45.899592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:45.900707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:45.901490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:20:45.902525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:45.903211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:45.904709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:45.905806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:45.906039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa289cdf-a87c-4704-8447-d5eb9e96ae66 req-72ff1e90-f03f-43d1-8098-3f594ba26c33 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:45.906500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fa289cdf-a87c-4704-8447-d5eb9e96ae66 req-72ff1e90-f03f-43d1-8098-3f594ba26c33 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:45.931622 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-fa289cdf-a87c-4704-8447-d5eb9e96ae66 req-72ff1e90-f03f-43d1-8098-3f594ba26c33 service nova] Creating event network-changed:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:20:45.938860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:20:45.949139 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-fa289cdf-a87c-4704-8447-d5eb9e96ae66 req-72ff1e90-f03f-43d1-8098-3f594ba26c33 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065503 Aug 03 05:20:45.950660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3386/6780] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:20:46.342143 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71f29227-4c23-43ec-8e7b-69eac5046d13 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 204 len: 0 microversion: 2.1 time: 0.463635 Aug 03 05:20:46.345355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3395/6781] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:20:45 2022] DELETE /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:20:46.353773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:46.354817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:46.362266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:46.362917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:46.363778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:46.364313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:46.521885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:46.530674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64971877-ddf3-4d6a-8fe1-1e4d8db1606e tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1685 microversion: 2.1 time: 0.182654 Aug 03 05:20:46.531248 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3387/6782] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:46 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:47.556143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:47.556984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:47.566139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:47.567908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:47.567908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:47.568162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:47.714101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:47.725850 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6985125e-383f-41f0-93ab-873efb7d6a78 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1685 microversion: 2.1 time: 0.174218 Aug 03 05:20:47.726830 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3396/6783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:47 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:48.494363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-df917f3f-7f61-44d3-a796-60c7a3f14579 req-d0d49545-ebd3-436a-9a5e-ae6e2179311f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d539978b-4512-4f25-b89a-ad1cdd6e518e", "name": "network-vif-deleted", "tag": "ba092d57-b54b-4b38-8815-bf9862eb4aa0"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:20:48.504668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-df917f3f-7f61-44d3-a796-60c7a3f14579 req-d0d49545-ebd3-436a-9a5e-ae6e2179311f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.505134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-df917f3f-7f61-44d3-a796-60c7a3f14579 req-d0d49545-ebd3-436a-9a5e-ae6e2179311f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.516859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-df917f3f-7f61-44d3-a796-60c7a3f14579 req-d0d49545-ebd3-436a-9a5e-ae6e2179311f service nova] Creating event network-vif-deleted:ba092d57-b54b-4b38-8815-bf9862eb4aa0 for instance d539978b-4512-4f25-b89a-ad1cdd6e518e on n-h2-826756-5 Aug 03 05:20:48.522395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-df917f3f-7f61-44d3-a796-60c7a3f14579 req-d0d49545-ebd3-436a-9a5e-ae6e2179311f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Aug 03 05:20:48.522988 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3388/6784] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:20:48.749493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:48.750374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:48.758717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.759451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.760261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.761363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.798673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:48.799124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:48.799581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lazy-loading 'fault' on Instance uuid d539978b-4512-4f25-b89a-ad1cdd6e518e {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:20:48.843058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08a9665f1cb6470fb2be1b081f6feeb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95fd507c073f40229445bb5c8a6fffcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:20:48.851062 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-691ae461-5a8b-4e2c-af5f-b5d8316dc051 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 200 len: 1353 microversion: 2.1 time: 0.106126 Aug 03 05:20:48.851648 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3397/6785] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:48 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 1353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:20:49.879311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:49.879940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [instance: d539978b-4512-4f25-b89a-ad1cdd6e518e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:49.887997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:49.888401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:49.889212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:49.889657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:49.907028 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] HTTP exception thrown: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Request method failure captured: Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e HTTP/1.1 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gPSTOtKiEXI_0NhisuynIBgN3s9eIkJ4LOfMKZgfi8uuS0yHI6qv24sjXrt_mJKc9qAw84fXtYPf-GK00vLFYdm2R0BfsvDeulbFSI7bpg7-my27HxSo6JO6EBXgu9n2R-XgWZdIH_KzvGSzAALiQ4thkSQEVHAyIPryj-TiY9c24M Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/95fd507c073f40229445bb5c8a6fffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 95fd507c073f40229445bb5c8a6fffcc Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1574519538 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 08a9665f1cb6470fb2be1b081f6feeb6 Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1574519538-project Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'd539978b-4512-4f25-b89a-ad1cdd6e518e'} Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:20:49.908801 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Returning 404 to user: Instance d539978b-4512-4f25-b89a-ad1cdd6e518e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18bff53b-d0e3-4e75-9b0a-55e482065f68 tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e" status: 404 len: 111 microversion: 2.1 time: 0.035291 Aug 03 05:20:49.913448 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3389/6786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:49 2022] GET /compute/v2.1/servers/d539978b-4512-4f25-b89a-ad1cdd6e518e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:20:53.471021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:53.471713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:53.479295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:53.480751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:53.481808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:53.482247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:53.571904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lazy-loading 'services' on Instance uuid 56b11813-55ee-4a10-b043-d3fb7c72b0fd {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:20:53.910641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4c6326bf-aec9-453d-9e9d-2ce419c7ebdb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd/os-volume_attachments/25f745d7-cb6c-4dae-a9bf-2b073d83a721" status: 202 len: 0 microversion: 2.1 time: 0.445393 Aug 03 05:20:53.911531 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3398/6787] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:20:53 2022] DELETE /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd/os-volume_attachments/25f745d7-cb6c-4dae-a9bf-2b073d83a721 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:20:54.128357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2801f30-2f75-4dc7-befb-a5810e4393ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] Calling method '.version_select at 0x7fdd442ccca0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:54.133069 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e2801f30-2f75-4dc7-befb-a5810e4393ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [1de44025-f827-4381-9159-aa8ab75d9296] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 05:20:55.142478 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [None req-e2801f30-2f75-4dc7-befb-a5810e4393ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] [1de44025-f827-4381-9159-aa8ab75d9296] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 37100. Aug 03 05:20:55.536995 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2801f30-2f75-4dc7-befb-a5810e4393ad tempest-TestNetworkAdvancedServerOps-1574519538 tempest-TestNetworkAdvancedServerOps-1574519538-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577041883" status: 202 len: 0 microversion: 2.1 time: 1.412348 Aug 03 05:20:55.537501 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3390/6788] 10.222.0.72 () {58 vars in 1281 bytes} [Wed Aug 3 05:20:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577041883 => generated 0 bytes in 1414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:20:59.303195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:59.303811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:59.312140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.312627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.313399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.313837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.339707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:20:59.793300 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-46cf9cce-6f54-4f9c-9663-bb958d877c08 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 204 len: 0 microversion: 2.1 time: 0.493078 Aug 03 05:20:59.793852 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3399/6789] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:20:59 2022] DELETE /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:20:59.803088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:20:59.803849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:20:59.811403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.811869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:20:59.812705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:20:59.813252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:00.017310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:00.025285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bc44956b-c7d5-4af7-83ac-847a1455035c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1513 microversion: 2.1 time: 0.226601 Aug 03 05:21:00.045961 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3391/6790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:20:59 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:01.048431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:01.049274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:01.056159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.056684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.058239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.059041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.289028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:01.299475 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37ccf9e7-4f66-4b4b-be59-f6f4c906ebaf tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1513 microversion: 2.1 time: 0.255363 Aug 03 05:21:01.300423 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3400/6791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:01 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:01.913003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2762f2a7-41af-4210-b963-41eb4b754b26 req-d2ec83e6-bc09-4198-8e93-5666bb03f391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b11813-55ee-4a10-b043-d3fb7c72b0fd", "name": "network-vif-deleted", "tag": "490f0046-b5f2-4c19-bb15-cf63d07cebc3"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:01.921692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2762f2a7-41af-4210-b963-41eb4b754b26 req-d2ec83e6-bc09-4198-8e93-5666bb03f391 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:01.922049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2762f2a7-41af-4210-b963-41eb4b754b26 req-d2ec83e6-bc09-4198-8e93-5666bb03f391 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:01.949831 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2762f2a7-41af-4210-b963-41eb4b754b26 req-d2ec83e6-bc09-4198-8e93-5666bb03f391 service nova] Creating event network-vif-deleted:490f0046-b5f2-4c19-bb15-cf63d07cebc3 for instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd on n-h2-826756-5 Aug 03 05:21:01.963897 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2762f2a7-41af-4210-b963-41eb4b754b26 req-d2ec83e6-bc09-4198-8e93-5666bb03f391 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059131 Aug 03 05:21:01.968736 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3392/6792] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:02.345948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:02.346833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:02.354388 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.354989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.355866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.357181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.394148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:02.395132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:02.395863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lazy-loading 'fault' on Instance uuid 56b11813-55ee-4a10-b043-d3fb7c72b0fd {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:21:02.469529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:02.478446 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72433f3e-1ecc-42e2-b1db-8faf4f395122 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 200 len: 1308 microversion: 2.1 time: 0.160553 Aug 03 05:21:02.479424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3401/6793] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:02 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:03.503933 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:03.505599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: 56b11813-55ee-4a10-b043-d3fb7c72b0fd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:03.513329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.514129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:03.515125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:03.515769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:03.531480 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] HTTP exception thrown: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Request method failure captured: Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd HTTP/1.1 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gUF_A2UcL9x90CUs7Q43YLX7Ta8ZZuy_TcXNkORwFZtVSYxHFaQh06dxujBlDFogInnoFCUB16rAGQNPrrx6qBtCwECLSoN7qfqlyfIhwE93cFVX8klxeMox_SmhxA4rJDvmOfshmiDX8HuB1S-jGKqrJSKcLI-nDT4raCSRIXuaR8 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 4422873adc4e4b728508657d099907d4 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4422873adc4e4b728508657d099907d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4422873adc4e4b728508657d099907d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4422873adc4e4b728508657d099907d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4422873adc4e4b728508657d099907d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 4422873adc4e4b728508657d099907d4 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-VolumesSnapshotTestJSON-1256752363-project Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 5d0ddb1df0f141b2a765c4c4c8f5a0d2 Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-VolumesSnapshotTestJSON-1256752363-project Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '56b11813-55ee-4a10-b043-d3fb7c72b0fd'} Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:03.533704 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Returning 404 to user: Instance 56b11813-55ee-4a10-b043-d3fb7c72b0fd could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ecaf066f-fd4b-4654-b879-fbb4fae93027 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd" status: 404 len: 111 microversion: 2.1 time: 0.037090 Aug 03 05:21:03.549650 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3393/6794] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:03 2022] GET /compute/v2.1/servers/56b11813-55ee-4a10-b043-d3fb7c72b0fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:21:14.766505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-286799333", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "10a92dd4-b0f8-4335-a9c9-43a5bce8c477"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:14.778553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:14.779497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:14.825932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] validate_networks() for [('10a92dd4-b0f8-4335-a9c9-43a5bce8c477', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:21:15.279123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:21:15.279602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:21:15.280110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:21:15.280567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:21:15.280988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:21:15.290230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:15.290731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:15.291577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:15.292023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:15.309813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Getting quotas for project 4422873adc4e4b728508657d099907d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:21:15.315648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Getting quotas for user 5d0ddb1df0f141b2a765c4c4c8f5a0d2 and project 4422873adc4e4b728508657d099907d4. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:21:15.329050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:21:15.331363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:21:15.466390 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8136f381-b3f3-4886-a180-c05f72328f0f tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704042 Aug 03 05:21:15.467054 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3402/6795] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:21:15.478084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-06c08590-723a-4d5d-87e4-590c030d472a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:15.478855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-06c08590-723a-4d5d-87e4-590c030d472a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:15.481604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:15.483470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:15.538736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-06c08590-723a-4d5d-87e4-590c030d472a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:15.545850 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-06c08590-723a-4d5d-87e4-590c030d472a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1218 microversion: 2.1 time: 0.071802 Aug 03 05:21:15.546410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3394/6796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:15 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:16.568324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c407252a-bb9e-4b06-b05c-c36a173cb340 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:16.568895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c407252a-bb9e-4b06-b05c-c36a173cb340 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:16.623934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c407252a-bb9e-4b06-b05c-c36a173cb340 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:16.631193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c407252a-bb9e-4b06-b05c-c36a173cb340 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1218 microversion: 2.1 time: 0.068070 Aug 03 05:21:16.631761 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3403/6797] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:16 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:17.654123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:17.654766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:17.662832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:17.663301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:17.664088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:17.664574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:17.867463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:17.876551 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dabbfc49-31fc-48ef-9bf3-3d6536e19f15 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1270 microversion: 2.1 time: 0.226630 Aug 03 05:21:17.886025 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3395/6798] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:17 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:18.900132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:18.900792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:18.908526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:18.911117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:18.911117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:18.911117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:19.045900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:19.053471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8947e96b-7b6f-4fe4-90a7-0c35ea241be8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.158256 Aug 03 05:21:19.068180 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3404/6799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:18 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:19.765401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-33653a05-8bcf-4c77-8f53-51687db9130f req-3f8152bb-af6f-49bc-afe0-e47cd3b36859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95ab983-074f-48e2-befc-21139e1cf9c1", "tag": "01203fc3-2307-4865-bda3-f9e545660e71"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:19.776599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-33653a05-8bcf-4c77-8f53-51687db9130f req-3f8152bb-af6f-49bc-afe0-e47cd3b36859 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:19.777072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-33653a05-8bcf-4c77-8f53-51687db9130f req-3f8152bb-af6f-49bc-afe0-e47cd3b36859 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:19.788645 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-33653a05-8bcf-4c77-8f53-51687db9130f req-3f8152bb-af6f-49bc-afe0-e47cd3b36859 service nova] Creating event network-changed:01203fc3-2307-4865-bda3-f9e545660e71 for instance c95ab983-074f-48e2-befc-21139e1cf9c1 on n-h2-826756-5 Aug 03 05:21:19.794426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-33653a05-8bcf-4c77-8f53-51687db9130f req-3f8152bb-af6f-49bc-afe0-e47cd3b36859 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032377 Aug 03 05:21:19.795227 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3396/6800] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:20.077029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:20.077635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:20.084626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:20.085075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:20.098246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:20.098246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:20.226572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:20.234652 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3ee5558-dc1a-4b1e-99c7-4bf95b0760c7 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.163436 Aug 03 05:21:20.235603 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3405/6801] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:20 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:21.259684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:21.259684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:21.265470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:21.265932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:21.266712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:21.267161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:21.400181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:21.407834 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22bc7bce-1628-4c70-bf00-95775111825d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.155269 Aug 03 05:21:21.408422 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3397/6802] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:21 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:22.428666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:22.429286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:22.436644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:22.437115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:22.437901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:22.438342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:22.569319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:22.577434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-533bc757-9d08-4e33-9412-6e038a36baf3 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.152735 Aug 03 05:21:22.578006 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3406/6803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:22 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:23.599124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:23.599784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:23.606663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:23.607306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:23.608164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:23.608706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:23.747255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:23.755497 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-558126c6-ce2e-4a80-a457-d3f05ec317fb tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.160260 Aug 03 05:21:23.756127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3398/6804] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:23 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:24.777525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:24.778135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:24.785604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:24.786055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:24.786824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:24.787264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:24.924620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:24.932049 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e7382b4-c47c-40ec-a10e-7e8a4a314776 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.158486 Aug 03 05:21:24.933295 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3407/6805] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:24 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:25.955572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:25.956200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:25.959151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:25.964005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:25.964513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:25.965350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:25.965805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:26.099095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:26.106880 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5f8eca55-25bb-4c44-ab20-100cb39ff3c9 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.155774 Aug 03 05:21:26.108001 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3399/6806] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:25 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:26.668812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-86429217-5689-42a9-a25e-8ef9673b969f req-26073127-f5f7-4a30-979f-3ef1f3aff132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95ab983-074f-48e2-befc-21139e1cf9c1", "name": "network-vif-plugged", "status": "completed", "tag": "01203fc3-2307-4865-bda3-f9e545660e71"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:26.674758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:26.676330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:26.681671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-86429217-5689-42a9-a25e-8ef9673b969f req-26073127-f5f7-4a30-979f-3ef1f3aff132 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:26.690913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-86429217-5689-42a9-a25e-8ef9673b969f req-26073127-f5f7-4a30-979f-3ef1f3aff132 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:26.693348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-86429217-5689-42a9-a25e-8ef9673b969f req-26073127-f5f7-4a30-979f-3ef1f3aff132 service nova] Creating event network-vif-plugged:01203fc3-2307-4865-bda3-f9e545660e71 for instance c95ab983-074f-48e2-befc-21139e1cf9c1 on n-h2-826756-5 Aug 03 05:21:26.698637 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-86429217-5689-42a9-a25e-8ef9673b969f req-26073127-f5f7-4a30-979f-3ef1f3aff132 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Aug 03 05:21:26.699457 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3408/6807] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:27.128333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:27.128910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:27.135711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:27.136181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:27.136997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:27.137459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:27.267217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:27.275009 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b8e40fb2-0ad8-435a-850d-0b96646abcd8 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1318 microversion: 2.1 time: 0.150920 Aug 03 05:21:27.275575 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3400/6808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:27 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:28.298808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:28.299518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:28.306834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:28.307289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:28.308058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:28.308533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:28.493333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:28.500970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6fc87fa-f881-4939-a1cb-848e1edd29d6 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1507 microversion: 2.1 time: 0.208198 Aug 03 05:21:28.501548 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3409/6809] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:28 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:28.522505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea69b8af-fd4b-4c85-80dd-fe42a62ba9d4", "device": "/dev/sdb"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:28.525463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:28.533441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:28.533920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:28.534726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:28.535187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:29.413665 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c073e45c-d104-4a09-85ac-3b02a8da4609 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "POST /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895282 Aug 03 05:21:29.414289 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3401/6810] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:21:28 2022] POST /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1/os-volume_attachments => generated 194 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:39.742331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:39.745834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:39.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:39.745960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:39.746479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:39.746479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=34 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:21:39.751154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-c9570eda-ce9f-4a3f-814a-75f7c87f9e35 req-a1d9689b-68ef-4d6f-8a98-efe9a103d469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deaa7ba-454b-4f11-80c2-af7a1485c454", "tag": "efab8c2d-0002-4142-b6ad-c12cfb298d7d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:39.752088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:39.752568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:39.753347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:39.753788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:39.762792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c9570eda-ce9f-4a3f-814a-75f7c87f9e35 req-a1d9689b-68ef-4d6f-8a98-efe9a103d469 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:39.763255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-c9570eda-ce9f-4a3f-814a-75f7c87f9e35 req-a1d9689b-68ef-4d6f-8a98-efe9a103d469 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:39.775352 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-c9570eda-ce9f-4a3f-814a-75f7c87f9e35 req-a1d9689b-68ef-4d6f-8a98-efe9a103d469 service nova] Creating event network-changed:efab8c2d-0002-4142-b6ad-c12cfb298d7d for instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 on n-h1-826756-5 Aug 03 05:21:39.780952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-c9570eda-ce9f-4a3f-814a-75f7c87f9e35 req-a1d9689b-68ef-4d6f-8a98-efe9a103d469 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039451 Aug 03 05:21:39.781239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:21:39.781757 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3402/6811] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:40.113325 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59c37942-b041-479b-b9b5-272d0f5ff91e tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 204 len: 0 microversion: 2.1 time: 0.375073 Aug 03 05:21:40.113938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3410/6812] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:21:39 2022] DELETE /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:21:40.128871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:40.129689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:40.137531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:40.138078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:40.139124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:40.139851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:40.278910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:40.287299 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4cf70223-dfa7-433c-a99e-66bb620866ca tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1579 microversion: 2.1 time: 0.162652 Aug 03 05:21:40.291392 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3403/6813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:40 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:21:41.311390 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:41.312184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:41.320659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:41.321110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:41.322026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:41.322647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:41.474013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:41.481627 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d88b572a-461a-4f33-9954-755d160bf7c7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1579 microversion: 2.1 time: 0.174680 Aug 03 05:21:41.482196 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3411/6814] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:41 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:42.194382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-12c800c1-faf4-40ea-ae51-0bd2435afc43 req-0d2c4f41-0b78-4f4c-b8cc-74fde35fd5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deaa7ba-454b-4f11-80c2-af7a1485c454", "name": "network-vif-deleted", "tag": "efab8c2d-0002-4142-b6ad-c12cfb298d7d"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:42.205642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-12c800c1-faf4-40ea-ae51-0bd2435afc43 req-0d2c4f41-0b78-4f4c-b8cc-74fde35fd5a0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:42.206110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-12c800c1-faf4-40ea-ae51-0bd2435afc43 req-0d2c4f41-0b78-4f4c-b8cc-74fde35fd5a0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:42.222211 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-12c800c1-faf4-40ea-ae51-0bd2435afc43 req-0d2c4f41-0b78-4f4c-b8cc-74fde35fd5a0 service nova] Creating event network-vif-deleted:efab8c2d-0002-4142-b6ad-c12cfb298d7d for instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 on n-h1-826756-5 Aug 03 05:21:42.227175 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-12c800c1-faf4-40ea-ae51-0bd2435afc43 req-0d2c4f41-0b78-4f4c-b8cc-74fde35fd5a0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036827 Aug 03 05:21:42.227780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3404/6815] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:42.504363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:42.505602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:42.513350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:42.513992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:42.515002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:42.515727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:42.593817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:42.601833 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03c693d9-91ac-4641-ac31-21b82ce132c1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1225 microversion: 2.1 time: 0.102341 Aug 03 05:21:42.602949 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3412/6816] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:42 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:43.626362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:43.627198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:43.634010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:43.634696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:43.635817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:43.636429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:43.710816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:43.719415 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e53063c-b41f-4650-a190-faf692083993 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1225 microversion: 2.1 time: 0.099842 Aug 03 05:21:43.719996 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3405/6817] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:43 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:44.749445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:44.750259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:44.757345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:44.757804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:44.758586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:44.759023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:44.822409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:44.831324 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbbef4ff-458a-45c6-858f-f153c1cbbba1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1225 microversion: 2.1 time: 0.086380 Aug 03 05:21:44.832028 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3413/6818] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:44 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:45.853397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:45.854047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:45.865622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:45.866405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:45.867441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:45.868109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:45.941448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:45.950199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-560456b1-3097-4dc2-be82-2d84bc90c2f1 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1225 microversion: 2.1 time: 0.101014 Aug 03 05:21:45.951101 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3406/6819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:45 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:46.973400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:46.973979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:46.980633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:46.981094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:46.981867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:46.982313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:47.015273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:47.015940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:47.016447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid 8deaa7ba-454b-4f11-80c2-af7a1485c454 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:21:47.059535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:47.068204 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a742307-fe24-4ae8-8dd7-5b41eba2f8c4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 200 len: 1230 microversion: 2.1 time: 0.098787 Aug 03 05:21:47.069072 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3414/6820] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:46 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:48.090730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:48.091361 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: 8deaa7ba-454b-4f11-80c2-af7a1485c454] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:48.098572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:48.099042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:48.099831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:48.100309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:48.113523 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 HTTP/1.1 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '8deaa7ba-454b-4f11-80c2-af7a1485c454'} Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:21:48.115156 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance 8deaa7ba-454b-4f11-80c2-af7a1485c454 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18ff5158-dcca-4ecb-a7eb-033400d9e8d8 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454" status: 404 len: 111 microversion: 2.1 time: 0.029963 Aug 03 05:21:48.120788 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3407/6821] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:48 2022] GET /compute/v2.1/servers/8deaa7ba-454b-4f11-80c2-af7a1485c454 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:21:52.797536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:52.798015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:52.805720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:52.806084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:52.806851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:52.807283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:52.902235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lazy-loading 'services' on Instance uuid c95ab983-074f-48e2-befc-21139e1cf9c1 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:21:53.140880 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8859ccbe-c805-4ee7-94a9-ae27d604133a tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1/os-volume_attachments/ea69b8af-fd4b-4c85-80dd-fe42a62ba9d4" status: 202 len: 0 microversion: 2.1 time: 0.346929 Aug 03 05:21:53.141476 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3415/6822] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:21:52 2022] DELETE /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1/os-volume_attachments/ea69b8af-fd4b-4c85-80dd-fe42a62ba9d4 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:21:54.920102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:54.920102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:54.931620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:54.932087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:54.933122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:54.933775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:54.965635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:21:55.005630 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-26cd2975-90e5-4037-a5e4-33e8971e2bde req-04c41dd0-4a65-481c-97ed-64bc2b414909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ab6d7-ce13-4f9e-8176-0c2b7ffba708", "tag": "59705293-b71e-41dd-899a-8f9fced7f056"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:55.015931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26cd2975-90e5-4037-a5e4-33e8971e2bde req-04c41dd0-4a65-481c-97ed-64bc2b414909 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:55.016413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-26cd2975-90e5-4037-a5e4-33e8971e2bde req-04c41dd0-4a65-481c-97ed-64bc2b414909 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:55.028070 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-26cd2975-90e5-4037-a5e4-33e8971e2bde req-04c41dd0-4a65-481c-97ed-64bc2b414909 service nova] Creating event network-changed:59705293-b71e-41dd-899a-8f9fced7f056 for instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 on n-h1-826756-5 Aug 03 05:21:55.033689 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-26cd2975-90e5-4037-a5e4-33e8971e2bde req-04c41dd0-4a65-481c-97ed-64bc2b414909 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114112 Aug 03 05:21:55.034475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3416/6823] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:55.308037 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc0628bc-5127-4fec-ad98-a18b80c25ee2 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 204 len: 0 microversion: 2.1 time: 0.394667 Aug 03 05:21:55.315719 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3408/6824] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:21:54 2022] DELETE /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:21:55.319522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:55.319522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:55.324808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:55.326981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:55.333823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:55.334692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:55.926950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:55.938723 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02390efb-82e7-4080-bce1-748de81ea111 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1576 microversion: 2.1 time: 0.625324 Aug 03 05:21:55.939887 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3417/6825] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:55 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1576 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:56.669919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-85e38357-2724-42e8-b889-63a9a18986a1 req-f7fbf270-592d-4c6c-a7b8-0ce8212278ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ab6d7-ce13-4f9e-8176-0c2b7ffba708", "name": "network-vif-deleted", "tag": "59705293-b71e-41dd-899a-8f9fced7f056"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:21:56.682109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-85e38357-2724-42e8-b889-63a9a18986a1 req-f7fbf270-592d-4c6c-a7b8-0ce8212278ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:56.682735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-85e38357-2724-42e8-b889-63a9a18986a1 req-f7fbf270-592d-4c6c-a7b8-0ce8212278ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:56.694928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-85e38357-2724-42e8-b889-63a9a18986a1 req-f7fbf270-592d-4c6c-a7b8-0ce8212278ac service nova] Creating event network-vif-deleted:59705293-b71e-41dd-899a-8f9fced7f056 for instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 on n-h1-826756-5 Aug 03 05:21:56.700542 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-85e38357-2724-42e8-b889-63a9a18986a1 req-f7fbf270-592d-4c6c-a7b8-0ce8212278ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034979 Aug 03 05:21:56.701684 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3409/6826] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:21:56.960649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:56.961676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:56.970409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:56.971144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:56.972059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:56.972646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:57.039927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:57.048440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7f2d59c-2c94-4428-9cee-fc86638cdb15 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1223 microversion: 2.1 time: 0.091593 Aug 03 05:21:57.049060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3418/6827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:56 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:58.071190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:58.072750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:58.081232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.081756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.082323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.082847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.145649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:58.147151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:58.155783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.156549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.157466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.157911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.158037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:58.166726 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b8d2bca-fbc2-486c-b0d4-42ea4eaf1c7a tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1223 microversion: 2.1 time: 0.100830 Aug 03 05:21:58.169874 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3410/6828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:58 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:58.184856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:21:58.559164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e790c9e-7036-45dd-80a2-02fce2a7eb44 tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 204 len: 0 microversion: 2.1 time: 0.417119 Aug 03 05:21:58.559957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3419/6829] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:21:58 2022] DELETE /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:21:58.569387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:58.571568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:58.576660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.577183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.577959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:58.578415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:58.731913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:58.736374 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c70aec62-947c-40a2-8794-4cc33ddd365c tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1513 microversion: 2.1 time: 0.170944 Aug 03 05:21:58.736971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3411/6830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:58 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:59.191032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:59.191770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:59.198675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:59.199126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:59.199893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:59.200364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:59.263009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:59.270755 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d350b862-5816-488c-b5ad-4c56c7212ba7 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1223 microversion: 2.1 time: 0.084705 Aug 03 05:21:59.271745 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3420/6831] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:59 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:21:59.758016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:21:59.758661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:21:59.766379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:59.766915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:59.767757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:21:59.768237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:21:59.906800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:21:59.914556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-029bbae3-947c-4fb5-9fbb-75d3d87e05ea tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1513 microversion: 2.1 time: 0.160531 Aug 03 05:21:59.915127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3412/6832] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:21:59 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:00.292958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:00.293860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:00.301141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:00.301597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:00.302380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:00.302817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:00.370756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:00.380200 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27c2d3ce-006e-4420-93d2-7315f4b2e777 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1223 microversion: 2.1 time: 0.090713 Aug 03 05:22:00.380676 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3421/6833] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:00 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:00.917546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f5c30577-e02a-42c8-a452-8cc62d533806 req-c60e6f0a-ece6-4b52-935b-ae4401c510bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95ab983-074f-48e2-befc-21139e1cf9c1", "name": "network-vif-deleted", "tag": "01203fc3-2307-4865-bda3-f9e545660e71"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:22:00.931611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5c30577-e02a-42c8-a452-8cc62d533806 req-c60e6f0a-ece6-4b52-935b-ae4401c510bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:00.932177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f5c30577-e02a-42c8-a452-8cc62d533806 req-c60e6f0a-ece6-4b52-935b-ae4401c510bd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:00.939304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:00.940145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:00.946799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:00.947256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:00.948042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:00.948518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:00.952891 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f5c30577-e02a-42c8-a452-8cc62d533806 req-c60e6f0a-ece6-4b52-935b-ae4401c510bd service nova] Creating event network-vif-deleted:01203fc3-2307-4865-bda3-f9e545660e71 for instance c95ab983-074f-48e2-befc-21139e1cf9c1 on n-h2-826756-5 Aug 03 05:22:00.960189 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f5c30577-e02a-42c8-a452-8cc62d533806 req-c60e6f0a-ece6-4b52-935b-ae4401c510bd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046029 Aug 03 05:22:00.963551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3413/6834] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:22:01.016045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0ddb1df0f141b2a765c4c4c8f5a0d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4422873adc4e4b728508657d099907d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:01.019654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:22:01.024398 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b01ae18b-bf10-4074-988c-2e5736fdc36d tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 200 len: 1471 microversion: 2.1 time: 0.089563 Aug 03 05:22:01.024997 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3422/6835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:00 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 1471 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:22:01.404155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:01.405043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:01.411714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:01.416134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:01.416134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:01.416134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:01.476980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:01.485648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34d730a8-7a46-4210-8f45-331ff5f06511 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1223 microversion: 2.1 time: 0.085795 Aug 03 05:22:01.486259 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3414/6836] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:01 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:02.047695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:02.048562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] [instance: c95ab983-074f-48e2-befc-21139e1cf9c1] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:02.056154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:02.056656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:02.057434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:02.057905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:02.074915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] HTTP exception thrown: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Request method failure captured: Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 HTTP/1.1 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gUF_A2UcL9x90CUs7Q43YLX7Ta8ZZuy_TcXNkORwFZtVSYxHFaQh06dxujBlDFogInnoFCUB16rAGQNPrrx6qBtCwECLSoN7qfqlyfIhwE93cFVX8klxeMox_SmhxA4rJDvmOfshmiDX8HuB1S-jGKqrJSKcLI-nDT4raCSRIXuaR8 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 4422873adc4e4b728508657d099907d4 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4422873adc4e4b728508657d099907d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4422873adc4e4b728508657d099907d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4422873adc4e4b728508657d099907d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4422873adc4e4b728508657d099907d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 4422873adc4e4b728508657d099907d4 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1256752363 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-VolumesSnapshotTestJSON-1256752363-project Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5d0ddb1df0f141b2a765c4c4c8f5a0d2 Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-VolumesSnapshotTestJSON-1256752363-project Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c95ab983-074f-48e2-befc-21139e1cf9c1'} Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:02.077202 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] Returning 404 to user: Instance c95ab983-074f-48e2-befc-21139e1cf9c1 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a536191-5422-4050-a034-f3d39f0218ad tempest-VolumesSnapshotTestJSON-1256752363 tempest-VolumesSnapshotTestJSON-1256752363-project] 10.222.0.72 "GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1" status: 404 len: 111 microversion: 2.1 time: 0.036394 Aug 03 05:22:02.082405 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3423/6837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:02 2022] GET /compute/v2.1/servers/c95ab983-074f-48e2-befc-21139e1cf9c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:22:02.507315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:02.508044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:02.515697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:02.516178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:02.517000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:02.517465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:02.548769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:02.549260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:02.549738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lazy-loading 'fault' on Instance uuid a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:22:02.592157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51371cd223cb46519727685d4a0f7c50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97672237e83943e29394199375ce1e97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:22:02.600183 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-19e8d48c-a1ec-47c4-a5e5-95c5ccd15113 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 200 len: 1228 microversion: 2.1 time: 0.096949 Aug 03 05:22:02.600797 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3415/6838] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:02 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:22:03.621577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:03.622227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: a52ab6d7-ce13-4f9e-8176-0c2b7ffba708] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:03.630678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:03.631138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:03.631902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:03.632371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:03.645704 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 HTTP/1.1 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'a52ab6d7-ce13-4f9e-8176-0c2b7ffba708'} Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:03.647476 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22296b61-6e71-401c-8182-a92c92432a1f tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708" status: 404 len: 111 microversion: 2.1 time: 0.031263 Aug 03 05:22:03.652433 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3424/6839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:03 2022] GET /compute/v2.1/servers/a52ab6d7-ce13-4f9e-8176-0c2b7ffba708 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:22:04.211693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:04.212200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:04.219843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:04.223102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:04.223102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:04.223102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:04.235700 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 HTTP/1.1 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c5ed0671-2b4d-4219-9016-d9a0fc072f84'} Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:22:04.237360 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0586e3c9-d1f7-444e-9a3b-3f65c35fc1f4 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 404 len: 111 microversion: 2.1 time: 0.031206 Aug 03 05:22:04.242460 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3416/6840] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:22:04 2022] DELETE /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:22:04.248385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:04.248883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] [instance: c5ed0671-2b4d-4219-9016-d9a0fc072f84] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:22:04.255287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:04.255759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:04.256568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:22:04.257015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:22:04.271116 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] HTTP exception thrown: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Request method failure captured: Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 HTTP/1.1 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gF_h-9KH2m1_G1ixEoMirNem4OzqiltLWfPkU8ozchs5hoqyPHpeVmrDY7dGlg1Qx2yxrscONBg1-CABZFdokw7yefY7FWEWpj_yPSSe7exANXz_iF4l5P8ALvWMEZ4bLd2lJwXNMcGmUcq1Nzc-hlkIBIQGgqU8k5o5tsiEZOsurY Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/97672237e83943e29394199375ce1e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_97672237e83943e29394199375ce1e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/97672237e83943e29394199375ce1e97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 97672237e83943e29394199375ce1e97 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBootPattern-379941229 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 51371cd223cb46519727685d4a0f7c50 Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBootPattern-379941229-project Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c5ed0671-2b4d-4219-9016-d9a0fc072f84'} Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:22:04.272934 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Returning 404 to user: Instance c5ed0671-2b4d-4219-9016-d9a0fc072f84 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-547c7076-0b62-4fe0-b564-609ca0803b29 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84" status: 404 len: 111 microversion: 2.1 time: 0.030595 Aug 03 05:22:04.277654 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3425/6841] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:22:04 2022] GET /compute/v2.1/servers/c5ed0671-2b4d-4219-9016-d9a0fc072f84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:22:08.022047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-160c72e8-2009-4e80-8ee6-882a99166606 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] Calling method '.version_select at 0x7fdd47368700>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:22:08.183730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-160c72e8-2009-4e80-8ee6-882a99166606 tempest-TestVolumeBootPattern-379941229 tempest-TestVolumeBootPattern-379941229-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-225511139" status: 202 len: 0 microversion: 2.1 time: 0.166717 Aug 03 05:22:08.184764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3417/6842] 10.222.0.72 () {58 vars in 1260 bytes} [Wed Aug 3 05:22:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-225511139 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:22:48.764925 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:22:48.765627 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:23:26.902366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:26.903134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:27.022144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:27.023002 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:23:27.023002 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:23:27.024424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:27.024882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:27.025722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:27.026200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:27.051578 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e6c4023a-705c-4bfb-babf-0f70a029a79d tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.151308 Aug 03 05:23:27.052146 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3426/6843] 10.222.0.72 () {58 vars in 1185 bytes} [Wed Aug 3 05:23:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:27.151964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:27.152949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:27.158082 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-355499282", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "availability_zone": "nova:n-h1-826756-5", "networks": [{"uuid": "c0be510a-3422-42a2-8349-d0f2aaf81a61"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:27.223318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] validate_networks() for [('c0be510a-3422-42a2-8349-d0f2aaf81a61', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:23:27.620317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:23:27.620840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:23:27.621370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:23:27.621801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:23:27.622233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:23:27.631578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:27.632044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:27.632905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:27.633578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:27.652930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Getting quotas for project ab619e5f740d4bb3b3e179856d4a2d93. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:23:27.658860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Getting quotas for user 9ba739b663d94ac4bf087d778b14dc43 and project ab619e5f740d4bb3b3e179856d4a2d93. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:23:27.671702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:23:27.674327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:23:27.795000 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d09e27be-60d0-4f3b-8c36-11012b5d38c7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644940 Aug 03 05:23:27.795913 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3418/6844] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:23:27.807351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9ceaa3a-fccd-4b18-9458-76a78b36ba3c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:27.808443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9ceaa3a-fccd-4b18-9458-76a78b36ba3c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:27.874994 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9ceaa3a-fccd-4b18-9458-76a78b36ba3c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1328 microversion: 2.1 time: 0.071346 Aug 03 05:23:27.875575 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3427/6845] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:27 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1328 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:28.898226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-482ac626-566d-4fd2-9607-55be9efc6877 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:28.899150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-482ac626-566d-4fd2-9607-55be9efc6877 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:28.962356 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-482ac626-566d-4fd2-9607-55be9efc6877 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1328 microversion: 2.1 time: 0.067861 Aug 03 05:23:28.962936 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3419/6846] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:28 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1328 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:29.984803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:29.993776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:29.996953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:29.997658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:30.003288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:30.005156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:30.092802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-888d0afe-c1c8-4ff3-aa65-6c5ae3f751ed tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1415 microversion: 2.1 time: 0.113411 Aug 03 05:23:30.094859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3428/6847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:29 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1415 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:31.116413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:31.117056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:31.124165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:31.124668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:31.125463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:31.125919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:31.346863 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5775ccd5-e22c-4c6f-bf04-a0899f4cc61a tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.234189 Aug 03 05:23:31.347465 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3420/6848] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:31 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:31.764464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-be332678-a59e-4ed9-ac28-598741ba92f3 req-605bf73e-312a-4b16-bd1b-f49e513b59d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "665e163d-9ab0-4476-a888-7b2a4244254c", "tag": "69e0cdd1-c398-4968-b3eb-c35ee37f63b9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:31.775922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be332678-a59e-4ed9-ac28-598741ba92f3 req-605bf73e-312a-4b16-bd1b-f49e513b59d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:31.776336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-be332678-a59e-4ed9-ac28-598741ba92f3 req-605bf73e-312a-4b16-bd1b-f49e513b59d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:31.788584 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-be332678-a59e-4ed9-ac28-598741ba92f3 req-605bf73e-312a-4b16-bd1b-f49e513b59d0 service nova] Creating event network-changed:69e0cdd1-c398-4968-b3eb-c35ee37f63b9 for instance 665e163d-9ab0-4476-a888-7b2a4244254c on n-h1-826756-5 Aug 03 05:23:31.798295 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-be332678-a59e-4ed9-ac28-598741ba92f3 req-605bf73e-312a-4b16-bd1b-f49e513b59d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037903 Aug 03 05:23:31.799567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3429/6849] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:23:32.375148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:32.375985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:32.383400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:32.383872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:32.384696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:32.385158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:32.559105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b82c7def-5bcf-4361-a53e-b05739614740 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.187715 Aug 03 05:23:32.559671 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3421/6850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:32 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:33.582067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:33.582695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:33.589033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:33.589489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:33.590271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:33.590715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:33.722108 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-38783cf9-f33f-41ec-8855-be8a61992bdd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.145019 Aug 03 05:23:33.722692 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3430/6851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:33 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:34.743402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:34.744036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:34.751007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:34.751474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:34.752775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:34.753333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:34.878058 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-21581d13-0cd6-4aa7-810e-80a20b51d4e7 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.138120 Aug 03 05:23:34.878634 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3422/6852] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:34 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:35.900424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:35.901055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:35.908124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:35.908884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:35.909914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:35.910364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:36.040045 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbea5415-17ec-494c-8e37-242dea7f37bc tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.143618 Aug 03 05:23:36.040748 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3431/6853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:35 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:37.061732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:37.062402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:37.070091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:37.070566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:37.071365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:37.071823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:37.199555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7695fd0a-e73d-4c99-bc33-b4bce3e81ec5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.141613 Aug 03 05:23:37.200121 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3423/6854] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:37 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:38.128207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-348a8f13-55c0-4893-8202-faa69ca6af02 req-2e69d2e6-9194-4d01-a2e0-5eb2acadbe37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665e163d-9ab0-4476-a888-7b2a4244254c", "name": "network-vif-plugged", "status": "completed", "tag": "69e0cdd1-c398-4968-b3eb-c35ee37f63b9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-348a8f13-55c0-4893-8202-faa69ca6af02 req-2e69d2e6-9194-4d01-a2e0-5eb2acadbe37 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-348a8f13-55c0-4893-8202-faa69ca6af02 req-2e69d2e6-9194-4d01-a2e0-5eb2acadbe37 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-348a8f13-55c0-4893-8202-faa69ca6af02 req-2e69d2e6-9194-4d01-a2e0-5eb2acadbe37 service nova] Creating event network-vif-plugged:69e0cdd1-c398-4968-b3eb-c35ee37f63b9 for instance 665e163d-9ab0-4476-a888-7b2a4244254c on n-h1-826756-5 Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-348a8f13-55c0-4893-8202-faa69ca6af02 req-2e69d2e6-9194-4d01-a2e0-5eb2acadbe37 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Aug 03 05:23:38.173487 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3432/6855] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:38.223596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:38.224462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:38.226436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:38.232467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:38.233025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:38.233913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:38.234447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:38.394440 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f0f25b9-8306-46b4-852c-3cbc7a86fc6e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.175331 Aug 03 05:23:38.395021 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3424/6856] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:38 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:23:39.419602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:39.420374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:39.428164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:39.428652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:39.429428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:39.429873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:39.568798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89911afb-0772-46c7-9a30-e8b4d387749c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1463 microversion: 2.1 time: 0.154391 Aug 03 05:23:39.569512 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3433/6857] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:39 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:40.591133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:40.591770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:40.594019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:40.600947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.608941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:40.608941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.608941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:40.731550 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6882fb7b-b158-439f-8bb4-4c5630d7fbe5 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1648 microversion: 2.1 time: 0.144111 Aug 03 05:23:40.732129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3425/6858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:40 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:40.753098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:40.753743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:40.761094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.761581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:40.762348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.762790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:40.893665 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db174174-dbcf-46ce-85b6-e22acc55c8c6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1648 microversion: 2.1 time: 0.144328 Aug 03 05:23:40.894251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3434/6859] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:40 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1648 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:40.914494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:40.915132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:40.921329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.921807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:40.922596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:40.923073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:41.050249 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-90f34d96-1891-4e8d-b8d0-1db256dd852e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1648 microversion: 2.1 time: 0.139409 Aug 03 05:23:41.050830 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3426/6860] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:40 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1648 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:41.110798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1728032293", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "availability_zone": "nova:n-h2-826756-5", "networks": [{"uuid": "c0be510a-3422-42a2-8349-d0f2aaf81a61"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:41.170853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] validate_networks() for [('c0be510a-3422-42a2-8349-d0f2aaf81a61', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:23:41.518176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:23:41.518752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:23:41.519233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:23:41.519674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:23:41.520091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:23:41.529416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:41.529810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:41.530645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:41.531089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:41.549415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Getting quotas for project ab619e5f740d4bb3b3e179856d4a2d93. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:23:41.554655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Getting quotas for user 9ba739b663d94ac4bf087d778b14dc43 and project ab619e5f740d4bb3b3e179856d4a2d93. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:23:41.566832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:23:41.569153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:23:41.678438 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5618d1a7-ec0f-422c-9d76-e7ecd24e34c0 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571259 Aug 03 05:23:41.679116 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3435/6861] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:23:41.690353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7eba3f3b-0b3b-4fae-b646-4b3dfc240751 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:41.690974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7eba3f3b-0b3b-4fae-b646-4b3dfc240751 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:41.754084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7eba3f3b-0b3b-4fae-b646-4b3dfc240751 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1329 microversion: 2.1 time: 0.067638 Aug 03 05:23:41.754683 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3427/6862] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:41 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1329 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:42.777749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:42.778654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:42.789645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:42.790478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:42.791765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:42.792517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:42.870263 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3db887c0-32f3-4748-a4b0-c17a52336f58 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1346 microversion: 2.1 time: 0.097597 Aug 03 05:23:42.870926 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3436/6863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:42 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:43.892110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:43.893976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:43.902132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:43.902642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:43.903455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:43.903921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:43.986932 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a02977dd-afd8-4cd4-a0c8-d606be13a801 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1424 microversion: 2.1 time: 0.097611 Aug 03 05:23:43.987537 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3428/6864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:43 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:45.008778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:45.009555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:45.016491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:45.016942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:45.017743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:45.018178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:45.143117 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0fb70bcc-bad9-4109-b78a-57cec43b14dd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.138077 Aug 03 05:23:45.143696 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3437/6865] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:45 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:45.227455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f8d1e4dd-1c7f-4e01-8403-10441ce46f74 req-7ff004b2-3f0f-4a29-8eac-0a60dc29d90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a912f5-5d8c-402c-ad24-0c433012c64b", "tag": "68c6e522-f9b4-4f5d-b9f8-98d12b47819a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:45.239461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f8d1e4dd-1c7f-4e01-8403-10441ce46f74 req-7ff004b2-3f0f-4a29-8eac-0a60dc29d90f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:45.239950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f8d1e4dd-1c7f-4e01-8403-10441ce46f74 req-7ff004b2-3f0f-4a29-8eac-0a60dc29d90f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:45.251082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f8d1e4dd-1c7f-4e01-8403-10441ce46f74 req-7ff004b2-3f0f-4a29-8eac-0a60dc29d90f service nova] Creating event network-changed:68c6e522-f9b4-4f5d-b9f8-98d12b47819a for instance 76a912f5-5d8c-402c-ad24-0c433012c64b on n-h2-826756-5 Aug 03 05:23:45.256307 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f8d1e4dd-1c7f-4e01-8403-10441ce46f74 req-7ff004b2-3f0f-4a29-8eac-0a60dc29d90f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Aug 03 05:23:45.259546 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3429/6866] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:46.164502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:46.165126 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:46.172083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:46.172571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:46.173345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:46.173887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:46.300227 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee6d251e-adfa-48ae-a8b6-de75c8f403a9 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.139428 Aug 03 05:23:46.300897 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3438/6867] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:46 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:23:47.322441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:47.323180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:47.330412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:47.331779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:47.332627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:47.333099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:47.460724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1efac13a-b32f-45d6-b746-4f58a09efd18 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.142389 Aug 03 05:23:47.461350 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3430/6868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:47 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:48.481869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:48.482483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:48.489994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:48.490448 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:48.491217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:48.491655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:48.620607 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1d7f6e4a-e1cd-491b-b699-e5d71321a5cb tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.142425 Aug 03 05:23:48.621189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3439/6869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:48 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:49.642122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:49.644152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:49.653918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:49.654399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:49.655212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:49.655681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:49.787494 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c15f2d22-2cd0-4d22-b7e4-d416cba3b64b tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.149309 Aug 03 05:23:49.788080 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3431/6870] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:49 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:50.809004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:50.809628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:50.817112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:50.817572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:50.818344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:50.818989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:50.943954 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4dd983a1-e327-435f-a652-7a1ceba01177 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.138649 Aug 03 05:23:50.944560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3440/6871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:50 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:51.699961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3709e286-bfc2-4eac-9a28-1b55852a74f0 req-4c826261-51f1-4549-9fa7-801d5960c915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a912f5-5d8c-402c-ad24-0c433012c64b", "name": "network-vif-plugged", "status": "completed", "tag": "68c6e522-f9b4-4f5d-b9f8-98d12b47819a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:51.710866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3709e286-bfc2-4eac-9a28-1b55852a74f0 req-4c826261-51f1-4549-9fa7-801d5960c915 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:51.711336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3709e286-bfc2-4eac-9a28-1b55852a74f0 req-4c826261-51f1-4549-9fa7-801d5960c915 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:51.723332 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3709e286-bfc2-4eac-9a28-1b55852a74f0 req-4c826261-51f1-4549-9fa7-801d5960c915 service nova] Creating event network-vif-plugged:68c6e522-f9b4-4f5d-b9f8-98d12b47819a for instance 76a912f5-5d8c-402c-ad24-0c433012c64b on n-h2-826756-5 Aug 03 05:23:51.728608 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3709e286-bfc2-4eac-9a28-1b55852a74f0 req-4c826261-51f1-4549-9fa7-801d5960c915 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Aug 03 05:23:51.732506 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3432/6872] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:23:51.966199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:51.966821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:51.968824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:51.969519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:51.975782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:51.976302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:51.977085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:51.977533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:52.107602 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1035c18b-de9f-4a55-85ec-b1a0370b1044 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.145102 Aug 03 05:23:52.108181 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3441/6873] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:51 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:53.130199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:53.130935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:53.132964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:53.139021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:53.139502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:53.140379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:53.140846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:53.270526 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-594d9497-a20b-4795-bc8b-2bb7f8893208 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1464 microversion: 2.1 time: 0.144631 Aug 03 05:23:53.271109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3433/6874] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:53 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:54.292227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:54.292799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:54.300134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.300621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.301389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.301829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.430301 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-79b1ddd0-bb9f-4858-a51d-3d07c6f1d118 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1649 microversion: 2.1 time: 0.141761 Aug 03 05:23:54.430883 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3442/6875] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:54 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:54.451343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:54.451985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:54.459188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.459661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.460503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.460965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.589207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cb4fe391-b4ff-4536-b92b-2f713cd982a1 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1649 microversion: 2.1 time: 0.141463 Aug 03 05:23:54.589788 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3434/6876] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:54 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:54.609815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:54.610416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:54.617222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.617676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.618463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.618903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.743395 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-da3a0489-6693-4d5a-9981-76fac0d0b099 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1649 microversion: 2.1 time: 0.137181 Aug 03 05:23:54.744002 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3443/6877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:54 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1649 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:54.772061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:54.772697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:54.779142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.779605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.780417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:54.780876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:54.806398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:23:55.095997 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a5e2508-bb68-430b-a13e-e101533d1d10 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "DELETE /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 204 len: 0 microversion: 2.1 time: 0.327528 Aug 03 05:23:55.097147 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3435/6878] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:23:54 2022] DELETE /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:23:55.105193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:55.105893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:55.112199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:55.115412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:55.115412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:55.115412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:55.241980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-009d5d74-0621-484d-a0e2-ecb3f93e8bf8 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1655 microversion: 2.1 time: 0.140392 Aug 03 05:23:55.242588 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3444/6879] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:55 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:56.263466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:56.264107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:56.272465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:56.272960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:56.273739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:56.274190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:56.395147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:56.399851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bab42a77-a6ce-4144-8d7e-3453868aaa8e tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1655 microversion: 2.1 time: 0.140282 Aug 03 05:23:56.400462 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3436/6880] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:56 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:23:57.008718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fc6ad527-c559-4d3a-967f-674d391d1be6 req-be196a73-a004-434a-b0af-c5bc49a5c54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a912f5-5d8c-402c-ad24-0c433012c64b", "name": "network-vif-deleted", "tag": "68c6e522-f9b4-4f5d-b9f8-98d12b47819a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:23:57.019576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:57.021792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc6ad527-c559-4d3a-967f-674d391d1be6 req-be196a73-a004-434a-b0af-c5bc49a5c54e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:57.022241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc6ad527-c559-4d3a-967f-674d391d1be6 req-be196a73-a004-434a-b0af-c5bc49a5c54e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:57.026557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=93 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:57.034875 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fc6ad527-c559-4d3a-967f-674d391d1be6 req-be196a73-a004-434a-b0af-c5bc49a5c54e service nova] Creating event network-vif-deleted:68c6e522-f9b4-4f5d-b9f8-98d12b47819a for instance 76a912f5-5d8c-402c-ad24-0c433012c64b on n-h2-826756-5 Aug 03 05:23:57.040258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fc6ad527-c559-4d3a-967f-674d391d1be6 req-be196a73-a004-434a-b0af-c5bc49a5c54e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035120 Aug 03 05:23:57.041304 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3445/6881] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:23:57.421991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:57.422617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:57.425450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:23:57.430615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:57.435694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:57.435694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:57.435694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:57.464756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:57.465227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:57.465718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lazy-loading 'fault' on Instance uuid 76a912f5-5d8c-402c-ad24-0c433012c64b {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:23:57.515847 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0c982ddc-5d81-4e74-acae-64d7c956f725 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 200 len: 1454 microversion: 2.1 time: 0.097961 Aug 03 05:23:57.516710 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3437/6882] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:57 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:23:58.541863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:58.542569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 76a912f5-5d8c-402c-ad24-0c433012c64b] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:58.550253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:58.550705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:58.551471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:58.551909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:58.565042 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] HTTP exception thrown: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Request method failure captured: Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b HTTP/1.1 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gZOFQbdTQoBWTQ9eWmNZJpntW0xbZgVq0CEMm2-iuFFYiCi_ba6lRjeFYuYdp3SOo7hGuGeDC5IVsm0nzfyVtIzL3BcVDRj1X5LJzuzTUbFCqsfBqClYkK_3QVg5VhJBrueHRNXwDiUk_wYQFLILXs8xFZubdw86e1w9D28BTgpfu0 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ab619e5f740d4bb3b3e179856d4a2d93 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestServerMultinode-537081237 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestServerMultinode-537081237 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ab619e5f740d4bb3b3e179856d4a2d93 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestServerMultinode-537081237 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestServerMultinode-537081237-project-admin Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9ba739b663d94ac4bf087d778b14dc43 Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestServerMultinode-537081237-project-admin Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '76a912f5-5d8c-402c-ad24-0c433012c64b'} Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:23:58.566834 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Returning 404 to user: Instance 76a912f5-5d8c-402c-ad24-0c433012c64b could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0e81310b-1e0f-48c9-83d0-36f18200032c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b" status: 404 len: 111 microversion: 2.1 time: 0.031855 Aug 03 05:23:58.572148 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3446/6883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:58 2022] GET /compute/v2.1/servers/76a912f5-5d8c-402c-ad24-0c433012c64b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:23:58.577634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:58.578229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:58.587419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:58.587896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:58.588717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:58.589176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:58.614783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:23:58.979420 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a60c424c-a937-4f8b-8fbd-7f329398ab8c tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "DELETE /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 204 len: 0 microversion: 2.1 time: 0.405864 Aug 03 05:23:58.980018 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3438/6884] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:23:58 2022] DELETE /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:23:58.989001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:23:58.989616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:23:58.996676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:58.997148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:59.000017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:23:59.000017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:23:59.128786 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75db3726-94a7-4c85-9080-16e7caaf2706 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1654 microversion: 2.1 time: 0.144179 Aug 03 05:23:59.129426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3447/6885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:23:58 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:00.151649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:00.152483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:00.160073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:00.160570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:00.161387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:00.161839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:00.288876 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2381d452-130a-4e63-a81e-da9f4ed0f471 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1654 microversion: 2.1 time: 0.141603 Aug 03 05:24:00.289449 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3439/6886] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:00 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:00.879295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cab860c7-fa01-4aa1-9a75-60422f8ef495 req-708da61d-8987-40c4-9cfc-682246d8079f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "665e163d-9ab0-4476-a888-7b2a4244254c", "name": "network-vif-deleted", "tag": "69e0cdd1-c398-4968-b3eb-c35ee37f63b9"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:24:00.889814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cab860c7-fa01-4aa1-9a75-60422f8ef495 req-708da61d-8987-40c4-9cfc-682246d8079f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:00.890267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cab860c7-fa01-4aa1-9a75-60422f8ef495 req-708da61d-8987-40c4-9cfc-682246d8079f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:00.902545 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cab860c7-fa01-4aa1-9a75-60422f8ef495 req-708da61d-8987-40c4-9cfc-682246d8079f service nova] Creating event network-vif-deleted:69e0cdd1-c398-4968-b3eb-c35ee37f63b9 for instance 665e163d-9ab0-4476-a888-7b2a4244254c on n-h1-826756-5 Aug 03 05:24:00.908186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cab860c7-fa01-4aa1-9a75-60422f8ef495 req-708da61d-8987-40c4-9cfc-682246d8079f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Aug 03 05:24:00.909300 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3448/6887] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:24:01.311052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:01.311722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:01.319204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:01.319678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:01.320515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:01.320982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:01.356212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:01.356717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:01.357192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lazy-loading 'fault' on Instance uuid 665e163d-9ab0-4476-a888-7b2a4244254c {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:24:01.405577 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0aa2328a-e3dc-4f22-a894-3a98ec25dca6 tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 200 len: 1453 microversion: 2.1 time: 0.098240 Aug 03 05:24:01.406158 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3440/6888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:01 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:24:02.428609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:24:02.429314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] [instance: 665e163d-9ab0-4476-a888-7b2a4244254c] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:24:02.436539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:02.436992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:02.437767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:24:02.438202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:24:02.451005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] HTTP exception thrown: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Request method failure captured: Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c HTTP/1.1 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gZOFQbdTQoBWTQ9eWmNZJpntW0xbZgVq0CEMm2-iuFFYiCi_ba6lRjeFYuYdp3SOo7hGuGeDC5IVsm0nzfyVtIzL3BcVDRj1X5LJzuzTUbFCqsfBqClYkK_3QVg5VhJBrueHRNXwDiUk_wYQFLILXs8xFZubdw86e1w9D28BTgpfu0 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: ab619e5f740d4bb3b3e179856d4a2d93 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestServerMultinode-537081237 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/ab619e5f740d4bb3b3e179856d4a2d93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestServerMultinode-537081237 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: ab619e5f740d4bb3b3e179856d4a2d93 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestServerMultinode-537081237 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestServerMultinode-537081237-project-admin Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 9ba739b663d94ac4bf087d778b14dc43 Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestServerMultinode-537081237-project-admin Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '665e163d-9ab0-4476-a888-7b2a4244254c'} Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:24:02.452629 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] Returning 404 to user: Instance 665e163d-9ab0-4476-a888-7b2a4244254c could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-46b7077b-0953-4fe0-aa06-d54dc08919fd tempest-TestServerMultinode-537081237 tempest-TestServerMultinode-537081237-project-admin] 10.222.0.72 "GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c" status: 404 len: 111 microversion: 2.1 time: 0.029600 Aug 03 05:24:02.458521 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3449/6889] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:24:02 2022] GET /compute/v2.1/servers/665e163d-9ab0-4476-a888-7b2a4244254c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:24:29.000322 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:24:29.002904 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:24:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:26:08.773748 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:26:08.774346 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:26:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:26:09.173600 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:26:09.174176 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:26:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:26:31.341531 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:26:31.342157 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:26:41.205469 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:26:41.206123 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:26:47.625911 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:26:47.626851 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:26:47.627600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:26:47.628398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:26:47.632386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-85d468c9-0558-4bd6-9b6a-87320581ef3f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Action: 'create', calling method: .version_select at 0x7fdd54e790d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-424214569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrf/Ux+cw1VH6pBI1Ns0zyeD+0JdRTOZvQUT55LuKHLwg4D1Dcj2wduBMm8cFnqHg6UhMLakJ0tiL5bjXMpe/cXXqFDZVoLMXIfOlVlFem8D8K7zVe/EFkQy2vbSYqHuA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:26:47.648042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-85d468c9-0558-4bd6-9b6a-87320581ef3f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Getting quotas for project 0405c0038e544404bf01109b13e2008f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:26:47.654454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-85d468c9-0558-4bd6-9b6a-87320581ef3f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Getting quotas for user 5078827384554a4fa3fb899ec403f50d and project 0405c0038e544404bf01109b13e2008f. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:26:47.800591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-85d468c9-0558-4bd6-9b6a-87320581ef3f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.176795 Aug 03 05:26:47.801186 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3441/6890] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:26:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:26:50.861364 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:26:50.862317 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:26:50.862873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=9 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:26:50.863610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:26:50.867550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1053695681", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "438262ce-1b7e-4322-8ef6-805eec9bda78", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-424214569", "security_groups": [{"name": "tempest-secgroup-smoke-1033096768"}], "networks": [{"uuid": "9b7f57d1-6e3d-4888-a885-037f340dd03d"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:26:51.223673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] validate_networks() for [('9b7f57d1-6e3d-4888-a885-037f340dd03d', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:26:51.716206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:26:51.716677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:26:51.717858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:26:51.718375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:26:51.718801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:26:51.727972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:51.728473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:51.729285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:51.729735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:51.747523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Getting quotas for project 0405c0038e544404bf01109b13e2008f. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:26:51.753164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Getting quotas for user 5078827384554a4fa3fb899ec403f50d and project 0405c0038e544404bf01109b13e2008f. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:26:51.812936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:26:51.815115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='438262ce-1b7e-4322-8ef6-805eec9bda78',volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:26:51.874085 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 39234. Aug 03 05:26:51.874867 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 39236. Aug 03 05:26:52.438767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7180bb46-4312-4aba-8534-80deeb17d367 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.579333 Aug 03 05:26:52.439581 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3450/6891] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:26:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:26:52.451569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba6612eb-da7d-4d44-ad6f-2521d092e61c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:52.456523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba6612eb-da7d-4d44-ad6f-2521d092e61c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:52.469133 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 39242. Aug 03 05:26:52.469892 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 39240. Aug 03 05:26:52.581079 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba6612eb-da7d-4d44-ad6f-2521d092e61c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:52.588699 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba6612eb-da7d-4d44-ad6f-2521d092e61c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1098 microversion: 2.1 time: 0.141977 Aug 03 05:26:52.589520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3442/6892] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:52 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1098 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:53.611248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08de08a6-7626-4ee7-b7d3-5823784a5b79 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:53.611807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08de08a6-7626-4ee7-b7d3-5823784a5b79 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:53.665507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08de08a6-7626-4ee7-b7d3-5823784a5b79 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:53.673595 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08de08a6-7626-4ee7-b7d3-5823784a5b79 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1098 microversion: 2.1 time: 0.067345 Aug 03 05:26:53.674172 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3451/6893] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:53 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1098 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:54.697144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:54.697875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:54.706970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:54.707449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:54.708248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:54.708803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:54.777061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:54.785008 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-042e3140-a20a-49dc-9680-c37b1d424a1a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1196 microversion: 2.1 time: 0.091778 Aug 03 05:26:54.785575 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3443/6894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:54 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1196 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:55.806751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:55.807399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:55.815795 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:55.816252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:55.817047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:55.817487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:56.056009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:56.064816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-456402e8-e143-476f-9866-7577f752a413 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1282 microversion: 2.1 time: 0.261861 Aug 03 05:26:56.069581 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3452/6895] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:55 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1282 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:57.065990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f8ffb897-7aa2-4ad4-bc87-c579b2cd7c16 req-89a08e6e-c38b-4b78-8e10-ac6bbc3fd19b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:26:57.078598 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f8ffb897-7aa2-4ad4-bc87-c579b2cd7c16 req-89a08e6e-c38b-4b78-8e10-ac6bbc3fd19b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:57.079173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f8ffb897-7aa2-4ad4-bc87-c579b2cd7c16 req-89a08e6e-c38b-4b78-8e10-ac6bbc3fd19b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:57.085864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:57.088000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:57.091154 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f8ffb897-7aa2-4ad4-bc87-c579b2cd7c16 req-89a08e6e-c38b-4b78-8e10-ac6bbc3fd19b service nova] Creating event network-changed:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:26:57.101194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f8ffb897-7aa2-4ad4-bc87-c579b2cd7c16 req-89a08e6e-c38b-4b78-8e10-ac6bbc3fd19b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120554 Aug 03 05:26:57.101366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:57.101809 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3444/6896] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:26:57.102051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:57.102835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:57.103595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:57.307334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:57.315909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-be72dbcb-aa7b-46d9-a8ad-05ad4a26fc36 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1282 microversion: 2.1 time: 0.233887 Aug 03 05:26:57.316528 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3453/6897] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:57 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1282 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:58.339268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:58.340025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:58.348551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:58.349026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:58.349831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:58.350293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:58.488385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:58.496739 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-47d296a7-42a4-468a-87cd-5b22e2d47c7a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1282 microversion: 2.1 time: 0.161739 Aug 03 05:26:58.497337 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3445/6898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:58 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:26:59.522047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:26:59.522047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:26:59.527693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:59.528287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:59.529657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:26:59.530245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:26:59.664885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:26:59.673477 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c30b466-a9aa-43af-a5c4-1cc882c8030f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1282 microversion: 2.1 time: 0.157988 Aug 03 05:26:59.674064 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3454/6899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:26:59 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:00.695583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:00.696306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:00.704688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:00.705639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:00.705957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:00.706447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:00.846443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:00.854059 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-529aacc2-65ff-4efa-820f-0395df2a0521 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1282 microversion: 2.1 time: 0.162440 Aug 03 05:27:00.854622 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3446/6900] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:00 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:01.875787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:01.876464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:01.879159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:01.884002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:01.884501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:01.885257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:01.885689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:02.018926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:02.026428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7eac95aa-bd55-417b-80fa-887c90325c4a tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.155330 Aug 03 05:27:02.027037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3455/6901] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:01 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:03.049606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:03.050260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:03.053252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:03.058240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:03.058720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:03.059516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:03.059982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:03.196390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:03.204946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dfaefdf2-90dc-4b47-8292-7d811ee124b2 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.160209 Aug 03 05:27:03.205522 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3447/6902] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:03 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:04.226622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:04.227240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:04.229911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:27:04.235912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:04.236427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:04.237206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:04.237649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:04.370431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:04.378223 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59e0a0fb-8f9d-410d-9b5f-d2f4bcf3239e tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.155553 Aug 03 05:27:04.378801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3456/6903] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:04 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:05.399890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:05.400538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:05.408532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:05.409002 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:05.409786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:05.410239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:05.553277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:05.561718 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-91fc7bff-3637-4ff6-9382-5e0999f5a04c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.165699 Aug 03 05:27:05.563812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3448/6904] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:05 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:06.582751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:06.583351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:06.590317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:06.590770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:06.592016 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:06.592494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:06.730660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:06.738974 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64dff4cd-3655-4620-86ae-0962143b92a1 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.160067 Aug 03 05:27:06.739551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3457/6905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:06 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:07.760665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:07.761305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:07.769537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:07.770008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:07.770797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:07.771257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:07.901971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:07.909758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-76339626-5214-4d10-9569-abc6a2277218 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.153134 Aug 03 05:27:07.910331 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3449/6906] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:07 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:08.931592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:08.932241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:08.939755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:08.940208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:08.941000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:08.941440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:09.080884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:09.088446 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2f693ed9-d2e1-4f14-b66a-6a2f421a003f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.160687 Aug 03 05:27:09.089024 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3458/6907] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:08 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:10.110029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:10.110699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:10.117762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:10.118234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:10.119030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:10.119488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:10.247538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:10.255595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec0298b7-fa21-4eb8-83d8-db98ab022862 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.149666 Aug 03 05:27:10.256174 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3450/6908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:10 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:11.281603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:11.282230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a311710b-2f78-455d-9d10-aeea5e98c732 req-4e3f3e5b-c823-40d8-836a-0998e24bd0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "name": "network-vif-plugged", "status": "completed", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:11.284473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:11.291583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:11.291760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a311710b-2f78-455d-9d10-aeea5e98c732 req-4e3f3e5b-c823-40d8-836a-0998e24bd0b6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:11.292060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:11.292178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a311710b-2f78-455d-9d10-aeea5e98c732 req-4e3f3e5b-c823-40d8-836a-0998e24bd0b6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:11.292916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:11.293381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:11.315032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a311710b-2f78-455d-9d10-aeea5e98c732 req-4e3f3e5b-c823-40d8-836a-0998e24bd0b6 service nova] Creating event network-vif-plugged:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:27:11.315032 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a311710b-2f78-455d-9d10-aeea5e98c732 req-4e3f3e5b-c823-40d8-836a-0998e24bd0b6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106023 Aug 03 05:27:11.315032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3459/6909] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:11.491393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:11.499892 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae067441-cb33-4fa2-82bd-1790a38b7220 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.226546 Aug 03 05:27:11.500645 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3451/6910] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:11 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:27:12.525246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:12.526371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:12.534055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:12.534493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:12.535260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:12.535728 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:12.690829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:12.690829 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-72d4faa7-ae8f-4300-8593-617df9841221 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1270 microversion: 2.1 time: 0.160157 Aug 03 05:27:12.690829 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3460/6911] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:12 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:13.702826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:13.703543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:13.710810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:13.711286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:13.712085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:13.712607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:13.862893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:13.871556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b68dc49e-4322-498a-b221-92785e8284bd tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1460 microversion: 2.1 time: 0.173919 Aug 03 05:27:13.872348 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3452/6912] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:13 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1460 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:27:13.893785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:27:13.894406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:27:13.902628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:13.903079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:13.904813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:13.905469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:14.065296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:27:14.073651 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-465ec1f4-1a33-47aa-abb6-cc10576d5873 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1460 microversion: 2.1 time: 0.183677 Aug 03 05:27:14.074250 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3461/6913] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:27:13 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1460 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:27:16.398306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-642c0c06-dcf0-4833-85dc-42dc5951a63e req-9ff45bc5-d03a-4e3c-a72d-68c4d708eba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:16.412290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-642c0c06-dcf0-4833-85dc-42dc5951a63e req-9ff45bc5-d03a-4e3c-a72d-68c4d708eba9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:16.412290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-642c0c06-dcf0-4833-85dc-42dc5951a63e req-9ff45bc5-d03a-4e3c-a72d-68c4d708eba9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:16.422674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-642c0c06-dcf0-4833-85dc-42dc5951a63e req-9ff45bc5-d03a-4e3c-a72d-68c4d708eba9 service nova] Creating event network-changed:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:27:16.428096 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-642c0c06-dcf0-4833-85dc-42dc5951a63e req-9ff45bc5-d03a-4e3c-a72d-68c4d708eba9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Aug 03 05:27:16.431667 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3453/6914] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:18.443103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}, {"name": "network-changed", "server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:27:18.455540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:27:18.456124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:27:18.469932 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] Creating event network-changed:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:27:18.470491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] Creating event network-changed:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:27:18.476579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-250fe2ea-b69a-47a4-8185-74a2929ace83 req-6ef7bde5-5919-40b0-b1ab-0d526b5ceaef service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036884 Aug 03 05:27:18.477382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3462/6915] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:27:49.011709 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:27:49.012435 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:28:32.066983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:28:32.068631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=58 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:28:32.068790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:28:32.069790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=60 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:28:32.073464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:32.074479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:32.081622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:32.087316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:32.087316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:32.087316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:32.116325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:28:32.146259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c29adfb8-a170-4666-8712-2de7de57c271 req-23820764-869c-4c91-8522-0991808f6d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:28:32.158378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c29adfb8-a170-4666-8712-2de7de57c271 req-23820764-869c-4c91-8522-0991808f6d1b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:32.158903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c29adfb8-a170-4666-8712-2de7de57c271 req-23820764-869c-4c91-8522-0991808f6d1b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:32.171419 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c29adfb8-a170-4666-8712-2de7de57c271 req-23820764-869c-4c91-8522-0991808f6d1b service nova] Creating event network-changed:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:28:32.176997 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c29adfb8-a170-4666-8712-2de7de57c271 req-23820764-869c-4c91-8522-0991808f6d1b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110912 Aug 03 05:28:32.177953 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3463/6916] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:28:32.755222 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ed2ce9a-26e2-460c-a3e6-fac3a89e25df tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "DELETE /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 204 len: 0 microversion: 2.1 time: 0.691291 Aug 03 05:28:32.756029 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3454/6917] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:28:32 2022] DELETE /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:28:32.765218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:32.765938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:32.773426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:32.773882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:32.774649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:32.775094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:32.916862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:32.926804 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d2c95a26-476c-4ceb-b94e-a8717e653b46 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1584 microversion: 2.1 time: 0.166103 Aug 03 05:28:32.929051 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3464/6918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:32 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1584 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:33.950857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:33.951585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:33.958605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:33.959023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:33.959817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:33.960293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:34.095410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:34.102498 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ca15e686-91a0-463d-8d5a-35be4e841fbf tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1466 microversion: 2.1 time: 0.156324 Aug 03 05:28:34.103069 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3455/6919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:33 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:34.894731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9ca876b4-299f-4c75-856f-998320367363 req-7cd5f98e-739e-455f-9d8c-957d5e9a3b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeab55e6-dbc3-4b0b-9dad-a87cdda2608f", "name": "network-vif-deleted", "tag": "2a5af09d-dfb3-42e3-be54-6beef5f34aab"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:28:34.906048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9ca876b4-299f-4c75-856f-998320367363 req-7cd5f98e-739e-455f-9d8c-957d5e9a3b9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:34.906506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9ca876b4-299f-4c75-856f-998320367363 req-7cd5f98e-739e-455f-9d8c-957d5e9a3b9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:34.918421 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9ca876b4-299f-4c75-856f-998320367363 req-7cd5f98e-739e-455f-9d8c-957d5e9a3b9b service nova] Creating event network-vif-deleted:2a5af09d-dfb3-42e3-be54-6beef5f34aab for instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f on n-h1-826756-5 Aug 03 05:28:34.925967 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9ca876b4-299f-4c75-856f-998320367363 req-7cd5f98e-739e-455f-9d8c-957d5e9a3b9b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032727 Aug 03 05:28:34.925967 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3465/6920] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:28:35.125020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:35.125698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:35.133047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:35.133526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:35.134334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:35.134832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:35.201675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:35.211122 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f2478a02-e8d7-451b-9c02-5214964631b6 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1229 microversion: 2.1 time: 0.090168 Aug 03 05:28:35.211882 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3456/6921] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:35 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:36.235694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:36.236486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:36.242855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:36.243320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:36.244094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:36.244560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:36.313022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:36.320895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea8c8013-8563-43aa-8951-df06bef3f73b tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1229 microversion: 2.1 time: 0.091062 Aug 03 05:28:36.321478 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3466/6922] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:36 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:37.342567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:37.343242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:37.350504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:37.350979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:37.351782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:37.352251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:37.418952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:37.427237 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-897bb564-15da-408d-8538-d5c91e920aa0 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1229 microversion: 2.1 time: 0.089021 Aug 03 05:28:37.427831 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3457/6923] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:37 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:38.449959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:38.450671 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:38.457602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:38.458045 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:38.458808 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:38.459248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:38.520652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:38.529116 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22f5eeca-fd24-4320-9097-2dfa91f22492 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1229 microversion: 2.1 time: 0.083688 Aug 03 05:28:38.529699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3467/6924] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:38 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1229 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:39.551083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:39.551730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:39.559279 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:39.559763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:39.560590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:39.561056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:39.592252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:39.592771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:39.593253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lazy-loading 'fault' on Instance uuid eeab55e6-dbc3-4b0b-9dad-a87cdda2608f {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:28:39.633432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5078827384554a4fa3fb899ec403f50d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0405c0038e544404bf01109b13e2008f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:28:39.641104 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db2bb0c0-d6f1-472b-8bc8-b6e713a4c80f tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 200 len: 1234 microversion: 2.1 time: 0.094012 Aug 03 05:28:39.641675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3458/6925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:39 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:28:40.663104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:40.663705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] [instance: eeab55e6-dbc3-4b0b-9dad-a87cdda2608f] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:28:40.670716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:40.671172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:40.671936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:28:40.672403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:28:40.685524 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] HTTP exception thrown: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Request method failure captured: Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f HTTP/1.1 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gaC15fsgkBjbmWB6PzWdXXPHrfbvLUOe-X8bUY6gAJSEad3vkSSJP9DDZt385ty_YIF7Vyf_H-inrSbgmrXjRkdV-1xTWM33lm31iOgGLXnRG7Ua87VKa5ZNv-Q0vqhpsh_wBD8UVo6Dgby3OaO-u-C6J6YhIxZTWg8Hsc2sCU77Ig Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 0405c0038e544404bf01109b13e2008f Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestVolumeBackupRestore-489038839 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0405c0038e544404bf01109b13e2008f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/0405c0038e544404bf01109b13e2008f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_0405c0038e544404bf01109b13e2008f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/0405c0038e544404bf01109b13e2008f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestVolumeBackupRestore-489038839 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 0405c0038e544404bf01109b13e2008f Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestVolumeBackupRestore-489038839 Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestVolumeBackupRestore-489038839-project Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 5078827384554a4fa3fb899ec403f50d Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestVolumeBackupRestore-489038839-project Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'eeab55e6-dbc3-4b0b-9dad-a87cdda2608f'} Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:28:40.687185 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Returning 404 to user: Instance eeab55e6-dbc3-4b0b-9dad-a87cdda2608f could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c6216c0-b04c-4b3c-aed9-dd41316f1d0c tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f" status: 404 len: 111 microversion: 2.1 time: 0.029420 Aug 03 05:28:40.692826 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3468/6926] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:28:40 2022] GET /compute/v2.1/servers/eeab55e6-dbc3-4b0b-9dad-a87cdda2608f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:28:40.918854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-07712a60-ab53-4a58-b176-dc47b8eec016 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] Calling method '.version_select at 0x7fdd5484c820>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:28:41.017136 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-07712a60-ab53-4a58-b176-dc47b8eec016 tempest-TestVolumeBackupRestore-489038839 tempest-TestVolumeBackupRestore-489038839-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-424214569" status: 202 len: 0 microversion: 2.1 time: 0.102826 Aug 03 05:28:41.017730 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3459/6927] 10.222.0.72 () {58 vars in 1266 bytes} [Wed Aug 3 05:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-424214569 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:29:08.115067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:08.115885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=24 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:08.275087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-377097778", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:08.328247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] validate_networks() for None {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:29:08.517143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:29:08.517586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:29:08.518043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:29:08.518453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:29:08.518867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:29:08.527817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:08.528282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:08.529094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:08.529535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:08.547144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Getting quotas for project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:29:08.552336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Getting quotas for user ec67fb22570f4971a2db8f0848620e0f and project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:29:08.565240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:29:08.567505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:29:08.720082 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-02281acf-752e-4a55-8a75-492dc657cccb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608759 Aug 03 05:29:08.720765 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3469/6928] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:29:08.736667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:08.737513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:08.741599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9078fe0-bac3-48b4-8b99-f3ffaa71065e tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:08.742610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9078fe0-bac3-48b4-8b99-f3ffaa71065e tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:08.842892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9078fe0-bac3-48b4-8b99-f3ffaa71065e tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:08.850073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9078fe0-bac3-48b4-8b99-f3ffaa71065e tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1221 microversion: 2.1 time: 0.115515 Aug 03 05:29:08.850659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3460/6929] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:08 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:09.872080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e096c48-9789-4d59-8ad4-cbb6b1a7ec3b tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:09.872731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e096c48-9789-4d59-8ad4-cbb6b1a7ec3b tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:09.925546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e096c48-9789-4d59-8ad4-cbb6b1a7ec3b tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:09.933168 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e096c48-9789-4d59-8ad4-cbb6b1a7ec3b tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1221 microversion: 2.1 time: 0.065388 Aug 03 05:29:09.933792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3470/6930] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:09 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:10.955179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:10.955816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:10.963467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:10.964520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:10.965313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:10.965765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:11.030621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:11.038701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63f3672f-d740-4560-adc5-a16869aa7b84 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1273 microversion: 2.1 time: 0.088132 Aug 03 05:29:11.039306 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3461/6931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:10 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:12.060149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:12.060803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:12.067781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:12.068234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:12.069061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:12.069499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:12.232775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:12.244678 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eab0e5a0-f611-484b-aaba-9bbbf78533ad tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.188707 Aug 03 05:29:12.245957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3471/6932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:12 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:13.271341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:13.272133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:13.281971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:13.285153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:13.285153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:13.285153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:13.417619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:13.426567 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b923b735-7f6a-4971-b672-e5f352d342b8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.159354 Aug 03 05:29:13.432500 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3462/6933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:13 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:29:13.474499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-8072f9dc-4d77-41e4-9882-ea0ac76095da req-f181a561-fad7-40eb-b6b6-338726830228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818c9fb2-4be8-42aa-b96f-db7aecbecd01", "tag": "1fe4f851-2a6e-41c4-a25f-6c1d486178f2"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:13.486793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8072f9dc-4d77-41e4-9882-ea0ac76095da req-f181a561-fad7-40eb-b6b6-338726830228 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:13.487247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-8072f9dc-4d77-41e4-9882-ea0ac76095da req-f181a561-fad7-40eb-b6b6-338726830228 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:13.501403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-8072f9dc-4d77-41e4-9882-ea0ac76095da req-f181a561-fad7-40eb-b6b6-338726830228 service nova] Creating event network-changed:1fe4f851-2a6e-41c4-a25f-6c1d486178f2 for instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 on n-h2-826756-5 Aug 03 05:29:13.507270 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-8072f9dc-4d77-41e4-9882-ea0ac76095da req-f181a561-fad7-40eb-b6b6-338726830228 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038600 Aug 03 05:29:13.508731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3472/6934] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:14.449313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:14.449939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:14.456955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:14.457424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:14.458203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:14.458656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:14.675943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:14.684408 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d94b1a47-1495-4460-8bde-eec66462b29c tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.239470 Aug 03 05:29:14.685026 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3463/6935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:14 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:15.706090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:15.706555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:15.713715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:15.715266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:15.716049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:15.716523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:15.856638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:15.865819 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f7ec8b0-265f-4fa6-90a4-58326c5a4cb8 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.164120 Aug 03 05:29:15.866659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3473/6936] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:15 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:16.888544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:16.889460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:16.896332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:16.896810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:16.897604 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:16.898063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:17.030617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:17.038607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c7d14774-369a-462a-9565-23039448dd88 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.154749 Aug 03 05:29:17.049915 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3464/6937] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:16 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:18.059369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:18.060002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:18.067318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:18.067770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:18.068564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:18.069026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:18.286547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:18.295109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f507611-df9f-430e-87bd-90f92117d344 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.240474 Aug 03 05:29:18.295686 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3474/6938] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:18 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:19.316919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:19.321522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:19.321522 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:19.326304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:19.326780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:19.327590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:19.328101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:19.400976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a2d8f38d-2613-427f-9c1a-1aa36facca2c req-0a20325b-acbf-4f01-ab2b-4870360ce077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c9fb2-4be8-42aa-b96f-db7aecbecd01", "name": "network-vif-plugged", "status": "completed", "tag": "1fe4f851-2a6e-41c4-a25f-6c1d486178f2"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:19.407072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:19.414207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2d8f38d-2613-427f-9c1a-1aa36facca2c req-0a20325b-acbf-4f01-ab2b-4870360ce077 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:19.414655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2d8f38d-2613-427f-9c1a-1aa36facca2c req-0a20325b-acbf-4f01-ab2b-4870360ce077 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:19.426331 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a2d8f38d-2613-427f-9c1a-1aa36facca2c req-0a20325b-acbf-4f01-ab2b-4870360ce077 service nova] Creating event network-vif-plugged:1fe4f851-2a6e-41c4-a25f-6c1d486178f2 for instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 on n-h2-826756-5 Aug 03 05:29:19.431429 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a2d8f38d-2613-427f-9c1a-1aa36facca2c req-0a20325b-acbf-4f01-ab2b-4870360ce077 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034996 Aug 03 05:29:19.433355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3475/6939] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:29:19.463095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:19.470952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d96f18d-ae2d-4a81-9fd5-e2fe6edcd058 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.158256 Aug 03 05:29:19.471540 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3465/6940] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:19 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:20.488405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:20.493656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:20.495449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:20.500813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:20.501289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:20.502044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:20.502484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:20.638546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:20.648244 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19276e74-c718-4008-b875-ace8303d620d tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1321 microversion: 2.1 time: 0.160215 Aug 03 05:29:20.648425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3476/6941] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:20 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:21.670833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:21.671464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:21.678733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:21.679199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:21.679971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:21.680460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:21.809778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:21.817367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-99958a11-3f34-4f51-a4b9-6b52fe7ccc67 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1471 microversion: 2.1 time: 0.151074 Aug 03 05:29:21.817947 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3466/6942] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:21 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:21.890110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-431cb55a-5666-42f9-8de5-a2e46a47e02e tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '.version_select at 0x7fdd4777b8b0>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:21.954882 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-431cb55a-5666-42f9-8de5-a2e46a47e02e tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/7f8f8804a6354ab9a763ad9f08eb99ef" status: 200 len: 371 microversion: 2.1 time: 0.117333 Aug 03 05:29:21.955464 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3477/6943] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 05:29:21 2022] GET /compute/v2.1/os-quota-sets/7f8f8804a6354ab9a763ad9f08eb99ef => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:21.967449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d1e990b6-6ee4-47c2-9fa8-87d13466a5ce tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-555346848", "id": 641620902, "os-flavor-access:is_public": "True"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:21.970488 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:29:21.970488 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:29:22.069032 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d1e990b6-6ee4-47c2-9fa8-87d13466a5ce tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.105839 Aug 03 05:29:22.069639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3467/6944] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:29:21 2022] POST /compute/v2.1/flavors => generated 434 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:22.082206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "641620902"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:22.084624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:22.091803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.100940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.100940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.100940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.185270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7333c40fc7124936ba8aebbc8bd745b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f8804a6354ab9a763ad9f08eb99ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:22.191638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-555346848 {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:29:22.198123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.199382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.200297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.200756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.221251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Getting quotas for project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:29:22.226210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Getting quotas for user ec67fb22570f4971a2db8f0848620e0f and project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:29:22.238342 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.compute.api [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] ram quota exceeded for 7f8f8804a6354ab9a763ad9f08eb99ef, tried to resize instance. Aug 03 05:29:22.238883 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Request method failure captured: Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action HTTP/1.1 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 38 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gejrT4jHBswSxgUgeGrBBtswR38o84li8RJTzV6RQX8HJbRLHHjczay3CJYQxRJzvE6a9FCYfa0-0rxdHvJKb9jGhSTRtJGcl5Xq0jxY8Hl3mBh7csL8KZmbJH2o1mIgL3Cpg8EZg8btS7CZCXWUR5KdGs7JtrB3i30DNfw6CmoToI Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7f8f8804a6354ab9a763ad9f08eb99ef Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,admin,member Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,admin,member Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7f8f8804a6354ab9a763ad9f08eb99ef Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersAdminNegativeTestJSON-77361137-project-admin Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 7333c40fc7124936ba8aebbc8bd745b5 Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersAdminNegativeTestJSON-77361137-project-admin Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: {"resize": {"flavorRef": "641620902"}} Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '818c9fb2-4be8-42aa-b96f-db7aecbecd01', 'body': {'resize': {'flavorRef': '641620902'}}} Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.240986 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-295da574-a1ff-4665-94eb-cfd6faa412a0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action" status: 403 len: 118 microversion: 2.1 time: 0.164220 Aug 03 05:29:22.247010 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3478/6945] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:29:22 2022] POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:29:22.252440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba8549f1-77a0-4091-8bad-cae2cd7ef36a tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:22.253199 n-d-826756-5 devstack@n-api.service[120832]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:29:22.253199 n-d-826756-5 devstack@n-api.service[120832]: warnings.warn(msg) Aug 03 05:29:22.346943 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba8549f1-77a0-4091-8bad-cae2cd7ef36a tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/641620902" status: 202 len: 0 microversion: 2.1 time: 0.098227 Aug 03 05:29:22.347540 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3468/6946] 10.222.0.72 () {58 vars in 1158 bytes} [Wed Aug 3 05:29:22 2022] DELETE /compute/v2.1/flavors/641620902 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:29:22.355569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0d11db34-257f-4931-86af-9b1a414f75c0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:22.378431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0d11db34-257f-4931-86af-9b1a414f75c0 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026470 Aug 03 05:29:22.379165 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3479/6947] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 05:29:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:22.398775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9808acce-a010-4e8f-8076-583e85bcf683 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '.version_select at 0x7fdd59dfc670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:22.467518 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9808acce-a010-4e8f-8076-583e85bcf683 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "GET /compute/v2.1/os-quota-sets/7f8f8804a6354ab9a763ad9f08eb99ef" status: 200 len: 371 microversion: 2.1 time: 0.072344 Aug 03 05:29:22.468102 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3469/6948] 10.222.0.72 () {58 vars in 1242 bytes} [Wed Aug 3 05:29:22 2022] GET /compute/v2.1/os-quota-sets/7f8f8804a6354ab9a763ad9f08eb99ef => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:22.479550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61a86df2-24ce-43a5-9de2-f66cfb4376a2 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1448730081", "id": 1277012748, "os-flavor-access:is_public": "True"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:22.482923 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:29:22.482923 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:29:22.612596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61a86df2-24ce-43a5-9de2-f66cfb4376a2 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.136954 Aug 03 05:29:22.613206 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3480/6949] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:29:22 2022] POST /compute/v2.1/flavors => generated 437 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:22.626822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1277012748"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:22.629317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:22.635539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.636307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.637126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.637594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.784621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7333c40fc7124936ba8aebbc8bd745b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f8f8804a6354ab9a763ad9f08eb99ef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:22.791167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1448730081 {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:29:22.798160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.798624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.799437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:22.799883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:22.820675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Getting quotas for project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:29:22.826238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Getting quotas for user ec67fb22570f4971a2db8f0848620e0f and project cf8df06a14064fad9c77d1e2b1e4367c. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:29:22.838111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] cores quota exceeded for 7f8f8804a6354ab9a763ad9f08eb99ef, tried to resize instance. Aug 03 05:29:22.838672 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Request method failure captured: Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action HTTP/1.1 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 39 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gejrT4jHBswSxgUgeGrBBtswR38o84li8RJTzV6RQX8HJbRLHHjczay3CJYQxRJzvE6a9FCYfa0-0rxdHvJKb9jGhSTRtJGcl5Xq0jxY8Hl3mBh7csL8KZmbJH2o1mIgL3Cpg8EZg8btS7CZCXWUR5KdGs7JtrB3i30DNfw6CmoToI Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7f8f8804a6354ab9a763ad9f08eb99ef Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,admin,member Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,admin,member Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7f8f8804a6354ab9a763ad9f08eb99ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7f8f8804a6354ab9a763ad9f08eb99ef Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-77361137 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminNegativeTestJSON-77361137-project-admin Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 7333c40fc7124936ba8aebbc8bd745b5 Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-77361137-project-admin Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: {"resize": {"flavorRef": "1277012748"}} Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '818c9fb2-4be8-42aa-b96f-db7aecbecd01', 'body': {'resize': {'flavorRef': '1277012748'}}} Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.840874 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4d8ea4e8-d920-4808-a2ca-daf751894dde tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action" status: 403 len: 113 microversion: 2.1 time: 0.219829 Aug 03 05:29:22.846204 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3470/6950] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:29:22 2022] POST /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01/action => generated 113 bytes in 221 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:29:22.852953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-283dabd1-d69f-4be2-a288-ddd0ea625fd2 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:22.853720 n-d-826756-5 devstack@n-api.service[120831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 05:29:22.853720 n-d-826756-5 devstack@n-api.service[120831]: warnings.warn(msg) Aug 03 05:29:22.943555 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-283dabd1-d69f-4be2-a288-ddd0ea625fd2 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "DELETE /compute/v2.1/flavors/1277012748" status: 202 len: 0 microversion: 2.1 time: 0.094928 Aug 03 05:29:22.944255 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3481/6951] 10.222.0.72 () {58 vars in 1161 bytes} [Wed Aug 3 05:29:22 2022] DELETE /compute/v2.1/flavors/1277012748 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:29:22.953007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b4e7eea-06b6-457a-9c3e-526be087d194 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:22.973870 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b4e7eea-06b6-457a-9c3e-526be087d194 tempest-ServersAdminNegativeTestJSON-77361137 tempest-ServersAdminNegativeTestJSON-77361137-project-admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024611 Aug 03 05:29:22.974574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3471/6952] 10.222.0.72 () {58 vars in 1146 bytes} [Wed Aug 3 05:29:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:29:22.996885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:23.003277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:23.004148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:23.004631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:23.005397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:23.005838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:23.030597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:29:23.343797 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56ca46b3-5590-44c6-a150-f6c1be066aef tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "DELETE /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 204 len: 0 microversion: 2.1 time: 0.350538 Aug 03 05:29:23.344338 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3482/6953] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:29:22 2022] DELETE /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:29:23.352333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:23.352995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:23.359385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:23.359854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:23.360666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:23.361120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:23.493031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:23.500844 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72eb9f1e-e9bf-47a6-88d5-1121487539fe tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1477 microversion: 2.1 time: 0.152422 Aug 03 05:29:23.501417 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3472/6954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:23 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:24.522735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:24.523432 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:24.530886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:24.531331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:24.532399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:24.532841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:24.671867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:24.679432 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ae91ad1-84ab-456a-aec3-351b08fc7d9a tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1477 microversion: 2.1 time: 0.160937 Aug 03 05:29:24.684919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3483/6955] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:24 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:25.588253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9edbe760-e432-4806-a6bf-ca40e61a7652 req-9ae47872-8d53-4312-919e-0dfbe2fd40b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818c9fb2-4be8-42aa-b96f-db7aecbecd01", "name": "network-vif-deleted", "tag": "1fe4f851-2a6e-41c4-a25f-6c1d486178f2"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:25.600174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9edbe760-e432-4806-a6bf-ca40e61a7652 req-9ae47872-8d53-4312-919e-0dfbe2fd40b8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:25.600673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9edbe760-e432-4806-a6bf-ca40e61a7652 req-9ae47872-8d53-4312-919e-0dfbe2fd40b8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:25.613240 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9edbe760-e432-4806-a6bf-ca40e61a7652 req-9ae47872-8d53-4312-919e-0dfbe2fd40b8 service nova] Creating event network-vif-deleted:1fe4f851-2a6e-41c4-a25f-6c1d486178f2 for instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 on n-h2-826756-5 Aug 03 05:29:25.618414 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9edbe760-e432-4806-a6bf-ca40e61a7652 req-9ae47872-8d53-4312-919e-0dfbe2fd40b8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034208 Aug 03 05:29:25.619174 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3473/6956] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:25.702180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:25.703094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:25.710400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:25.710855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:25.711634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:25.712073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:25.777820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec67fb22570f4971a2db8f0848620e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8df06a14064fad9c77d1e2b1e4367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:25.786434 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56e59a21-a1c6-4879-82b5-25a5d8dff4bb tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 200 len: 1435 microversion: 2.1 time: 0.089355 Aug 03 05:29:25.787117 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3484/6957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:25 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 1435 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:26.808664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:26.809392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] [instance: 818c9fb2-4be8-42aa-b96f-db7aecbecd01] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:26.815768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:26.816184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:26.817034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:26.817493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:26.830979 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] HTTP exception thrown: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Request method failure captured: Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 HTTP/1.1 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gejWHeI4KhpCrz4OEo8wNmxR9DH0Ncyu1YruJHyPQJz3zu8dq5J8q7G3UvcNUO7gAQw2EcaltjTM8wucW2Je6aqEgNvCtlAQacA1fPtXWfY_O8rzZ3VvaASabf6xW7UHdHseVgaFqNFEHNhnTeqhd_PkG_CWcdXZW_G9c4IPyoMLXQ Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf8df06a14064fad9c77d1e2b1e4367c Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1872083638 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf8df06a14064fad9c77d1e2b1e4367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf8df06a14064fad9c77d1e2b1e4367c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf8df06a14064fad9c77d1e2b1e4367c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf8df06a14064fad9c77d1e2b1e4367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1872083638 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf8df06a14064fad9c77d1e2b1e4367c Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1872083638 Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersAdminNegativeTestJSON-1872083638-project Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: ec67fb22570f4971a2db8f0848620e0f Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1872083638-project Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '818c9fb2-4be8-42aa-b96f-db7aecbecd01'} Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:26.832706 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] Returning 404 to user: Instance 818c9fb2-4be8-42aa-b96f-db7aecbecd01 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-158df4d3-d200-42f5-b21c-6a0173f32498 tempest-ServersAdminNegativeTestJSON-1872083638 tempest-ServersAdminNegativeTestJSON-1872083638-project] 10.222.0.72 "GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01" status: 404 len: 111 microversion: 2.1 time: 0.030900 Aug 03 05:29:26.839093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3474/6958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:26 2022] GET /compute/v2.1/servers/818c9fb2-4be8-42aa-b96f-db7aecbecd01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:29:28.782954 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:29:28.783954 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:29:36.089274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.090285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.091031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.091683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.210599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1220666923", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "63dfdbb7-f384-4204-9c92-78d712e5ddd4"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:36.276139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] validate_networks() for [('63dfdbb7-f384-4204-9c92-78d712e5ddd4', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:29:36.670846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:29:36.671279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:29:36.671764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:29:36.672233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:29:36.672719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:29:36.681829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:36.682286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:36.683454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:36.683908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:36.702465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Getting quotas for project cf3e09bfbf1a46adbb07a186dc2a4c43. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:29:36.707794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Getting quotas for user 589b9184a32a4c6daf1b469dbdae6b70 and project cf3e09bfbf1a46adbb07a186dc2a4c43. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:29:36.721194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:29:36.723500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:29:36.899916 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76350c7e-b2e0-4f5f-abd5-f671de18af05 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816361 Aug 03 05:29:36.900620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3485/6959] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:29:36.913195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-362bd062-ab91-4c06-a37c-db77625d2ad3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:36.913844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-362bd062-ab91-4c06-a37c-db77625d2ad3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:36.917817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.919183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.919935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.920617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=59 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:36.981737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-362bd062-ab91-4c06-a37c-db77625d2ad3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:36.988608 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-362bd062-ab91-4c06-a37c-db77625d2ad3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1215 microversion: 2.1 time: 0.079921 Aug 03 05:29:36.989154 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3475/6960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:36 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:38.011856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-054d929b-532d-43bc-8ea0-3d45e4b1beae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:38.012946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-054d929b-532d-43bc-8ea0-3d45e4b1beae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:38.071187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-054d929b-532d-43bc-8ea0-3d45e4b1beae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:38.078762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-054d929b-532d-43bc-8ea0-3d45e4b1beae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1215 microversion: 2.1 time: 0.072826 Aug 03 05:29:38.079370 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3486/6961] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:38 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:39.099872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:39.100723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:39.110355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:39.110934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:39.111921 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:39.112592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:39.178956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:39.192664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fd6220c-da51-4b35-94a9-d8a0570fc730 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1219 microversion: 2.1 time: 0.097032 Aug 03 05:29:39.193335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3476/6962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:39 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:40.214915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:40.215860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:40.223012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:40.223556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:40.224431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:40.224944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:40.291252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:40.299650 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22afe6d8-3df5-42fd-94c4-d706448a48d5 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1267 microversion: 2.1 time: 0.089439 Aug 03 05:29:40.300243 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3487/6963] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:40 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:41.322389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:41.323499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:41.330563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:41.331036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:41.331838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:41.332317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:41.410767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:41.418888 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8d4ce778-e653-403a-9c76-4c92090933a8 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1273 microversion: 2.1 time: 0.101737 Aug 03 05:29:41.428664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3477/6964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:41 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:42.440200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:42.440783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:42.447717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:42.448171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:42.449497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:42.449497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:42.663189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:42.671854 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a340eadd-fb6d-4f1b-9bad-88d6823dfd40 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.235899 Aug 03 05:29:42.685303 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3488/6965] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:42 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:42.873747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-ee6cb0a2-0b14-4c45-818d-a492191825de req-86d46f86-f1ff-492b-a60f-d28fc5ac7bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:42.884592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ee6cb0a2-0b14-4c45-818d-a492191825de req-86d46f86-f1ff-492b-a60f-d28fc5ac7bfb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:42.885146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-ee6cb0a2-0b14-4c45-818d-a492191825de req-86d46f86-f1ff-492b-a60f-d28fc5ac7bfb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:42.897132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-ee6cb0a2-0b14-4c45-818d-a492191825de req-86d46f86-f1ff-492b-a60f-d28fc5ac7bfb service nova] Creating event network-changed:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h1-826756-5 Aug 03 05:29:42.902285 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-ee6cb0a2-0b14-4c45-818d-a492191825de req-86d46f86-f1ff-492b-a60f-d28fc5ac7bfb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033327 Aug 03 05:29:42.903127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3478/6966] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:43.692865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:43.693522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:43.701319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:43.701779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:43.702542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:43.702980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:43.837413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:43.845760 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fce391b4-f832-45f9-94dd-3149ffd23fbc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.156690 Aug 03 05:29:43.846251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3489/6967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:43 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:44.867667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:44.868329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:44.875617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:44.876091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:44.876929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:44.877384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:45.006468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:45.014674 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4b77eb4-41cc-48f5-9457-996891c61347 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.151384 Aug 03 05:29:45.015252 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3479/6968] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:44 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:46.036992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:46.037608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:46.045622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:46.046076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:46.046846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:46.047285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:46.181801 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:46.189613 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-094da7da-b52d-47e9-95bc-dd69eaad9d5e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.156669 Aug 03 05:29:46.190372 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3490/6969] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:46 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:47.210560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:47.211199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:47.218914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:47.219387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:47.220175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:47.220658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:47.351226 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:47.358867 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e91ca8db-6065-4fd5-8d84-18807fb62ee4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.152250 Aug 03 05:29:47.359427 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3480/6970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:47 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:47.904605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cbd2bbf8-1402-4dc5-8764-7100e1c18694 req-2e2bfab1-39bd-498a-9a6a-c86a8fcfa2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "name": "network-vif-plugged", "status": "completed", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:47.910161 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:47.916429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cbd2bbf8-1402-4dc5-8764-7100e1c18694 req-2e2bfab1-39bd-498a-9a6a-c86a8fcfa2a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:47.916912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cbd2bbf8-1402-4dc5-8764-7100e1c18694 req-2e2bfab1-39bd-498a-9a6a-c86a8fcfa2a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:47.927712 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cbd2bbf8-1402-4dc5-8764-7100e1c18694 req-2e2bfab1-39bd-498a-9a6a-c86a8fcfa2a2 service nova] Creating event network-vif-plugged:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h1-826756-5 Aug 03 05:29:47.933261 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cbd2bbf8-1402-4dc5-8764-7100e1c18694 req-2e2bfab1-39bd-498a-9a6a-c86a8fcfa2a2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 Aug 03 05:29:47.933855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3491/6971] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:29:48.379360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:48.379997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:48.387389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:48.387856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:48.388682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:48.389150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:48.525195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:48.533617 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee078eae-34e6-4c78-81be-43a6d2ba9416 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1315 microversion: 2.1 time: 0.158182 Aug 03 05:29:48.534252 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3481/6972] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:48 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:49.552379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:49.558594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:49.559323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:49.567022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:49.569561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:49.569561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:49.569561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:49.713048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:49.719939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3b2d822f-f488-4c15-82fb-6471f9884fd2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1503 microversion: 2.1 time: 0.168547 Aug 03 05:29:49.720558 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3492/6973] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:49 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:49.741966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:29:49.745766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:49.747922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:29:49.754364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:49.754838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:49.755653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:49.756112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:49.786323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:49.793372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:29:49.799911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:29:49.804699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:29:49.804699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:29:49.804699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:29:49.804699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:29:50.102624 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aab228a0-f441-4510-8bac-1ea6a83db1a9 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "POST /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8/action" status: 202 len: 0 microversion: 2.1 time: 0.365432 Aug 03 05:29:50.103168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3482/6974] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:29:49 2022] POST /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:29:50.117655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:50.118269 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:50.124733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:50.125214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:50.125995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:50.126437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:50.280691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:50.288659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd80c437-3114-4889-ac72-5b974bee50c0 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1512 microversion: 2.1 time: 0.179069 Aug 03 05:29:50.289244 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3493/6975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:50 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:51.310187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:51.310831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:51.318563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:51.319038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:51.319834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:51.320315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:51.457470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:51.465860 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-77202886-ee9e-4c81-b4e7-e10e3a39856f tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1512 microversion: 2.1 time: 0.160371 Aug 03 05:29:51.473812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3483/6976] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:51 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:52.486667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:52.487317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:52.493624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:52.494075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:52.494843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:52.496011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:52.636360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:52.643845 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4e3244c-beac-4e08-81da-06a0a2f707ae tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1512 microversion: 2.1 time: 0.161259 Aug 03 05:29:52.644445 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3494/6977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:52 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:53.666434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:53.671936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:53.673122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:53.673594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:53.674378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:53.674839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:53.808897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:53.816722 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02b96e88-e0c7-47de-bfaa-5b05f0eb40d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1512 microversion: 2.1 time: 0.154526 Aug 03 05:29:53.817303 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3484/6978] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:53 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:29:54.839070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:54.839878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:54.847333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:54.847882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:54.848771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:54.849215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:54.980651 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:54.988381 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5a08399c-e4f5-48b3-b918-1afaa600f622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.154355 Aug 03 05:29:54.988971 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3495/6979] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:54 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:56.012652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:56.013285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:56.020314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:56.020871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:56.021652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:56.022106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:56.161256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:56.169530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-71d691fa-4fc3-43f5-85ff-03d74fce71c2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.160977 Aug 03 05:29:56.170308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3485/6980] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:56 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:57.191004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:57.191618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:57.198741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:57.199186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:57.199945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:57.200411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:57.327414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:57.335041 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61d0d8c2-5af9-40fc-827d-970c4f768651 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.147871 Aug 03 05:29:57.335616 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3496/6981] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:57 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:58.357133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:58.357748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:58.364736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:58.365211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:58.365999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:58.366461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:58.500634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:58.508182 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-154aeabe-7d9d-4d2c-9bb2-a56fd442cd36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.155075 Aug 03 05:29:58.508818 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3486/6982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:58 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:29:59.530633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:29:59.531277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:29:59.538516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:59.538972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:59.539739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:29:59.540173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:29:59.675607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:29:59.678521 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-24b2fe4a-449f-48e6-b6a5-16e1a5d4fcbe tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.152467 Aug 03 05:29:59.679095 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3497/6983] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:29:59 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:00.700535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:00.701177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:00.708476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:00.708958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:00.709757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:00.710223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:00.842470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:00.849407 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3c40b4f-a08e-45fc-9f9d-7e1f96849aee tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.153277 Aug 03 05:30:00.849976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3487/6984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:00 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:01.870988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:01.871513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:01.878576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:01.879004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:01.879773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:01.880231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:02.016560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:02.024123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5916ff3c-d97e-40d9-b739-7cacf032f91a tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.157729 Aug 03 05:30:02.031607 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3498/6985] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:01 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:03.046986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:03.047524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:03.054456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:03.055017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:03.055802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:03.056254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:03.187538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:03.195450 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-233e0b86-60e3-400a-b85e-5d18166e39cf tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.152473 Aug 03 05:30:03.196036 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3488/6986] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:03 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:04.216849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:04.217465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:04.224454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:04.224912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:04.225683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:04.226122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:04.359199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:04.366701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-18c4bab7-b7dd-4bf0-b823-d0b1b6871042 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.153738 Aug 03 05:30:04.367229 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3499/6987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:04 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:05.389348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:05.390021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:05.397020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:05.397494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:05.398294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:05.398756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:05.529819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:05.537764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3bf99dc7-f5e1-4a6e-b03e-3b4d5de2d5d3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.153242 Aug 03 05:30:05.538339 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3489/6988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:05 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:06.559833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:06.560438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:06.567680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:06.568140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:06.568953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:06.569399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:06.709860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:06.712057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=81 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:06.718728 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b918a66-9d6b-4d88-a1f1-0d6546ed8622 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.163093 Aug 03 05:30:06.719314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3500/6989] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:06 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:07.740032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:07.740686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:07.748489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:07.748968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:07.749763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:07.750231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:07.883086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:07.891978 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f88d669-0f2b-4a78-b8f9-83ef3b3f4dc2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.155903 Aug 03 05:30:07.892606 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3490/6990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:07 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:08.914480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:08.915098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:08.918264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:08.923712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:08.924168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:08.924965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:08.925409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:09.058327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:09.065833 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40990567-75e2-4b33-9be0-5b3b4a4b299b tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.155268 Aug 03 05:30:09.066460 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3501/6991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:08 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:10.086580 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:10.087139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:10.095019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:10.095490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:10.096305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:10.096769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:10.099350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:10.233149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:10.240695 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bf34bf0f-11a8-47ef-9bb3-aae47e9977dc tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.158124 Aug 03 05:30:10.241270 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3491/6992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:10 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:11.262076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:11.262708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:11.269837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:11.270417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:11.271200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:11.271644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:11.403153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:11.411527 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0fa08e00-85fa-4b7f-9ce6-599ac43a2050 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.153413 Aug 03 05:30:11.412092 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3502/6993] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:11 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:12.432918 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:12.433606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:12.436300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=41 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:12.441192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:12.441659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:12.442444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:12.442896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:12.575385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:12.584151 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f09f94e4-2428-49d8-9e33-94d397a00949 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.155281 Aug 03 05:30:12.584766 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3492/6994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:12 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:13.609966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:13.610613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:13.617565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:13.618021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:13.618781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:13.619223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:13.752525 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:13.760406 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8988eaf0-5c65-4e64-a1f6-3d1ccf2ba098 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.154312 Aug 03 05:30:13.760992 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3503/6995] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:13 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:14.782120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:14.782947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:14.790072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:14.790547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:14.791417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:14.791878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:14.921418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:14.929021 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-049a4d8a-32cf-4ce7-83b2-279a3c72b4eb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.151648 Aug 03 05:30:14.929593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3493/6996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:14 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:15.951003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:15.951990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:15.959122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:15.959521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:15.960314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:15.960761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:16.098508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:16.106052 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b562a69b-4555-4f52-9292-1833ea9d4692 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.158987 Aug 03 05:30:16.106628 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3504/6997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:15 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:17.127808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:17.128399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:17.135816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:17.136303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:17.137108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:17.137572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:17.265937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:17.273549 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba2251a9-35ff-42d2-989f-b99c951da9bb tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.150445 Aug 03 05:30:17.274136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3494/6998] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:17 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:18.294990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:18.295713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:18.302511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:18.307113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:18.307113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:18.307113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:18.465532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:18.473678 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2288723e-6463-41b8-ac9d-479e479fa069 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.182625 Aug 03 05:30:18.474246 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3505/6999] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:18 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:19.494307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:19.494943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:19.502248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:19.502723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:19.503521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:19.503990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:19.640275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:19.648363 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b92b4cc8-4b5c-4e07-aba9-3154a41adcea tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.157989 Aug 03 05:30:19.651975 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3495/7000] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:19 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:20.671025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:20.671634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:20.680864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:20.688205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:20.688205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:20.688205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:20.830033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:20.837775 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85810b0b-9805-4425-aa94-149eb7f8e62d tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.170699 Aug 03 05:30:20.838392 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3506/7001] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:20 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:21.860655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:21.861300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:21.870459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:21.870937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:21.871735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:21.872200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:22.005636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:22.013616 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b14f4a17-446a-4860-bc0a-ff31e1e7a7c4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.158352 Aug 03 05:30:22.014209 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3496/7002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:21 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:23.035819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:23.036406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:23.042664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:23.043120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:23.043889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:23.044357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:23.171889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:23.179497 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03f5e99c-e6cd-4980-867c-b80f68adab84 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.148240 Aug 03 05:30:23.180080 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3507/7003] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:23 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:24.201934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:24.202630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:24.209318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:24.209821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:24.210615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:24.211105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:24.344485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:24.352154 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a4e3e3c7-413d-42d2-b253-c5777e6e9caa tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.154497 Aug 03 05:30:24.352764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3497/7004] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:24 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:25.373829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:25.375163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:25.381456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:25.381911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:25.382682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:25.383123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:25.565634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:25.573537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6dc9643c-84d4-4a2f-88df-f93893b5219e tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1517 microversion: 2.1 time: 0.203807 Aug 03 05:30:25.574136 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3508/7005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:25 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:26.594347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:26.594986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:26.601911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:26.602382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:26.603178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:26.603636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:26.745860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:26.750153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:26.757431 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2920c3c0-7c2e-4f92-8674-377a20c7ee36 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1516 microversion: 2.1 time: 0.164162 Aug 03 05:30:26.757431 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3498/7006] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:26 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:26.759512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:26.759962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:26.771483 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] Creating event network-vif-unplugged:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h2-826756-5 Aug 03 05:30:26.776857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:30:26.787971 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4e394296-773e-4847-9440-27cb596357db req-9b182054-c34e-40fd-b912-eceb3314acde service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094573 Aug 03 05:30:26.788620 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3509/7007] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:27.776294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:27.776931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:27.784922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:27.791038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:27.791038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:27.791038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:27.919154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:27.927077 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23c92b1d-0c35-401a-afb9-3cdd47c0db34 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1516 microversion: 2.1 time: 0.154816 Aug 03 05:30:27.927652 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3499/7008] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:27 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:28.806117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:28.815920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:28.816395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:28.828186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] Creating event network-changed:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h2-826756-5 Aug 03 05:30:28.833409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:30:28.844725 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-50889c0e-ea65-4454-bfba-30abf1b7c6b7 req-2e30c708-42b1-4091-be7b-a48f8d00dcb7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043400 Aug 03 05:30:28.845316 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3510/7009] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:28.949326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:28.949989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:28.957829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:28.958238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:28.959046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:28.959589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:29.214304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:29.223102 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04cb1ed2-9f81-4a5b-81c0-eee3f8633df3 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1514 microversion: 2.1 time: 0.277859 Aug 03 05:30:29.223696 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3500/7010] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:28 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:30.246064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:30.246760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:30.253715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:30.254169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:30.254928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:30.255363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:30.384641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:30.392241 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c336ccc-657b-4e3f-8c9e-28a36f714492 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1511 microversion: 2.1 time: 0.151164 Aug 03 05:30:30.392834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3511/7011] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:30 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:30.412285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:30.412805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:30.420247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:30.420740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:30.421520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:30.421978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:30.447922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:30:30.626717 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Found an unconfirmed migration during delete, id: 16, status: finished Aug 03 05:30:33.222764 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0ecf1202-626c-494e-a106-a01396992162 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 204 len: 0 microversion: 2.1 time: 2.814360 Aug 03 05:30:33.223447 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3501/7012] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:30:30 2022] DELETE /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 0 bytes in 2816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:30:33.231619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:33.232405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:33.240431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:33.240884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:33.241934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:33.242380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:33.374360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:33.383125 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63369d73-6725-4690-8765-b277305c5f55 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1503 microversion: 2.1 time: 0.155288 Aug 03 05:30:33.383720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3512/7013] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:33 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:33.792357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-5c8f8aea-6890-4a47-85af-2169ccf185e7 req-b1b06ab2-9041-47f7-aa34-4e657ac6317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "name": "network-vif-plugged", "status": "completed", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:33.802358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5c8f8aea-6890-4a47-85af-2169ccf185e7 req-b1b06ab2-9041-47f7-aa34-4e657ac6317a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:33.802825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-5c8f8aea-6890-4a47-85af-2169ccf185e7 req-b1b06ab2-9041-47f7-aa34-4e657ac6317a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:33.813327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-5c8f8aea-6890-4a47-85af-2169ccf185e7 req-b1b06ab2-9041-47f7-aa34-4e657ac6317a service nova] Creating event network-vif-plugged:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h2-826756-5 Aug 03 05:30:33.818333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-5c8f8aea-6890-4a47-85af-2169ccf185e7 req-b1b06ab2-9041-47f7-aa34-4e657ac6317a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083712 Aug 03 05:30:33.818944 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3502/7014] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:34.405589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:34.406199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:34.413472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:34.413923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:34.414688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:34.415123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:34.553294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:34.561141 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc7a62d6-a1f4-4a13-be5a-ef549bae79f4 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1503 microversion: 2.1 time: 0.159499 Aug 03 05:30:34.561746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3513/7015] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:34 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:35.165863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4b733da9-1c25-4383-a8ce-b46612f3ca7c req-06e4859a-b164-43bb-9538-c2680c0aa3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff0235d-4c6c-4352-943a-92416d0f6eb8", "name": "network-vif-deleted", "tag": "ead0ca06-8bd7-4e0d-a4f1-da63afac76ea"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:35.177703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4b733da9-1c25-4383-a8ce-b46612f3ca7c req-06e4859a-b164-43bb-9538-c2680c0aa3a4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:35.178420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4b733da9-1c25-4383-a8ce-b46612f3ca7c req-06e4859a-b164-43bb-9538-c2680c0aa3a4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:35.192248 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4b733da9-1c25-4383-a8ce-b46612f3ca7c req-06e4859a-b164-43bb-9538-c2680c0aa3a4 service nova] Creating event network-vif-deleted:ead0ca06-8bd7-4e0d-a4f1-da63afac76ea for instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 on n-h2-826756-5 Aug 03 05:30:35.197277 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4b733da9-1c25-4383-a8ce-b46612f3ca7c req-06e4859a-b164-43bb-9538-c2680c0aa3a4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036526 Aug 03 05:30:35.197899 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3503/7016] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:35.581892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:35.582505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:35.589459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:35.589862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:35.595138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:35.595138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:35.621914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:35.622366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:35.622818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lazy-loading 'fault' on Instance uuid 1ff0235d-4c6c-4352-943a-92416d0f6eb8 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:30:35.664750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589b9184a32a4c6daf1b469dbdae6b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf3e09bfbf1a46adbb07a186dc2a4c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:35.672821 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3787c1db-e4dc-49e4-8c61-ac3f18c4abe2 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 200 len: 1305 microversion: 2.1 time: 0.094837 Aug 03 05:30:35.673421 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3514/7017] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:35 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:36.695563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:36.696297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:36.703562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:36.704028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:36.705255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:36.705364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:36.719294 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] HTTP exception thrown: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Request method failure captured: Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 HTTP/1.1 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ge_62UQuIwfvvp54qtwuzxIxOwPNoYOLEOCARC1hoFCHvHrcaZTL0PnlIXx61dWWGLz2dnkuLcgZd9Qu6jVQH0NGaJ6pJ-u9fnFhEj8bpc8Y-RrWn0d6NMbdLguQqnn7wYM143Yk5Vl6D9-zalgU-TPba2UjNryEOHXS-WzEd89L8E Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 589b9184a32a4c6daf1b469dbdae6b70 Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1ff0235d-4c6c-4352-943a-92416d0f6eb8'} Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:36.721031 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Returning 404 to user: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-861b0bed-6b03-4d67-bf23-cfaf22beb2ac tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 404 len: 111 microversion: 2.1 time: 0.032003 Aug 03 05:30:36.727211 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3504/7018] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:36 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:30:36.741273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:36.741811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] HTTP exception thrown: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Request method failure captured: Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 HTTP/1.1 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ge_62UQuIwfvvp54qtwuzxIxOwPNoYOLEOCARC1hoFCHvHrcaZTL0PnlIXx61dWWGLz2dnkuLcgZd9Qu6jVQH0NGaJ6pJ-u9fnFhEj8bpc8Y-RrWn0d6NMbdLguQqnn7wYM143Yk5Vl6D9-zalgU-TPba2UjNryEOHXS-WzEd89L8E Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 589b9184a32a4c6daf1b469dbdae6b70 Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1ff0235d-4c6c-4352-943a-92416d0f6eb8'} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:30:37.097319 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Returning 404 to user: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-888400e5-1e5c-4baf-a275-87b38d2ab733 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 404 len: 111 microversion: 2.1 time: 0.030363 Aug 03 05:30:37.100867 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3515/7019] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:30:36 2022] DELETE /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] [instance: 1ff0235d-4c6c-4352-943a-92416d0f6eb8] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] HTTP exception thrown: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Request method failure captured: Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 HTTP/1.1 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ge_62UQuIwfvvp54qtwuzxIxOwPNoYOLEOCARC1hoFCHvHrcaZTL0PnlIXx61dWWGLz2dnkuLcgZd9Qu6jVQH0NGaJ6pJ-u9fnFhEj8bpc8Y-RrWn0d6NMbdLguQqnn7wYM143Yk5Vl6D9-zalgU-TPba2UjNryEOHXS-WzEd89L8E Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/cf3e09bfbf1a46adbb07a186dc2a4c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: cf3e09bfbf1a46adbb07a186dc2a4c43 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-DeleteServersTestJSON-261169913 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 589b9184a32a4c6daf1b469dbdae6b70 Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-DeleteServersTestJSON-261169913-project Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.102818 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1ff0235d-4c6c-4352-943a-92416d0f6eb8'} Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] Returning 404 to user: Instance 1ff0235d-4c6c-4352-943a-92416d0f6eb8 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64a00860-dde3-4717-bc50-6243d5567d10 tempest-DeleteServersTestJSON-261169913 tempest-DeleteServersTestJSON-261169913-project] 10.222.0.72 "GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8" status: 404 len: 111 microversion: 2.1 time: 0.031090 Aug 03 05:30:37.105223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3505/7020] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:36 2022] GET /compute/v2.1/servers/1ff0235d-4c6c-4352-943a-92416d0f6eb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:30:48.545396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=31 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:48.546155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=85 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:48.670185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-813904720", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "ea863e54-c089-424f-9845-b12aed8d0cc5"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:48.732639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] validate_networks() for [('ea863e54-c089-424f-9845-b12aed8d0cc5', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:30:49.192687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:30:49.193245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:30:49.193742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:30:49.194176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:30:49.194581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:30:49.206876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:49.207319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:49.208137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:49.208771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:49.229354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:30:49.234747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for user 1d49a6a2f2a0431782bd4d4ee36c89e3 and project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:30:49.247451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:30:49.249784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:30:49.374202 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6a63315f-de5e-47d1-b99f-c636fa283cbd tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835504 Aug 03 05:30:49.374862 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3516/7021] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:30:49.386170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5c8ee20-4007-4522-b9a6-15baf10f822c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:49.386920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5c8ee20-4007-4522-b9a6-15baf10f822c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:49.391735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:49.392512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:49.448893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5c8ee20-4007-4522-b9a6-15baf10f822c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:49.460536 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5c8ee20-4007-4522-b9a6-15baf10f822c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1217 microversion: 2.1 time: 0.078135 Aug 03 05:30:49.461648 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3506/7022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:49 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:50.483958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8a43797-f375-45c7-a5c3-0d780e3df08b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:50.484626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d8a43797-f375-45c7-a5c3-0d780e3df08b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:50.545943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d8a43797-f375-45c7-a5c3-0d780e3df08b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:50.553557 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8a43797-f375-45c7-a5c3-0d780e3df08b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1217 microversion: 2.1 time: 0.074422 Aug 03 05:30:50.554145 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3517/7023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:50 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:51.575882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:51.576546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:51.595068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:51.595535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:51.596355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:51.596810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:51.663093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:51.671369 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e039677-9c0f-4285-a622-4f010bdc1444 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1269 microversion: 2.1 time: 0.100654 Aug 03 05:30:51.671956 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3507/7024] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:51 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:52.693748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:52.700740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:52.702458 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:52.703014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:52.703761 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:52.704168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:52.911209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:52.921313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee8cf318-2427-41bc-bbaa-7a45bcf29c21 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.231489 Aug 03 05:30:52.930989 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3518/7025] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:52 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:53.700529 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3f471f5c-047c-485f-b209-9ebb3bb28965 req-afb6d4d3-3770-4c08-b721-988c5b7f160e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470153d4-2578-4baf-826e-29db05436464", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:53.710609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3f471f5c-047c-485f-b209-9ebb3bb28965 req-afb6d4d3-3770-4c08-b721-988c5b7f160e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:53.711007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3f471f5c-047c-485f-b209-9ebb3bb28965 req-afb6d4d3-3770-4c08-b721-988c5b7f160e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:53.724146 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3f471f5c-047c-485f-b209-9ebb3bb28965 req-afb6d4d3-3770-4c08-b721-988c5b7f160e service nova] Creating event network-changed:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h1-826756-5 Aug 03 05:30:53.729546 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3f471f5c-047c-485f-b209-9ebb3bb28965 req-afb6d4d3-3770-4c08-b721-988c5b7f160e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095626 Aug 03 05:30:53.730196 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3508/7026] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:53.942204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:53.942849 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:53.949803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:53.952220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:53.953078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:53.953521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:54.137461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:54.145211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c03bff10-bde4-49d3-80a1-e5b0d89275b8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.206927 Aug 03 05:30:54.145806 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3519/7027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:53 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:55.168863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:55.169940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:55.176474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:55.176953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:55.177755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:55.178236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:55.412112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:55.420189 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cea82610-e3b3-4165-975f-672ecc62c310 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.256780 Aug 03 05:30:55.420805 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3509/7028] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:55 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:56.441194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:56.442470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:56.449558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:56.450311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:56.451267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:56.451720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:56.592951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:56.600359 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7879115-3756-4a84-9277-59cd5eef34c4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.163047 Aug 03 05:30:56.600937 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3520/7029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:56 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:57.620989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:57.621602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:57.629248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:57.629717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:57.630506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:57.630966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:57.761867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:57.769683 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a36ebb2f-6f75-4e1a-851f-0da6338ec6ff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.152639 Aug 03 05:30:57.770267 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3510/7030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:57 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:58.071387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a593e6dd-4271-4e7c-bf4d-8e64f640d197 req-8725828f-ab14-4a50-982f-cf0fe42c5c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470153d4-2578-4baf-826e-29db05436464", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:30:58.082270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a593e6dd-4271-4e7c-bf4d-8e64f640d197 req-8725828f-ab14-4a50-982f-cf0fe42c5c6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:58.082722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a593e6dd-4271-4e7c-bf4d-8e64f640d197 req-8725828f-ab14-4a50-982f-cf0fe42c5c6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:58.094282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a593e6dd-4271-4e7c-bf4d-8e64f640d197 req-8725828f-ab14-4a50-982f-cf0fe42c5c6c service nova] Creating event network-vif-plugged:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h1-826756-5 Aug 03 05:30:58.099316 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a593e6dd-4271-4e7c-bf4d-8e64f640d197 req-8725828f-ab14-4a50-982f-cf0fe42c5c6c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Aug 03 05:30:58.105429 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3521/7031] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:30:58.791047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:58.791682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:58.799304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:58.799772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:58.800577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:58.801031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:58.930864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:30:58.938687 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f61178be-001e-4ecc-8b85-a813e85f92f9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1317 microversion: 2.1 time: 0.151594 Aug 03 05:30:58.939266 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3511/7032] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:58 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:30:59.958397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:30:59.962658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:30:59.963357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:30:59.969480 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:59.971786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:30:59.971786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:30:59.971786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.109011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:00.116686 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4a75edce-93d5-400e-af77-ef56e28121af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1506 microversion: 2.1 time: 0.160187 Aug 03 05:31:00.117280 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3522/7033] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:30:59 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:00.137138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:00.138365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:00.140426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:00.146106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.146573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.147351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.147803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.276707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:00.284570 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5b727e1-5eaf-4bb0-83c8-fc4bd824d0ad tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1506 microversion: 2.1 time: 0.151314 Aug 03 05:31:00.285153 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3512/7034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:00 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:00.304260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:00.306797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:00.313329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.313778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.314535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.314970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.426781 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc59f03b-83b2-4eed-ae58-c3418a98a6db tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "PUT /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1078 microversion: 2.1 time: 0.126282 Aug 03 05:31:00.427430 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3523/7035] 10.222.0.72 () {60 vars in 1256 bytes} [Wed Aug 3 05:31:00 2022] PUT /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1078 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:00.445251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:00.445897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:00.452296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.452793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.453592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.454056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.583478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:00.592184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0644c1a5-90b6-436c-bb81-627eaa009eaa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1504 microversion: 2.1 time: 0.150616 Aug 03 05:31:00.592803 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3513/7036] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:00 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:00.612089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:00.612739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:00.614654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:00.619512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.619967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.620763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.621207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.756629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:00.765142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bd52ad6b-2921-4686-89ea-e1741174f507 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1504 microversion: 2.1 time: 0.156990 Aug 03 05:31:00.765722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3524/7037] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:00 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:00.785927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:00.788367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:00.795253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.795716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.796524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:00.796976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:00.824626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:00.830333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:31:00.836550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:31:00.836991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:31:00.837483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:31:00.837911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:31:00.838340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:31:01.027203 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8d574be-3d01-4ca8-8c55-a35d966436d1 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464/action" status: 202 len: 0 microversion: 2.1 time: 0.245070 Aug 03 05:31:01.027840 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3514/7038] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:31:00 2022] POST /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:01.052186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:01.180575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:01.188661 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0346e46-d3e5-4e90-a1ca-7fd40c183328 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1515 microversion: 2.1 time: 0.155172 Aug 03 05:31:01.189240 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3525/7039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:01 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:31:02.210562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:02.211208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:02.219119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:02.219597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:02.220462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:02.220927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:02.357574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:02.365416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-000a92ad-816c-46fa-b2b1-aa7b5e5b0030 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1515 microversion: 2.1 time: 0.159030 Aug 03 05:31:02.365997 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3515/7040] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:02 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:03.388206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:03.389000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:03.397411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:03.397855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:03.398621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:03.399053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:03.533546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:03.541969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e76be284-8fb9-4a7e-9333-f0066e405da0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1515 microversion: 2.1 time: 0.158252 Aug 03 05:31:03.542556 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3526/7041] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:03 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:04.563745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:04.564412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:04.571287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:04.571750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:04.572570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:04.573019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:04.714507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:04.722754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f27a6d42-5c24-4748-9712-bc5723593d3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1515 microversion: 2.1 time: 0.163007 Aug 03 05:31:04.723327 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3516/7042] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:04 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:05.744177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:05.744832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:05.752118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:05.752626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:05.753395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:05.753841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:05.889752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:05.897369 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-67b8fd27-7f7a-417d-ad72-66aa1dc08e52 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.157124 Aug 03 05:31:05.897958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3527/7043] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:05 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:06.921993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:06.922630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:06.929514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:06.929986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:06.930772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:06.931229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:07.059789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:07.067416 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-401c83fd-d486-47cc-9f8f-3bf48caca8aa tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.149970 Aug 03 05:31:07.067993 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3517/7044] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:06 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:08.088988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:08.089537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:08.096381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:08.096829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:08.097583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:08.098012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:08.487118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:08.494819 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8bbca372-d8d7-4155-bb61-d8265a348b1e tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.409788 Aug 03 05:31:08.495404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3528/7045] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:08 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:08.668044 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:31:08.668705 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:31:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:31:09.020193 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:31:09.020428 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:31:09.516138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:09.516800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:09.525865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:09.526340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:09.527132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:09.527592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:09.660895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:09.668540 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-997b8042-1931-4e87-85a8-0627e70e2b27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.157167 Aug 03 05:31:09.669236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3518/7046] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:09 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:10.690647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:10.691256 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:10.701369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:10.701820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:10.702587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:10.703021 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:10.838412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:10.846642 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6ce54ff7-2333-4827-8be7-e02da680ca6a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.159986 Aug 03 05:31:10.847219 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3529/7047] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:10 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:11.867930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:11.868517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:11.876372 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:11.876844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:11.877627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:11.878077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:12.007876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:12.016132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b469aac-c657-4a58-bf13-1609e27c5e1c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.152159 Aug 03 05:31:12.016737 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3519/7048] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:11 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:31:13.037926 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:13.038552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:13.046108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:13.046573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:13.047361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:13.047807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:13.181578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:13.190221 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91a11b2d-c731-4b55-81c8-75c509556209 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.156684 Aug 03 05:31:13.190794 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3530/7049] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:13 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:14.211771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:14.212453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:14.219533 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:14.220005 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:14.220822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:14.221280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:14.352350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:14.359992 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b146050a-dabc-4cf2-8aef-a65aa0fd3150 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.152154 Aug 03 05:31:14.360611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3520/7050] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:14 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:15.381704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:15.382360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:15.389675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:15.390119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:15.390871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:15.391305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:15.525658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:15.534746 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70b2343f-8b1e-4494-84ee-4c60f60903a3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.156984 Aug 03 05:31:15.535318 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3531/7051] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:15 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:16.558056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:16.558691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:16.566335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:16.566816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:16.567606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:16.568062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:16.703314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:16.710967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f3cca48d-b4a0-4643-899b-89261aaa743d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.156979 Aug 03 05:31:16.711546 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3521/7052] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:16 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:17.731804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:17.732386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:17.739919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:17.740530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:17.741310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:17.741765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:17.870923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:17.879310 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d8b57439-7c7d-4487-99ea-c7c12d7d85b9 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.151599 Aug 03 05:31:17.879888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3532/7053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:17 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:18.900257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:18.900983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:18.908646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:18.909385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:18.910168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:18.910625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:19.046644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:19.050287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:19.054928 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cef92f52-8000-41c9-8f88-f82f27977ebf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.158605 Aug 03 05:31:19.055542 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3522/7054] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:18 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:20.076889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:20.077511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:20.080252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:20.085168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:20.085629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:20.086411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:20.086860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:20.091189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:20.218971 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:20.226455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f52be09-70a5-4011-9d95-340858f1be22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.153985 Aug 03 05:31:20.227027 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3533/7055] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:20 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:21.249114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:21.249844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:21.257461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:21.257931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:21.258717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:21.259175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:21.785363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:21.791468 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dbc77b7d-8372-45db-861a-45a5f4cf554c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1520 microversion: 2.1 time: 0.547067 Aug 03 05:31:21.792051 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3523/7056] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:21 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1520 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:22.792081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470153d4-2578-4baf-826e-29db05436464", "name": "network-vif-unplugged", "status": "completed", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:22.802963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:22.803409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:22.812871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:22.813509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:22.815499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=43 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:22.815852 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] Creating event network-vif-unplugged:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h2-826756-5 Aug 03 05:31:22.820237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:22.825717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:22.825717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:22.825920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] Instance 470153d4-2578-4baf-826e-29db05436464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:31:22.826034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:22.834744 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2ac1c503-aee0-4d43-8998-1cffdc37c00a req-49848b86-2cc9-46b3-bb2f-4c3943d5d58f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047049 Aug 03 05:31:22.835454 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3534/7057] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:22.956934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:22.966560 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29ec0d51-d59d-436d-affb-3c62a41dc98d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1519 microversion: 2.1 time: 0.158045 Aug 03 05:31:22.967394 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3524/7058] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:22 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:31:23.994159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:23.995220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:24.001697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:24.002255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:24.002936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:24.003344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:24.145529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:24.151293 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3d625fe-9eab-466f-b43e-fe1b4b36a5bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1519 microversion: 2.1 time: 0.166268 Aug 03 05:31:24.151856 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3535/7059] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:23 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:24.850353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "470153d4-2578-4baf-826e-29db05436464", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:24.861297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:24.861764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:24.873650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] Creating event network-changed:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h2-826756-5 Aug 03 05:31:24.878997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] Instance 470153d4-2578-4baf-826e-29db05436464 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:31:24.889927 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-63acce45-44fe-436e-82b3-4de5a5c72890 req-172efab1-586b-4a15-bb0f-6488f4b91951 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043273 Aug 03 05:31:24.890519 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3525/7060] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:25.173279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:25.173898 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:25.181274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:25.181904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:25.182690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:25.183134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:25.416122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:25.424887 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9357e74f-c2de-495e-b976-9e4b29fe6a3f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1517 microversion: 2.1 time: 0.255470 Aug 03 05:31:25.425879 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3536/7061] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:25 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:26.447707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:26.448472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:26.457616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.458090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:26.458884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.459345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:26.597470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:26.604980 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7311864-e5b3-42a9-bdc2-788b83991163 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1514 microversion: 2.1 time: 0.162354 Aug 03 05:31:26.605605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3526/7062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:26 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:26.625435 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:26.625978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:26.632771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.633228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:26.633997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.634437 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:26.822374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-613a1599-8d73-4ff1-a86f-f523feda6448 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464/action" status: 204 len: 0 microversion: 2.1 time: 0.200567 Aug 03 05:31:26.823034 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3537/7063] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:31:26 2022] POST /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:31:26.833086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:26.833737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:26.840554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.841016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:26.841832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:26.842336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:27.007378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:27.013075 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1191fa81-cd55-4ef2-813f-aa8955f98098 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1514 microversion: 2.1 time: 0.184598 Aug 03 05:31:27.013813 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3527/7064] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:26 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:28.036378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:28.037128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:28.044090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:28.044568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:28.045408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:28.045856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:28.191685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:28.200100 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7400965e-f13f-4021-956e-76219fd11a8a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1514 microversion: 2.1 time: 0.168424 Aug 03 05:31:28.200851 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3538/7065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:28 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:29.221983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:29.222618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:29.229539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:29.230008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:29.231626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:29.232077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:29.360555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:29.368185 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37feeb88-e718-4c92-9b1e-0f16b49ea273 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1506 microversion: 2.1 time: 0.150233 Aug 03 05:31:29.368804 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3528/7066] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:29 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:29.389080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:29.389717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:29.396490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:29.396943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:29.397704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:29.398137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:29.530998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:29.538781 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1a224259-e7aa-49ba-b07e-e8a063a4388f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1506 microversion: 2.1 time: 0.153682 Aug 03 05:31:29.539350 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3539/7067] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:29 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:29.563263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0730bb6b-173a-458f-9e82-73afc364fca4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'create', calling method: .version_select at 0x7fdd47368670>, body: {"keypair": {"name": "tempest-keypair-591479345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOtpSlclmSmtMz/QGKAH9pkTuTKQ1BMCFE65gdtDT17s33LA9r8GgeUb23zckUQ8f4mo6CtA6+Q9Q+28P8NZxO1uQ3pG+l+VivvidW+DXAaDoLj1CWRcs737hoc0sxjaA=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:29.580337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0730bb6b-173a-458f-9e82-73afc364fca4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:31:29.585428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0730bb6b-173a-458f-9e82-73afc364fca4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for user 1d49a6a2f2a0431782bd4d4ee36c89e3 and project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:31:29.674037 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0730bb6b-173a-458f-9e82-73afc364fca4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114723 Aug 03 05:31:29.674654 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3529/7068] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:31:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:29.816095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a0e50cc6-8334-4403-bc08-59136f25016a req-917a35c7-df10-47a0-9fa4-5b08247c2d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470153d4-2578-4baf-826e-29db05436464", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:29.827028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0e50cc6-8334-4403-bc08-59136f25016a req-917a35c7-df10-47a0-9fa4-5b08247c2d10 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:29.827463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0e50cc6-8334-4403-bc08-59136f25016a req-917a35c7-df10-47a0-9fa4-5b08247c2d10 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:29.842278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a0e50cc6-8334-4403-bc08-59136f25016a req-917a35c7-df10-47a0-9fa4-5b08247c2d10 service nova] Creating event network-vif-plugged:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h2-826756-5 Aug 03 05:31:29.847361 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a0e50cc6-8334-4403-bc08-59136f25016a req-917a35c7-df10-47a0-9fa4-5b08247c2d10 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035385 Aug 03 05:31:29.847980 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3540/7069] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:32.067410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:32.068105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:32.075536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:32.076003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:32.076947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:32.077401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:32.207420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:32.215108 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5d39e16-15d2-4f46-8b06-b54514fd9deb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 200 len: 1506 microversion: 2.1 time: 0.152489 Aug 03 05:31:32.215674 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3530/7070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:32 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:32.236174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:32.236798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:32.242951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:32.243400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:32.244154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:32.244614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:32.270009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:31:32.577188 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c28f97fa-a9d7-44c9-95f4-5098bf177bc6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "DELETE /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 204 len: 0 microversion: 2.1 time: 0.345832 Aug 03 05:31:32.577790 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3541/7071] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:31:32 2022] DELETE /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:31:32.633104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1868579345", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "ea863e54-c089-424f-9845-b12aed8d0cc5"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:32.688166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] validate_networks() for [('ea863e54-c089-424f-9845-b12aed8d0cc5', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:31:33.141055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:31:33.141601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:31:33.141990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:31:33.142421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:31:33.142874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:31:33.151919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:33.152922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:33.153754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:33.154212 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:33.174390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:31:33.179555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Getting quotas for user 1d49a6a2f2a0431782bd4d4ee36c89e3 and project 7c6a4962f5a14e90928342032a1a1de7. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:31:33.191884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:31:33.194249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:31:33.309603 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4625f3a2-9b43-42e8-bc36-69700e6238f4 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680228 Aug 03 05:31:33.310276 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3531/7072] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:31:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:31:33.321518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8a5b11bb-54c3-44cc-ae17-4026351d37cc tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:33.322222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8a5b11bb-54c3-44cc-ae17-4026351d37cc tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:33.381863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8a5b11bb-54c3-44cc-ae17-4026351d37cc tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:33.390008 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8a5b11bb-54c3-44cc-ae17-4026351d37cc tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1218 microversion: 2.1 time: 0.072669 Aug 03 05:31:33.390593 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3542/7073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:33 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:34.412358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:34.412997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:34.422413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:34.422925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:34.423756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:34.424233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:34.497879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:34.508909 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c94a62a8-2faf-489e-933b-1c56a503292c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1222 microversion: 2.1 time: 0.101583 Aug 03 05:31:34.509506 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3532/7074] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:34 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:34.526599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b34aff02-9804-40db-8c26-e96e42ef2e9f req-f5994930-2a32-4289-9d52-f121ff39f50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "470153d4-2578-4baf-826e-29db05436464", "name": "network-vif-deleted", "tag": "9f6cee39-b631-4f84-9c15-92cc5b006bee"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:34.538536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b34aff02-9804-40db-8c26-e96e42ef2e9f req-f5994930-2a32-4289-9d52-f121ff39f50d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:34.539072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b34aff02-9804-40db-8c26-e96e42ef2e9f req-f5994930-2a32-4289-9d52-f121ff39f50d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:34.553592 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b34aff02-9804-40db-8c26-e96e42ef2e9f req-f5994930-2a32-4289-9d52-f121ff39f50d service nova] Creating event network-vif-deleted:9f6cee39-b631-4f84-9c15-92cc5b006bee for instance 470153d4-2578-4baf-826e-29db05436464 on n-h2-826756-5 Aug 03 05:31:34.561507 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b34aff02-9804-40db-8c26-e96e42ef2e9f req-f5994930-2a32-4289-9d52-f121ff39f50d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038476 Aug 03 05:31:34.562144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3543/7075] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:35.529832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:35.530478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:35.538028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:35.538507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:35.539339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:35.540048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:35.629946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:35.638073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cecb1240-6d21-470f-9adb-414a2edfea1b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1278 microversion: 2.1 time: 0.112292 Aug 03 05:31:35.638671 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3533/7076] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:35 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:36.661486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:36.662197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:36.668590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:36.669046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:36.669825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:36.670266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:36.914224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:36.922982 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9b62436c-f3da-4fb4-a160-1921bebf9a3a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.266855 Aug 03 05:31:36.923586 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3544/7077] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:36 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:37.440955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-072268f3-a577-4c70-addb-1b2b2ff6407a req-d882a0bc-1fb1-42be-a96e-a119100671c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:37.451802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-072268f3-a577-4c70-addb-1b2b2ff6407a req-d882a0bc-1fb1-42be-a96e-a119100671c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:37.452307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-072268f3-a577-4c70-addb-1b2b2ff6407a req-d882a0bc-1fb1-42be-a96e-a119100671c9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:37.463434 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-072268f3-a577-4c70-addb-1b2b2ff6407a req-d882a0bc-1fb1-42be-a96e-a119100671c9 service nova] Creating event network-changed:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h1-826756-5 Aug 03 05:31:37.470406 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-072268f3-a577-4c70-addb-1b2b2ff6407a req-d882a0bc-1fb1-42be-a96e-a119100671c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033294 Aug 03 05:31:37.471106 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3534/7078] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:37.944696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:37.945326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:37.953100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:37.953560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:37.954343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:37.954807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:38.162397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:38.170597 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-467ee36c-3814-4751-9153-b80ccbf970eb tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.229863 Aug 03 05:31:38.171192 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3545/7079] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:37 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:39.191886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:39.192635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:39.200092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:39.200594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:39.201386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:39.201852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:39.332217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:39.339804 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e62fbff-b815-4332-84b9-5a10fb375282 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.152117 Aug 03 05:31:39.340395 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3535/7080] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:39 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:40.359785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:40.360450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:40.367644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:40.368101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:40.368911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:40.369360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:40.505853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:40.514216 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d58be8f-5c13-4698-9503-9fa98a15c6e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.158472 Aug 03 05:31:40.514792 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3546/7081] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:40 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:41.535273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:41.535935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:41.543723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:41.544202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:41.545021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:41.545479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:41.675020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:41.682643 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f184d650-55bc-482b-9fb8-591dff8b60ce tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.151610 Aug 03 05:31:41.683588 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3536/7082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:41 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:42.435631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4f913ad1-5094-4327-90c0-10a297dcd7a8 req-0aaaf41f-c40c-4c93-84d8-84d9344ba645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "name": "network-vif-plugged", "status": "completed", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:42.446378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4f913ad1-5094-4327-90c0-10a297dcd7a8 req-0aaaf41f-c40c-4c93-84d8-84d9344ba645 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:42.446829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4f913ad1-5094-4327-90c0-10a297dcd7a8 req-0aaaf41f-c40c-4c93-84d8-84d9344ba645 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:42.461266 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4f913ad1-5094-4327-90c0-10a297dcd7a8 req-0aaaf41f-c40c-4c93-84d8-84d9344ba645 service nova] Creating event network-vif-plugged:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h1-826756-5 Aug 03 05:31:42.466591 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4f913ad1-5094-4327-90c0-10a297dcd7a8 req-0aaaf41f-c40c-4c93-84d8-84d9344ba645 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035542 Aug 03 05:31:42.467372 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3547/7083] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:31:42.704545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:42.705940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:42.713039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:42.713515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:42.714347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:42.714809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:42.844258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:42.851983 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b41ac19-76d0-4a6b-b956-50af5328cb64 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1318 microversion: 2.1 time: 0.152079 Aug 03 05:31:42.852590 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3537/7084] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:42 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:43.873965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:43.874726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:43.876789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:43.882723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:43.883179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:43.883981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:43.884460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.021280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:44.025075 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9690e9c8-ed5c-4f76-9c8c-0feabc5fbb8c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1507 microversion: 2.1 time: 0.156116 Aug 03 05:31:44.025642 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3548/7085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:43 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:44.046311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:44.046989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:44.049105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:44.049805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:44.055624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.061398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.061398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.061398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.193824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:44.202278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b373c2a4-9a81-4695-919f-4c373dd8e384 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1507 microversion: 2.1 time: 0.159999 Aug 03 05:31:44.202870 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3538/7086] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:44 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:44.223117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:31:44.225578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:44.231647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.232376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.233283 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.233733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.261957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:44.268848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Old instance type m1.heat2, new instance type m1.heat {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:31:44.275098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:31:44.275529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:31:44.276015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:31:44.276466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:31:44.276887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:31:44.292786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:44.530427 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9aff716e-80f9-4a19-b222-f0d95b6e4109 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897/action" status: 202 len: 0 microversion: 2.1 time: 0.311229 Aug 03 05:31:44.531060 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3549/7087] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:31:44 2022] POST /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:31:44.539885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:44.540504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:44.555026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.555026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.555026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:44.555026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:44.679336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:44.687260 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e7a0338-0ae2-4a33-97cf-b44890f1cd22 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1514 microversion: 2.1 time: 0.151777 Aug 03 05:31:44.687862 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3539/7088] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:44 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:45.710904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:45.716548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:45.719005 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:45.719535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:45.720427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:45.720947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:45.865993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:45.874123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b4e3bc1a-0e50-446a-922f-a06a221fa167 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1514 microversion: 2.1 time: 0.168157 Aug 03 05:31:45.874721 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3550/7089] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:45 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:46.898228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:46.898857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:46.906782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:46.913969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:46.913969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:46.913969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:47.075874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:47.084615 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff885179-2703-4061-bc99-2bbb01147f8d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1514 microversion: 2.1 time: 0.190487 Aug 03 05:31:47.085218 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3540/7090] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:46 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:48.106562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:48.107235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:48.115393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:48.115853 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:48.116646 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:48.117091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:48.244903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:48.252796 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-401fd83e-bb21-420f-b179-bbbe67a850cf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.150165 Aug 03 05:31:48.253314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3551/7091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:48 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:49.274198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:49.274866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:49.282791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:49.283264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:49.284058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:49.284817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:49.418125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:49.425890 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e5347f5-5e08-4395-bdfc-ed5e8a79380a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155637 Aug 03 05:31:49.426468 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3541/7092] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:49 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:31:50.447094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:50.447740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:50.455055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:50.455510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:50.456302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:50.456743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:50.599383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:50.607187 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ce014a3-35c6-4d10-8162-66a05a3c8637 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.164022 Aug 03 05:31:50.607767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3552/7093] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:50 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:51.631241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:51.631785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:51.638994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:51.639644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:51.640521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:51.640978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:51.643560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=99 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:51.775029 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:51.783215 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3b9fe1d2-ecba-426e-ac4c-900329ba805d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155989 Aug 03 05:31:51.783794 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3542/7094] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:51 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:52.805786 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:52.806405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:52.808497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:52.814592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:52.815055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:52.815834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:52.816301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:52.949658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:52.957676 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1f3e0517-fa17-4b70-ab39-edbaa1497dab tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155950 Aug 03 05:31:52.958218 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3553/7095] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:52 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:53.979436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:53.980053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:53.981934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:31:53.987374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:53.987837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:53.988644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:53.989098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:54.125080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:54.132595 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c154ecf-63ee-4425-9197-ae4d63ef3d83 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.157453 Aug 03 05:31:54.133212 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3543/7096] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:53 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:55.153643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:55.154943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:55.162643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:55.163127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:55.163899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:55.164365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:55.295706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:55.303523 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6123000b-8350-4bdf-b94d-6dccd28dbed3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.153813 Aug 03 05:31:55.304109 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3554/7097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:55 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:56.324260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:56.324853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:56.332719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:56.333196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:56.333984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:56.334446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:56.477026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:56.485106 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f50620b-d3e5-48db-bdbe-cedc6cdcf51a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.164781 Aug 03 05:31:56.485677 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3544/7098] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:56 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:57.506636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:57.507255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:57.515025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:57.515477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:57.516240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:57.516705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:58.000658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:58.008258 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-12ae52d5-0004-42ec-8b06-a2facadb1781 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.505684 Aug 03 05:31:58.008866 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3555/7099] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:57 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:31:59.030916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:31:59.031540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:31:59.038717 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:59.039177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:59.039953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:31:59.040436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:31:59.169206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:31:59.176862 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f70021dc-add2-4c36-9cc9-0f3dd38e8bd2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.150620 Aug 03 05:31:59.177434 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3545/7100] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:31:59 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:00.198314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:00.199019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:00.206599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:00.207053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:00.207821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:00.208284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:00.338386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:00.345979 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-101d24c9-f20e-4156-ad7c-0bafac65e62a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.151590 Aug 03 05:32:00.346554 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3556/7101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:00 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:01.367733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:01.368398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:01.375712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:01.378581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:01.378581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:01.378581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:01.507086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:01.515405 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9bff711-b851-4002-a8d1-1ef5f78da2d5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.151686 Aug 03 05:32:01.516005 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3546/7102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:01 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:02.537094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:02.537640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:02.544621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:02.545901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:02.546884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:02.547337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:02.680287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:02.687794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4eafbae-f220-48a9-ac72-8ca7a689e110 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155027 Aug 03 05:32:02.688389 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3557/7103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:02 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:03.709294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:03.709941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:03.717649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:03.718193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:03.719035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:03.719497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:03.850427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:03.858923 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e1a5aff-b4f4-4cf7-8959-f74d44070a48 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.153529 Aug 03 05:32:03.859527 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3547/7104] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:03 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:04.879792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:04.880394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:04.887598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:04.888052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:04.888886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:04.889322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:05.017345 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:05.025060 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1cc2bcdc-a81e-4c5d-be55-401a369d0fff tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.149264 Aug 03 05:32:05.026001 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3558/7105] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:04 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:06.047975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:06.048642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:06.055672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:06.056144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:06.056982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:06.057423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:06.191500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:06.199531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f58aa7f0-d42e-46d9-8c4c-43fcb9337a27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.156154 Aug 03 05:32:06.200112 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3548/7106] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:06 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:07.222289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:07.222914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:07.229931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:07.230387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:07.231155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:07.231593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:07.360557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:07.368196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b721361-e7ec-4dd9-a975-8edb7672fd27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.149921 Aug 03 05:32:07.368821 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3559/7107] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:07 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:08.390034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:08.390655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:08.397738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:08.398200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:08.398978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:08.399430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:08.536847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:08.545264 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4a77e9b2-4b2e-4176-a846-f446e8778b8f tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.159134 Aug 03 05:32:08.545898 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3549/7108] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:08 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:09.567450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:09.568095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:09.575266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:09.575725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:09.576635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:09.577082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:09.709063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:09.717498 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ce2f684-0e1e-4ce0-9517-dc76f1d7d4f3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.153495 Aug 03 05:32:09.718220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3560/7109] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:09 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:10.749253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:10.749882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:10.756763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:10.757229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:10.758036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:10.758488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:10.892728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:10.900412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ff3a680b-620b-4060-b7be-929d40c56d71 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155518 Aug 03 05:32:10.901000 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3550/7110] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:10 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:11.923656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:11.924354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:11.931235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:11.931692 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:11.932498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:11.932947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:12.066058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:12.073857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e85debe6-101f-45bf-b079-5c43f829b510 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.154950 Aug 03 05:32:12.074434 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3561/7111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:11 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:13.095987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:13.096642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:13.103638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:13.104104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:13.104907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:13.105363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:13.236881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:13.244623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e93116a0-141a-46cb-8e54-5063622c2290 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.153368 Aug 03 05:32:13.245139 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3551/7112] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:13 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:14.265791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:14.266414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:14.273467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:14.273929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:14.274764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:14.275209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:14.408569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:14.416367 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5702a7ad-f89f-4838-9f82-732cd39b152c tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.154465 Aug 03 05:32:14.416958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3562/7113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:14 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:15.449927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:15.451100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:15.458247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:15.458723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:15.459504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:15.459961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:15.590953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:15.599275 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f0059e93-7b10-41c8-b498-eb48f6a74598 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.153294 Aug 03 05:32:15.599859 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3552/7114] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:15 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:16.620831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:16.621466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:16.629276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:16.629736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:16.630506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:16.630944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:16.764602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:16.772089 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c91b991b-0881-4825-b83c-1754a1356a35 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155221 Aug 03 05:32:16.772691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3563/7115] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:16 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:17.793295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:17.793937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:17.802616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:17.803094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:17.803894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:17.804382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:17.937268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:17.945031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3103ae7c-8622-41f9-9821-45281db86bd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.155874 Aug 03 05:32:17.945611 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3553/7116] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:17 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:18.967486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:18.968058 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:18.975363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:18.982523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:18.982523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:18.982523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:18.982523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:19.109543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:19.116961 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2454b8d-6e23-4016-bf7b-367dc9d6e9af tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1519 microversion: 2.1 time: 0.154285 Aug 03 05:32:19.117543 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3564/7117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:18 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:20.139166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:20.139856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:20.147645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:20.148126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:20.148967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:20.149427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:20.287599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:20.296182 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-29c96b0e-1c9c-43e9-84d9-3e88464596a8 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1518 microversion: 2.1 time: 0.161823 Aug 03 05:32:20.296834 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3554/7118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:20 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:20.813100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "name": "network-vif-unplugged", "status": "completed", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:20.824052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:20.837711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:20.837711 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] Creating event network-vif-unplugged:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h2-826756-5 Aug 03 05:32:20.843952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] Instance 46ce4375-2419-4544-b019-606ae2092897 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:32:20.855651 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-84953ad6-5fa7-4d03-90a6-77facda83b92 req-5de0426b-3de3-4081-acfc-6519e2156aaf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046614 Aug 03 05:32:20.856365 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3565/7119] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:21.318727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:21.319393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:21.326638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:21.330214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:21.330214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:21.330214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:21.466194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:21.473858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f87de11-20a7-4b78-88d3-5646adbe24bf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1518 microversion: 2.1 time: 0.159099 Aug 03 05:32:21.474445 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3555/7120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:21 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:22.498751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:22.499373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:22.505806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:22.506257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:22.507029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:22.507500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:22.643430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:22.651176 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a626a053-a5ed-4405-ada9-72fb6de0571b tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1516 microversion: 2.1 time: 0.158664 Aug 03 05:32:22.651786 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3566/7121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:22 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:22.869962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:22.879579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:22.880068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:22.882605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=84 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:22.892730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] Creating event network-changed:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h2-826756-5 Aug 03 05:32:22.897909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] Instance 46ce4375-2419-4544-b019-606ae2092897 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:32:22.909310 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-25151e17-89e3-493a-88a7-b4a744103529 req-99ccce6f-c0fc-47e4-86ff-842eaf2a7b6c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043217 Aug 03 05:32:22.910210 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3556/7122] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:23.674484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:23.675100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:23.677214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=28 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:23.682097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:23.682555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:23.683368 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:23.683815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:23.816073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:23.823751 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e55bdf1-9214-41ac-b56e-768b58f6c275 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1513 microversion: 2.1 time: 0.154321 Aug 03 05:32:23.824375 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3567/7123] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:23 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:23.845966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:23.846612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:23.852952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:23.853424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:23.854228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:23.855196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:24.091147 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bd2f6f8e-f036-43a8-991b-3c26c6b7bcd3 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "POST /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897/action" status: 204 len: 0 microversion: 2.1 time: 0.250171 Aug 03 05:32:24.091855 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3557/7124] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:32:23 2022] POST /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897/action => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:32:24.100447 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:24.101275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:24.107804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:24.108378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:24.109229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:24.109741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:24.250764 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:24.258949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-49a1caf7-7b7d-4fca-b40d-233f79c993a6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1513 microversion: 2.1 time: 0.162663 Aug 03 05:32:24.259659 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3568/7125] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:24 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:32:25.282016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:25.282739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:25.285813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=30 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:25.290826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:25.291300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:25.292086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:25.292574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:25.430298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:25.438556 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c862d0ec-68ad-415c-92ba-001a379a9d6d tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1513 microversion: 2.1 time: 0.161683 Aug 03 05:32:25.439144 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3558/7126] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:25 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:26.333154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-94fb2507-c628-4556-95a9-0a67ebe14f2b req-83d6d5e3-19a9-4c82-8d66-027b11d3709a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "name": "network-vif-plugged", "status": "completed", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:26.344139 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-94fb2507-c628-4556-95a9-0a67ebe14f2b req-83d6d5e3-19a9-4c82-8d66-027b11d3709a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.344619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-94fb2507-c628-4556-95a9-0a67ebe14f2b req-83d6d5e3-19a9-4c82-8d66-027b11d3709a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.355801 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-94fb2507-c628-4556-95a9-0a67ebe14f2b req-83d6d5e3-19a9-4c82-8d66-027b11d3709a service nova] Creating event network-vif-plugged:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h2-826756-5 Aug 03 05:32:26.361656 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-94fb2507-c628-4556-95a9-0a67ebe14f2b req-83d6d5e3-19a9-4c82-8d66-027b11d3709a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Aug 03 05:32:26.362305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3569/7127] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:26.460249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:26.460925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:26.469017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.469488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.470293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.470755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.601974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:26.609625 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9a31d40-24dc-4a97-a1d7-45cb271a883a tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1505 microversion: 2.1 time: 0.153314 Aug 03 05:32:26.610192 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3559/7128] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:26 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:26.630595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:26.631307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:26.637637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.638840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.639609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.640053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.770998 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:26.779172 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6ee39dc-a153-4260-8e22-9a0a15eccb66 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1505 microversion: 2.1 time: 0.152346 Aug 03 05:32:26.779767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3570/7129] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:26 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:26.799492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:26.800123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:26.806106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.806578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.807348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:26.807798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:26.942639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:26.950178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-38fe695a-8609-44ab-a0a1-6d00c824e9e6 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1505 microversion: 2.1 time: 0.154535 Aug 03 05:32:26.952164 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3560/7130] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:26 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:26.970654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:27.003383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:27.003383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.003383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.003383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.003383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.003824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:32:27.616428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fed1b7e3-06bc-4411-bf06-7d6d50ead2f0 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "DELETE /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 204 len: 0 microversion: 2.1 time: 0.649432 Aug 03 05:32:27.617194 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3571/7131] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:32:26 2022] DELETE /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:32:27.641550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:27.642136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:27.649062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.649536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.650323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.650782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.677532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:32:27.789600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.compute.api [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Instance is already in deleting state, ignoring this request Aug 03 05:32:27.790443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f928bb2-43b8-426e-aa36-79ba87c3e2e5 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "DELETE /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 204 len: 0 microversion: 2.1 time: 0.153232 Aug 03 05:32:27.791008 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3561/7132] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:32:27 2022] DELETE /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:32:27.800519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:27.804978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:27.807271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.807729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.808559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:27.809003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:27.939033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:27.946596 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-64b1a130-a8a7-43df-95ab-3f3de273d7e2 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1511 microversion: 2.1 time: 0.150392 Aug 03 05:32:27.947176 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3572/7133] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:27 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:28.967931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:28.968552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:28.975698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:28.976893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:28.977052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:28.977505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:29.113706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:29.121620 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39ad12be-b749-472a-bf27-2c061535eb27 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1511 microversion: 2.1 time: 0.157760 Aug 03 05:32:29.122211 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3562/7134] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:28 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:29.561067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-73b7e90c-af35-4989-9ddd-4e13aea73df7 req-e1d735b4-ac79-40ed-b0b1-70d48b794763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ce4375-2419-4544-b019-606ae2092897", "name": "network-vif-deleted", "tag": "c2dd1ead-467d-47b1-a87e-fd4409622c32"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:29.571881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-73b7e90c-af35-4989-9ddd-4e13aea73df7 req-e1d735b4-ac79-40ed-b0b1-70d48b794763 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:29.572358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-73b7e90c-af35-4989-9ddd-4e13aea73df7 req-e1d735b4-ac79-40ed-b0b1-70d48b794763 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:29.587444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-73b7e90c-af35-4989-9ddd-4e13aea73df7 req-e1d735b4-ac79-40ed-b0b1-70d48b794763 service nova] Creating event network-vif-deleted:c2dd1ead-467d-47b1-a87e-fd4409622c32 for instance 46ce4375-2419-4544-b019-606ae2092897 on n-h2-826756-5 Aug 03 05:32:29.593086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-73b7e90c-af35-4989-9ddd-4e13aea73df7 req-e1d735b4-ac79-40ed-b0b1-70d48b794763 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036373 Aug 03 05:32:29.593767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3573/7135] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:30.143391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:30.143945 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:30.151060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:30.151528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:30.152335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:30.152826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:30.190707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:30.191176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:30.191651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lazy-loading 'fault' on Instance uuid 46ce4375-2419-4544-b019-606ae2092897 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:32:30.233685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d49a6a2f2a0431782bd4d4ee36c89e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c6a4962f5a14e90928342032a1a1de7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:30.240561 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f2f6da7-fa39-4ea4-b329-806fdb88ae23 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 200 len: 1306 microversion: 2.1 time: 0.101214 Aug 03 05:32:30.241148 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3563/7136] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:30 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:32:31.266402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:31.267118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 46ce4375-2419-4544-b019-606ae2092897] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:31.273493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:31.273952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:31.274750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:31.275194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:31.289417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] HTTP exception thrown: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Request method failure captured: Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 HTTP/1.1 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ggIANdl3rYXO6bOtAxlPDStqJxk5iRdfzrk0jqZnhcrQeRiq3HZPJpN9_5J0IerTASwEUj7piAd5rOLcXHDnu56h7Rbouj19XOgr1xdMgFnLO206-nqFSB1NeqD6PmOB_3alHVO6GkeuMijcy-hb1D6vzBJB8n_3fF39cPlCoyStDM Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1d49a6a2f2a0431782bd4d4ee36c89e3 Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '46ce4375-2419-4544-b019-606ae2092897'} Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:31.291177 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Returning 404 to user: Instance 46ce4375-2419-4544-b019-606ae2092897 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-723d5922-08f0-4441-b6a9-b9fb259fd372 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897" status: 404 len: 111 microversion: 2.1 time: 0.031636 Aug 03 05:32:31.295942 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3574/7137] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:31 2022] GET /compute/v2.1/servers/46ce4375-2419-4544-b019-606ae2092897 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:32:31.302026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf0bdb7d-f9ab-4665-9763-4490c552cfbf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '.version_select at 0x7fdd47c171f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:31.410375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf0bdb7d-f9ab-4665-9763-4490c552cfbf tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591479345" status: 202 len: 0 microversion: 2.1 time: 0.111862 Aug 03 05:32:31.410974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3564/7138] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 05:32:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591479345 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:32:32.208331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:32.208850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:32.215258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:32.217222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:32.217222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:32.217395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:32.231160 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] HTTP exception thrown: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Request method failure captured: Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 HTTP/1.1 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6ggIANdl3rYXO6bOtAxlPDStqJxk5iRdfzrk0jqZnhcrQeRiq3HZPJpN9_5J0IerTASwEUj7piAd5rOLcXHDnu56h7Rbouj19XOgr1xdMgFnLO206-nqFSB1NeqD6PmOB_3alHVO6GkeuMijcy-hb1D6vzBJB8n_3fF39cPlCoyStDM Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 1d49a6a2f2a0431782bd4d4ee36c89e3 Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '470153d4-2578-4baf-826e-29db05436464'} Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:32:32.232890 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Returning 404 to user: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eeaddf69-763e-49db-9187-a0773605f272 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "DELETE /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 404 len: 111 microversion: 2.1 time: 0.030023 Aug 03 05:32:32.236996 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3575/7139] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:32:32 2022] DELETE /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:32:32.244482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:32.245116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] [instance: 470153d4-2578-4baf-826e-29db05436464] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:32.252356 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:32.252827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:32.253608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:32.254054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:32.269010 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] HTTP exception thrown: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Request method failure captured: Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 HTTP/1.1 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6ggIANdl3rYXO6bOtAxlPDStqJxk5iRdfzrk0jqZnhcrQeRiq3HZPJpN9_5J0IerTASwEUj7piAd5rOLcXHDnu56h7Rbouj19XOgr1xdMgFnLO206-nqFSB1NeqD6PmOB_3alHVO6GkeuMijcy-hb1D6vzBJB8n_3fF39cPlCoyStDM Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/7c6a4962f5a14e90928342032a1a1de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 7c6a4962f5a14e90928342032a1a1de7 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-460909703 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 1d49a6a2f2a0431782bd4d4ee36c89e3 Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerDiskConfigTestJSON-460909703-project Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '470153d4-2578-4baf-826e-29db05436464'} Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:32:32.270734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] Returning 404 to user: Instance 470153d4-2578-4baf-826e-29db05436464 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34b707c0-a9e8-4265-aceb-6b827d5e4b05 tempest-ServerDiskConfigTestJSON-460909703 tempest-ServerDiskConfigTestJSON-460909703-project] 10.222.0.72 "GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464" status: 404 len: 111 microversion: 2.1 time: 0.031692 Aug 03 05:32:32.274859 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3565/7140] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:32 2022] GET /compute/v2.1/servers/470153d4-2578-4baf-826e-29db05436464 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:32:43.315497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:43.316719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:43.458184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d58bc87d-9aca-467c-9379-9b2328e4dbcd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: .version_select at 0x7fdd476d5d30>, body: {"keypair": {"name": "tempest-keypair-556250000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ9hvcxpgkqCpA/S0TYPVUXiBiegh3bWRDyoRBYoIfP7XD9ulBHMe/WobVu0RD0VhNwAW9UFaikqiyqpzTJd4+2baI8wf2LQ4FtI7bcFCahmJAUML5gAGx+XmbAzec8yQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:43.475833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d58bc87d-9aca-467c-9379-9b2328e4dbcd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:32:43.482381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d58bc87d-9aca-467c-9379-9b2328e4dbcd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:32:43.608388 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d58bc87d-9aca-467c-9379-9b2328e4dbcd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.299114 Aug 03 05:32:43.608934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3576/7141] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:32:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:46.206264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-447380043", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41e14199-88e7-452d-8480-c9e908f8bcaf"}], "security_groups": [{"name": "tempest-securitygroup--1506820787"}], "key_name": "tempest-keypair-556250000", "user_data": "}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:46.216192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:46.217100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:46.345835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] validate_networks() for [('41e14199-88e7-452d-8480-c9e908f8bcaf', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:32:46.778433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:32:46.780128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:32:46.780859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:32:46.781375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:32:46.782795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:32:46.792967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:46.793523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:46.794438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:46.794963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:46.817909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:32:46.828487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:32:46.847431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:32:46.849324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:32:46.973544 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2da535bc-98a6-4241-a54e-02bc718da4aa tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.772372 Aug 03 05:32:46.974197 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3566/7142] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:32:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:32:46.985919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-872c124a-d128-4ace-aef0-300a2053ebb8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:46.986691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-872c124a-d128-4ace-aef0-300a2053ebb8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:47.049576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-872c124a-d128-4ace-aef0-300a2053ebb8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:47.057624 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-872c124a-d128-4ace-aef0-300a2053ebb8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1237 microversion: 2.1 time: 0.076495 Aug 03 05:32:47.076627 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3577/7143] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:46 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:48.080127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-17ffba4a-cc7d-44e6-a70f-3a5b3f2a4076 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:48.080744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-17ffba4a-cc7d-44e6-a70f-3a5b3f2a4076 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:48.510471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-17ffba4a-cc7d-44e6-a70f-3a5b3f2a4076 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:48.517868 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-17ffba4a-cc7d-44e6-a70f-3a5b3f2a4076 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1237 microversion: 2.1 time: 0.442778 Aug 03 05:32:48.519975 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3567/7144] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:48 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1237 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:49.538870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:49.539493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:49.547497 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:49.548606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:49.549080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:49.549522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:49.640502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:49.648968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c34e7537-4c3f-4bd4-aea4-406b0adeb63b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1297 microversion: 2.1 time: 0.114392 Aug 03 05:32:49.651089 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3578/7145] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:49 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1297 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:50.670413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:50.671664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:50.679449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:50.680046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:50.680744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:50.681202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:50.839912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:50.847725 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04a5de88-5b98-49ef-9158-7d3359fecb24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.181263 Aug 03 05:32:50.848325 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3568/7146] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:50 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:51.180879 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9cf3c21a-c752-4411-95c4-4d718c73b8a3 req-2d7c77ff-cb98-46e9-8f52-c6dd6eb12ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:51.192496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9cf3c21a-c752-4411-95c4-4d718c73b8a3 req-2d7c77ff-cb98-46e9-8f52-c6dd6eb12ea0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:51.192955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9cf3c21a-c752-4411-95c4-4d718c73b8a3 req-2d7c77ff-cb98-46e9-8f52-c6dd6eb12ea0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:51.204074 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9cf3c21a-c752-4411-95c4-4d718c73b8a3 req-2d7c77ff-cb98-46e9-8f52-c6dd6eb12ea0 service nova] Creating event network-changed:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h1-826756-5 Aug 03 05:32:51.209709 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9cf3c21a-c752-4411-95c4-4d718c73b8a3 req-2d7c77ff-cb98-46e9-8f52-c6dd6eb12ea0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032613 Aug 03 05:32:51.210260 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3579/7147] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:51.868221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:51.868871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:51.875665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:51.876157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:51.877260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:51.877441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:52.009635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:52.018163 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7dc86115-c989-45e7-b1a7-5c5b4a9e6646 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.153277 Aug 03 05:32:52.022724 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3569/7148] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:51 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:53.042445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:53.043065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:53.050363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:53.050814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:53.051599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:53.052049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:53.195290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:53.202842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8c82adb7-0109-4369-b3e6-2ebe9b4ea841 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.165965 Aug 03 05:32:53.203416 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3580/7149] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:53 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:54.223854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:54.224524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:54.230961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:54.231431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:54.232225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:54.232707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:54.366370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:54.373808 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2ee1b518-919e-42b4-9da5-cacf1d82cc1e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.154366 Aug 03 05:32:54.374376 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3570/7150] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:54 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:55.395179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:55.395774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:55.402915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:55.403370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:55.404138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:55.404606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:55.536453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:55.544196 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-301b46fd-f54a-4313-a4df-7c4522d47113 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.153087 Aug 03 05:32:55.544867 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3581/7151] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:55 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:56.565875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:56.566512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:56.574516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:56.574983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:56.575770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:56.576220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:56.686308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a0c324e8-f95c-4326-b077-4c04a4e031e7 req-37967990-d45b-489a-b134-cc91e2c82cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "name": "network-vif-plugged", "status": "completed", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:32:56.698443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0c324e8-f95c-4326-b077-4c04a4e031e7 req-37967990-d45b-489a-b134-cc91e2c82cea service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:56.698909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0c324e8-f95c-4326-b077-4c04a4e031e7 req-37967990-d45b-489a-b134-cc91e2c82cea service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:56.711315 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a0c324e8-f95c-4326-b077-4c04a4e031e7 req-37967990-d45b-489a-b134-cc91e2c82cea service nova] Creating event network-vif-plugged:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h1-826756-5 Aug 03 05:32:56.716422 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a0c324e8-f95c-4326-b077-4c04a4e031e7 req-37967990-d45b-489a-b134-cc91e2c82cea service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034575 Aug 03 05:32:56.717045 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3582/7152] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:32:56.719667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:56.729012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86db5dda-feec-4ea2-8adb-ca5e43c2d918 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.167127 Aug 03 05:32:56.729610 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3571/7153] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:56 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:57.747527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:57.752811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:57.753514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:57.760338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:57.760794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:57.761557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:57.761995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:57.906496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:57.914843 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cec6eb72-591b-4fca-9831-fcd40169ac46 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1363 microversion: 2.1 time: 0.168188 Aug 03 05:32:57.915425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3583/7154] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:57 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:58.936392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:58.937021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:58.938903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:58.940403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:32:58.945337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:58.951750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:58.951750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:58.951750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:59.077905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:32:59.086047 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f77c544-2e0c-4911-a3eb-898bc48af5e3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1549 microversion: 2.1 time: 0.153717 Aug 03 05:32:59.086662 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3572/7155] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:32:58 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:32:59.106179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:32:59.106676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:32:59.113529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:59.113989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:59.114745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:32:59.115182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:32:59.193819 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5d3e3f57-f9c6-4b2f-8aeb-3a3dc031a11b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091422 Aug 03 05:32:59.194475 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3584/7156] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:32:59 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:33:00.235239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2b61ab2a-648b-4e9b-96d9-cfdfbdf2bd2a req-0215119c-d303-4359-a151-5f599de27594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:00.246123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2b61ab2a-648b-4e9b-96d9-cfdfbdf2bd2a req-0215119c-d303-4359-a151-5f599de27594 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:00.246510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2b61ab2a-648b-4e9b-96d9-cfdfbdf2bd2a req-0215119c-d303-4359-a151-5f599de27594 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:00.258360 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2b61ab2a-648b-4e9b-96d9-cfdfbdf2bd2a req-0215119c-d303-4359-a151-5f599de27594 service nova] Creating event network-changed:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h1-826756-5 Aug 03 05:33:00.264072 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2b61ab2a-648b-4e9b-96d9-cfdfbdf2bd2a req-0215119c-d303-4359-a151-5f599de27594 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032129 Aug 03 05:33:00.264551 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3573/7157] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:33:34.021032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:34.021754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=32 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:34.026688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:34.027344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:34.033400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.039595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.039595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.039595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.168358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:34.175953 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e94f6e99-8807-4f7d-b264-fe1d0d288106 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.156900 Aug 03 05:33:34.176566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3585/7158] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:34 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:34.197600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:34.198327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:34.200577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:34.201252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:34.206346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.206843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.207635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.208159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.342208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:34.349678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ac6b2da-9987-4cf6-ace3-8e1ddf98f506 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.157439 Aug 03 05:33:34.350250 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3574/7159] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:34 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:34.369518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:34.370133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:34.376144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.376632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.377395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.377839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.508961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:34.516581 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e652899d-de0f-46af-a737-cdfb23ba207f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.150880 Aug 03 05:33:34.517168 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3586/7160] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:34 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:34.537076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:34.539282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:34.545301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.545762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.546550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.546988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.575958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:34.581813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:33:34.589050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:33:34.589050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:33:34.589050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:33:34.589331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:33:34.589755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:33:34.817733 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3e72da0-192c-43d7-aa49-208e0d9f9a5d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/action" status: 202 len: 0 microversion: 2.1 time: 0.284754 Aug 03 05:33:34.822014 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3575/7161] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:33:34 2022] POST /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:33:34.827852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:34.827852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:34.834110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.834572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.835680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:34.836215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:34.968917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:34.977026 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc9d1a9a-bf40-43cd-9c0e-adeb570b731a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1677 microversion: 2.1 time: 0.153749 Aug 03 05:33:34.977610 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3587/7162] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:34 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:35.999642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:36.000292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:36.006306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:36.006774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:36.007631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:36.008080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:36.144016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:36.152588 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15115442-2414-498c-8717-3f9521adb952 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1677 microversion: 2.1 time: 0.157608 Aug 03 05:33:36.153182 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3576/7163] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:35 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:37.174812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:37.175449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:37.183019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:37.183468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:37.184230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:37.184687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:37.353330 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:37.361225 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-046a2c8e-2afa-4f21-a407-0dad7c01ddf1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1677 microversion: 2.1 time: 0.190294 Aug 03 05:33:37.361855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3588/7164] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:37 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:38.383716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:38.384380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:38.391350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:38.391822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:38.392651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:38.393111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:38.525288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:38.532849 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe5b9f3e-3c29-4c50-84d7-10b10c3fdb39 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.153953 Aug 03 05:33:38.533419 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3577/7165] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:38 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:39.554961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:39.555578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:39.562677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:39.563141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:39.563927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:39.564401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:39.696028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:39.705126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4aad43d-07d9-4f45-9b26-13d88b71f753 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.153161 Aug 03 05:33:39.705126 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3589/7166] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:39 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:40.726851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:40.727484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:40.734381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:40.739640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:40.739640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:40.739640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:40.871351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:40.879153 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb645130-f653-4a05-9441-fd38d2b25ba7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.156347 Aug 03 05:33:40.879731 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3578/7167] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:40 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:41.901493 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:41.902115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:41.909129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:41.909588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:41.910387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:41.910834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:42.044693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:42.052305 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea2349b0-ae1c-4b7e-a2c0-f18b37b24f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.154905 Aug 03 05:33:42.052880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3590/7168] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:41 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:43.074627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:43.075201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:43.082195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:43.082670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:43.083457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:43.083920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:43.216650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:43.224111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb746a5d-1cf5-4068-a35a-aa8ba55d69f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.153489 Aug 03 05:33:43.224716 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3579/7169] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:43 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:33:44.246634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:44.247261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:44.254297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:44.254754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:44.255519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:44.255962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:44.384246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:44.391728 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9467b6c3-567f-4654-8af9-2a6a18fd99a8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.149045 Aug 03 05:33:44.392319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3591/7170] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:44 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:45.414691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:45.415365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:45.422403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:45.422873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:45.423663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:45.424118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:45.622796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:45.630412 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a230c8a4-8533-4553-8c43-e85b6f7431f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.220390 Aug 03 05:33:45.631005 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3580/7171] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:45 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:46.653461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:46.654087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:46.661044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:46.661762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:46.662533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:46.662968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:46.801755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:46.810890 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7db74ed8-24f1-4d89-83b2-0f140d0cd060 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.162278 Aug 03 05:33:46.811489 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3592/7172] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:46 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:47.832793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:47.833432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:47.841176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:47.841654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:47.842449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:47.842910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:47.971646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:47.979693 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4138906-62bc-44d2-96b5-8718894d619d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.150884 Aug 03 05:33:47.980290 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3581/7173] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:47 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:49.002073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:49.002617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:49.010714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:49.011181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:49.011961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:49.012518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:49.489782 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:49.497999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-edb174e6-a20d-48ff-ad41-15a288ddcfcf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1682 microversion: 2.1 time: 0.500032 Aug 03 05:33:49.498579 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3593/7174] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:48 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1682 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:50.519699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:50.520365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:50.527743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:50.528214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:50.529047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:50.529502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:50.667787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:50.676667 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-582875ac-a101-48d9-90e6-bf7a0ade5195 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1681 microversion: 2.1 time: 0.160572 Aug 03 05:33:50.696503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "name": "network-vif-unplugged", "status": "completed", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:50.703794 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3582/7175] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:50 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:50.708096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:50.708611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:50.721144 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] Creating event network-vif-unplugged:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h2-826756-5 Aug 03 05:33:50.726556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:33:50.738122 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1d0bce94-9a91-4078-a57b-86c099ed0967 req-0c5715c0-3d89-4762-a7d4-712f72e77af9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048285 Aug 03 05:33:50.738722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3594/7176] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:33:51.707623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:51.708326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:51.715485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:51.715965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:51.716799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:51.717249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:51.948476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:51.956548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f52c7cc-73f5-45f8-8389-8d4d49c95362 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1681 microversion: 2.1 time: 0.252792 Aug 03 05:33:51.957143 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3583/7177] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:51 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:33:52.755471 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:52.766168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:52.766730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:52.779011 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] Creating event network-changed:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h2-826756-5 Aug 03 05:33:52.784387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:33:52.796342 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b26b58ab-0aa3-4914-bd24-22b41737b1bf req-737284a0-3430-409d-ac0a-adb0c15b5745 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045986 Aug 03 05:33:52.796946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3595/7178] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:33:52.979807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:52.980642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:52.986842 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:52.987385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:52.988181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:52.988667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:53.206362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:53.215121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd7a4d40-0bd4-4215-890c-8e5c9cf7b7ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1679 microversion: 2.1 time: 0.240252 Aug 03 05:33:53.215715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3584/7179] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:52 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:54.238986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:54.239694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:54.246130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:54.246587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:54.247451 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:54.247891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:54.416688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:54.424688 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fda05bfa-93b5-4ccd-bf01-e7e9a57589a2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1679 microversion: 2.1 time: 0.190861 Aug 03 05:33:54.425355 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3596/7180] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:54 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:55.448023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:55.461242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:55.461242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.461242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:55.461242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.461242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:55.589640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:55.605283 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-82006389-fb34-4e6c-abc3-1b733b4af8dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1676 microversion: 2.1 time: 0.154280 Aug 03 05:33:55.605283 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3585/7181] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:55 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:55.619371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:55.619911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:55.627012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.627474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:55.628385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.628834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:55.831820 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c517745-91a8-45ea-9e72-ef745d78c080 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/action" status: 204 len: 0 microversion: 2.1 time: 0.216788 Aug 03 05:33:55.832672 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3597/7182] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:33:55 2022] POST /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078/action => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:33:55.841083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:55.841726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:55.848198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.848759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:55.849589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:55.850053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:56.033572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:56.042027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0226e8d0-65ba-46d0-b8ab-2d397ab3f170 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1676 microversion: 2.1 time: 0.205095 Aug 03 05:33:56.042626 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3586/7183] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:55 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:56.761445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "name": "network-vif-plugged", "status": "completed", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:33:56.772112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:56.772714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:56.785161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] Creating event network-vif-plugged:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h2-826756-5 Aug 03 05:33:56.791744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:33:56.803341 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2ad3dc7f-d6ee-481f-b12f-8f303c59c984 req-2858dbdb-b82d-4646-beea-ce05ce8a1697 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047749 Aug 03 05:33:56.804341 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3598/7184] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:33:57.063139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:57.064335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:57.071363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:57.071928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:57.072756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:57.073810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:57.210066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:57.218863 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f90f7eb7-b9e0-4041-9116-36984ca410fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1676 microversion: 2.1 time: 0.159563 Aug 03 05:33:57.219435 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3587/7185] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:57 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:58.241647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:58.242367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:58.250183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.250640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.251406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.251845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.381063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:58.388956 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-68b31b59-eb9d-4a5d-9285-928aef28d105 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.151627 Aug 03 05:33:58.389537 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3599/7186] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:58 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:58.409256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:58.409894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:58.417974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.418449 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.419239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.419702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.547528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:58.555119 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40105ab0-588f-4e5e-b225-e8d48339f6c5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.149710 Aug 03 05:33:58.555698 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3588/7187] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:58 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:58.574924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:58.575540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:58.581673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.582127 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.582894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.583328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.716577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:58.724162 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4028fa2-af8f-4f4d-a2ea-e7811f2c4ccb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1668 microversion: 2.1 time: 0.153152 Aug 03 05:33:58.724765 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3600/7188] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:58 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:33:58.744757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:58.746500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:58.751428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.751898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.752708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:58.753167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:58.757251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:58.779311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:33:59.089979 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88c82ac1-3a04-45d8-8b08-87911e1f2559 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 204 len: 0 microversion: 2.1 time: 0.349321 Aug 03 05:33:59.090518 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3589/7189] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:33:58 2022] DELETE /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:33:59.098915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:33:59.105214 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:33:59.105927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:59.106382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:59.107153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:33:59.107594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:33:59.122825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:33:59.236714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:33:59.244826 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-727e4cdf-fb71-4520-80f2-6fa3b99459a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1674 microversion: 2.1 time: 0.150005 Aug 03 05:33:59.245410 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3601/7190] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:33:59 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:00.266352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:00.267066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:00.274003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:00.274990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:00.275772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:00.276218 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:00.413204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:00.420899 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04c3f173-e855-4fad-87f1-10bbe6810c0d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1674 microversion: 2.1 time: 0.158794 Aug 03 05:34:00.421471 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3590/7191] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:00 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:01.388171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a9f700bc-61c3-4eb5-ad63-88a38252a067 req-36e9d6ff-fc48-47fd-b91d-562072fb248c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9211de0b-2d76-4225-9ffc-cd07afa9c078", "name": "network-vif-deleted", "tag": "ca271972-bf99-4dc9-a9b1-2dc6be741a41"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:01.401197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a9f700bc-61c3-4eb5-ad63-88a38252a067 req-36e9d6ff-fc48-47fd-b91d-562072fb248c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:01.402498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a9f700bc-61c3-4eb5-ad63-88a38252a067 req-36e9d6ff-fc48-47fd-b91d-562072fb248c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:01.413909 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a9f700bc-61c3-4eb5-ad63-88a38252a067 req-36e9d6ff-fc48-47fd-b91d-562072fb248c service nova] Creating event network-vif-deleted:ca271972-bf99-4dc9-a9b1-2dc6be741a41 for instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 on n-h2-826756-5 Aug 03 05:34:01.419371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a9f700bc-61c3-4eb5-ad63-88a38252a067 req-36e9d6ff-fc48-47fd-b91d-562072fb248c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035943 Aug 03 05:34:01.420159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3602/7192] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:34:01.446308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:01.447208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:01.455440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:01.456486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:01.457358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:01.457881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:01.528223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:01.536372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f60b5241-d610-498f-a04f-04b51c3fce7a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1606 microversion: 2.1 time: 0.097228 Aug 03 05:34:01.537713 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3591/7193] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:01 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:02.560504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:02.561226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:02.568571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:02.569037 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:02.573585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:02.573585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:02.604122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:02.604596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:02.605052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lazy-loading 'fault' on Instance uuid 9211de0b-2d76-4225-9ffc-cd07afa9c078 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:34:02.647535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:02.655410 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1bb1bdbb-797c-43b2-b9fa-03dd6d203e23 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 200 len: 1327 microversion: 2.1 time: 0.100301 Aug 03 05:34:02.656004 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3603/7194] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:02 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:03.677103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:03.677735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:03.685317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:03.685786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:03.686565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:03.687023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:03.701781 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 HTTP/1.1 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9211de0b-2d76-4225-9ffc-cd07afa9c078'} Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:34:03.704035 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-948c1bbd-c2d9-449a-8c2e-3398b24de247 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 404 len: 111 microversion: 2.1 time: 0.031850 Aug 03 05:34:03.708244 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3592/7195] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:03 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:34:03.719113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:03.719726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:03.726819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:03.727311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:03.728259 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:03.728776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:03.742519 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 HTTP/1.1 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9211de0b-2d76-4225-9ffc-cd07afa9c078'} Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:34:03.745203 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55f67348-145c-418f-8c17-1652bc4da5bd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 404 len: 111 microversion: 2.1 time: 0.031611 Aug 03 05:34:03.749040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3604/7196] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:03 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:34:03.796109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2077103703", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "41e14199-88e7-452d-8480-c9e908f8bcaf"}], "security_groups": [{"name": "tempest-securitygroup--1506820787"}], "key_name": "tempest-keypair-556250000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:03.900695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] validate_networks() for [('41e14199-88e7-452d-8480-c9e908f8bcaf', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:34:04.271332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:34:04.271770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:34:04.272286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:34:04.272715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:34:04.273143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:34:04.282181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:04.282654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:04.283468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:04.283924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:04.301436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:34:04.307845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:34:04.320162 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:34:04.322669 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:34:04.333731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:04.479073 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31564af7-f84f-4439-83e7-877ae0c21947 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.686782 Aug 03 05:34:04.480260 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3593/7197] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:34:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:34:04.491333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-42c9a9e3-a7ad-430b-8bfc-a97f0166c3a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:04.491952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-42c9a9e3-a7ad-430b-8bfc-a97f0166c3a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:04.494307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=43 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:04.548208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-42c9a9e3-a7ad-430b-8bfc-a97f0166c3a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:04.555192 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-42c9a9e3-a7ad-430b-8bfc-a97f0166c3a6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1238 microversion: 2.1 time: 0.067703 Aug 03 05:34:04.562362 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3605/7198] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:04 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:05.578881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:05.579514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:05.586545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:05.587140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:05.587926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:05.588417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:05.651769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:05.659443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-316da5ce-b830-47c8-91dd-472341dc0b55 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1242 microversion: 2.1 time: 0.085712 Aug 03 05:34:05.660067 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3594/7199] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:05 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:06.682768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:06.683374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:06.691270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:06.691726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:06.692520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:06.692957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:06.756834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:06.765614 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e4b2380-a7cd-47e8-b8f7-a51791cf1032 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1308 microversion: 2.1 time: 0.087774 Aug 03 05:34:06.766382 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3606/7200] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:06 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:07.790765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:07.791521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:07.798290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:07.798762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:07.799550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:07.800006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:07.994818 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:08.002327 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c5219447-6f04-458c-8ca0-f59f93c48054 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.216416 Aug 03 05:34:08.002900 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3595/7201] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:07 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:08.131391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f89f9ee6-7103-4ef3-877d-776a4bdd01f8 req-b65e74d6-b20c-4b9b-b2cc-c7d419f872bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:08.142328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f89f9ee6-7103-4ef3-877d-776a4bdd01f8 req-b65e74d6-b20c-4b9b-b2cc-c7d419f872bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:08.142778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f89f9ee6-7103-4ef3-877d-776a4bdd01f8 req-b65e74d6-b20c-4b9b-b2cc-c7d419f872bb service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:08.157793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f89f9ee6-7103-4ef3-877d-776a4bdd01f8 req-b65e74d6-b20c-4b9b-b2cc-c7d419f872bb service nova] Creating event network-changed:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h2-826756-5 Aug 03 05:34:08.163114 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f89f9ee6-7103-4ef3-877d-776a4bdd01f8 req-b65e74d6-b20c-4b9b-b2cc-c7d419f872bb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Aug 03 05:34:08.163739 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3607/7202] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:34:09.024179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:09.024881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:09.031676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:09.032137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:09.032988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:09.033435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:09.256597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:09.265314 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8328ba3b-0bd4-4bde-8e49-79e8d4f6fd0f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.245016 Aug 03 05:34:09.265909 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3596/7203] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:09 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:10.288108 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:10.288848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:10.295376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:10.295827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:10.296617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:10.297056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:10.431375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:10.438919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92e92c18-047b-494b-809b-ae2d36d7baa4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.156260 Aug 03 05:34:10.439542 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3608/7204] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:10 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:11.460617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:11.461170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:11.468347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:11.468808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:11.469673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:11.470152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:11.604122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:11.611676 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f317da98-6d50-4f3a-83d2-ae1023dafed9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.155367 Aug 03 05:34:11.612336 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3597/7205] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:11 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:12.633917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:12.634549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:12.642116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:12.642591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:12.643400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:12.643848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:12.784887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:12.795414 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6132defa-b795-4a8e-a4e2-b04b6a27d04a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.165419 Aug 03 05:34:12.795991 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3609/7206] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:12 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:13.816729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:13.817363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:13.825053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:13.825526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:13.826318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:13.826773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:13.965294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:13.972907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57f70790-b0cb-45b2-827d-38480ccec42d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.160125 Aug 03 05:34:13.973494 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3598/7207] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:13 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:14.775660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-41ffdc61-0c76-4ad4-aede-b267d5808d3e req-b7ba874e-9a34-4877-ab3c-934ca329a828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "name": "network-vif-plugged", "status": "completed", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:14.781617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:14.787203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41ffdc61-0c76-4ad4-aede-b267d5808d3e req-b7ba874e-9a34-4877-ab3c-934ca329a828 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:14.787713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-41ffdc61-0c76-4ad4-aede-b267d5808d3e req-b7ba874e-9a34-4877-ab3c-934ca329a828 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:14.798840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-41ffdc61-0c76-4ad4-aede-b267d5808d3e req-b7ba874e-9a34-4877-ab3c-934ca329a828 service nova] Creating event network-vif-plugged:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h2-826756-5 Aug 03 05:34:14.803898 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-41ffdc61-0c76-4ad4-aede-b267d5808d3e req-b7ba874e-9a34-4877-ab3c-934ca329a828 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Aug 03 05:34:14.804700 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3610/7208] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:34:14.995560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:14.996144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:14.998168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:14.998872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:15.004663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:15.008874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:15.008874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:15.008874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:15.201210 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:15.201210 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d0eb09e-8285-4a61-b34b-b3041b282a63 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1364 microversion: 2.1 time: 0.209477 Aug 03 05:34:15.201210 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3599/7209] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:14 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:16.222706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:16.223445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:16.230636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:16.231095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:16.231877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:16.232346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:16.364200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:16.372290 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89ffc815-7a3b-4871-9609-b9b7c1673f5e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1550 microversion: 2.1 time: 0.154768 Aug 03 05:34:16.372954 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3611/7210] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:16 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:16.396208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:16.396826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:16.404247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:16.404739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:16.405510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:16.405966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:16.483251 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4c7c52a9-ca21-45c8-961b-e0b3bfb4267e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090962 Aug 03 05:34:16.483856 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3600/7211] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:34:16 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:34:17.479707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6873fea5-7298-4dd1-aa05-1febf0e9e80e req-52d246fe-b550-4bdd-ba7c-0d60063352ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:17.490026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6873fea5-7298-4dd1-aa05-1febf0e9e80e req-52d246fe-b550-4bdd-ba7c-0d60063352ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:17.490477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6873fea5-7298-4dd1-aa05-1febf0e9e80e req-52d246fe-b550-4bdd-ba7c-0d60063352ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:17.502197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6873fea5-7298-4dd1-aa05-1febf0e9e80e req-52d246fe-b550-4bdd-ba7c-0d60063352ac service nova] Creating event network-changed:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h2-826756-5 Aug 03 05:34:17.507957 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6873fea5-7298-4dd1-aa05-1febf0e9e80e req-52d246fe-b550-4bdd-ba7c-0d60063352ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031979 Aug 03 05:34:17.509364 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3612/7212] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:34:29.187319 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:34:29.188000 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:34:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:34:58.274013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=14 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:58.274799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:58.278881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4e4fcb54-86ec-4e8c-87df-d6548429d924 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:34:58.288396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb54-86ec-4e8c-87df-d6548429d924 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:58.288396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4e4fcb54-86ec-4e8c-87df-d6548429d924 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:58.308652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4e4fcb54-86ec-4e8c-87df-d6548429d924 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 05:34:58.497071 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4e4fcb54-86ec-4e8c-87df-d6548429d924 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action" status: 202 len: 0 microversion: 2.1 time: 0.224794 Aug 03 05:34:58.497744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3601/7213] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:34:58 2022] POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:34:58.504925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=17 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:58.505693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=45 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:34:58.509825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:58.510547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:58.518297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:58.520381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:58.520381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:58.520381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:58.711731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:58.720025 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5cd5325-d173-48fd-b1cb-402f72c58825 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.217150 Aug 03 05:34:58.720656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3613/7214] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:58 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:34:59.745609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:34:59.746267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:34:59.753559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:59.755346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:59.755346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:34:59.755346 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:34:59.890139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:34:59.897734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6e2177c-b135-4393-b9e0-3ebaa26c236b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.157919 Aug 03 05:34:59.898308 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3602/7215] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:34:59 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:00.919703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:00.920867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:00.927779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:00.928235 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:00.929040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:00.929478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:01.059856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:01.068480 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb4e0b70-b1ad-4cc5-b2d2-eeb57185b47a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.152702 Aug 03 05:35:01.069071 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3614/7216] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:00 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:02.090302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:02.090855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:02.098111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:02.098574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:02.099350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:02.099796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:02.230477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:02.237946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10296a7c-a9d3-48e5-93cf-bfb40ef404bc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.151656 Aug 03 05:35:02.238509 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3603/7217] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:02 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:03.258981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:03.259602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:03.267821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:03.268303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:03.269078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:03.269520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:03.400056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:03.410968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8daeef4-1f73-4582-9a26-e3cff4eb5d24 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.155868 Aug 03 05:35:03.411542 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3615/7218] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:03 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:04.432796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:04.433432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:04.440599 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:04.441071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:04.441853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:04.442307 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:04.578667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:04.586331 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46096a95-9aee-435d-abe8-a4f3f2fa7046 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.157623 Aug 03 05:35:04.586916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3604/7219] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:04 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:05.609698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:05.610329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:05.617298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:05.617756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:05.618533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:05.618976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:05.751799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:05.759453 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-572fe68d-d461-4db8-9bea-de23876c602a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.154687 Aug 03 05:35:05.760225 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3616/7220] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:05 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:06.781396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:06.782039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:06.789381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:06.789841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:06.790633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:06.791091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:06.925546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:06.933256 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5fb4035-ea42-4f56-964f-8f38f2e5900f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.156101 Aug 03 05:35:06.933822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3605/7221] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:06 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:07.956170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:07.956852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:07.963689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:07.964142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:07.964940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:07.965377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:08.095191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:08.102748 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35c3cfaf-c4e1-46a6-8eff-614c98504159 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.151342 Aug 03 05:35:08.103318 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3617/7222] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:07 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:09.124567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:09.125206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:09.132231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:09.132731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:09.133517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:09.133991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:09.263626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:09.271902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2da92fa-ee03-44cf-943d-eeff8b75484a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.151568 Aug 03 05:35:09.272506 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3606/7223] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:09 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:10.294313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:10.294931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:10.302183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:10.302635 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:10.303400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:10.303840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:10.438238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:10.445803 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e04abede-a942-4368-8b4b-650ae5027e42 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.155437 Aug 03 05:35:10.446371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3618/7224] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:10 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:11.467769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:11.468559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:11.475492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:11.475957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:11.476858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:11.477296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:11.607432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:11.615012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e6159c5-c3d6-4872-a27b-9ab85904abbf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.151907 Aug 03 05:35:11.617764 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3607/7225] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:11 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:12.636785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:12.637305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:12.644396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:12.644860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:12.645620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:12.646055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:12.779027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:12.787424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb225f12-4358-4875-9938-2455da19f507 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.154644 Aug 03 05:35:12.788287 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3619/7226] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:12 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:13.810235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:13.811493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:13.819887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:13.820390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:13.821195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:13.821656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:13.958147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:13.966118 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4de0a4ba-779e-44d7-a777-438c433db7a3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.160160 Aug 03 05:35:13.966784 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3608/7227] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:13 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:14.988099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:14.988746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:14.995722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:14.996179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:14.996995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:14.997441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:15.129009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:15.136771 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77dfa719-1a53-459a-b099-13a4542fa7af tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1656 microversion: 2.1 time: 0.152763 Aug 03 05:35:15.137366 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3620/7228] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:14 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:15.157154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:15.159579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:15.167056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:15.167526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:15.168335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:15.168793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:15.196910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:15.203319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:35:15.209563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:35:15.210084 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:35:15.210587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:35:15.211024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:35:15.211444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:35:15.455370 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d881152-951e-4ae5-89c1-47f28de58c79 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action" status: 202 len: 0 microversion: 2.1 time: 0.302201 Aug 03 05:35:15.456136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3609/7229] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:35:15 2022] POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:35:15.464231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:15.464872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:15.471572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:15.472020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:15.472826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:15.473262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:15.606863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:15.614429 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b24d0e6b-19ff-4d91-8de8-c19c54740e58 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.154197 Aug 03 05:35:15.615017 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3621/7230] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:15 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:16.636926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:16.637589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:16.644662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:16.645136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:16.645953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:16.646380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:16.786385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:16.794299 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f2515a2-3b3e-4a2e-b689-495d3b10c546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.162063 Aug 03 05:35:16.794871 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3610/7231] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:16 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:17.816074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:17.816701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:17.823593 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:17.824081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:17.824894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:17.825338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:18.034581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:18.042549 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c5510c9-4968-4097-ad60-553a4155155c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1679 microversion: 2.1 time: 0.230660 Aug 03 05:35:18.043159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3622/7232] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:17 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:19.065388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:19.065935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:19.072853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:19.073323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:19.074107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:19.074560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:19.203823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:19.211358 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-74399f20-6513-4b3e-96e1-3726fb0b0f5b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1684 microversion: 2.1 time: 0.149969 Aug 03 05:35:19.211941 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3611/7233] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:19 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:20.233789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:20.234326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:20.241323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:20.241785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:20.242561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:20.243011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:20.379882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:20.387419 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a8e34657-b549-4a1e-8680-df4738d24b26 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1684 microversion: 2.1 time: 0.158397 Aug 03 05:35:20.387993 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3623/7234] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:20 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:21.334108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "name": "network-vif-unplugged", "status": "completed", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:21.345549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:21.346046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:21.358913 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] Creating event network-vif-unplugged:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h1-826756-5 Aug 03 05:35:21.364724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:35:21.378940 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-1b71c7d7-23d1-46aa-9049-4acf7e71b371 req-f697f209-4ec5-4623-8bd8-f25c6a3e6944 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048678 Aug 03 05:35:21.379814 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3612/7235] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:35:21.409333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:21.409983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:21.417732 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:21.418194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:21.418968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:21.419416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:21.664552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:21.673105 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e0598a5d-0c0c-40cb-a383-958bc2df28fd tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1683 microversion: 2.1 time: 0.267798 Aug 03 05:35:21.673702 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3624/7236] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:21 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:22.696857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:22.698320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:22.705038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:22.705508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:22.706305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:22.706922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:22.863267 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:22.871099 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46c2b9d5-7e6d-4a06-b6d9-eafeac1bf7da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1683 microversion: 2.1 time: 0.179744 Aug 03 05:35:22.877618 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3613/7237] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:22 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:23.393992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:23.403771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:23.404222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:23.416930 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] Creating event network-changed:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h1-826756-5 Aug 03 05:35:23.422258 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:35:23.432911 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-63039891-4735-464d-9e6c-74d555f3a478 req-c2fd872b-208b-4364-9e0c-31f03c50ef18 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043617 Aug 03 05:35:23.433501 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3625/7238] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:35:23.893838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:23.894475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:23.901166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:23.901640 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:23.902432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:23.902890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:24.036252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:24.043970 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36137f77-5590-4a4d-b19a-295173dfd583 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1681 microversion: 2.1 time: 0.154188 Aug 03 05:35:24.044571 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3614/7239] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:23 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:25.068650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:25.069347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:25.075606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.076054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.077046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.077498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.217239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:25.224701 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eecdbe7c-016f-4912-a3e0-5987e1d7cf62 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1677 microversion: 2.1 time: 0.161348 Aug 03 05:35:25.225276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3626/7240] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:25 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:25.245990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:25.246493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:25.254467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.254944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.255745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.256204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.274745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:25.482112 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e161d0b3-eabb-47c8-8ce9-ce70cfca63ac tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action" status: 204 len: 0 microversion: 2.1 time: 0.239919 Aug 03 05:35:25.482780 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3615/7241] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:35:25 2022] POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:35:25.490952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:25.491697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:25.497953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.498958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.500080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:25.500555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:25.693934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:25.702590 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-612856df-efb3-4af1-adc7-59ccb17cc3f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1677 microversion: 2.1 time: 0.215208 Aug 03 05:35:25.703265 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3627/7242] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:25 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:26.726111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:26.739552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:26.739552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:26.739552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:26.739552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:26.739552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:26.876148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:26.883973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7841ae9e-8b9f-4541-83c5-96604b67be6b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1677 microversion: 2.1 time: 0.163051 Aug 03 05:35:26.884605 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3616/7243] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:26 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:27.456989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c3997aae-04b7-4697-93f4-2ef4e7995a64 req-8b3b9d0c-f466-498d-b18d-cbc9bf2d8477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "name": "network-vif-plugged", "status": "completed", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:27.467194 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c3997aae-04b7-4697-93f4-2ef4e7995a64 req-8b3b9d0c-f466-498d-b18d-cbc9bf2d8477 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:27.467680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c3997aae-04b7-4697-93f4-2ef4e7995a64 req-8b3b9d0c-f466-498d-b18d-cbc9bf2d8477 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:27.479482 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c3997aae-04b7-4697-93f4-2ef4e7995a64 req-8b3b9d0c-f466-498d-b18d-cbc9bf2d8477 service nova] Creating event network-vif-plugged:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h1-826756-5 Aug 03 05:35:27.485128 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c3997aae-04b7-4697-93f4-2ef4e7995a64 req-8b3b9d0c-f466-498d-b18d-cbc9bf2d8477 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031965 Aug 03 05:35:27.485742 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3628/7244] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:35:27.906770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:27.907399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:27.914491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:27.914952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:27.915725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:27.916170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.048794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:28.056232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-550a4516-60e5-425d-a707-80470c4b9aab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1656 microversion: 2.1 time: 0.153981 Aug 03 05:35:28.056901 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3617/7245] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:27 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:28.077575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:28.078292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:28.084530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:28.084995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.085762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:28.086204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.214976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:28.223286 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-440b6afd-a30d-40b7-8551-b952ed5e3323 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1656 microversion: 2.1 time: 0.150717 Aug 03 05:35:28.223866 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3629/7246] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:28 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:28.243319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cf5e212-8e14-4b08-bffe-22941096513a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:28.250094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cf5e212-8e14-4b08-bffe-22941096513a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:28.250561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cf5e212-8e14-4b08-bffe-22941096513a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.272932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cf5e212-8e14-4b08-bffe-22941096513a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Going to try to start instance {{(pid=120832) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 05:35:28.472375 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cf5e212-8e14-4b08-bffe-22941096513a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action" status: 202 len: 0 microversion: 2.1 time: 0.229081 Aug 03 05:35:28.473235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3618/7247] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:35:28 2022] POST /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:35:28.481343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:28.481970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:28.489464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:28.489923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.490704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:28.491154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:28.511020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=100 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:28.625549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:28.633178 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9c7e717e-288d-4c4e-83ed-24908ae6f1e1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1665 microversion: 2.1 time: 0.155850 Aug 03 05:35:28.633772 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3630/7248] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:28 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:29.657904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:29.658636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:29.661243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=41 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:29.666857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:29.667363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:29.668172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:29.668659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:29.811739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:29.819481 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2fc1e494-2430-4205-89c2-f74091300dff tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1665 microversion: 2.1 time: 0.168444 Aug 03 05:35:29.820068 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3619/7249] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:29 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:30.841439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:30.842748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:30.845626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=37 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:30.850444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:30.850897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:30.851660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:30.852099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:30.983979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:30.993339 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-367296a7-584c-49cf-a010-8a1388f8d96f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1669 microversion: 2.1 time: 0.155800 Aug 03 05:35:30.993927 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3631/7250] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:30 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:35:31.014173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:31.014806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:31.021873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:31.022373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:31.023163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:31.023627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:31.049483 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:35:31.511040 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-edc44dec-675e-4975-a3d9-6d6c19ec6237 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 204 len: 0 microversion: 2.1 time: 0.501065 Aug 03 05:35:31.511659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3620/7251] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:35:31 2022] DELETE /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:35:31.520986 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:31.521614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:31.527787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:31.528249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:31.529289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:31.529553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:31.662362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:31.670731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3835916b-db08-4a6f-a12b-e3e8eaf395c4 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1675 microversion: 2.1 time: 0.153855 Aug 03 05:35:31.671311 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3632/7252] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:31 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:32.692895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:32.693627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:32.700793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:32.701786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:32.702901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:32.703365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:32.864729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:32.872393 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b7df1437-e1bc-43c2-83a2-28969c204739 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1675 microversion: 2.1 time: 0.183842 Aug 03 05:35:32.872984 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3621/7253] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:32 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:33.716030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-397bbadf-f7f1-47cb-a46c-a106342b3c7d req-af2fb4d0-507d-44ba-9c9d-05ec6de78c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d638c6-53b0-43e3-ad67-4f5c9a64d632", "name": "network-vif-deleted", "tag": "369865f6-3c5e-47b9-8122-eb566ef81503"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:33.726489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-397bbadf-f7f1-47cb-a46c-a106342b3c7d req-af2fb4d0-507d-44ba-9c9d-05ec6de78c3d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:33.729591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-397bbadf-f7f1-47cb-a46c-a106342b3c7d req-af2fb4d0-507d-44ba-9c9d-05ec6de78c3d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:33.739735 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-397bbadf-f7f1-47cb-a46c-a106342b3c7d req-af2fb4d0-507d-44ba-9c9d-05ec6de78c3d service nova] Creating event network-vif-deleted:369865f6-3c5e-47b9-8122-eb566ef81503 for instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 on n-h1-826756-5 Aug 03 05:35:33.744869 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-397bbadf-f7f1-47cb-a46c-a106342b3c7d req-af2fb4d0-507d-44ba-9c9d-05ec6de78c3d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032470 Aug 03 05:35:33.745395 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3633/7254] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:35:33.894942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:33.895581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:33.902819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:33.903297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:33.904093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:33.905256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:33.972834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:33.981065 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dab68e29-5a99-47d3-aa62-869699d80679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 200 len: 1323 microversion: 2.1 time: 0.090022 Aug 03 05:35:33.981663 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3622/7255] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:33 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:35.005260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:35.006109 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:35.013166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.013586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.014374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.014821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.029763 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 HTTP/1.1 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '13d638c6-53b0-43e3-ad67-4f5c9a64d632'} Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:35:35.031550 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a4c4a90-8bdc-4516-a4ce-64ae336bf577 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 404 len: 111 microversion: 2.1 time: 0.033893 Aug 03 05:35:35.035888 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3634/7256] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:34 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:35:35.050250 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:35.050877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:35.057853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.058318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.059101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.059554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.073306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 HTTP/1.1 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '13d638c6-53b0-43e3-ad67-4f5c9a64d632'} Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:35:35.074961 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-944dca67-9cf5-4099-92b0-94340c9dfe7b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 404 len: 111 microversion: 2.1 time: 0.030328 Aug 03 05:35:35.080166 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3623/7257] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:35 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:35:35.126724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-862928949", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "41e14199-88e7-452d-8480-c9e908f8bcaf"}], "security_groups": [{"name": "tempest-securitygroup--1506820787"}], "key_name": "tempest-keypair-556250000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:35.233961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] validate_networks() for [('41e14199-88e7-452d-8480-c9e908f8bcaf', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:35:35.611875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:35:35.612350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:35:35.612870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:35:35.613288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:35:35.613706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:35:35.622839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.623293 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.624095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:35.624574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:35.642278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:35:35.647594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:35:35.660032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:35:35.662392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:35:35.800884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-58a8b9ae-4190-4a88-bfb6-25d5747ef037 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.678747 Aug 03 05:35:35.801510 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3635/7258] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:35:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:35:35.813037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-90958b6b-9d2a-4b1b-9bcd-2eda284588d6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:35.813679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-90958b6b-9d2a-4b1b-9bcd-2eda284588d6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:35.872069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-90958b6b-9d2a-4b1b-9bcd-2eda284588d6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:35.879184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-90958b6b-9d2a-4b1b-9bcd-2eda284588d6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1237 microversion: 2.1 time: 0.070494 Aug 03 05:35:35.885093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3624/7259] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:35 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:36.900286 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:36.900922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:36.909131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:36.909588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:36.910364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:36.910811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:36.980164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:36.988804 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19d21581-9282-4a74-a3ad-f1c87a6993ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1241 microversion: 2.1 time: 0.092565 Aug 03 05:35:36.989438 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3636/7260] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:36 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:38.012519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:38.013193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:38.022602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:38.023332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:38.024133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:38.024612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:38.108784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:38.116796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a5323a2c-2027-4e4b-8d6e-35615d2d57ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1297 microversion: 2.1 time: 0.109617 Aug 03 05:35:38.117469 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3625/7261] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:38 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1297 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:35:39.141899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:39.142411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:39.149334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:39.149798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:39.150576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:39.151024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:39.365542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:39.373110 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f94121ad-9f1f-4ad5-abd0-aefbae3cfe50 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.235741 Aug 03 05:35:39.373690 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3637/7262] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:39 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:35:39.803648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f3a0660a-7de4-4338-9a5b-e9c6ff67741a req-c47cc512-cfe6-459f-b591-b2ee1a0658fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:39.814866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3a0660a-7de4-4338-9a5b-e9c6ff67741a req-c47cc512-cfe6-459f-b591-b2ee1a0658fc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:39.815334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f3a0660a-7de4-4338-9a5b-e9c6ff67741a req-c47cc512-cfe6-459f-b591-b2ee1a0658fc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:39.826653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f3a0660a-7de4-4338-9a5b-e9c6ff67741a req-c47cc512-cfe6-459f-b591-b2ee1a0658fc service nova] Creating event network-changed:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:35:39.831903 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f3a0660a-7de4-4338-9a5b-e9c6ff67741a req-c47cc512-cfe6-459f-b591-b2ee1a0658fc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032314 Aug 03 05:35:39.832544 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3626/7263] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:35:40.396043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:40.396706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:40.403693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:40.404162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:40.404978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:40.405509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:40.933587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:40.942067 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ec2f64f-e8d2-4e4d-8e6e-51c3db9f8d3c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.550731 Aug 03 05:35:40.942657 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3638/7264] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:40 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:41.965020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:41.965668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:41.973496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:41.973969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:41.974749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:41.975203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:42.104345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:42.112297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-86affecb-e196-4a8d-99fc-e9fac87ad55d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.151589 Aug 03 05:35:42.112873 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3627/7265] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:41 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:43.134019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:43.134604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:43.142086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:43.142542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:43.143303 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:43.143743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:43.279096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:43.287103 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c1a7e9f-1623-426c-9800-fb9423e9d4e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.157101 Aug 03 05:35:43.287691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3639/7266] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:43 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:44.309211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:44.309850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:44.317862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:44.318339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:44.319129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:44.319587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:44.452080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:44.459845 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1c8f423a-5a73-4c58-a7ba-d4f26f5d1c8c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.154557 Aug 03 05:35:44.460490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3628/7267] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:44 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:45.481623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:45.482267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:45.489852 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:45.490313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:45.491107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:45.491529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:45.550861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0226cd65-caa2-4337-b43f-d6412eb3ae68 req-988b46aa-d7b3-4618-a32e-d2ff81930a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-plugged", "status": "completed", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:45.560428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0226cd65-caa2-4337-b43f-d6412eb3ae68 req-988b46aa-d7b3-4618-a32e-d2ff81930a32 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:45.560898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0226cd65-caa2-4337-b43f-d6412eb3ae68 req-988b46aa-d7b3-4618-a32e-d2ff81930a32 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:45.573256 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0226cd65-caa2-4337-b43f-d6412eb3ae68 req-988b46aa-d7b3-4618-a32e-d2ff81930a32 service nova] Creating event network-vif-plugged:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:35:45.582287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0226cd65-caa2-4337-b43f-d6412eb3ae68 req-988b46aa-d7b3-4618-a32e-d2ff81930a32 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098230 Aug 03 05:35:45.582908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3629/7268] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:35:45.635729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:45.638262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:45.645583 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e7e1d39-1777-4765-8c90-865e406e66a5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.167939 Aug 03 05:35:45.646183 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3640/7269] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:45 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:46.664575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:46.669575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:46.670295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:46.677929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:46.678398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:46.679187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:46.679671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:46.817350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:46.825481 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2dacd537-908e-444a-ae22-353674c4f9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1363 microversion: 2.1 time: 0.162054 Aug 03 05:35:46.826089 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3630/7270] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:46 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:35:47.848099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:47.848776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:47.850961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:47.857292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:47.857798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:47.858578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:47.859023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:47.992880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:35:48.000350 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f34c447a-245d-460b-a1f8-b6b4ca891e6a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1550 microversion: 2.1 time: 0.156945 Aug 03 05:35:48.000945 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3641/7271] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:35:47 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:35:48.022630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:35:48.023125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:35:48.030119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:48.030590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:48.031363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:48.031809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:48.045684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:35:48.109311 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d5ea64e9-a84c-47a8-853f-68ad627aab51 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090599 Aug 03 05:35:48.109908 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3631/7272] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:35:48 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:35:49.128162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6d008885-f553-42fe-984f-296a69085208 req-b99c9f71-20ef-4c8d-8316-f11cbb233fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:35:49.139450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6d008885-f553-42fe-984f-296a69085208 req-b99c9f71-20ef-4c8d-8316-f11cbb233fa9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:35:49.140154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6d008885-f553-42fe-984f-296a69085208 req-b99c9f71-20ef-4c8d-8316-f11cbb233fa9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:35:49.154056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6d008885-f553-42fe-984f-296a69085208 req-b99c9f71-20ef-4c8d-8316-f11cbb233fa9 service nova] Creating event network-changed:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:35:49.161023 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6d008885-f553-42fe-984f-296a69085208 req-b99c9f71-20ef-4c8d-8316-f11cbb233fa9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035904 Aug 03 05:35:49.161874 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3642/7273] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:22.017983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:22.022044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:22.024471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:22.030757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:22.031252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:22.032128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:22.032686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:22.061869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:22.068508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:36:22.074861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:36:22.075650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:36:22.075858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:36:22.076352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:36:22.076790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:36:22.291479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df7afe54-84ea-498b-940b-debe567f894a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/action" status: 202 len: 0 microversion: 2.1 time: 0.275537 Aug 03 05:36:22.292017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3632/7274] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:36:22 2022] POST /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:36:22.301681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:22.306865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:22.306865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:22.306865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=58 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:22.311062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:22.311518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:22.312315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:22.312755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:22.448691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:22.456402 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d1951a27-082a-4ce1-b90b-433d8ae73bb0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1678 microversion: 2.1 time: 0.159741 Aug 03 05:36:22.457011 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3643/7275] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:22 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:23.479469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:23.480108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:23.486624 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:23.487098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:23.487892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:23.488382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:23.628847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:23.636372 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3acd9f0e-35f3-4952-93d6-54b6ed92f4ef tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1678 microversion: 2.1 time: 0.161939 Aug 03 05:36:23.637227 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3633/7276] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:23 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:24.660434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:24.661102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:24.669090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:24.669555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:24.670329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:24.670773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:24.854247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:24.862134 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e03ad528-2dd5-4f89-80a0-34b0ada8e7f9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1678 microversion: 2.1 time: 0.207064 Aug 03 05:36:24.862740 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3644/7277] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:24 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:25.882896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:25.883525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:25.890456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:25.890919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:25.892584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:25.893041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:26.028556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:26.036312 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-542cde8a-e88c-4aad-8ee9-475dc22d5401 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.157313 Aug 03 05:36:26.036890 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3634/7278] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:25 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:27.058712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:27.059359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:27.066626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:27.067078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:27.067857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:27.068323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:27.199333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:27.207749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-386f2cf9-45c2-46fc-b009-df62c96e21dc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.153089 Aug 03 05:36:27.208344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3645/7279] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:27 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:28.230362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:28.231016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:28.239113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:28.239570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:28.240390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:28.240820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:28.376666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:28.384359 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-00195319-5849-41bd-bb5e-b3b713fda63a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.157840 Aug 03 05:36:28.385261 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3635/7280] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:28 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:29.405775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:29.406397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:29.413477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:29.413933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:29.414958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:29.415402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:29.547125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:29.555631 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c6dd39e0-ae15-4916-89bc-12538a0194db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.153787 Aug 03 05:36:29.556220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3646/7281] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:29 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:30.576424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:30.577091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:30.584422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:30.584895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:30.585688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:30.586145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:30.718160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:30.726451 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3bd7aff3-effa-4c08-bad8-c0e32d7e0abf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.153995 Aug 03 05:36:30.727299 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3636/7282] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:30 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:31.749047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:31.749738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:31.757450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:31.757907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:31.758673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:31.759182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:31.892341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:31.899862 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3449bcc-f22e-4af9-a97c-272661c56679 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.154773 Aug 03 05:36:31.900467 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3647/7283] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:31 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:32.921056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:32.921687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:32.929405 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:32.929875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:32.930656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:32.931112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:33.061649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:33.069336 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db7ae242-2fcd-458e-81ba-774093ded2b0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.152228 Aug 03 05:36:33.069913 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3637/7284] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:32 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:36:34.091809 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:34.092380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:34.099693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:34.100156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:34.101003 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:34.101452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:34.234075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:34.242560 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f3fbd115-71bf-43ae-a8f8-414ec9f963a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.154969 Aug 03 05:36:34.243144 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3648/7285] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:34 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:35.264186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:35.264869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:35.272609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:35.273072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:35.273849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:35.274297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:35.403930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:35.412495 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d7b31be-cceb-4159-b6e3-e584e01dd2e0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.152208 Aug 03 05:36:35.413093 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3638/7286] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:35 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:36.434661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:36.435289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:36.442997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:36.443457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:36.444230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:36.444702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:36.575929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:36.583980 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-698bd1f2-7d4c-4657-aae2-ad6acc4b0301 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.153327 Aug 03 05:36:36.584616 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3649/7287] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:36 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:37.606411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:37.607043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:37.614602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:37.615070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:37.615849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:37.616324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:37.751546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:37.759930 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c9162af6-e2ef-4560-ad19-64e702a7349a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.157415 Aug 03 05:36:37.760532 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3639/7288] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:37 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:38.781931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:38.782553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:38.789997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:38.790457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:38.791232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:38.791677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:38.921156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:38.929471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-16a16f81-ccbd-4fcc-8e5c-53f9cb04392c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.151493 Aug 03 05:36:38.930052 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3650/7289] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:38 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:39.951146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:39.951781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:39.959037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:39.959428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:39.960215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:39.960700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:40.093299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:40.101494 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e56d594b-021c-4b8d-9907-9a81d483e440 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.154310 Aug 03 05:36:40.102066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3640/7290] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:39 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:41.123560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:41.124107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:41.132509 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:41.133125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:41.134063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:41.134666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:41.266611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:41.275092 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c5c5b5e-38ee-4815-8ae5-a4ef7158a669 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.155576 Aug 03 05:36:41.275671 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3651/7291] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:41 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:42.297692 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:42.298219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:42.305948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:42.306409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:42.307186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:42.307690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:42.439362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:42.447016 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-74255216-ac6a-41aa-8509-108a2556c764 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1683 microversion: 2.1 time: 0.153432 Aug 03 05:36:42.447613 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3641/7292] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:42 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:43.469891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:43.470660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:43.478527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:43.478988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:43.479936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:43.480405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:43.539625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-unplugged", "status": "completed", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:43.547198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:43.547940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:43.564067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] Creating event network-vif-unplugged:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h2-826756-5 Aug 03 05:36:43.571062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:36:43.582929 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2919db19-ea6a-4809-ac04-0880daf0a5af req-936f9811-afff-4557-b06b-584f45e7a00f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114352 Aug 03 05:36:43.583555 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3642/7293] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:43.711719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:43.719373 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1e936cad-9690-442d-bcb5-888b586019da tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1682 microversion: 2.1 time: 0.253731 Aug 03 05:36:43.719954 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3652/7294] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:43 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:44.742463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:44.743185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:44.749660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:44.750140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:44.750915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:44.751365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:44.883232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:44.890847 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-53add2ca-4704-4e0f-9993-b494e83e8fc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1682 microversion: 2.1 time: 0.153938 Aug 03 05:36:44.891426 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3643/7295] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:44 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:45.601246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:45.611689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:45.612195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:45.624926 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] Creating event network-changed:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h2-826756-5 Aug 03 05:36:45.630810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:36:45.641949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-14059e23-cd62-4194-9074-e851d7fb7561 req-e67eddbb-f1c9-4e0b-96ca-2acd1bcf00d8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045316 Aug 03 05:36:45.642560 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3653/7296] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:45.914879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:45.915521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:45.923569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:45.924037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:45.924870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:45.925673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:46.383204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:46.392533 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1af38767-52c8-42c3-b915-039d76ff7f29 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1680 microversion: 2.1 time: 0.482420 Aug 03 05:36:46.395589 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3644/7297] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:45 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1680 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:47.417931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:47.418650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:47.425842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.426302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.427086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.427533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.572461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:47.580403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db66ae1e-e723-4d90-8409-1b562faeb703 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1677 microversion: 2.1 time: 0.167455 Aug 03 05:36:47.580403 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3654/7298] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:47 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:47.601303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:47.601853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:47.608869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.609337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.610127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.610594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.648974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.649441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.650262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.650719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.671299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:36:47.676714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:36:47.772564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:47.971143 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0d7a3cf5-37c4-4145-97d3-57dd9663b1ca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/action" status: 202 len: 0 microversion: 2.1 time: 0.373832 Aug 03 05:36:47.971981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3645/7299] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:36:47 2022] POST /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:36:47.980102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:47.980751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:47.986895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.987860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:47.988665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:47.989103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:48.193675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:48.201326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d788927-5ae7-483b-8052-8fb089eb541b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.225119 Aug 03 05:36:48.201924 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3655/7300] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:47 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:49.224950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:49.225677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:49.232027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:49.232537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:49.233319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:49.233770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:49.372747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:49.380593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e4cd74e3-a2ad-4590-8e90-9d0e1feff21f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.161389 Aug 03 05:36:49.381178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3646/7301] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:49 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:49.653569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-plugged", "status": "completed", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:49.665098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:49.665543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:49.681454 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] Creating event network-vif-plugged:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h2-826756-5 Aug 03 05:36:49.686867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:36:49.698051 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a2ae6037-b73b-42f6-bcce-e41fce0745da req-7364dc50-e415-495f-98df-2d2755a98a8e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048236 Aug 03 05:36:49.698731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3656/7302] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:50.402207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:50.402849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:50.410667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:50.411143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:50.411930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:50.412423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:50.546076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:50.555682 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d46a113-cb15-48be-b157-c77c7ee62b04 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.157357 Aug 03 05:36:50.556593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3647/7303] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:50 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:51.559266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-unplugged", "status": "completed", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:51.570169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:51.570722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:51.576514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:51.580969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:51.583253 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] Creating event network-vif-unplugged:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:36:51.584423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:51.584899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:51.585700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:51.586284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:51.588843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:36:51.599999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-7a8cb46f-225e-4804-b60a-3098fbf07503 req-c6190d1c-963e-4c2b-bf32-fdf9ea4e2bd9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045578 Aug 03 05:36:51.603882 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3657/7304] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:51.846886 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:51.854568 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1a41f90a-cc2a-4218-a65c-246f2dd82dcb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.281952 Aug 03 05:36:51.855155 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3648/7305] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:51 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:36:52.936857 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:52.937568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:52.944676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:52.945135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:52.945900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:52.946343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:53.075937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:53.083537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-119f99e6-e178-4f3a-b2dd-77f0929a4565 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.151985 Aug 03 05:36:53.084124 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3658/7306] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:52 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:53.614915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:53.620165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:53.625452 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:53.625942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:53.637650 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] Creating event network-changed:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:36:53.642965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:36:53.654043 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8aec6991-d226-4d1a-bea4-66aa4c9c1524 req-d50d48a5-7022-412a-a7d3-b6797c189bb9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043209 Aug 03 05:36:53.654638 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3649/7307] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:54.104840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:54.105469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:54.112660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:54.120185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:54.120185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:54.120185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:54.399620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:54.407407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc387dc1-5293-43dc-a0c8-e02b31a2a428 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1676 microversion: 2.1 time: 0.306494 Aug 03 05:36:54.408091 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3659/7308] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:54 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:55.432434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:55.433168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:55.439538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:55.440949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:55.441390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:55.441836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:55.573269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:55.581652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-93b3e075-f2f2-4c13-abc0-485814e897eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1669 microversion: 2.1 time: 0.154123 Aug 03 05:36:55.582278 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3650/7309] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:55 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:36:55.604855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:55.605528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:55.608466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=35 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:55.613474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:55.613932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:55.614700 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:55.615141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:55.619114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=97 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:56.108455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:56.116975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e62be62-65e9-4bcb-8537-f4d531e7a7d5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1669 microversion: 2.1 time: 0.516083 Aug 03 05:36:56.117567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3660/7310] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:55 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:56.138791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:56.139428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:56.145555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.146015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.146988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.147469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.281184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:56.289862 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9a88d60-0531-4a4f-be4f-15ddf2b9c4f7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1669 microversion: 2.1 time: 0.154884 Aug 03 05:36:56.290541 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3651/7311] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:56 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:56.311262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:56.319343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:56.319343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.319343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.319614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.319942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.344884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:36:56.653106 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29ac522d-dba4-49a5-aa69-1becefe18402 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 204 len: 0 microversion: 2.1 time: 0.345191 Aug 03 05:36:56.653782 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3661/7312] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:36:56 2022] DELETE /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:36:56.662849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:56.674324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:56.674324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.674324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.674324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:56.674324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:56.815114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:56.822907 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d9263a01-06bb-410f-adfe-405a2c348d75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1675 microversion: 2.1 time: 0.164737 Aug 03 05:36:56.823482 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3652/7313] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:56 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:57.848659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:57.849411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:57.857408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:57.857872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:57.858659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:57.859106 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:57.890633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-016a14a1-d60f-474c-9e1e-00fbed20289c req-75e5212c-a955-485c-8325-3abc5ee0bbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-plugged", "status": "completed", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:57.899736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:36:57.902605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-016a14a1-d60f-474c-9e1e-00fbed20289c req-75e5212c-a955-485c-8325-3abc5ee0bbd5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:57.903073 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-016a14a1-d60f-474c-9e1e-00fbed20289c req-75e5212c-a955-485c-8325-3abc5ee0bbd5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:57.916040 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-016a14a1-d60f-474c-9e1e-00fbed20289c req-75e5212c-a955-485c-8325-3abc5ee0bbd5 service nova] Creating event network-vif-plugged:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:36:57.921530 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-016a14a1-d60f-474c-9e1e-00fbed20289c req-75e5212c-a955-485c-8325-3abc5ee0bbd5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034576 Aug 03 05:36:57.924857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3653/7314] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:36:58.063409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:58.071580 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e155b4dd-1411-418e-8524-1b69f20eaf9e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1675 microversion: 2.1 time: 0.227887 Aug 03 05:36:58.084289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3662/7315] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:57 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:36:58.886271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-78fe4f2e-f01f-4532-a24e-13487abf1c24 req-9d75f544-bffd-4887-b09c-e8a1fc2e77e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00dd2bb5-65dd-4ed2-9007-cb5e5157b131", "name": "network-vif-deleted", "tag": "69cf2ae2-1162-4801-80e0-f3e5eb678c10"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:36:58.896304 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-78fe4f2e-f01f-4532-a24e-13487abf1c24 req-9d75f544-bffd-4887-b09c-e8a1fc2e77e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:58.899703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-78fe4f2e-f01f-4532-a24e-13487abf1c24 req-9d75f544-bffd-4887-b09c-e8a1fc2e77e8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:58.911253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-78fe4f2e-f01f-4532-a24e-13487abf1c24 req-9d75f544-bffd-4887-b09c-e8a1fc2e77e8 service nova] Creating event network-vif-deleted:69cf2ae2-1162-4801-80e0-f3e5eb678c10 for instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 on n-h1-826756-5 Aug 03 05:36:58.916465 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-78fe4f2e-f01f-4532-a24e-13487abf1c24 req-9d75f544-bffd-4887-b09c-e8a1fc2e77e8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Aug 03 05:36:58.917066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3654/7316] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:36:59.093888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:36:59.094428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:36:59.102667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:59.103124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:59.103908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:36:59.104376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:36:59.172082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:36:59.181040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aca8ad7c-65f8-49a6-9fd5-9df3718efa75 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 200 len: 1322 microversion: 2.1 time: 0.091707 Aug 03 05:36:59.181641 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3663/7317] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:36:59 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 1322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:37:00.203893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:00.204646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:00.211700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.212165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.212973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.213427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.226698 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 HTTP/1.1 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '00dd2bb5-65dd-4ed2-9007-cb5e5157b131'} Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:37:00.228386 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3a0154ae-34f9-43a3-86bb-3cb74b42d150 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 404 len: 111 microversion: 2.1 time: 0.031091 Aug 03 05:37:00.232821 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3655/7318] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:00 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:37:00.248540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:00.249189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:00.256935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.257329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.258103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.258548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.272605 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 HTTP/1.1 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '00dd2bb5-65dd-4ed2-9007-cb5e5157b131'} Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:37:00.274280 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d5a356fc-46b2-4898-b60b-82cbc5c591cc tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 03 05:37:00.278142 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3664/7319] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:00 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:37:00.352946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-574489043", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "41e14199-88e7-452d-8480-c9e908f8bcaf"}], "security_groups": [{"name": "tempest-securitygroup--1506820787"}], "key_name": "tempest-keypair-556250000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:37:00.457060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] validate_networks() for [('41e14199-88e7-452d-8480-c9e908f8bcaf', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:37:00.904314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:37:00.904764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:37:00.905265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:37:00.905697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:37:00.906132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:37:00.916011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.916498 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.917360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:00.917819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:00.934990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:37:00.940493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:37:00.952919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:37:00.955223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:37:01.100583 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ad74514-1151-47ce-97d4-f93a0f82887e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751482 Aug 03 05:37:01.101228 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3656/7320] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:37:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:37:01.112355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2769aaa2-634c-4cb4-8c7a-b5331ca22f95 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:01.112967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2769aaa2-634c-4cb4-8c7a-b5331ca22f95 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:01.172847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2769aaa2-634c-4cb4-8c7a-b5331ca22f95 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:01.180327 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2769aaa2-634c-4cb4-8c7a-b5331ca22f95 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1237 microversion: 2.1 time: 0.071755 Aug 03 05:37:01.180906 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3665/7321] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:01 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:02.202844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:02.203397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:02.212581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:02.213083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:02.213869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:02.214320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:02.277479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:02.286031 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22cba21d-bc0e-4574-a326-0b558ac6df82 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1241 microversion: 2.1 time: 0.087987 Aug 03 05:37:02.286532 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3657/7322] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:02 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:03.307803 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:03.308645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:03.316679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:03.317138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:03.317912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:03.318353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:03.381148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:03.388835 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6047a480-0810-48e4-964f-2e6a160f95d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1289 microversion: 2.1 time: 0.085019 Aug 03 05:37:03.389411 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3666/7323] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:03 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:04.411288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:04.411980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:04.418931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:04.419401 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:04.420217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:04.420752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:04.665374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:04.673227 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15856f38-49ac-4f9d-a769-79870820a29e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.266028 Aug 03 05:37:04.673800 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3658/7324] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:04 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:05.133401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-28a1352a-bb4c-4d03-97d2-9e468f18746c req-48df9ff6-980e-427f-9651-023717a1cb70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:37:05.144781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-28a1352a-bb4c-4d03-97d2-9e468f18746c req-48df9ff6-980e-427f-9651-023717a1cb70 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:05.145266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-28a1352a-bb4c-4d03-97d2-9e468f18746c req-48df9ff6-980e-427f-9651-023717a1cb70 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:05.156567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-28a1352a-bb4c-4d03-97d2-9e468f18746c req-48df9ff6-980e-427f-9651-023717a1cb70 service nova] Creating event network-changed:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:37:05.162164 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-28a1352a-bb4c-4d03-97d2-9e468f18746c req-48df9ff6-980e-427f-9651-023717a1cb70 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032564 Aug 03 05:37:05.162955 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3667/7325] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:37:05.695966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:05.696761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:05.707114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:05.707592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:05.708532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:05.708962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:05.911658 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:05.920053 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-96daac59-1d67-4adc-9491-599d4e92388a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.228226 Aug 03 05:37:05.920696 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3659/7326] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:05 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:06.942006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:06.942921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:06.950349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:06.950804 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:06.951566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:06.952013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:07.085467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:07.091235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ff6696d3-cee1-4ca7-8918-5219c6ca6596 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.153587 Aug 03 05:37:07.091801 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3668/7327] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:06 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:08.114075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:08.114748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:08.121919 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:08.122394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:08.123186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:08.123645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:08.255150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:08.262730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cc570bc-a960-4db0-b9d6-8d92059d2fca tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.153426 Aug 03 05:37:08.263303 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3660/7328] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:08 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:09.284527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:09.285067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:09.293231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:09.294773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:09.294773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:09.294951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:09.424409 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:09.432257 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3bdcf6e0-6ee5-4b91-b1aa-010015afca3e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.151732 Aug 03 05:37:09.433043 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3669/7329] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:09 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:10.454216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:10.454854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:10.462546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:10.463019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:10.463805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:10.464263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:10.591238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:10.598815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ba5f9963-17cf-48cc-aee7-6c09ac020975 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.148647 Aug 03 05:37:10.599383 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3661/7330] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:10 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:11.621304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:11.621928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:11.625203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:11.630228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:11.630684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:11.631468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:11.631914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:11.655956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4c3826e9-7d94-4de3-b2ce-a077497ea4f8 req-f63a3822-d573-4124-ac2f-b27e1c4fc9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-plugged", "status": "completed", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:37:11.661552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:11.662245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:11.669014 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4c3826e9-7d94-4de3-b2ce-a077497ea4f8 req-f63a3822-d573-4124-ac2f-b27e1c4fc9ca service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:11.669479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4c3826e9-7d94-4de3-b2ce-a077497ea4f8 req-f63a3822-d573-4124-ac2f-b27e1c4fc9ca service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:11.681169 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4c3826e9-7d94-4de3-b2ce-a077497ea4f8 req-f63a3822-d573-4124-ac2f-b27e1c4fc9ca service nova] Creating event network-vif-plugged:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:37:11.686165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4c3826e9-7d94-4de3-b2ce-a077497ea4f8 req-f63a3822-d573-4124-ac2f-b27e1c4fc9ca service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034080 Aug 03 05:37:11.686794 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3662/7331] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:37:11.770919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:11.779444 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-790da595-c192-4e52-8b83-461724522595 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.162031 Aug 03 05:37:11.780036 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3670/7332] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:11 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:12.803067 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:12.803774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:12.810650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:12.811112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:12.811881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:12.812355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:12.953505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:12.961788 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a98e95d-6e21-4c49-afef-2c7b69fc3e9b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1363 microversion: 2.1 time: 0.164130 Aug 03 05:37:12.962517 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3663/7333] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:12 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:13.984461 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:13.985088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:13.992844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:13.993299 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:13.994099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:13.994540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:14.131861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:14.139474 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-143d51eb-ea5c-4d19-9620-54c1d2d1a537 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1550 microversion: 2.1 time: 0.159173 Aug 03 05:37:14.140070 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3671/7334] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:13 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:37:14.161577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:14.162111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:14.169244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:14.169704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:14.170475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:14.170924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:14.251368 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8178d8f4-1596-4970-b6dd-e26ee61a6096 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094321 Aug 03 05:37:14.251972 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3664/7335] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:37:14 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:37:15.588607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4b052077-3c90-4bfb-8bfe-8607a051d3d8 req-fe405500-d11f-4072-8563-e9925ef33e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:37:15.599308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4b052077-3c90-4bfb-8bfe-8607a051d3d8 req-fe405500-d11f-4072-8563-e9925ef33e67 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:15.599765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4b052077-3c90-4bfb-8bfe-8607a051d3d8 req-fe405500-d11f-4072-8563-e9925ef33e67 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:15.612884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4b052077-3c90-4bfb-8bfe-8607a051d3d8 req-fe405500-d11f-4072-8563-e9925ef33e67 service nova] Creating event network-changed:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:37:15.618203 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4b052077-3c90-4bfb-8bfe-8607a051d3d8 req-fe405500-d11f-4072-8563-e9925ef33e67 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033404 Aug 03 05:37:15.618907 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3672/7336] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:37:48.680741 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:37:48.681351 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:37:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:37:49.032696 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:37:49.033232 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:37:53.467017 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:53.467778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:53.471577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:37:53.472227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:53.478475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:53.483791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:53.483791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:53.483791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:53.610777 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:37:53.619781 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-55e50bfd-b096-46ed-8ba8-b7d7344dc92e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1669 microversion: 2.1 time: 0.154876 Aug 03 05:37:53.620380 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3665/7337] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:37:53 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:37:53.639204 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:53.639955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:37:53.644366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e09ca77-2d8d-4dc8-99e0-09865e669a29"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:37:53.646794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:37:53.653102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:53.656469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:53.656469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:37:53.656469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:37:54.416449 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9bcc01d7-e2bd-4d07-ad26-42d3086e6390 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779091 Aug 03 05:37:54.417094 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3673/7338] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:37:53 2022] POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:06.189618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:06.191922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:06.194739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:06.199800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:06.200296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:06.202062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:06.202523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:06.230388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:06.236681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Old instance type m1.heat2, new instance type m1.heat {{(pid=120832) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:38:06.243643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:38:06.244087 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:38:06.244617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:38:06.245055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:38:06.245489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:38:06.538205 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-176a8c04-f998-4f95-8f9e-22a732b5f28d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.353659 Aug 03 05:38:06.538857 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3666/7339] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:38:06 2022] POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:38:06.545647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:06.546428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:06.550812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:06.551403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:06.558097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:06.558548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:06.559371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:06.559837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:06.699163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:06.708168 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3f302b7-d72c-4a0f-871b-a734ac52d614 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1724 microversion: 2.1 time: 0.164535 Aug 03 05:38:06.708774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3674/7340] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:06 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:38:07.731444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:07.732746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:07.738843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:07.739310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:07.740080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:07.740557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:07.879328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:07.887634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7430aa1d-b257-4753-b031-58bc00c35d2c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1724 microversion: 2.1 time: 0.161009 Aug 03 05:38:07.888198 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3667/7341] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:07 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:08.910438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:08.911050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:08.918874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:08.919329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:08.920093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:08.920694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:09.052742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:09.061300 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7ca28cc7-9e79-41b9-b93f-56911124e1d9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1724 microversion: 2.1 time: 0.154491 Aug 03 05:38:09.062068 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3675/7342] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:08 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:10.083790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:10.084439 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:10.091337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:10.091796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:10.092829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:10.093281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:10.227428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:10.235895 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c668cae0-d8c7-4efc-ba6e-30be6a8d0993 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.156076 Aug 03 05:38:10.236491 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3668/7343] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:10 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:11.257807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:11.258431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:11.265933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:11.266417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:11.267184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:11.267629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:11.401226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:11.409612 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-db639603-9fa7-40a0-b415-75ba9518d546 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.155830 Aug 03 05:38:11.410170 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3676/7344] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:11 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:12.519411 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:12.578337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:12.586593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fe757427-3bb1-4c10-b16d-a4c449eb9461 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.158200 Aug 03 05:38:12.587345 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3669/7345] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:12 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:13.609585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:13.610210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:13.617297 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:13.617774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:13.618550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:13.619000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:13.766701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:13.774278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab156304-aaab-490a-b257-2b242af8dbea tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.168751 Aug 03 05:38:13.774905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3677/7346] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:13 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:14.796436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:14.797199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:14.804176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:14.804677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:14.805462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:14.805920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:14.937334 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:14.945701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed522ff4-ad57-4954-8bb9-5e75c2e911d0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.153245 Aug 03 05:38:14.946280 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3670/7347] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:14 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:15.967079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:15.967605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:15.974896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:15.975362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:15.976130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:15.976591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:16.110889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:16.119077 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f985e9ef-778a-4b87-b59e-bee4fc0e3921 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.156003 Aug 03 05:38:16.119656 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3678/7348] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:15 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:17.140978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:17.142109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:17.149101 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:17.149572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:17.150343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:17.150794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:17.279135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:17.287753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-64ed1448-2de3-413e-ac17-a57de01242c6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.150677 Aug 03 05:38:17.288352 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3671/7349] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:17 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:18.309291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:18.309916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:18.317095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:18.317552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:18.318348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:18.318794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:18.455189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:18.462067 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-19d0365e-ae3a-4e06-9230-28d8f02760c9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.156763 Aug 03 05:38:18.463931 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3679/7350] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:18 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:19.483612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:19.484248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:19.491530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:19.491999 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:19.492802 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:19.493262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:19.623768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:19.632448 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-daa3f912-b73b-4afd-b5af-cf1e3c996177 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.152761 Aug 03 05:38:19.633017 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3672/7351] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:19 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:20.654596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:20.655223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:20.663195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:20.663658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:20.664552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:20.664999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:20.795777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:20.804294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e4f74e4-84d8-4add-8b5e-9557fc43e71b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.153685 Aug 03 05:38:20.804890 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3680/7352] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:20 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:21.825409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:21.826044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:21.834661 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:21.835130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:21.835927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:21.836415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:21.973091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:21.981226 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7fd190ef-e739-4541-8f30-fe48a8711a4f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.159782 Aug 03 05:38:21.981807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3673/7353] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:21 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:23.003581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:23.004193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:23.010981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:23.011431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:23.012190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:23.012824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:23.151400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:23.160049 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bddd7c16-a00e-448f-addb-152b7cee9fba tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.160862 Aug 03 05:38:23.160680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3681/7354] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:22 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:24.182141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:24.182771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:24.189106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:24.191456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:24.191456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:24.191456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:24.372486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:24.381559 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81683390-1d65-4f50-97b8-1a054e1e46f1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1729 microversion: 2.1 time: 0.203336 Aug 03 05:38:24.382139 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3674/7355] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:24 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:25.213529 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:25.225131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:25.225574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:25.237479 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] Creating event network-vif-unplugged:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h1-826756-5 Aug 03 05:38:25.242745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] Instance c315f592-f9bf-43c7-9091-87a78a088bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:38:25.253687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3680f489-7d18-4d91-948b-35d14de8e5e5 req-e0071198-df7b-46ca-b594-0bceddc56688 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043942 Aug 03 05:38:25.254279 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3682/7356] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:25.402825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:25.403466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:25.411399 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:25.411880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:25.412722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:25.413182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:25.613063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:25.621066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ec1fbe15-dbbc-4b5b-9e98-c1c9e1b7c7d2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1728 microversion: 2.1 time: 0.222180 Aug 03 05:38:25.621651 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3675/7357] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:25 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:26.646098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:26.646812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:26.653468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:26.653921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:26.654696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:26.655234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:26.808953 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:26.818755 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5fd7e127-bd8e-4a45-81f9-dc92f0bcd18b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.178821 Aug 03 05:38:26.819425 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3683/7358] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:26 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:27.269023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:27.279823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:27.280306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:27.293755 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] Creating event network-changed:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h1-826756-5 Aug 03 05:38:27.299877 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] Instance c315f592-f9bf-43c7-9091-87a78a088bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120832) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:38:27.311602 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6f58f4de-02ba-42a7-9a2d-d1e6b86ab542 req-ccad65b6-1629-42a4-a6aa-e7be5182d6ad service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046853 Aug 03 05:38:27.312222 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3676/7359] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:27.841800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:27.843002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:27.850976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:27.851679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:27.852495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:27.852942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:28.291019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:28.300662 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4e0fac9-4744-4c61-9f87-1b70258c8dab tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.462991 Aug 03 05:38:28.301571 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3684/7360] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:27 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:29.324398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:29.325035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:29.331422 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:29.331885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:29.332699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:29.333155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:29.477555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:29.485913 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-158f7a01-3a73-4d3a-8d90-1d929a85e50d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.166650 Aug 03 05:38:29.487295 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3677/7361] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:29 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:30.509305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:30.509923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:30.516988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:30.518007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:30.518779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:30.519213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:30.655172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:30.663553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ef1995f-ab5f-43bf-8104-c5fc80fa940b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.158212 Aug 03 05:38:30.664143 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3685/7362] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:30 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:31.686109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:31.686796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:31.695132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:31.695609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:31.696470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:31.696937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:31.835241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:31.844662 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-685ddf76-3d45-4f0c-a6ce-00e440c3d8bf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.161782 Aug 03 05:38:31.845660 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3678/7363] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:31 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:32.866610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:32.867236 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:32.874329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:32.874812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:32.875607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:32.876090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:33.006685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:33.016513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ddbc4e4-17e8-4828-a8f7-3cc7c9964fbe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.153833 Aug 03 05:38:33.017104 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3686/7364] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:32 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:34.038908 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:34.039453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:34.046814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:34.047283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:34.048135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:34.048725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:34.183953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:34.192422 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a73ccd0-03ec-4448-a577-cd1fc3b0f4d7 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.157567 Aug 03 05:38:34.193011 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3679/7365] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:34 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:35.214518 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:35.215144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:35.222825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:35.223277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:35.224043 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:35.224511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:35.357152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:35.366005 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6240bff9-67f6-447c-9763-c8b051e809c2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.155502 Aug 03 05:38:35.366585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3687/7366] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:35 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:36.388309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:36.388974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:36.391809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=33 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:36.397447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:36.405885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:36.405885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:36.405885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:36.405885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:36.532832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:36.541597 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-da6bc46d-5fc1-442a-ac8f-ef19f8ee0d10 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.157177 Aug 03 05:38:36.542178 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3680/7367] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:36 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:37.563918 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:37.564787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:37.568077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:37.573252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:37.573712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:37.574583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:37.575054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:37.714854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:37.722965 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d69110c-9b07-427b-b2e7-482cbf139268 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.163194 Aug 03 05:38:37.723544 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3688/7368] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:37 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:38:38.745635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:38.746266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:38.753829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:38.754342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:38.755131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:38.755587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:38.885382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:38.894600 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e7a5324-23ee-481c-ad45-e8dfc3a15b94 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1726 microversion: 2.1 time: 0.152594 Aug 03 05:38:38.895230 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3681/7369] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:38 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:39.924328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:39.924977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:39.932459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:39.932920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:39.933691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:39.934133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:39.936693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=89 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:40.073667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:40.081827 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8b00acc9-cb21-4139-ad91-a522f3cc5839 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1723 microversion: 2.1 time: 0.161628 Aug 03 05:38:40.082428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3689/7370] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:39 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:40.104025 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:40.104627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:40.111617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.112126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.112937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.113409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.154734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.155204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.156114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.156603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.179584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:38:40.184959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Getting quotas for user e32a56f682734604a4a9853ad0fc3483 and project 9b455bd53ea54d6fa0fbf3cff5acffca. Resources: {'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:38:40.610204 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5df70ac9-ce8f-46dc-bfce-83b2b95de6ce tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/action" status: 202 len: 0 microversion: 2.1 time: 0.509804 Aug 03 05:38:40.611005 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3682/7371] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:38:40 2022] POST /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:38:40.620178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:40.620980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:40.627149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.627614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.628431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:40.628878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:40.823449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:40.831539 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aa3b271d-d052-4ce8-8372-662822cf9892 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.216133 Aug 03 05:38:40.832122 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3690/7372] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:40 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:41.856535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:41.857265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:41.864931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:41.865407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:41.866195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:41.866651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:42.003324 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:42.012093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ef39c0cc-c6e0-41cf-9c56-d4d81ee24d91 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.160848 Aug 03 05:38:42.012702 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3683/7373] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:41 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:38:42.383094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-plugged", "status": "completed", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:42.393454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:42.393912 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:42.405977 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] Creating event network-vif-plugged:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h1-826756-5 Aug 03 05:38:42.411245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] Instance c315f592-f9bf-43c7-9091-87a78a088bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:38:42.422382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e82cfa4a-ee5b-4f63-bd95-c8d485254568 req-819ca179-32ae-4892-b2be-4a904b47a7e0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043984 Aug 03 05:38:42.423029 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3691/7374] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:43.033830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:43.034468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:43.042754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:43.043464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:43.044288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:43.044786 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:43.180325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:43.188490 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2c025ca-e243-4e9c-a113-bf89ae039494 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.158508 Aug 03 05:38:43.191243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3684/7375] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:43 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:38:44.212038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:44.212845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:44.219241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:44.219687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:44.220486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:44.220923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:44.358041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:44.367166 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-55157b70-ac90-4922-aef4-b47eea8f8fc6 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.160226 Aug 03 05:38:44.367699 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3692/7376] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:44 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:45.389207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:45.389758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:45.397075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:45.397525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:45.398300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:45.398753 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:45.528812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:45.537166 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e3c8462-1d30-4293-9535-439fb64bf17f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.152161 Aug 03 05:38:45.537825 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3685/7377] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:45 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:46.285730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:46.297260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:46.302753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:46.311407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] Creating event network-vif-unplugged:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:38:46.317105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] Instance c315f592-f9bf-43c7-9091-87a78a088bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:38:46.329603 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-daa3ca76-40c6-485f-8a94-4f810df24391 req-8514b491-7227-4a79-b486-1f59b7456764 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047810 Aug 03 05:38:46.330289 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3693/7378] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:46.559126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:46.559757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:46.566812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:46.567392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:46.568191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:46.568668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:46.768721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:46.777696 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aaece231-896d-49bc-a700-a535cf2de245 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.222368 Aug 03 05:38:46.778281 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3686/7379] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:46 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:47.561320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:38:47.571875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:47.572442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:47.584520 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] Creating event network-changed:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:38:47.590344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] Instance c315f592-f9bf-43c7-9091-87a78a088bfa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:38:47.601239 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-6dc78561-cb6a-4c04-875f-bfe9d4fc52a8 req-1969599f-9856-474f-b2fe-714326c3ef06 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045320 Aug 03 05:38:47.601876 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3694/7380] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:38:47.800880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:47.804874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:47.812756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:47.813299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:47.814066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:47.814521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:48.139519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:48.149148 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a6d159e-cd79-40e5-a8a0-b6c0091759b3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.352571 Aug 03 05:38:48.149750 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3687/7381] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:47 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:49.173577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:49.174315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:49.186771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:49.187221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:49.187995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:49.188463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:49.322257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:49.330311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e144845b-e0f6-4421-bddf-60999a54708b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.163194 Aug 03 05:38:49.330892 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3695/7382] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:49 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:50.351720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:50.352238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:50.355193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:38:50.360120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:50.360615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:50.361396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:50.361843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:50.495253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:50.503392 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aebc740e-73dc-4ae9-9ee6-d1bca42a85f0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.156260 Aug 03 05:38:50.503958 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3688/7383] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:50 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:51.526500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:51.527172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:51.534851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:51.535306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:51.536090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:51.536688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:51.680729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:51.688983 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a476146-d280-4a34-9dbc-1a6a35cc8114 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.166425 Aug 03 05:38:51.689577 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3696/7384] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:51 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:52.712232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:52.712978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:52.719556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:52.720112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:52.720983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:52.721506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:52.853954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:52.862553 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5efc5e42-dc30-4036-bd64-cebcf51817f2 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.154826 Aug 03 05:38:52.863143 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3689/7385] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:52 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:53.883392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:53.883924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:53.890262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:53.890715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:53.891474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:53.891909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:54.023364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:54.031309 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ce4d8085-3ebc-4778-bc0a-da4e3168683e tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.152234 Aug 03 05:38:54.031885 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3697/7386] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:53 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:55.053426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:55.054049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:55.061280 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:55.061746 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:55.062602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:55.063056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:55.191982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:55.201946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8398b6be-bedf-4b6c-8bef-13287ef520c1 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.152471 Aug 03 05:38:55.202520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3690/7387] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:55 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:38:56.222927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:56.223599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:56.230923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:56.231379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:56.232153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:56.232624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:56.468526 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:56.476968 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b703fe85-ce8b-40d5-af35-5fd6a48066eb tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.257883 Aug 03 05:38:56.477582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3698/7388] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:56 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:57.498979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:57.499648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:57.507120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:57.507620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:57.508559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:57.509093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:57.640156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:57.649087 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54a00a50-3988-467a-adbc-308d625de8db tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.154015 Aug 03 05:38:57.649667 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3691/7389] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:57 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:58.670187 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:58.670805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:58.678485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:58.678932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:58.679719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:58.680155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:58.808698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:38:58.816731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b91cca3d-767e-4b06-992e-6a7bd6fe2d8b tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.150437 Aug 03 05:38:58.817341 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3699/7390] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:58 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:38:59.838638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:38:59.839198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:38:59.846602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:59.847080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:59.847907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:38:59.849095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:38:59.996803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:00.005493 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e1b26ee6-71e0-4cea-a2b8-a5307a36dbaf tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.170850 Aug 03 05:39:00.006085 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3692/7391] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:38:59 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:39:01.027433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:01.028054 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:01.035182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:01.035641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:01.036524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:01.036976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:01.171382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:01.180307 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c3215073-1d8c-43f4-82ba-9935d058dde8 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1722 microversion: 2.1 time: 0.156629 Aug 03 05:39:01.180893 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3700/7392] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:01 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:02.206225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:02.207458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:02.217904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.225015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.225015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.225015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.352228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:02.354546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:02.361097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9d4917a5-e514-4868-ab77-4d786bf44983 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1715 microversion: 2.1 time: 0.162007 Aug 03 05:39:02.366749 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3693/7393] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:02 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:02.382877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:02.383502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:02.390703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.391162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.391943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.392473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.525784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:02.534107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-40f84f2d-673a-41e0-9b7a-fa89af84eefe tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1715 microversion: 2.1 time: 0.155631 Aug 03 05:39:02.534696 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3701/7394] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:02 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:02.555538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:02.556121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:02.563016 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.563489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.564301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.564768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.697499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:02.706274 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-09e2605c-0c5a-4ced-a1d0-496da823e97f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1715 microversion: 2.1 time: 0.155155 Aug 03 05:39:02.706866 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3694/7395] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:02 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:02.726779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:02.727310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:02.733534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.734088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.734921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:02.735371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:02.761539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:39:03.118355 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-29ea39f4-0c07-4bf1-b390-9df095974da5 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 204 len: 0 microversion: 2.1 time: 0.395249 Aug 03 05:39:03.118994 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3702/7396] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:02 2022] DELETE /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:39:03.127239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:03.129164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:03.134758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:03.135243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:03.136023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:03.136512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:03.270937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:03.278997 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2742f90-9c81-4e30-b3fe-34ecd06b54e9 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1721 microversion: 2.1 time: 0.155658 Aug 03 05:39:03.279568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3695/7397] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:03 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:04.146337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f9d8b921-8b65-4657-9551-21be0f29b242 req-fdf80d85-b3b0-432a-88e0-8297d1eb415f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-plugged", "status": "completed", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:04.157673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9d8b921-8b65-4657-9551-21be0f29b242 req-fdf80d85-b3b0-432a-88e0-8297d1eb415f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:04.158131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9d8b921-8b65-4657-9551-21be0f29b242 req-fdf80d85-b3b0-432a-88e0-8297d1eb415f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:04.169375 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f9d8b921-8b65-4657-9551-21be0f29b242 req-fdf80d85-b3b0-432a-88e0-8297d1eb415f service nova] Creating event network-vif-plugged:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:39:04.174374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f9d8b921-8b65-4657-9551-21be0f29b242 req-fdf80d85-b3b0-432a-88e0-8297d1eb415f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Aug 03 05:39:04.175009 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3703/7398] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:04.300723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:04.302119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:04.309070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:04.312907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:04.312907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:04.312907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:04.440982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:04.449214 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-39f3729d-273b-43f9-8522-49565b6f3035 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1721 microversion: 2.1 time: 0.152484 Aug 03 05:39:04.449786 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3696/7399] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:04 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:05.472076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:05.472933 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:05.479835 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:05.480309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:05.481100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:05.481581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:05.698666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:05.707705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c96b3fe-c13f-43d3-8fe8-0cdd99387445 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1721 microversion: 2.1 time: 0.240599 Aug 03 05:39:05.708476 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3704/7400] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:05 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:06.358671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-84f85622-d783-40db-b5b2-9f740f92df26 req-6be8d3b2-12e6-44f0-9dff-11a78de48f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c315f592-f9bf-43c7-9091-87a78a088bfa", "name": "network-vif-deleted", "tag": "dc7b1537-0bf8-4733-b8d2-8b536b2da561"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:06.369763 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-84f85622-d783-40db-b5b2-9f740f92df26 req-6be8d3b2-12e6-44f0-9dff-11a78de48f4a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:06.370231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-84f85622-d783-40db-b5b2-9f740f92df26 req-6be8d3b2-12e6-44f0-9dff-11a78de48f4a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:06.384237 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-84f85622-d783-40db-b5b2-9f740f92df26 req-6be8d3b2-12e6-44f0-9dff-11a78de48f4a service nova] Creating event network-vif-deleted:dc7b1537-0bf8-4733-b8d2-8b536b2da561 for instance c315f592-f9bf-43c7-9091-87a78a088bfa on n-h2-826756-5 Aug 03 05:39:06.389652 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-84f85622-d783-40db-b5b2-9f740f92df26 req-6be8d3b2-12e6-44f0-9dff-11a78de48f4a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Aug 03 05:39:06.390781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3697/7401] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:06.729952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:06.730571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:06.737725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:06.738183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:06.738982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:06.739427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:06.808169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:06.810538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:06.818889 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0df5afcf-e681-4b09-a82a-a91f151eb9a0 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1368 microversion: 2.1 time: 0.092793 Aug 03 05:39:06.819478 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3705/7402] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:06 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:07.843966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:07.844659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:07.847462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:07.853695 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:07.854126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:07.854937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:07.855390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:07.920420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:07.929308 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d6cae8a8-7c13-43c7-bace-a8ae5dc73dc3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1368 microversion: 2.1 time: 0.089809 Aug 03 05:39:07.929892 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3698/7403] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:07 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:08.950995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:08.951605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:08.954505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:08.960429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:08.960888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:08.961660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:08.962117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:09.026687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:09.035166 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-519f0269-7058-432d-9ec9-858543f77085 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1368 microversion: 2.1 time: 0.088412 Aug 03 05:39:09.035746 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3706/7404] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:08 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:10.057836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:10.058569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:10.065955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:10.067134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:10.068040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:10.068513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:10.136182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:10.144678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d71dfe2d-eb86-4920-9516-a1c6bf8ecd52 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1368 microversion: 2.1 time: 0.090696 Aug 03 05:39:10.145258 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3699/7405] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:10 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:11.168014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:11.168661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:11.176909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:11.177362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:11.178473 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:11.178917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:11.212844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:11.213339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:11.213824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lazy-loading 'fault' on Instance uuid c315f592-f9bf-43c7-9091-87a78a088bfa {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:39:11.254873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e32a56f682734604a4a9853ad0fc3483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b455bd53ea54d6fa0fbf3cff5acffca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:11.262805 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-99a8a046-888d-426f-a58a-9a65377d7f33 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 200 len: 1373 microversion: 2.1 time: 0.100497 Aug 03 05:39:11.263409 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3707/7406] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:11 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 1373 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:12.284915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:12.286228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:12.293525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:12.294001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:12.294784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:12.295238 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:12.308784 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa HTTP/1.1 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c315f592-f9bf-43c7-9091-87a78a088bfa'} Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:12.310474 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7832ce8a-5e2c-47a1-a957-782e17798c35 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 404 len: 111 microversion: 2.1 time: 0.031064 Aug 03 05:39:12.315006 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3700/7407] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:12 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:12.372164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:12.374406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:12.381814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:12.382261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:12.383029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:12.383469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:12.396988 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-volume_attachments HTTP/1.1 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': 'c315f592-f9bf-43c7-9091-87a78a088bfa'} Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:12.398657 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7c88c4d3-1ab4-4869-a02d-d74c27ae4ed3 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031875 Aug 03 05:39:12.402490 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3708/7408] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:39:12 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:15.915382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:15.915916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:15.923035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:15.923511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:15.924342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:15.924790 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:15.939664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa HTTP/1.1 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'c315f592-f9bf-43c7-9091-87a78a088bfa'} Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:15.941729 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-54d08717-ff14-4ba4-8d88-f46ba03e5c9a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 404 len: 111 microversion: 2.1 time: 0.032273 Aug 03 05:39:15.948926 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3701/7409] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:15 2022] DELETE /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:15.955309 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:15.956057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: c315f592-f9bf-43c7-9091-87a78a088bfa] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:15.963861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:15.964344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:15.965158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:15.965631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:15.980557 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa HTTP/1.1 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'c315f592-f9bf-43c7-9091-87a78a088bfa'} Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:15.982117 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance c315f592-f9bf-43c7-9091-87a78a088bfa could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-649d31de-ea98-42e5-b63a-c0dca9c7714c tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa" status: 404 len: 111 microversion: 2.1 time: 0.032386 Aug 03 05:39:15.985604 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3709/7410] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:15 2022] GET /compute/v2.1/servers/c315f592-f9bf-43c7-9091-87a78a088bfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:15.992063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:15.992610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:15.999247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:15.999715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.000525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.000979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.014829 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 HTTP/1.1 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '00dd2bb5-65dd-4ed2-9007-cb5e5157b131'} Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.016469 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.021265 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d3f91fad-1878-42c3-a429-ca7752557d1a tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 404 len: 111 microversion: 2.1 time: 0.029654 Aug 03 05:39:16.022493 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3702/7411] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:15 2022] DELETE /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.028168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.028854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 00dd2bb5-65dd-4ed2-9007-cb5e5157b131] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:16.035797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.042866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.042866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.042866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.051857 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 HTTP/1.1 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '00dd2bb5-65dd-4ed2-9007-cb5e5157b131'} Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.053466 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 00dd2bb5-65dd-4ed2-9007-cb5e5157b131 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1ce7fb0-7bd3-42c0-b96e-6dee17e018df tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131" status: 404 len: 111 microversion: 2.1 time: 0.030928 Aug 03 05:39:16.057585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3710/7412] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:16 2022] GET /compute/v2.1/servers/00dd2bb5-65dd-4ed2-9007-cb5e5157b131 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.066521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.067027 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:16.073698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.074160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.074939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.075392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.092475 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 HTTP/1.1 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '13d638c6-53b0-43e3-ad67-4f5c9a64d632'} Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.094105 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae0e7c05-657e-4803-88d1-8e79388c62ec tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 404 len: 111 microversion: 2.1 time: 0.033021 Aug 03 05:39:16.101593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3703/7413] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:16 2022] DELETE /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.104909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.105531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 13d638c6-53b0-43e3-ad67-4f5c9a64d632] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:16.111606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.112061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.112878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.113327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.126864 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 HTTP/1.1 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '13d638c6-53b0-43e3-ad67-4f5c9a64d632'} Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.128423 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 13d638c6-53b0-43e3-ad67-4f5c9a64d632 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a294ca5c-a3c1-452c-974f-d96188cfb963 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632" status: 404 len: 111 microversion: 2.1 time: 0.029039 Aug 03 05:39:16.132362 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3711/7414] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:16 2022] GET /compute/v2.1/servers/13d638c6-53b0-43e3-ad67-4f5c9a64d632 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.138768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.139290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:16.146436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.146910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.147706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.148164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.162859 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 HTTP/1.1 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '9211de0b-2d76-4225-9ffc-cd07afa9c078'} Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.164734 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.169313 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b30f2fc1-5d2a-4cc3-a211-63be23d56f8f tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 03 05:39:16.170485 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3704/7415] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:16 2022] DELETE /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.175878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.176628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] [instance: 9211de0b-2d76-4225-9ffc-cd07afa9c078] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:16.182753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.183209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.183979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:16.184470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:16.201283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] HTTP exception thrown: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Request method failure captured: Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 HTTP/1.1 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gh7KBH2m7aVOFZQHeVRBYvIWjzEtuz-I_9sOKJH-0A2DbmMEXjpndizklSguu3lrm0sJHtD6HnqkCZpa1izzNFHJ-bRYMUDblSDIsVBmgzPwlrwAG7ylluvjPwwQO_s4pTAY3P5eK6fdF0CG27AtP7rRGhiaQ1GrWJzfOMSmh2_Yeo Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9b455bd53ea54d6fa0fbf3cff5acffca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9b455bd53ea54d6fa0fbf3cff5acffca Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServerActionsTestJSON-1365341235 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: e32a56f682734604a4a9853ad0fc3483 Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServerActionsTestJSON-1365341235-project Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '9211de0b-2d76-4225-9ffc-cd07afa9c078'} Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:16.202823 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Returning 404 to user: Instance 9211de0b-2d76-4225-9ffc-cd07afa9c078 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:16.207573 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7e17c8a9-2abb-4b0b-90d5-8958111e425d tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078" status: 404 len: 111 microversion: 2.1 time: 0.033152 Aug 03 05:39:16.208492 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3712/7416] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:16 2022] GET /compute/v2.1/servers/9211de0b-2d76-4225-9ffc-cd07afa9c078 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:16.213516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cc63ed1b-bca0-4967-ad20-629cdcf35f37 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] Calling method '.version_select at 0x7fdd473751f0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:16.325654 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cc63ed1b-bca0-4967-ad20-629cdcf35f37 tempest-ServerActionsTestJSON-1365341235 tempest-ServerActionsTestJSON-1365341235-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-556250000" status: 202 len: 0 microversion: 2.1 time: 0.115803 Aug 03 05:39:16.326247 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3705/7417] 10.222.0.72 () {58 vars in 1218 bytes} [Wed Aug 3 05:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-556250000 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:39:28.658481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=15 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:28.661318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=25 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:28.798633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1692663066", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8d37878e-a824-4956-8686-2851463411da"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:28.855137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] validate_networks() for [('8d37878e-a824-4956-8686-2851463411da', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:39:29.293656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:39:29.294092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:39:29.294577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:39:29.294994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:39:29.295411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:39:29.304948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:29.305404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:29.306242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:29.306685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:29.326482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Getting quotas for project de7ca67b02d9439a8f2ad4c5e0b0b7f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:39:29.331881 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Getting quotas for user 84338027af254212abd2578391d93492 and project de7ca67b02d9439a8f2ad4c5e0b0b7f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:39:29.345565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:39:29.347887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:39:29.452365 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-657f0ba9-69f6-4d7f-b94d-ab3668b00362 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799130 Aug 03 05:39:29.453313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3713/7418] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:39:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:39:29.464340 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f75ff5d2-e5c4-49f9-90e6-54086ecd62bb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:29.464980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f75ff5d2-e5c4-49f9-90e6-54086ecd62bb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:29.468107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=43 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:29.468822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:29.604202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f75ff5d2-e5c4-49f9-90e6-54086ecd62bb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:29.611301 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f75ff5d2-e5c4-49f9-90e6-54086ecd62bb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1217 microversion: 2.1 time: 0.150851 Aug 03 05:39:29.611974 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3706/7419] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:29 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:30.632909 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f0d15fc9-f285-419e-a133-30975c422ba8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:30.633614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f0d15fc9-f285-419e-a133-30975c422ba8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:30.690886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f0d15fc9-f285-419e-a133-30975c422ba8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:30.698900 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f0d15fc9-f285-419e-a133-30975c422ba8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1217 microversion: 2.1 time: 0.071187 Aug 03 05:39:30.703846 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3714/7420] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:30 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:31.721022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:31.721748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:31.729364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:31.729846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:31.730659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:31.731118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:31.797347 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:31.806254 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fada3873-f79e-4376-a9fd-344d9dd5d984 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1269 microversion: 2.1 time: 0.088475 Aug 03 05:39:31.806868 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3707/7421] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:31 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:32.828222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:32.828816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:32.836910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:32.839314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:32.839314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:32.839314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:33.076893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:33.089471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d3a175a-7016-4296-9e99-b654eba2825a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.261131 Aug 03 05:39:33.089471 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3715/7422] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:32 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:33.963539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-add87aba-3fe7-4d7c-a2a1-bab050aad4da req-6b309af3-e2c3-4df3-aae9-8d90cba9e470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a8cb18-bf82-41ac-a4ed-8a414e34b696", "tag": "4b7d1dd1-a8fd-4453-a7e4-709dc653b242"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:33.974593 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-add87aba-3fe7-4d7c-a2a1-bab050aad4da req-6b309af3-e2c3-4df3-aae9-8d90cba9e470 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:33.975720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-add87aba-3fe7-4d7c-a2a1-bab050aad4da req-6b309af3-e2c3-4df3-aae9-8d90cba9e470 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:33.988553 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-add87aba-3fe7-4d7c-a2a1-bab050aad4da req-6b309af3-e2c3-4df3-aae9-8d90cba9e470 service nova] Creating event network-changed:4b7d1dd1-a8fd-4453-a7e4-709dc653b242 for instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 on n-h1-826756-5 Aug 03 05:39:33.994661 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-add87aba-3fe7-4d7c-a2a1-bab050aad4da req-6b309af3-e2c3-4df3-aae9-8d90cba9e470 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035592 Aug 03 05:39:33.997943 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3708/7423] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:34.108070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:34.109320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:34.116640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:34.117167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:34.118008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:34.118539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:34.333067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:34.341855 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ce22bca-edb4-44f0-a45e-19b5d175f4d3 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.238499 Aug 03 05:39:34.342561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3716/7424] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:34 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:35.363641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:35.364298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:35.372360 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:35.372840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:35.373668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:35.374126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:35.502769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:35.512027 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b3ef1ae-5fd7-4406-975f-d9bd6621b21d tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.152645 Aug 03 05:39:35.512959 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3709/7425] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:35 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:36.533101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:36.533712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:36.542862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:36.543538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:36.544588 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:36.545028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:36.679020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:36.686698 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6eeffa5e-7eb6-49f2-a07b-c3da0f827172 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.157485 Aug 03 05:39:36.687279 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3717/7426] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:36 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:37.707502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:37.708135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:37.715819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:37.716309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:37.717159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:37.717614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:37.848413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:37.856579 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f7a6b062-28d9-41fe-8132-2db05129b7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.152968 Aug 03 05:39:37.857150 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3710/7427] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:37 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:39:38.877872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:38.878508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:38.885475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:38.885913 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:38.886678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:38.887112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:39.023775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:39.031463 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-94fe264e-3356-49c2-8466-e997f45290e1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.157417 Aug 03 05:39:39.032233 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3718/7428] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:38 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:40.053468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:40.054612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:40.058686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:40.062460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:40.062929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:40.063723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:40.064178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:40.194124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:40.202140 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-63a61e22-44d7-4999-a069-ba84f4b807f6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.152580 Aug 03 05:39:40.202709 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3711/7429] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:40 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:40.645319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-cf1dc3ac-7b7c-41a6-a10d-0729d91b6694 req-a4b1017a-fa28-4657-a623-b443b65a5ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a8cb18-bf82-41ac-a4ed-8a414e34b696", "name": "network-vif-plugged", "status": "completed", "tag": "4b7d1dd1-a8fd-4453-a7e4-709dc653b242"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:40.650880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:40.657092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cf1dc3ac-7b7c-41a6-a10d-0729d91b6694 req-a4b1017a-fa28-4657-a623-b443b65a5ea4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:40.657547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-cf1dc3ac-7b7c-41a6-a10d-0729d91b6694 req-a4b1017a-fa28-4657-a623-b443b65a5ea4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:40.669332 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-cf1dc3ac-7b7c-41a6-a10d-0729d91b6694 req-a4b1017a-fa28-4657-a623-b443b65a5ea4 service nova] Creating event network-vif-plugged:4b7d1dd1-a8fd-4453-a7e4-709dc653b242 for instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 on n-h1-826756-5 Aug 03 05:39:40.676205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-cf1dc3ac-7b7c-41a6-a10d-0729d91b6694 req-a4b1017a-fa28-4657-a623-b443b65a5ea4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Aug 03 05:39:40.676205 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3719/7430] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:41.223633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:41.224306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:41.230681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:41.231227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:41.231959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:41.232448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:41.370954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:41.378623 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3c77040-8756-4624-b7e2-432881a4efd7 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1317 microversion: 2.1 time: 0.159801 Aug 03 05:39:41.379399 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3712/7431] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:41 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:42.397545 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:42.403360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:42.404135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:42.410538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:42.410999 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:42.412541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:42.412541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:42.547033 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:42.554543 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7802ea51-35d4-4288-a6d3-ac5e172317fb tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.158096 Aug 03 05:39:42.555125 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3720/7432] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:42 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:39:42.613370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-162321942", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8d37878e-a824-4956-8686-2851463411da"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:42.668085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] validate_networks() for [('8d37878e-a824-4956-8686-2851463411da', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:39:43.034459 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:39:43.034932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:39:43.035433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:39:43.035863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:39:43.036318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:39:43.045817 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:43.046312 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:43.047140 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:43.047595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:43.064645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Getting quotas for project de7ca67b02d9439a8f2ad4c5e0b0b7f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:39:43.070020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Getting quotas for user 84338027af254212abd2578391d93492 and project de7ca67b02d9439a8f2ad4c5e0b0b7f6. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:39:43.083030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:39:43.085385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:39:43.199281 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2cff245-534c-4113-8e1e-fc70519584c5 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589634 Aug 03 05:39:43.199929 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3713/7433] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:39:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:39:43.210951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f626834b-1665-4d03-99ac-37a36290a802 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:43.211576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f626834b-1665-4d03-99ac-37a36290a802 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:43.270305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f626834b-1665-4d03-99ac-37a36290a802 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:43.277995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f626834b-1665-4d03-99ac-37a36290a802 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1216 microversion: 2.1 time: 0.070970 Aug 03 05:39:43.278737 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3721/7434] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:43 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:44.300009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:44.300665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:44.308437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:44.308913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:44.309743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:44.310196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:44.373117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:44.380648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-34c77d2f-bfb9-4083-9695-0a3cf9120486 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1220 microversion: 2.1 time: 0.085455 Aug 03 05:39:44.383900 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3714/7435] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:44 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:45.401650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:45.402422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:45.410051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:45.410512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:45.411278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:45.411718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:45.483358 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:45.491138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d7003f8e-b224-47e9-884f-61a09d321ce8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1286 microversion: 2.1 time: 0.093419 Aug 03 05:39:45.491741 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3722/7436] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:45 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:46.512728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:46.513331 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:46.520607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:46.521085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:46.521874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:46.522335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:46.756816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:46.765344 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a45b9ccf-57eb-4d9f-853f-f858453f0233 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.256635 Aug 03 05:39:46.765846 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3715/7437] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:46 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:46.907819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3bea4246-af64-4c9f-b6b2-274b87076537 req-5e74b36c-7db6-4f0c-b7ca-14048778d155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2933c08d-0961-4214-8d64-3e38bc00ba69", "tag": "f8d07e8c-f70f-45fd-a52c-7170736f43ea"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:46.920985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bea4246-af64-4c9f-b6b2-274b87076537 req-5e74b36c-7db6-4f0c-b7ca-14048778d155 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:46.924942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3bea4246-af64-4c9f-b6b2-274b87076537 req-5e74b36c-7db6-4f0c-b7ca-14048778d155 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:46.933416 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3bea4246-af64-4c9f-b6b2-274b87076537 req-5e74b36c-7db6-4f0c-b7ca-14048778d155 service nova] Creating event network-changed:f8d07e8c-f70f-45fd-a52c-7170736f43ea for instance 2933c08d-0961-4214-8d64-3e38bc00ba69 on n-h2-826756-5 Aug 03 05:39:46.938953 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3bea4246-af64-4c9f-b6b2-274b87076537 req-5e74b36c-7db6-4f0c-b7ca-14048778d155 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Aug 03 05:39:46.939588 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3723/7438] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:47.786983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:47.787616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:47.795054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:47.795521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:47.796308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:47.796762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:47.925756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:47.933553 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-72ff54c8-131a-46a2-9acb-a6943e9ff507 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.150244 Aug 03 05:39:47.934122 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3716/7439] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:47 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:48.955985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:48.956721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:48.963024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:48.963475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:48.964242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:48.965244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:49.097861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:49.106329 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ea1d98bc-5ee0-4a9d-8d8f-d34e0f1eeb5a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.155186 Aug 03 05:39:49.106946 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3724/7440] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:48 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:50.127184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:50.127832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:50.134869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:50.135377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:50.136188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:50.136784 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:50.268581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:50.276444 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-20547608-9949-46e5-95d6-110039eebc88 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.153077 Aug 03 05:39:50.277616 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3717/7441] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:50 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:51.298873 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:51.299491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:51.306504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:51.306960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:51.307725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:51.308205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:51.442581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:51.450895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5149f2b4-a459-4b67-9929-11f43f2cb580 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.156167 Aug 03 05:39:51.451473 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3725/7442] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:51 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:52.430687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-6d2f9be4-e594-4ada-9641-0792814b94e4 req-98e6782a-b4d0-4eb6-a79b-bba95cf58259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2933c08d-0961-4214-8d64-3e38bc00ba69", "name": "network-vif-plugged", "status": "completed", "tag": "f8d07e8c-f70f-45fd-a52c-7170736f43ea"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:52.443845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6d2f9be4-e594-4ada-9641-0792814b94e4 req-98e6782a-b4d0-4eb6-a79b-bba95cf58259 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:52.444409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-6d2f9be4-e594-4ada-9641-0792814b94e4 req-98e6782a-b4d0-4eb6-a79b-bba95cf58259 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:52.456933 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-6d2f9be4-e594-4ada-9641-0792814b94e4 req-98e6782a-b4d0-4eb6-a79b-bba95cf58259 service nova] Creating event network-vif-plugged:f8d07e8c-f70f-45fd-a52c-7170736f43ea for instance 2933c08d-0961-4214-8d64-3e38bc00ba69 on n-h2-826756-5 Aug 03 05:39:52.462113 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-6d2f9be4-e594-4ada-9641-0792814b94e4 req-98e6782a-b4d0-4eb6-a79b-bba95cf58259 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Aug 03 05:39:52.462916 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3718/7443] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:52.472154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:52.473000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:52.480444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:52.481818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:52.482878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:52.483399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:52.774891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:52.780345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aad0814b-dd26-4c52-9761-747827138b5e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.313046 Aug 03 05:39:52.780941 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3726/7444] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:52 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:53.802528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:53.803257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:53.805537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:53.815192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:53.815192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:53.815192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:53.815192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:53.815576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:53.955026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:53.962656 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fd47a275-45dd-4a32-9287-09ed6e563844 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1316 microversion: 2.1 time: 0.164711 Aug 03 05:39:53.966728 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3719/7445] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:53 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:54.984816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:54.985336 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:54.987301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:54.993454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:54.999866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:54.999866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:54.999866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:55.124192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:55.131939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bdffe131-fdef-48d2-bb00-b332cfae457f tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1506 microversion: 2.1 time: 0.151804 Aug 03 05:39:55.132538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3727/7446] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:54 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:55.152046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:55.152588 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:55.160299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:55.160787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:55.161595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:55.162049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:55.187808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:39:55.420464 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-200bc593-f3f8-4ea5-9e30-d75fc8f14357 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 204 len: 0 microversion: 2.1 time: 0.271987 Aug 03 05:39:55.421046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3720/7447] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:39:55 2022] DELETE /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:39:55.429136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:55.429793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:55.436546 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:55.437004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:55.437776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:55.438224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:55.575000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:55.582884 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56383391-7233-4065-be93-70f234aad879 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1512 microversion: 2.1 time: 0.157701 Aug 03 05:39:55.583477 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3728/7448] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:55 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:56.604742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:56.605466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:56.612511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:56.612983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:56.613762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:56.614216 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:56.743446 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:56.751621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eb0d4689-c952-4c94-a275-b1b5fcad5110 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1512 microversion: 2.1 time: 0.151288 Aug 03 05:39:56.752199 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3721/7449] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:56 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:57.288159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2debad61-b8c6-4393-823f-72de79ebd51f req-99c1ed92-7040-43ca-8e10-a5ae1a77678d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2933c08d-0961-4214-8d64-3e38bc00ba69", "name": "network-vif-deleted", "tag": "f8d07e8c-f70f-45fd-a52c-7170736f43ea"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:57.299978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2debad61-b8c6-4393-823f-72de79ebd51f req-99c1ed92-7040-43ca-8e10-a5ae1a77678d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:57.300551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2debad61-b8c6-4393-823f-72de79ebd51f req-99c1ed92-7040-43ca-8e10-a5ae1a77678d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:57.313535 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2debad61-b8c6-4393-823f-72de79ebd51f req-99c1ed92-7040-43ca-8e10-a5ae1a77678d service nova] Creating event network-vif-deleted:f8d07e8c-f70f-45fd-a52c-7170736f43ea for instance 2933c08d-0961-4214-8d64-3e38bc00ba69 on n-h2-826756-5 Aug 03 05:39:57.319570 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2debad61-b8c6-4393-823f-72de79ebd51f req-99c1ed92-7040-43ca-8e10-a5ae1a77678d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Aug 03 05:39:57.320551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3729/7450] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:39:57.773378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:57.774006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:57.782143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:57.782143 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:57.782927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:57.783375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:57.814122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:57.814584 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:57.815046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lazy-loading 'fault' on Instance uuid 2933c08d-0961-4214-8d64-3e38bc00ba69 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:39:57.856950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:57.864569 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a91587e7-1173-4bac-bc59-939aed600bd1 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 200 len: 1306 microversion: 2.1 time: 0.095136 Aug 03 05:39:57.865137 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3722/7451] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:57 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:58.887080 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:58.887791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:58.890429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:58.895454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:58.895907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:58.896703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:58.897143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:58.901122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=75 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:58.910424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 HTTP/1.1 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2933c08d-0961-4214-8d64-3e38bc00ba69'} Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:58.912090 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 404 to user: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1dfedfd7-a7a3-4ae5-936a-92975809d58a tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 404 len: 111 microversion: 2.1 time: 0.031700 Aug 03 05:39:58.916848 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3730/7452] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:58 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:58.923252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:58.923887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:58.931013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:58.936668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:58.936668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:58.936668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:58.951414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:59.065189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.072634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b9f9865-453e-4def-858b-e1a516bf1612 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.153666 Aug 03 05:39:59.073196 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3723/7453] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:58 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:39:59.094567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:59.096856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: df6aab2a-9723-4552-a114-7274fe21fc04] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.102924 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/df6aab2a-9723-4552-a114-7274fe21fc04/action HTTP/1.1 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 32 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: {"resize": {"flavorRef": "452"}} Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'df6aab2a-9723-4552-a114-7274fe21fc04', 'body': {'resize': {'flavorRef': '452'}}} Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:39:59.104506 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 404 to user: Instance df6aab2a-9723-4552-a114-7274fe21fc04 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-61b8ffea-dea3-4f86-b5b9-6ff3da32a004 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "POST /compute/v2.1/servers/df6aab2a-9723-4552-a114-7274fe21fc04/action" status: 404 len: 111 microversion: 2.1 time: 0.016371 Aug 03 05:39:59.110643 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3731/7454] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:39:59 2022] POST /compute/v2.1/servers/df6aab2a-9723-4552-a114-7274fe21fc04/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:39:59.116739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:59.117369 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.123362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.123934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.124769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.125220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.257375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.265610 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e7547c92-c087-448b-89af-e94db3c01b40 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.152418 Aug 03 05:39:59.266149 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3724/7455] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:59 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:59.286959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:59.287576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.295658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.296327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.297115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.297564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.477386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.485177 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6c59cce8-7cc9-4647-a49d-3fe6303e92ef tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.202181 Aug 03 05:39:59.485754 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3732/7456] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:59 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:59.507116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8137bce8-3f6e-47d6-88aa-aedcafadf1b2"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:59.509436 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.516398 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.516811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.517597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.518052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.561435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.567334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: request: POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action HTTP/1.1 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 65 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: {"resize": {"flavorRef": "8137bce8-3f6e-47d6-88aa-aedcafadf1b2"}} Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: exception: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '25a8cb18-bf82-41ac-a4ed-8a414e34b696', 'body': {'resize': {'flavorRef': '8137bce8-3f6e-47d6-88aa-aedcafadf1b2'}}} Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 05:39:59.569348 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 400 to user: Flavor 8137bce8-3f6e-47d6-88aa-aedcafadf1b2 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e065eb3e-51df-4273-86a0-52313a262616 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action" status: 400 len: 107 microversion: 2.1 time: 0.067648 Aug 03 05:39:59.573219 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3725/7457] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:39:59 2022] POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action => generated 107 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:39:59.580474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:59.581097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.587131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.587597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.588445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.588890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.720513 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.728011 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9cd23c4-7d8b-444c-80bf-21e27ca3a7c6 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.152364 Aug 03 05:39:59.728665 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3733/7458] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:59 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:59.750080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:59.750710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.752601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:39:59.757539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.758009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.758787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.759240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.893121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:39:59.901633 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3deec388-d4a4-4c63-9a4b-ae53811a2ad0 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.155558 Aug 03 05:39:59.902812 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3726/7459] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:59 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:39:59.925637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf07b93e-9bc8-4f4a-8e35-c7e38a9a1b42 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf07b93e-9bc8-4f4a-8e35-c7e38a9a1b42 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: request: POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action HTTP/1.1 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 29 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: {"resize": {"flavorRef": ""}} Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '25a8cb18-bf82-41ac-a4ed-8a414e34b696', 'body': {'resize': {'flavorRef': ''}}} Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise error Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi '' Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.929238 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf07b93e-9bc8-4f4a-8e35-c7e38a9a1b42 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf07b93e-9bc8-4f4a-8e35-c7e38a9a1b42 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action" status: 400 len: 113 microversion: 2.1 time: 0.009256 Aug 03 05:39:59.933313 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3734/7460] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:39:59 2022] POST /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 05:39:59.939858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:39:59.940520 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:39:59.947865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.948370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:39:59.949160 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:39:59.949615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.077887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:00.085625 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e0739bf-8754-4d2d-8a94-87e214e9d7cc tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1506 microversion: 2.1 time: 0.150521 Aug 03 05:40:00.086201 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3727/7461] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:39:59 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:00.110481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:00.110900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:00.119374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.119823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.120616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.121055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.134543 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 HTTP/1.1 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2933c08d-0961-4214-8d64-3e38bc00ba69'} Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:40:00.136079 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 404 to user: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d42d2771-18a2-4d30-aff9-4c5c80bdb410 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 404 len: 111 microversion: 2.1 time: 0.031774 Aug 03 05:40:00.139891 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3735/7462] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:40:00 2022] DELETE /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:40:00.146281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:00.146910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 2933c08d-0961-4214-8d64-3e38bc00ba69] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:00.153095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.153554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.154328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.154782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.168021 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 HTTP/1.1 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '2933c08d-0961-4214-8d64-3e38bc00ba69'} Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:00.169590 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 404 to user: Instance 2933c08d-0961-4214-8d64-3e38bc00ba69 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4a9a67c-a08e-4e0b-8e1d-8b2b6cc8700e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69" status: 404 len: 111 microversion: 2.1 time: 0.029190 Aug 03 05:40:00.174785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3728/7463] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:00 2022] GET /compute/v2.1/servers/2933c08d-0961-4214-8d64-3e38bc00ba69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 05:40:00.180928 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:00.181436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:00.187968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.188512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.189288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.189757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.214709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:40:00.563859 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3f5adfeb-ed1e-42e5-88b4-68d84088128c tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "DELETE /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 204 len: 0 microversion: 2.1 time: 0.386609 Aug 03 05:40:00.564509 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3736/7464] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:40:00 2022] DELETE /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:40:00.572903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:00.573553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:00.580491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.580966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.581831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:00.582292 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:00.730844 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:00.737949 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-81ea289a-d928-4129-a145-97f4c8927870 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1512 microversion: 2.1 time: 0.168961 Aug 03 05:40:00.738566 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3729/7465] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:00 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:01.759587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:01.760379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:01.767647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:01.774350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:01.774350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:01.774350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:01.903308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:01.911448 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-65be6d76-1ae2-49ea-9ed6-1f585f60a04e tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1512 microversion: 2.1 time: 0.156172 Aug 03 05:40:01.912021 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3737/7466] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:01 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:02.480712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-d450550c-f14f-4145-b88c-10034eb9d2be req-ed6aba9d-7046-4f06-9806-10a1fbc28fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a8cb18-bf82-41ac-a4ed-8a414e34b696", "name": "network-vif-deleted", "tag": "4b7d1dd1-a8fd-4453-a7e4-709dc653b242"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:40:02.492618 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d450550c-f14f-4145-b88c-10034eb9d2be req-ed6aba9d-7046-4f06-9806-10a1fbc28fb6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:02.493090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-d450550c-f14f-4145-b88c-10034eb9d2be req-ed6aba9d-7046-4f06-9806-10a1fbc28fb6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:02.510439 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-d450550c-f14f-4145-b88c-10034eb9d2be req-ed6aba9d-7046-4f06-9806-10a1fbc28fb6 service nova] Creating event network-vif-deleted:4b7d1dd1-a8fd-4453-a7e4-709dc653b242 for instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 on n-h1-826756-5 Aug 03 05:40:02.516066 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-d450550c-f14f-4145-b88c-10034eb9d2be req-ed6aba9d-7046-4f06-9806-10a1fbc28fb6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039169 Aug 03 05:40:02.516714 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3730/7467] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:40:02.934251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:02.935229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:02.942581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:02.943030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:02.943793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:02.944222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:02.976817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:02.977205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:02.977666 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lazy-loading 'fault' on Instance uuid 25a8cb18-bf82-41ac-a4ed-8a414e34b696 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:40:03.018342 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84338027af254212abd2578391d93492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de7ca67b02d9439a8f2ad4c5e0b0b7f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:03.026035 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-812e8c23-67db-4062-8fe7-6d793f2f7eb8 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 200 len: 1307 microversion: 2.1 time: 0.096376 Aug 03 05:40:03.026619 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3738/7468] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:02 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:40:04.048939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:04.049572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] [instance: 25a8cb18-bf82-41ac-a4ed-8a414e34b696] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:04.056931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:04.057396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:04.058174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:04.058627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:04.074605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] HTTP exception thrown: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Request method failure captured: Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 HTTP/1.1 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6goQJI2PMHIMXCdgDD9Wqh7WTtZPDai7rob5NfIdRTQRkUpmNdH5ZzAJb-mD24C0akFdg_H4Kwb-uesQOsE8-7ulByuXHv_Z2MGzUG5iZh-RgSi0-jz5Tc9tAJlGH1UoCtpPUqCxn80SedOVrif4Jo_I3J6pxoyz2f_zfsozsg1q1QU Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/de7ca67b02d9439a8f2ad4c5e0b0b7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: de7ca67b02d9439a8f2ad4c5e0b0b7f6 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-ServersNegativeTestJSON-873989247 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 84338027af254212abd2578391d93492 Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-ServersNegativeTestJSON-873989247-project Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '25a8cb18-bf82-41ac-a4ed-8a414e34b696'} Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:40:04.076254 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] Returning 404 to user: Instance 25a8cb18-bf82-41ac-a4ed-8a414e34b696 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-92d98339-a936-43d7-87d4-c83fbc202213 tempest-ServersNegativeTestJSON-873989247 tempest-ServersNegativeTestJSON-873989247-project] 10.222.0.72 "GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696" status: 404 len: 111 microversion: 2.1 time: 0.033936 Aug 03 05:40:04.080201 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3731/7469] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:04 2022] GET /compute/v2.1/servers/25a8cb18-bf82-41ac-a4ed-8a414e34b696 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:40:49.416452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:40:49.417221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:40:49.636048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: .version_select at 0x7fdd54741a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1252695010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJbvse9nwE5UqpR06cvr3M9TMG7jhBmRVkqtojaMjrUSgKtMKRhEEVgUFDm0HRzzjMpUm+3cdcYVGo46nE7zdfzT8CxaHuTjrl/r5vJB2NZO1GcPTT4472jZv82gB+aAA=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:40:49.653694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:40:49.659629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:40:49.675387 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 05:40:50.683642 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [531dac11-d6f5-477c-bc3f-e7ea1ade744b] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 42232. Aug 03 05:40:50.818338 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-608d3523-9e09-42b9-8a46-fcba35d98f74 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.407668 Aug 03 05:40:50.819014 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3739/7470] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:40:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:40:50.871814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1135131194", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1252695010", "networks": [{"uuid": "50e591b9-8da9-4e57-99b8-0b0d826b9962"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:40:50.883187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=11 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:40:50.883957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=36 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:40:50.937942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] validate_networks() for [('50e591b9-8da9-4e57-99b8-0b0d826b9962', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:40:51.683229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:40:51.683666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:40:51.684151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:40:51.684613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:40:51.685040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:40:51.704857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:51.705327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:51.706146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:51.706602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:51.725089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:40:51.730559 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:40:51.744159 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:40:51.746442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:40:51.843648 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49fd2df0-fa02-471e-8f79-9b77cb1b1d24 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975722 Aug 03 05:40:51.850872 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3732/7471] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:40:51.857006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-84038621-1470-490b-9258-4d95488f02c7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:51.857715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-84038621-1470-490b-9258-4d95488f02c7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:51.916520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-84038621-1470-490b-9258-4d95488f02c7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:51.923500 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-84038621-1470-490b-9258-4d95488f02c7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1263 microversion: 2.1 time: 0.071010 Aug 03 05:40:51.924091 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3740/7472] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:51 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1263 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:52.946247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:52.950657 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:52.958191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:52.958672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:52.959494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:52.959962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:53.032417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:53.042578 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-11c4ea23-63fd-4760-be0b-bfbe6c018103 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1267 microversion: 2.1 time: 0.101831 Aug 03 05:40:53.043701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3733/7473] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:52 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:54.064885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:54.065622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:54.072968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:54.073433 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:54.074223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:54.074672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:54.141310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:54.149069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ae555547-652f-487c-81b5-2490a97dad50 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1323 microversion: 2.1 time: 0.088760 Aug 03 05:40:54.149685 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3741/7474] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:54 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1323 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:40:55.171278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:55.171890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:55.179183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:55.179647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:55.180457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:55.180911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:55.387724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:55.393588 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8c29d800-1171-4d0e-b2b6-7d20b1fb9d91 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.226165 Aug 03 05:40:55.394184 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3734/7475] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:55 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:55.823836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-65df0555-4c46-4dc5-a89b-ea61d20a1663 req-01a5b9c9-dbb3-46b5-8232-afff78f5db98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e691ac-100d-49fb-965b-84eee85a1ac5", "tag": "666fb452-5a12-4c1c-80c4-aa724023ee66"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:40:55.834536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-65df0555-4c46-4dc5-a89b-ea61d20a1663 req-01a5b9c9-dbb3-46b5-8232-afff78f5db98 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:55.835153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-65df0555-4c46-4dc5-a89b-ea61d20a1663 req-01a5b9c9-dbb3-46b5-8232-afff78f5db98 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:55.847543 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-65df0555-4c46-4dc5-a89b-ea61d20a1663 req-01a5b9c9-dbb3-46b5-8232-afff78f5db98 service nova] Creating event network-changed:666fb452-5a12-4c1c-80c4-aa724023ee66 for instance 51e691ac-100d-49fb-965b-84eee85a1ac5 on n-h1-826756-5 Aug 03 05:40:55.852716 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-65df0555-4c46-4dc5-a89b-ea61d20a1663 req-01a5b9c9-dbb3-46b5-8232-afff78f5db98 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 Aug 03 05:40:55.853426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3742/7476] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:40:56.415476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:56.418865 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:56.423367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:56.423835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:56.424843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:56.425106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:56.614659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:56.622424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b777b25-cbce-4acb-a72d-45de120c7a60 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.211314 Aug 03 05:40:56.622996 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3735/7477] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:56 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:57.645290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:57.645931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:57.652606 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:57.653148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:57.653924 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:57.654366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:57.788050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:57.795773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-300942d6-6a91-48f6-a03c-aba15de2ea6d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.156312 Aug 03 05:40:57.796369 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3743/7478] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:57 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:58.816524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:58.817157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:58.823975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:58.824473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:58.825252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:58.825702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:40:58.962554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:40:58.970677 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e2d926f2-4d9d-4a06-9951-8815fc889f99 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.158377 Aug 03 05:40:58.971252 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3736/7479] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:58 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:40:59.991202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:40:59.991823 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:40:59.998906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:40:59.999359 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:00.000238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:00.000639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:00.130343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:00.137838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81aa0c15-0df0-40e1-be10-bbbf0ffbb88f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.150598 Aug 03 05:41:00.138415 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3744/7480] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:40:59 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:00.950155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a29f76b1-16c1-4a62-afbf-ddc6578daf1b req-8dba9025-bdb8-470e-aa69-79946e4ee1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e691ac-100d-49fb-965b-84eee85a1ac5", "name": "network-vif-plugged", "status": "completed", "tag": "666fb452-5a12-4c1c-80c4-aa724023ee66"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:00.960982 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a29f76b1-16c1-4a62-afbf-ddc6578daf1b req-8dba9025-bdb8-470e-aa69-79946e4ee1b4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:00.961547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a29f76b1-16c1-4a62-afbf-ddc6578daf1b req-8dba9025-bdb8-470e-aa69-79946e4ee1b4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:00.973353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a29f76b1-16c1-4a62-afbf-ddc6578daf1b req-8dba9025-bdb8-470e-aa69-79946e4ee1b4 service nova] Creating event network-vif-plugged:666fb452-5a12-4c1c-80c4-aa724023ee66 for instance 51e691ac-100d-49fb-965b-84eee85a1ac5 on n-h1-826756-5 Aug 03 05:41:00.978513 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a29f76b1-16c1-4a62-afbf-ddc6578daf1b req-8dba9025-bdb8-470e-aa69-79946e4ee1b4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094177 Aug 03 05:41:00.979398 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3737/7481] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:01.159147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:01.159767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:01.167113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:01.167569 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:01.168391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:01.168839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:01.308427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:01.316415 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d08c1820-605a-4755-88a0-b5d4a4c5ce61 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1363 microversion: 2.1 time: 0.161325 Aug 03 05:41:01.316994 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3745/7482] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:01 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:02.335521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:02.336583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:02.341680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:02.342490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:02.353764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:02.354257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:02.355075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:02.356806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:02.513629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:02.526398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e9c51b87-2c6c-4275-896b-69720ebe3159 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1556 microversion: 2.1 time: 0.191781 Aug 03 05:41:02.526994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3738/7483] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:02 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:02.547113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:02.547734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:02.549770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:02.555673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:02.556136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:02.556975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:02.557418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:02.710360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:02.721409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bf3d360b-c587-4627-b3b6-b8da62b3b5b5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1556 microversion: 2.1 time: 0.177863 Aug 03 05:41:02.729082 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3746/7484] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:02 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:05.895666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ea7108f-c9f1-4f40-b82d-855128e9dd1d"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:05.898235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:05.906549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:05.907121 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:05.907902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:05.908409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:06.759190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7447acf6-a0bf-46a4-9451-b4500a1614d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867452 Aug 03 05:41:06.759811 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3739/7485] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:41:05 2022] POST /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:18.541095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:18.541625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:18.544483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:18.547527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=32 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:18.551028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:18.551516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:18.552320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:18.552771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:18.636094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lazy-loading 'services' on Instance uuid 51e691ac-100d-49fb-965b-84eee85a1ac5 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:41:18.866714 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4d72af96-430d-43e8-afdc-9ce063e4c990 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments/9ea7108f-c9f1-4f40-b82d-855128e9dd1d" status: 202 len: 0 microversion: 2.1 time: 0.329702 Aug 03 05:41:18.867319 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3747/7486] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:41:18 2022] DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments/9ea7108f-c9f1-4f40-b82d-855128e9dd1d => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:41:18.874181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:18.875152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:18.879705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:18.882030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:18.889053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:18.893144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:18.893144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:18.893144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:18.920848 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50113607-e10a-4ad1-85d4-0934995ce55f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048517 Aug 03 05:41:18.921383 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3740/7487] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:18 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:19.935470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:19.938642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:19.945397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:19.945856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:19.946641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:19.947089 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:19.978112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34c605c0-ab9e-4074-acae-26971ff75351 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048304 Aug 03 05:41:19.978617 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3748/7488] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:19 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:20.992037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:20.994947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:21.004233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:21.004741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:21.005550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:21.006018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:21.039028 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ddb36b7-71a2-4217-8b78-ffdb6d9a8339 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051491 Aug 03 05:41:21.039624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3741/7489] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:20 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:22.051744 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:22.054172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:22.060360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:22.060817 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:22.062191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:22.062958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:22.094161 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b7b556a0-51ef-4d8c-b0a2-9c6ec0c78613 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Aug 03 05:41:22.094749 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3749/7490] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:22 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:23.108229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:23.111288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:23.118805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:23.119277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:23.120071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:23.120561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:23.150380 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3c350b21-d556-4793-94f1-4505ceaca0e5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Aug 03 05:41:23.150953 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3742/7491] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:23 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:24.162884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:24.165372 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:24.172551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:24.173007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:24.173773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:24.174215 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:24.204410 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d6b06bf-05b3-4337-9a90-b8647b1fc6c1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045535 Aug 03 05:41:24.204984 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3750/7492] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:24 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:41:24.215620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:24.216135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:24.224083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:24.224572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:24.225428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:24.226085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:24.303158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 is not attached to volume 9ea7108f-c9f1-4f40-b82d-855128e9dd1d Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments/9ea7108f-c9f1-4f40-b82d-855128e9dd1d HTTP/1.1 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 is not attached to volume 9ea7108f-c9f1-4f40-b82d-855128e9dd1d Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': '51e691ac-100d-49fb-965b-84eee85a1ac5', 'id': '9ea7108f-c9f1-4f40-b82d-855128e9dd1d'} Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ea7108f-c9f1-4f40-b82d-855128e9dd1d. Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 is not attached to volume 9ea7108f-c9f1-4f40-b82d-855128e9dd1d Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:41:24.318902 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 is not attached to volume 9ea7108f-c9f1-4f40-b82d-855128e9dd1d Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 is not attached to volume 9ea7108f-c9f1-4f40-b82d-855128e9dd1d {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1fb83dd5-3053-4f31-b9f6-a844f03828f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments/9ea7108f-c9f1-4f40-b82d-855128e9dd1d" status: 404 len: 154 microversion: 2.1 time: 0.108917 Aug 03 05:41:24.323329 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3743/7493] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:41:24 2022] DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5/os-volume_attachments/9ea7108f-c9f1-4f40-b82d-855128e9dd1d => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:41:27.945551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:27.951945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:27.953851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:27.954254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:27.955031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:27.955487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:27.980750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:41:28.343058 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-04925962-9926-45cf-8f1b-cf4ad9d3f0ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 204 len: 0 microversion: 2.1 time: 0.400864 Aug 03 05:41:28.343585 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3751/7494] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:41:27 2022] DELETE /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:41:28.352126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:28.355469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:28.362463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:28.363154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:28.363975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:28.364475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:28.503086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:28.517080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a114f28-16c5-4cca-bc13-5f1ebff4a2b7 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1562 microversion: 2.1 time: 0.168899 Aug 03 05:41:28.517871 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3744/7495] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:28 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:29.539029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:29.539759 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:29.546845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:29.547292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:29.548053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:29.548514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:29.682979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:29.691981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1053dd6c-9857-4e61-b42a-2e8eeafada29 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1562 microversion: 2.1 time: 0.157507 Aug 03 05:41:29.694090 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3752/7496] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:29 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:30.397075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-efffac37-f46e-47d3-8728-1142c90d39df req-0540d7ac-617b-4b31-a573-048f82de0dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e691ac-100d-49fb-965b-84eee85a1ac5", "name": "network-vif-deleted", "tag": "666fb452-5a12-4c1c-80c4-aa724023ee66"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:30.407976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-efffac37-f46e-47d3-8728-1142c90d39df req-0540d7ac-617b-4b31-a573-048f82de0dd8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:30.408476 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-efffac37-f46e-47d3-8728-1142c90d39df req-0540d7ac-617b-4b31-a573-048f82de0dd8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:30.419803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-efffac37-f46e-47d3-8728-1142c90d39df req-0540d7ac-617b-4b31-a573-048f82de0dd8 service nova] Creating event network-vif-deleted:666fb452-5a12-4c1c-80c4-aa724023ee66 for instance 51e691ac-100d-49fb-965b-84eee85a1ac5 on n-h1-826756-5 Aug 03 05:41:30.424902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-efffac37-f46e-47d3-8728-1142c90d39df req-0540d7ac-617b-4b31-a573-048f82de0dd8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Aug 03 05:41:30.425490 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3745/7497] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:30.714159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:30.714778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:30.721957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:30.722624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:30.723371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:30.723814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:30.760009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:30.772627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:30.772627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lazy-loading 'fault' on Instance uuid 51e691ac-100d-49fb-965b-84eee85a1ac5 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:41:30.804981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:30.813721 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0cf4b4a2-df0a-4bce-ac8b-586208a9e97f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 200 len: 1353 microversion: 2.1 time: 0.103434 Aug 03 05:41:30.814326 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3753/7498] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:30 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:31.839329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:31.840039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 51e691ac-100d-49fb-965b-84eee85a1ac5] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:31.847167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:31.847638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:31.848488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:31.848943 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:31.862851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 HTTP/1.1 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '51e691ac-100d-49fb-965b-84eee85a1ac5'} Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:31.864528 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 51e691ac-100d-49fb-965b-84eee85a1ac5 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04e0d644-f1ce-4bad-b5f8-21439041ff69 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5" status: 404 len: 111 microversion: 2.1 time: 0.031881 Aug 03 05:41:31.869188 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3746/7499] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:31 2022] GET /compute/v2.1/servers/51e691ac-100d-49fb-965b-84eee85a1ac5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:41:31.874645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-63bca2cc-7497-44e9-a11e-d1bb0f645af4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '.version_select at 0x7fdd5496b310>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:31.960995 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-63bca2cc-7497-44e9-a11e-d1bb0f645af4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1252695010" status: 202 len: 0 microversion: 2.1 time: 0.090072 Aug 03 05:41:31.961506 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3754/7500] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 05:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1252695010 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:41:31.979857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b234518-53e8-4ba8-b534-eb50f1cd36a2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: .version_select at 0x7fdd47e88a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1186454178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNod80LLG5EAbAlPNDi758KJQhyBdPGfnLQ1GOpvKjRvRTRxABcamhX+dPwnxnAWSFmk02lISAtjLMdu+jbSqt2m64zQgnNFiRI8QlaWSTXN+VnntUden6Oe2eUsNwVtXg=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:31.999595 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6b234518-53e8-4ba8-b534-eb50f1cd36a2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:41:32.004979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-6b234518-53e8-4ba8-b534-eb50f1cd36a2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:41:32.092371 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b234518-53e8-4ba8-b534-eb50f1cd36a2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.116544 Aug 03 05:41:32.093689 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3747/7501] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:41:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:32.146681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-391439776", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1186454178", "networks": [{"uuid": "50e591b9-8da9-4e57-99b8-0b0d826b9962"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:32.199576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] validate_networks() for [('50e591b9-8da9-4e57-99b8-0b0d826b9962', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:41:32.569452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:41:32.573949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:41:32.573949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:41:32.573949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:41:32.573949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:41:32.581250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:32.581707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:32.582514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:32.582961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:32.600134 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:41:32.605653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:41:32.619431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:41:32.622180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:41:32.793207 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4a7918f-0f91-43c7-b5cb-989e2f54a0fb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650343 Aug 03 05:41:32.793896 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3755/7502] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:41:32.806118 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f605cdab-c96f-4a0e-8be2-95b8acee25bb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:32.807048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f605cdab-c96f-4a0e-8be2-95b8acee25bb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:32.867767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f605cdab-c96f-4a0e-8be2-95b8acee25bb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:32.875407 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f605cdab-c96f-4a0e-8be2-95b8acee25bb tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1262 microversion: 2.1 time: 0.073489 Aug 03 05:41:32.875993 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3748/7503] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:32 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1262 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:41:33.896053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:33.896705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:33.903796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:33.904255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:33.905130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:33.905583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:33.969842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:33.979592 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a6c5fbae-7a8e-4941-8e5e-e6591472dfe8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1266 microversion: 2.1 time: 0.087445 Aug 03 05:41:33.980433 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3756/7504] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:33 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:35.000978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:35.004102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:35.009299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:35.009780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:35.010583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:35.011043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:35.080962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:35.088921 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d75d7a23-ae32-4208-a34a-70e0d1f95b7c tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1322 microversion: 2.1 time: 0.092305 Aug 03 05:41:35.103039 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3749/7505] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:34 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:36.109944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:36.110679 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:36.117663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:36.118125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:36.118900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:36.119341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:36.334118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:36.341981 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7a10a153-8824-4a10-8ead-d78cbff316d4 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.235871 Aug 03 05:41:36.342661 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3757/7506] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:36 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:36.550128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4d7dc26a-b137-47a0-b6e6-c83b717b1d96 req-e72f1a17-bb88-4ed7-b8e5-eb475b5fc632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652c714b-aaca-4f09-880f-8c8e4599cc88", "tag": "80ea4e41-6aab-4137-910a-d54eafe5f596"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:36.560841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d7dc26a-b137-47a0-b6e6-c83b717b1d96 req-e72f1a17-bb88-4ed7-b8e5-eb475b5fc632 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:36.562037 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4d7dc26a-b137-47a0-b6e6-c83b717b1d96 req-e72f1a17-bb88-4ed7-b8e5-eb475b5fc632 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:36.573653 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4d7dc26a-b137-47a0-b6e6-c83b717b1d96 req-e72f1a17-bb88-4ed7-b8e5-eb475b5fc632 service nova] Creating event network-changed:80ea4e41-6aab-4137-910a-d54eafe5f596 for instance 652c714b-aaca-4f09-880f-8c8e4599cc88 on n-h1-826756-5 Aug 03 05:41:36.578969 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4d7dc26a-b137-47a0-b6e6-c83b717b1d96 req-e72f1a17-bb88-4ed7-b8e5-eb475b5fc632 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035407 Aug 03 05:41:36.579576 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3750/7507] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:37.363598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:37.364211 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:37.371117 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:37.371570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:37.372356 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:37.372821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:37.507034 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:37.515802 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8ac279aa-d55a-4ff0-91a5-11af871ad781 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.156015 Aug 03 05:41:37.516435 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3758/7508] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:37 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:38.538620 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:38.539373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:38.545781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:38.546254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:38.547713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:38.548165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:38.682768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:38.690446 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c6fe6b4-f600-41d0-be4b-6a22730e465a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.157257 Aug 03 05:41:38.695746 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3751/7509] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:38 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:39.711057 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:39.711684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:39.718936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:39.719396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:39.720169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:39.720639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:39.848539 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:39.856138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3d865e45-b0bc-494b-8bc4-21d5eb8bdff2 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.149022 Aug 03 05:41:39.856741 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3759/7510] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:39 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:41:40.879424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:40.880069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:40.887080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:40.887612 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:40.888443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:40.888903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:41.025194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:41.033263 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ec75f02-6c32-43d3-9fe4-77444ea7572a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.158656 Aug 03 05:41:41.033844 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3752/7511] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:40 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:41.058319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-52171a6c-5525-4869-bc81-00d8ce6da904 req-a363f542-24a5-4da5-a3e9-78bc2dd7e75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652c714b-aaca-4f09-880f-8c8e4599cc88", "name": "network-vif-plugged", "status": "completed", "tag": "80ea4e41-6aab-4137-910a-d54eafe5f596"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:41.069531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-52171a6c-5525-4869-bc81-00d8ce6da904 req-a363f542-24a5-4da5-a3e9-78bc2dd7e75f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:41.069973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-52171a6c-5525-4869-bc81-00d8ce6da904 req-a363f542-24a5-4da5-a3e9-78bc2dd7e75f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:41.081264 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-52171a6c-5525-4869-bc81-00d8ce6da904 req-a363f542-24a5-4da5-a3e9-78bc2dd7e75f service nova] Creating event network-vif-plugged:80ea4e41-6aab-4137-910a-d54eafe5f596 for instance 652c714b-aaca-4f09-880f-8c8e4599cc88 on n-h1-826756-5 Aug 03 05:41:41.088091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-52171a6c-5525-4869-bc81-00d8ce6da904 req-a363f542-24a5-4da5-a3e9-78bc2dd7e75f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031975 Aug 03 05:41:41.088091 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3760/7512] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:41:42.055113 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:42.055673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:42.063127 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:42.063601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:42.064409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:42.064867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:42.195514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:42.200229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed8af705-638c-4faf-9fbd-e80f06e299d3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1362 microversion: 2.1 time: 0.149118 Aug 03 05:41:42.200822 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3753/7513] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:42 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:43.221142 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:43.221831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:43.225885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:43.226583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:43.232758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:43.233210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:43.233967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:43.234406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:43.368590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:43.376840 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d807dc3-9b2a-488a-bddc-79db850fc80f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1555 microversion: 2.1 time: 0.157977 Aug 03 05:41:43.377443 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3761/7514] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:43 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:43.397910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:43.398541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:43.400720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:43.411195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:43.411668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:43.412502 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:43.412957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:43.542852 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:41:43.550505 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4754ac12-84e1-4232-92b0-b170d161ea9a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1555 microversion: 2.1 time: 0.156491 Aug 03 05:41:43.551080 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3754/7515] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:41:43 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:41:46.724713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf9cfb34-5b91-4a9c-9828-6c1f32e2679b"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:41:46.727120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:46.734002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:46.734465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:46.735206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:46.735640 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:47.057032 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:47.740016 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9cebdd4f-ec9d-4d6a-9c8e-21c3800e4ef3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.019786 Aug 03 05:41:47.740689 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3762/7516] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:41:46 2022] POST /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:41:59.496457 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:59.496976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:59.499144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:59.499860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=66 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:59.505435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:59.505987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:59.506672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:59.507128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:59.589950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lazy-loading 'services' on Instance uuid 652c714b-aaca-4f09-880f-8c8e4599cc88 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:41:59.849184 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdefe2b5-6a81-479b-bf33-9ac2b4884d07 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments/cf9cfb34-5b91-4a9c-9828-6c1f32e2679b" status: 202 len: 0 microversion: 2.1 time: 0.356611 Aug 03 05:41:59.849838 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3755/7517] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:41:59 2022] DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments/cf9cfb34-5b91-4a9c-9828-6c1f32e2679b => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:41:59.856657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:59.857590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:41:59.862659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:41:59.865347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:41:59.872500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:59.872964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:59.873743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:41:59.874186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:41:59.903487 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d25c0e6a-2d7b-4987-830e-44d1d069bec6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048885 Aug 03 05:41:59.904063 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3763/7518] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:41:59 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:42:00.916993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:00.919417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:00.925931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:00.927076 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:00.927979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:00.928471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:00.959174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1a9eb04-d8b4-4d37-9162-744f8654b039 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047734 Aug 03 05:42:00.959772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3756/7519] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:00 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:01.971967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:01.974252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:01.981989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:01.982443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:01.983213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:01.983677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:02.019269 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0bfe2e47-603a-42a6-9bed-07cea418b667 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052023 Aug 03 05:42:02.020567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3764/7520] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:01 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:03.032526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:03.034728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:03.051825 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:03.055089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:03.055089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:03.055089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:03.086779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-31aabd46-1cb9-433e-804d-7401d14fab56 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058321 Aug 03 05:42:03.087356 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3757/7521] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:03 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:04.099610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:04.101862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:04.109866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:04.110329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:04.111116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:04.111562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:04.145695 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-401f3f0d-0ab1-4019-8920-654276f5be17 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050582 Aug 03 05:42:04.146305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3765/7522] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:04 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:05.158231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:05.160475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:05.168412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:05.168888 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:05.169702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:05.170203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:05.199351 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e95a8f9f-55fe-4d67-86c6-2576bdf31995 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045199 Aug 03 05:42:05.199914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3758/7523] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:05 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:42:05.211047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:05.211549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:05.218618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:05.219074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:05.219846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:05.220311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:05.299009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 is not attached to volume cf9cfb34-5b91-4a9c-9828-6c1f32e2679b Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments/cf9cfb34-5b91-4a9c-9828-6c1f32e2679b HTTP/1.1 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 is not attached to volume cf9cfb34-5b91-4a9c-9828-6c1f32e2679b Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '652c714b-aaca-4f09-880f-8c8e4599cc88', 'id': 'cf9cfb34-5b91-4a9c-9828-6c1f32e2679b'} Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cf9cfb34-5b91-4a9c-9828-6c1f32e2679b. Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 is not attached to volume cf9cfb34-5b91-4a9c-9828-6c1f32e2679b Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:05.301035 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 is not attached to volume cf9cfb34-5b91-4a9c-9828-6c1f32e2679b Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 is not attached to volume cf9cfb34-5b91-4a9c-9828-6c1f32e2679b {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e6b53d2-8ca7-4634-9ae1-a4225bfd8c73 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments/cf9cfb34-5b91-4a9c-9828-6c1f32e2679b" status: 404 len: 154 microversion: 2.1 time: 0.096008 Aug 03 05:42:05.304777 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3766/7524] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:42:05 2022] DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88/os-volume_attachments/cf9cfb34-5b91-4a9c-9828-6c1f32e2679b => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:42:08.829085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:08.829590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:08.837629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:08.838102 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:08.838955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:08.839409 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:08.865455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:42:09.175736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8570a2f0-241a-48ce-91ec-d8b986a87cf8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 204 len: 0 microversion: 2.1 time: 0.350403 Aug 03 05:42:09.176375 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3759/7525] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:42:08 2022] DELETE /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 05:42:09.184769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:09.194257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:09.194257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:09.194257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:09.194636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:09.195119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:09.344995 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:09.352743 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1696b9cf-1674-4d1f-b5bb-d17793bd0668 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1561 microversion: 2.1 time: 0.171931 Aug 03 05:42:09.353321 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3767/7526] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:09 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:10.375539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:10.376290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:10.384225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:10.384930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:10.385726 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:10.386189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:10.518065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:10.526076 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cf9a2ea2-3a80-44d0-af9e-f19bd5867405 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1561 microversion: 2.1 time: 0.154852 Aug 03 05:42:10.526664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3760/7527] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:10 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:11.428094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-81e7786d-b524-47c5-99d6-ed17e788f403 req-96559a0e-ad18-483b-a3f9-0dc82b0bfc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652c714b-aaca-4f09-880f-8c8e4599cc88", "name": "network-vif-deleted", "tag": "80ea4e41-6aab-4137-910a-d54eafe5f596"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:11.437895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-81e7786d-b524-47c5-99d6-ed17e788f403 req-96559a0e-ad18-483b-a3f9-0dc82b0bfc0a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:11.438344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-81e7786d-b524-47c5-99d6-ed17e788f403 req-96559a0e-ad18-483b-a3f9-0dc82b0bfc0a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:11.450200 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-81e7786d-b524-47c5-99d6-ed17e788f403 req-96559a0e-ad18-483b-a3f9-0dc82b0bfc0a service nova] Creating event network-vif-deleted:80ea4e41-6aab-4137-910a-d54eafe5f596 for instance 652c714b-aaca-4f09-880f-8c8e4599cc88 on n-h1-826756-5 Aug 03 05:42:11.455645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-81e7786d-b524-47c5-99d6-ed17e788f403 req-96559a0e-ad18-483b-a3f9-0dc82b0bfc0a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089250 Aug 03 05:42:11.456302 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3768/7528] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:11.547667 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:11.548325 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:11.556133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:11.556583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:11.557374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:11.557833 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:11.623527 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:11.631476 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57e9e595-ffb4-4b83-b6a2-e073c4becaed tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 200 len: 1347 microversion: 2.1 time: 0.087731 Aug 03 05:42:11.632062 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3761/7529] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:11 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 1347 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:12.655378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:12.656079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 652c714b-aaca-4f09-880f-8c8e4599cc88] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:12.663486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:12.663934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:12.665401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:12.665848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:12.679292 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 HTTP/1.1 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '652c714b-aaca-4f09-880f-8c8e4599cc88'} Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:12.681183 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 652c714b-aaca-4f09-880f-8c8e4599cc88 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9160e6d9-1060-417d-b12f-135b61904db3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88" status: 404 len: 111 microversion: 2.1 time: 0.032329 Aug 03 05:42:12.685639 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3769/7530] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:12 2022] GET /compute/v2.1/servers/652c714b-aaca-4f09-880f-8c8e4599cc88 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:42:12.691200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-035c0b4c-6e75-4610-b450-c17a85b35580 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '.version_select at 0x7fdd47e88160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:12.760692 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-035c0b4c-6e75-4610-b450-c17a85b35580 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1186454178" status: 202 len: 0 microversion: 2.1 time: 0.072864 Aug 03 05:42:12.762792 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3762/7531] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 05:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1186454178 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:42:12.781344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5b508588-aff4-42c3-9a09-f3a810de80c0 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: .version_select at 0x7fdd54791700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-102792389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPepdJ/KccRHiPzGDu3awmpKucVBtfA626Akj6T8AVNsZJPkHKUwsoixFLLUA59Q5si+XDMTTZTSvBmwTjVKd3rTDQGCXJJhOdFIMzyqb+Q72eOst4lcJ3pDR7b0LHDDXg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:12.796842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5b508588-aff4-42c3-9a09-f3a810de80c0 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:42:12.802704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5b508588-aff4-42c3-9a09-f3a810de80c0 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:42:12.919628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5b508588-aff4-42c3-9a09-f3a810de80c0 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.142201 Aug 03 05:42:12.920247 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3770/7532] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:42:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:12.971256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-442213423", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-102792389", "networks": [{"uuid": "50e591b9-8da9-4e57-99b8-0b0d826b9962"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:13.027001 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] validate_networks() for [('50e591b9-8da9-4e57-99b8-0b0d826b9962', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:42:13.468629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:42:13.469071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:42:13.469567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:42:13.470362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:42:13.470940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:42:13.481135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:13.481616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:13.482427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:13.482878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:13.500592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:42:13.506268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Getting quotas for user 0298978964d243a5ab062d01cbfa3059 and project 27796d6300cd4fea8deb8b4796dbdae3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:42:13.519808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:42:13.522557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:42:13.658696 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-510678e2-6daa-413a-874e-a082e1e644ba tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691300 Aug 03 05:42:13.659571 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3763/7533] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:42:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:42:13.671877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c4ddd05d-07eb-4d6a-bd73-9de5d0c0e244 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:13.672960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c4ddd05d-07eb-4d6a-bd73-9de5d0c0e244 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:13.748189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c4ddd05d-07eb-4d6a-bd73-9de5d0c0e244 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:13.755240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c4ddd05d-07eb-4d6a-bd73-9de5d0c0e244 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1261 microversion: 2.1 time: 0.088315 Aug 03 05:42:13.756037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3771/7534] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:13 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:14.779120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:14.779675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:14.786676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:14.787555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:14.788200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:14.788678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:14.855543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:14.863198 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2026b804-6f86-480f-8d5d-a1fdfa5b808a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1265 microversion: 2.1 time: 0.089826 Aug 03 05:42:14.863768 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3764/7535] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:14 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:15.883989 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:15.884631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:15.892470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:15.893022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:15.893798 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:15.894233 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:15.966081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:15.973773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-32be59d3-ed20-4026-b85c-c4ad8dca1e42 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1331 microversion: 2.1 time: 0.094151 Aug 03 05:42:15.974351 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3772/7536] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:15 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:16.996077 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:16.996829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:17.003955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:17.004454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:17.005239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:17.005691 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:17.152892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-22a7afbf-0581-4802-be58-66bfd388c71c req-64cb09c8-d40d-4737-b22d-9e915b9c09ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bfadd3f-e4fc-4d05-9f38-238a22588163", "tag": "640d46a1-292f-4017-be65-49f4767fac80"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:17.156355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:17.164935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-22a7afbf-0581-4802-be58-66bfd388c71c req-64cb09c8-d40d-4737-b22d-9e915b9c09ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:17.165806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-22a7afbf-0581-4802-be58-66bfd388c71c req-64cb09c8-d40d-4737-b22d-9e915b9c09ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:17.166105 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a3923322-f34b-4669-8cfc-e95da83ef8e6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1361 microversion: 2.1 time: 0.174392 Aug 03 05:42:17.166704 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3765/7537] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:16 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:17.191275 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-22a7afbf-0581-4802-be58-66bfd388c71c req-64cb09c8-d40d-4737-b22d-9e915b9c09ce service nova] Creating event network-changed:640d46a1-292f-4017-be65-49f4767fac80 for instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 on n-h1-826756-5 Aug 03 05:42:17.196824 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-22a7afbf-0581-4802-be58-66bfd388c71c req-64cb09c8-d40d-4737-b22d-9e915b9c09ce service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047762 Aug 03 05:42:17.197310 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3773/7538] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:18.186615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:18.187269 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:18.194246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:18.194706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:18.195985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:18.196561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:18.324091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:18.331607 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01e00fa7-4e24-41b9-8655-9b809fe12a05 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1361 microversion: 2.1 time: 0.148933 Aug 03 05:42:18.332187 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3766/7539] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:18 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:19.354244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:19.354992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:19.361307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:19.361762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:19.362566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:19.363010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:19.502093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:19.510066 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3ae4ef2c-a1dc-4940-80f4-28dacca389cd tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1361 microversion: 2.1 time: 0.160962 Aug 03 05:42:19.510894 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3774/7540] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:19 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:20.530940 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:20.531627 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:20.539106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:20.539731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:20.540541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:20.540993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:20.670651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:20.678384 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-14201bb3-c77e-4231-9691-8602f99c6c0f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1361 microversion: 2.1 time: 0.151389 Aug 03 05:42:20.678970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3767/7541] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:20 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:21.427352 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-99e092c2-4112-48ac-ba9e-f7b68143590b req-98bacdd2-45e5-4eb3-9e74-a398fb609bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfadd3f-e4fc-4d05-9f38-238a22588163", "name": "network-vif-plugged", "status": "completed", "tag": "640d46a1-292f-4017-be65-49f4767fac80"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:21.438886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99e092c2-4112-48ac-ba9e-f7b68143590b req-98bacdd2-45e5-4eb3-9e74-a398fb609bb4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:21.439343 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-99e092c2-4112-48ac-ba9e-f7b68143590b req-98bacdd2-45e5-4eb3-9e74-a398fb609bb4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:21.451137 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-99e092c2-4112-48ac-ba9e-f7b68143590b req-98bacdd2-45e5-4eb3-9e74-a398fb609bb4 service nova] Creating event network-vif-plugged:640d46a1-292f-4017-be65-49f4767fac80 for instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 on n-h1-826756-5 Aug 03 05:42:21.455915 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-99e092c2-4112-48ac-ba9e-f7b68143590b req-98bacdd2-45e5-4eb3-9e74-a398fb609bb4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Aug 03 05:42:21.456548 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3775/7542] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:21.699647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:21.700202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:21.707342 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:21.707815 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:21.708666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:21.709123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:21.846548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:21.854605 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7de81af4-1c6b-4af3-90c1-3b8d0ba9ceb1 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1361 microversion: 2.1 time: 0.159032 Aug 03 05:42:21.855194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3768/7543] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:21 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:22.876943 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:22.877560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:22.883746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:22.884202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:22.885738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:22.886178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:23.019088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:23.026669 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-251f3e23-11f5-44ea-88cb-142b3acd6757 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1553 microversion: 2.1 time: 0.155005 Aug 03 05:42:23.027275 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3776/7544] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:22 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:23.048805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:23.049469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:23.055843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:23.056957 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:23.057747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:23.058205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:23.191133 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:23.199241 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-84d18ecd-7112-4e02-8b50-a72153a4825d tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1553 microversion: 2.1 time: 0.154582 Aug 03 05:42:23.199847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3769/7545] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:23 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:42:26.220131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33acae90-3d4d-4055-bb09-8e0e16739a04"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:26.222508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:26.224484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:26.230547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:26.231022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:26.231805 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:26.232250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:27.161952 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ab0d171-aa02-4501-ac72-2ca526ebad7f tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "POST /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945491 Aug 03 05:42:27.162621 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3777/7546] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:42:26 2022] POST /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 194 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:38.922996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:38.923523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:38.925571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:38.926313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:38.927873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:38.928563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:38.934534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:38.935010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:38.935819 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:38.936314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:39.016463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lazy-loading 'services' on Instance uuid 8bfadd3f-e4fc-4d05-9f38-238a22588163 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:42:39.225270 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0f4052a9-c9c2-4778-94b5-83af01870f52 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments/33acae90-3d4d-4055-bb09-8e0e16739a04" status: 202 len: 0 microversion: 2.1 time: 0.305489 Aug 03 05:42:39.226152 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3770/7547] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:42:38 2022] DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments/33acae90-3d4d-4055-bb09-8e0e16739a04 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:42:39.235561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:39.237969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:39.240950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:39.241684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:42:39.246961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:39.247417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:39.248190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:39.248664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:39.279440 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dbe36e5-0abd-4002-a941-30f5e127ac11 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 03 05:42:39.280014 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3778/7548] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:39 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:42:40.295729 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:40.298086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:40.305896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:40.306359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:40.307244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:40.307925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:40.337995 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a09d3cd7-9606-45fd-ae0c-de3f37fcece8 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Aug 03 05:42:40.339315 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3771/7549] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:40 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:41.351681 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:41.353938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:41.362874 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:41.363333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:41.364125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:41.364602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:41.403240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05a1907b-e0d8-42bf-95fb-2a6fbe57792b tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056192 Aug 03 05:42:41.403850 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3779/7550] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:41 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:42.417716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:42.419910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:42.427490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:42.427956 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:42.428770 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:42.429230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:42.459428 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1ba1d39b-9d62-419c-b160-812644057615 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047456 Aug 03 05:42:42.459923 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3772/7551] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:42 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:43.473479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:43.475695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:43.484484 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:43.484945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:43.485736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:43.486184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:43.521635 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee6f4a81-fe0a-4777-88ac-a367bcd28558 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052998 Aug 03 05:42:43.522220 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3780/7552] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:43 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:44.534258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:44.536578 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:44.544424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:44.544902 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:44.545725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:44.546185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:44.576598 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24a6b762-ae54-4eb0-8f08-36d5203ba50a tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046374 Aug 03 05:42:44.580832 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3773/7553] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:42:44 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:42:44.587965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:44.589633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:44.595734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:44.596195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:44.596975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:44.597413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:44.675109 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 is not attached to volume 33acae90-3d4d-4055-bb09-8e0e16739a04 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments/33acae90-3d4d-4055-bb09-8e0e16739a04 HTTP/1.1 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 is not attached to volume 33acae90-3d4d-4055-bb09-8e0e16739a04 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '8bfadd3f-e4fc-4d05-9f38-238a22588163', 'id': '33acae90-3d4d-4055-bb09-8e0e16739a04'} Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 33acae90-3d4d-4055-bb09-8e0e16739a04. Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 is not attached to volume 33acae90-3d4d-4055-bb09-8e0e16739a04 Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:44.676757 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 is not attached to volume 33acae90-3d4d-4055-bb09-8e0e16739a04 Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 is not attached to volume 33acae90-3d4d-4055-bb09-8e0e16739a04 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4a9ef11-46aa-461b-bd7b-217b4a8394f6 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments/33acae90-3d4d-4055-bb09-8e0e16739a04" status: 404 len: 154 microversion: 2.1 time: 0.094663 Aug 03 05:42:44.680838 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3781/7554] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:42:44 2022] DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163/os-volume_attachments/33acae90-3d4d-4055-bb09-8e0e16739a04 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:42:48.250412 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:48.257315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:48.257873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:48.258345 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:48.259130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:48.259586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:48.285742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:42:48.551670 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d924b4d6-1fee-4a70-8817-e88aec319f16 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 204 len: 0 microversion: 2.1 time: 0.304771 Aug 03 05:42:48.552222 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3774/7555] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:42:48 2022] DELETE /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:42:48.560353 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:48.565799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:48.568156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:48.568655 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:48.569419 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:48.569863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:48.711807 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:48.720235 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-32e26c59-ba00-41c3-a6c4-02bd9308b762 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1559 microversion: 2.1 time: 0.163748 Aug 03 05:42:48.720842 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3782/7556] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:48 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:49.741579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:49.742353 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:49.753174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:49.753680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:49.754481 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:49.754939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:49.888477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:49.896278 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4dbee83-ea89-44b8-b330-559e9e50c8f5 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1559 microversion: 2.1 time: 0.158968 Aug 03 05:42:49.907557 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3775/7557] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:49 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:50.627748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a0242017-8f89-478a-84af-18824af7b61c req-e8b72ac6-eafd-4160-9396-af751d4d95fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfadd3f-e4fc-4d05-9f38-238a22588163", "name": "network-vif-deleted", "tag": "640d46a1-292f-4017-be65-49f4767fac80"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:42:50.639310 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0242017-8f89-478a-84af-18824af7b61c req-e8b72ac6-eafd-4160-9396-af751d4d95fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:50.639762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a0242017-8f89-478a-84af-18824af7b61c req-e8b72ac6-eafd-4160-9396-af751d4d95fe service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:50.651204 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a0242017-8f89-478a-84af-18824af7b61c req-e8b72ac6-eafd-4160-9396-af751d4d95fe service nova] Creating event network-vif-deleted:640d46a1-292f-4017-be65-49f4767fac80 for instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 on n-h1-826756-5 Aug 03 05:42:50.656211 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a0242017-8f89-478a-84af-18824af7b61c req-e8b72ac6-eafd-4160-9396-af751d4d95fe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032284 Aug 03 05:42:50.656834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3783/7558] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:42:50.919157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:50.919800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:50.927206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:50.927675 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:50.928495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:50.928947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:51.003178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0298978964d243a5ab062d01cbfa3059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27796d6300cd4fea8deb8b4796dbdae3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:42:51.011702 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-aa3fb75b-0666-4a98-8b02-f3d59325aff3 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 200 len: 1346 microversion: 2.1 time: 0.097002 Aug 03 05:42:51.012335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3776/7559] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:50 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:42:52.034495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:52.035201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] [instance: 8bfadd3f-e4fc-4d05-9f38-238a22588163] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:42:52.041983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:52.042978 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:52.043742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:42:52.044183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:42:52.057357 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] HTTP exception thrown: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Request method failure captured: Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 HTTP/1.1 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gpbbaPEevI9F6YQAd_rI-BNF5pbBZy9dNn0HA2GCf1F-IeVUrZRlXhp27Qa3pD3eOMqSszaX6sLg3pbJURDhpqmyDwqgze92rdadu1UnCKWyAkhroy-4LbQMkG67s_QpdoNhPgHpvRKIM5Q8_niwPWb805nOMyUIdjQRGgU458M2w8 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/27796d6300cd4fea8deb8b4796dbdae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 27796d6300cd4fea8deb8b4796dbdae3 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1598890306 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 0298978964d243a5ab062d01cbfa3059 Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestEncryptedCinderVolumes-1598890306-project Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '8bfadd3f-e4fc-4d05-9f38-238a22588163'} Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:52.058974 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Returning 404 to user: Instance 8bfadd3f-e4fc-4d05-9f38-238a22588163 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e1f7576-96c7-4b09-9a8d-7e43772d8788 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163" status: 404 len: 111 microversion: 2.1 time: 0.031156 Aug 03 05:42:52.064340 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3784/7560] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:42:52 2022] GET /compute/v2.1/servers/8bfadd3f-e4fc-4d05-9f38-238a22588163 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:42:52.069284 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-869ec411-2f69-4af8-9f7a-13e0e730eb72 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] Calling method '.version_select at 0x7fdd473ba3a0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:42:52.169796 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-869ec411-2f69-4af8-9f7a-13e0e730eb72 tempest-TestEncryptedCinderVolumes-1598890306 tempest-TestEncryptedCinderVolumes-1598890306-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-102792389" status: 202 len: 0 microversion: 2.1 time: 0.104313 Aug 03 05:42:52.170409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3777/7561] 10.222.0.72 () {58 vars in 1275 bytes} [Wed Aug 3 05:42:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-102792389 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:43:25.864339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e21b8aa-1edf-434e-bc0d-d85ed7f9c6e5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: .version_select at 0x7fdd54791d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2134453395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp4RdTuicTxMqUjIBH5ZjSb1HIiCWzigKQYQEdi1nyzUvE8bPrksGg8ieyslXKGsWLNbMmCmElQQzPMAzJYR8YumTIGUzVE3HGZsuUsHLU3FF8JO5CFLA76rQptH2Y4yw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:43:25.870178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=14 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:25.870923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=34 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:25.881510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8e21b8aa-1edf-434e-bc0d-d85ed7f9c6e5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for project d96f47f8c8a7444c962fff649dfaef96. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:43:25.888197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8e21b8aa-1edf-434e-bc0d-d85ed7f9c6e5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for user 65320edfff424b909b52bf8eb3f85396 and project d96f47f8c8a7444c962fff649dfaef96. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:43:26.032031 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e21b8aa-1edf-434e-bc0d-d85ed7f9c6e5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.172151 Aug 03 05:43:26.032678 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3785/7562] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:43:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:43:26.080938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:26.081707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:26.085814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-556835488", "imageRef": "6b58f10c-6fc0-4856-a584-ac13d5a7a73c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2134453395", "networks": [{"uuid": "97a9df79-33a2-44da-9643-6f12cc92696a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:43:26.138555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] validate_networks() for [('97a9df79-33a2-44da-9643-6f12cc92696a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:43:26.516709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:43:26.517154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:43:26.517655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:43:26.518086 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:43:26.518517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:43:26.527950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:26.528470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:26.529300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:26.529760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:26.547359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for project d96f47f8c8a7444c962fff649dfaef96. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:43:26.552807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for user 65320edfff424b909b52bf8eb3f85396 and project d96f47f8c8a7444c962fff649dfaef96. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:43:26.566569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:43:26.568756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b58f10c-6fc0-4856-a584-ac13d5a7a73c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:43:26.701165 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b84a9be-d739-494f-8043-fec0b84cb8cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622444 Aug 03 05:43:26.702071 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3778/7563] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:43:26.713182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6210dc04-fc7b-4d88-a904-5844c492dd1f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:26.713944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6210dc04-fc7b-4d88-a904-5844c492dd1f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:26.771948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6210dc04-fc7b-4d88-a904-5844c492dd1f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:26.779024 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6210dc04-fc7b-4d88-a904-5844c492dd1f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1258 microversion: 2.1 time: 0.070466 Aug 03 05:43:26.779606 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3786/7564] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:26 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:43:27.801912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3bfbee75-600a-459b-b463-b2329a407100 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:27.802545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3bfbee75-600a-459b-b463-b2329a407100 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:27.857996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3bfbee75-600a-459b-b463-b2329a407100 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:27.864827 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3bfbee75-600a-459b-b463-b2329a407100 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1258 microversion: 2.1 time: 0.067764 Aug 03 05:43:27.867999 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3779/7565] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:27 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:28.887059 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:28.887702 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:28.895827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:28.896290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:28.897086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:28.897524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:28.960155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:28.968591 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e49fd0b-c293-43bd-ad8d-a09555e5969f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1310 microversion: 2.1 time: 0.085567 Aug 03 05:43:28.969178 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3787/7566] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:28 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:29.992727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:29.996396 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:30.006712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:30.007535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:30.016934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:30.017733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:30.250154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:30.261846 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-48774512-9b77-43ba-a7e2-9bd58f2e06e3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.275520 Aug 03 05:43:30.262768 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3780/7567] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:29 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:31.285124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:31.285763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:31.293369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:31.293827 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:31.294631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:31.295073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:31.438375 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:31.446506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b175c1a-217e-44ea-93db-5fa425c59714 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.165532 Aug 03 05:43:31.448189 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3788/7568] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:31 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:32.468961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:32.469688 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:32.477676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:32.478962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:32.479775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:32.480235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:32.634023 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:32.642860 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-665c828a-884f-4796-9c56-49558e57bcde tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.177815 Aug 03 05:43:32.657528 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3781/7569] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:32 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:33.666770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:33.667444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:33.674607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:33.675064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:33.675843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:33.676350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:33.823428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:33.832471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c9e68e5-fd01-4b16-8efc-f7cfb74ded28 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.170153 Aug 03 05:43:33.833428 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3789/7570] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:33 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:43:34.855693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:34.856240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:34.863319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:34.863787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:34.864608 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:34.865059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:35.015289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:35.023402 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ede216fa-f33d-48bb-86b6-bcc95bdbb59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.172850 Aug 03 05:43:35.036948 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3782/7571] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:34 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:36.044406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:36.045738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:36.054091 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:36.054820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:36.056638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:36.057424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:36.199242 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:36.207174 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-935eafff-f790-4074-9b0e-0737859c0672 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.167182 Aug 03 05:43:36.208105 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3790/7572] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:36 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:37.229641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:37.230282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:37.233040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:37.238068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:37.238544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:37.239365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:37.239822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:37.381864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:37.389967 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1081cac9-b104-4c2b-8272-0e315d9ac142 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.164888 Aug 03 05:43:37.390881 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3783/7573] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:37 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:38.413519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:38.414174 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:38.416829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:38.423431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:38.423890 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:38.424720 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:38.425165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:38.576587 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:38.584499 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-60527fc1-1940-49b0-8ea9-c7990b51bd5e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.175927 Aug 03 05:43:38.585071 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3791/7574] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:38 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:38.762521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-0f5adf77-7ece-497b-8a4f-84763e217d18 req-8243ecff-c74c-4214-baea-bcfbfb6479cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:43:38.767832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:43:38.774265 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0f5adf77-7ece-497b-8a4f-84763e217d18 req-8243ecff-c74c-4214-baea-bcfbfb6479cc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:38.775486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-0f5adf77-7ece-497b-8a4f-84763e217d18 req-8243ecff-c74c-4214-baea-bcfbfb6479cc service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:38.787071 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-0f5adf77-7ece-497b-8a4f-84763e217d18 req-8243ecff-c74c-4214-baea-bcfbfb6479cc service nova] Creating event network-changed:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:43:38.792770 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-0f5adf77-7ece-497b-8a4f-84763e217d18 req-8243ecff-c74c-4214-baea-bcfbfb6479cc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034889 Aug 03 05:43:38.793667 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3784/7575] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:43:39.606228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:39.606862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:39.614070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:39.614520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:39.616683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:39.616683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:39.751175 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:39.759102 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2d1a4d45-6b9a-4bd6-8958-7101f5b7c441 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.157205 Aug 03 05:43:39.759685 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3792/7576] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:39 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:40.782032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:40.782745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:40.789652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:40.790736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:40.791507 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:40.791954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:40.919492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:40.927079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57999dac-8f51-4d05-8a0c-ec20be8c0ed5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.150142 Aug 03 05:43:40.927659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3785/7577] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:40 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:41.948780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:41.949394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:41.956387 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:41.956843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:41.957607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:41.958048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:42.085292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:42.092865 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-17151449-2aff-467d-9c39-72342393835b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.148459 Aug 03 05:43:42.093436 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3793/7578] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:41 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:43.114509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:43.115148 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:43.122972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:43.123445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:43.124240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:43.124727 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:43.255575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:43.263707 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ccbab28d-2c44-483e-8d3a-5ef49cd4890d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.153200 Aug 03 05:43:43.264307 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3786/7579] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:43 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:43.538570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-065b3e95-afc9-4aee-af7f-993cd22072df req-cd4f2160-6c9d-450d-b4a8-f9ca0d1f53d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "name": "network-vif-plugged", "status": "completed", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:43:43.549549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-065b3e95-afc9-4aee-af7f-993cd22072df req-cd4f2160-6c9d-450d-b4a8-f9ca0d1f53d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:43.550001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-065b3e95-afc9-4aee-af7f-993cd22072df req-cd4f2160-6c9d-450d-b4a8-f9ca0d1f53d0 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:43.561451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-065b3e95-afc9-4aee-af7f-993cd22072df req-cd4f2160-6c9d-450d-b4a8-f9ca0d1f53d0 service nova] Creating event network-vif-plugged:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:43:43.566460 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-065b3e95-afc9-4aee-af7f-993cd22072df req-cd4f2160-6c9d-450d-b4a8-f9ca0d1f53d0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 Aug 03 05:43:43.567044 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3794/7580] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:43:44.284606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:44.285243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:44.292928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:44.293400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:44.294186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:44.294643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:44.426513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:44.434538 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-110771a2-5cb8-4519-9740-b07104d98556 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1358 microversion: 2.1 time: 0.153944 Aug 03 05:43:44.435110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3787/7581] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:44 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:45.457784 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:45.458523 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:45.464941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.465397 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.466159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.466627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.601381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:45.609761 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1fbad49e-9f45-4470-9f50-2d2219a7905f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1547 microversion: 2.1 time: 0.157129 Aug 03 05:43:45.610487 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3795/7582] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:45 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:45.630854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:45.631469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:45.638965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.642266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.642266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.642266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.770136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:45.778306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-002cb9c0-2367-49d6-9498-166c68fd5626 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1547 microversion: 2.1 time: 0.151546 Aug 03 05:43:45.778905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3788/7583] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:45 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:45.799426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:45.803993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:45.804785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Searching by: {'deleted': False, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96'} {{(pid=120831) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 05:43:45.811083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.811534 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.812346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.812789 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.837711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.multi_cell_list [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120831) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 05:43:45.865629 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-178a9cea-90b3-40bb-80b6-9a809e1fefa3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069988 Aug 03 05:43:45.866231 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3796/7584] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 05:43:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:43:45.878167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:43:45.878798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:45.885575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.885953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:45.886725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:45.887172 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:46.023863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:43:46.031769 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d97ca87b-d979-4a29-af9b-925cf8f70fa4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1547 microversion: 2.1 time: 0.157417 Aug 03 05:43:46.032409 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3789/7585] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:43:45 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:43:48.889062 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22d4204d-2ec4-414b-8a54-bb3194d4eef1"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:43:48.891469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:43:48.898487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:48.898947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:48.899718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:43:48.900162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:43:49.622403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0b17ac88-2eb8-45b4-b2de-d2f4ae626eeb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738014 Aug 03 05:43:49.623032 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3797/7586] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:43:48 2022] POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:44:04.018341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:44:04.018976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:44:04.021388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:44:04.022355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=58 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:44:04.027816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:04.028413 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:04.029255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:04.029714 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:04.186971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:44:04.195313 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5359c86a-9ff8-4c12-8bac-60e833bb0f3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1593 microversion: 2.1 time: 0.181180 Aug 03 05:44:04.195887 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3790/7587] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:44:04 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1593 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:44:06.549205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:44:06.549997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:44:06.550865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:44:06.555373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-128823f0-e95f-4d40-8c12-410b02a8d697 req-bbbfa1a4-3e95-40b4-8228-7104cfe497f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:44:06.566143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-128823f0-e95f-4d40-8c12-410b02a8d697 req-bbbfa1a4-3e95-40b4-8228-7104cfe497f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:06.566598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-128823f0-e95f-4d40-8c12-410b02a8d697 req-bbbfa1a4-3e95-40b4-8228-7104cfe497f6 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:06.580403 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-128823f0-e95f-4d40-8c12-410b02a8d697 req-bbbfa1a4-3e95-40b4-8228-7104cfe497f6 service nova] Creating event network-changed:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:44:06.586311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-128823f0-e95f-4d40-8c12-410b02a8d697 req-bbbfa1a4-3e95-40b4-8228-7104cfe497f6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038275 Aug 03 05:44:06.586722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3798/7588] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:44:09.118966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1333720190"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:44:09.119569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:44:09.127382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:09.127885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:09.128704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:09.129157 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:09.259286 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.network.security_group_api [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Adding security group 8e78e5b6-085a-4018-bfba-db535e016f2d to port 7ae6f697-ceae-47db-ad8e-190c54be4136 Aug 03 05:44:09.629351 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3170db27-ef5c-4faa-9991-105edc3f271f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action" status: 202 len: 0 microversion: 2.1 time: 0.514326 Aug 03 05:44:09.630069 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3791/7589] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:44:09 2022] POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:44:09.640816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:44:09.641532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:44:09.641674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-a3387f2b-d42b-4cb4-97d2-2b8b99d097ab req-88c13eb6-480f-46b8-8579-fb3137f7fbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:44:09.649566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:09.650349 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:09.651386 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:09.651858 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a3387f2b-d42b-4cb4-97d2-2b8b99d097ab req-88c13eb6-480f-46b8-8579-fb3137f7fbb2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:44:09.652315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:09.652998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-a3387f2b-d42b-4cb4-97d2-2b8b99d097ab req-88c13eb6-480f-46b8-8579-fb3137f7fbb2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:44:09.667825 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-a3387f2b-d42b-4cb4-97d2-2b8b99d097ab req-88c13eb6-480f-46b8-8579-fb3137f7fbb2 service nova] Creating event network-changed:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:44:09.675851 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-a3387f2b-d42b-4cb4-97d2-2b8b99d097ab req-88c13eb6-480f-46b8-8579-fb3137f7fbb2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039490 Aug 03 05:44:09.684645 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3792/7590] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:44:09.959302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:44:09.967939 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-81b72e59-8d56-4a4e-a8f7-3f031948510c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1757 microversion: 2.1 time: 0.333224 Aug 03 05:44:09.968711 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3799/7591] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:44:09 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1757 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:44:29.207819 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:44:29.208506 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:45:42.949122 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:45:42.950814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:45:42.955630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:45:42.957944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:45:42.964881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:42.965989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:42.966626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:42.967129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:43.262483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-682bf9e2-ce7f-47f1-bbf1-beb9b4e636a6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action" status: 202 len: 0 microversion: 2.1 time: 0.315553 Aug 03 05:45:43.263153 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3793/7592] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:45:42 2022] POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:45:43.269276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:45:43.270097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:45:43.274015 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:45:43.277502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:45:43.281118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:43.281566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:43.282331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:43.282768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:43.650384 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:45:43.659374 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9169214c-4901-4f7b-8850-7835234933ad tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1759 microversion: 2.1 time: 0.391928 Aug 03 05:45:43.659951 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3800/7593] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:45:43 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1759 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:45:44.683474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:45:44.684224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:45:44.690561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:44.691680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:44.691838 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:45:44.692243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:45:44.888610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:45:44.897362 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5346d8f-e104-4542-9be4-c7a9781375d7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1757 microversion: 2.1 time: 0.218997 Aug 03 05:45:44.897932 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3794/7594] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:45:44 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:46:08.694306 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:46:08.694879 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:46:08.804597 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:46:08.804746 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 05:46:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:46:09.051038 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:46:09.051585 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:46:41.230807 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:46:41.242699 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:46:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:46:58.857345 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:46:58.858148 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 05:46:58.858636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:46:58.859411 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:46:58.863412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1333720190"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:46:58.864049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:46:58.870042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:46:58.873878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:46:58.873878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:46:58.873878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:46:59.009576 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Removing security group 8e78e5b6-085a-4018-bfba-db535e016f2d from port 7ae6f697-ceae-47db-ad8e-190c54be4136 Aug 03 05:46:59.384554 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-88ed16e8-8042-4750-8b08-de681abac43d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action" status: 202 len: 0 microversion: 2.1 time: 0.528063 Aug 03 05:46:59.385538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3801/7595] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:46:58 2022] POST /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:46:59.392339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:46:59.393394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:46:59.398730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-447681db-06c2-474a-8b4f-f4f83ed5cdbb req-c7bcf48f-6545-4e4e-984d-cb2c52f7ac80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:46:59.409565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-447681db-06c2-474a-8b4f-f4f83ed5cdbb req-c7bcf48f-6545-4e4e-984d-cb2c52f7ac80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:46:59.410354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-447681db-06c2-474a-8b4f-f4f83ed5cdbb req-c7bcf48f-6545-4e4e-984d-cb2c52f7ac80 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:46:59.423253 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-447681db-06c2-474a-8b4f-f4f83ed5cdbb req-c7bcf48f-6545-4e4e-984d-cb2c52f7ac80 service nova] Creating event network-changed:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:46:59.429079 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-447681db-06c2-474a-8b4f-f4f83ed5cdbb req-c7bcf48f-6545-4e4e-984d-cb2c52f7ac80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038425 Aug 03 05:46:59.430048 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3795/7596] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:00.783239 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 43142. Aug 03 05:47:00.796834 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 43140. Aug 03 05:47:00.837830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:00.838519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:00.845926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:00.846244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:00.847370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:00.848153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:00.891077 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5a6998c1-4a4b-47fb-b938-1cfcadb77569 req-f77fbf71-ecb2-489d-96d8-65f01ca622e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:00.905465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5a6998c1-4a4b-47fb-b938-1cfcadb77569 req-f77fbf71-ecb2-489d-96d8-65f01ca622e5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:00.906291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5a6998c1-4a4b-47fb-b938-1cfcadb77569 req-f77fbf71-ecb2-489d-96d8-65f01ca622e5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:00.918679 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5a6998c1-4a4b-47fb-b938-1cfcadb77569 req-f77fbf71-ecb2-489d-96d8-65f01ca622e5 service nova] Creating event network-changed:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:47:00.925659 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5a6998c1-4a4b-47fb-b938-1cfcadb77569 req-f77fbf71-ecb2-489d-96d8-65f01ca622e5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160149 Aug 03 05:47:00.926615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3802/7597] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:00.940542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lazy-loading 'services' on Instance uuid 3220ed55-db91-4cd4-83bd-9e130da6d609 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:47:01.205704 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8154e822-3494-4a8d-a22b-21dfe6d9a3f0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments/22d4204d-2ec4-414b-8a54-bb3194d4eef1" status: 202 len: 0 microversion: 2.1 time: 0.375329 Aug 03 05:47:01.210675 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3796/7598] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:47:00 2022] DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments/22d4204d-2ec4-414b-8a54-bb3194d4eef1 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:47:01.218963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:01.221706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:01.229535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:01.230371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:01.231406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:01.232083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:01.269069 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bea078d8-b574-4dbb-b93c-4cb17864afd5 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053999 Aug 03 05:47:01.269069 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3803/7599] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:01 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:02.280887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:02.283904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:02.290564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:02.291032 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:02.291827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:02.292305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:02.323559 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30c94555-c144-4313-9998-eda9a02dcbab tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048104 Aug 03 05:47:02.324520 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3797/7600] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:02 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:03.337300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:03.339549 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:03.347312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:03.347768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:03.348576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:03.349018 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:03.380803 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5af27045-6815-40b9-ae94-a09532303129 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Aug 03 05:47:03.381393 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3804/7601] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:03 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:04.393359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:04.395969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:04.402987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:04.403447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:04.404224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:04.404696 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:04.434819 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5ae15da7-a88b-4984-ad4b-16077494d695 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Aug 03 05:47:04.435384 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3798/7602] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:04 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:05.447406 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:05.449869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:05.457067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:05.457531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:05.458323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:05.458768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:05.498068 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91455a74-a6ac-49dc-be7e-d057ee51010b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054630 Aug 03 05:47:05.498653 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3805/7603] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:05 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:47:06.510112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:06.512323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:06.519973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:06.520469 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:06.521249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:06.521704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:06.550753 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d93af829-7615-4f7f-92cc-91d3b44c5e16 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044667 Aug 03 05:47:06.551366 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3799/7604] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:47:06 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:47:06.561980 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:06.562502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:06.569777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:06.570230 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:06.571755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:06.571755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:06.646646 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] HTTP exception thrown: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 is not attached to volume 22d4204d-2ec4-414b-8a54-bb3194d4eef1 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Request method failure captured: Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: request: DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments/22d4204d-2ec4-414b-8a54-bb3194d4eef1 HTTP/1.1 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6grsxya8-0QE1Q6UzcgENkR07BMxnKk4NlVh17HEclJ2r0YFTyh8c_M0peX_rH2i9GoDzjvND36-P31oBY8ovZM8JXgZzZAeHzjGWmLaYJCuoXodjqowQbiNqLEKf1fk_vRlY6svEfMz4HwUjW3JB-t4rdhxvcJbfCRa6q94yYeHV70 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 65320edfff424b909b52bf8eb3f85396 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 is not attached to volume 22d4204d-2ec4-414b-8a54-bb3194d4eef1 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'server_id': '3220ed55-db91-4cd4-83bd-9e130da6d609', 'id': '22d4204d-2ec4-414b-8a54-bb3194d4eef1'} Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 22d4204d-2ec4-414b-8a54-bb3194d4eef1. Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 is not attached to volume 22d4204d-2ec4-414b-8a54-bb3194d4eef1 Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:47:06.648317 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 is not attached to volume 22d4204d-2ec4-414b-8a54-bb3194d4eef1 Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Returning 404 to user: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 is not attached to volume 22d4204d-2ec4-414b-8a54-bb3194d4eef1 {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-df8d10d0-27f7-45b7-8307-a29fd8419653 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments/22d4204d-2ec4-414b-8a54-bb3194d4eef1" status: 404 len: 154 microversion: 2.1 time: 0.091811 Aug 03 05:47:06.652860 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3806/7605] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:47:06 2022] DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609/os-volume_attachments/22d4204d-2ec4-414b-8a54-bb3194d4eef1 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:47:10.022163 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:10.022806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:10.029909 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:10.030495 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:10.031286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:10.031740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:10.058315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:47:10.319306 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-23509aa2-3634-4ffd-9b60-f2616195a052 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 204 len: 0 microversion: 2.1 time: 0.301152 Aug 03 05:47:10.319817 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3800/7606] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:47:10 2022] DELETE /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:47:10.328319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:10.329742 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:10.337614 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:10.338092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:10.338872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:10.339314 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:10.476113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:10.483777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e1c302f9-ec59-435c-bd59-7edc443261b8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1553 microversion: 2.1 time: 0.159414 Aug 03 05:47:10.484351 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3807/7607] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:10 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:11.505468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:11.506120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:11.513782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:11.514252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:11.515062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:11.515518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:11.644555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:11.652223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-15211666-69fa-455d-b373-ddebbe7779e9 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1553 microversion: 2.1 time: 0.151107 Aug 03 05:47:11.652785 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3801/7608] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:11 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:47:12.674579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:12.675354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:12.683997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:12.684730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:12.685623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:12.686190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:12.765253 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:12.777009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8f686281-0786-4938-aba8-191de7a56853 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 200 len: 1511 microversion: 2.1 time: 0.106398 Aug 03 05:47:12.777934 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3808/7609] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:12 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 1511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:12.806958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3cc19b2e-81a3-48ac-a239-79d518315a28 req-8092658a-e55d-4411-b5ea-c1ad32790591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220ed55-db91-4cd4-83bd-9e130da6d609", "name": "network-vif-deleted", "tag": "7ae6f697-ceae-47db-ad8e-190c54be4136"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:12.817389 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3cc19b2e-81a3-48ac-a239-79d518315a28 req-8092658a-e55d-4411-b5ea-c1ad32790591 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:12.817853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3cc19b2e-81a3-48ac-a239-79d518315a28 req-8092658a-e55d-4411-b5ea-c1ad32790591 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:12.829145 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3cc19b2e-81a3-48ac-a239-79d518315a28 req-8092658a-e55d-4411-b5ea-c1ad32790591 service nova] Creating event network-vif-deleted:7ae6f697-ceae-47db-ad8e-190c54be4136 for instance 3220ed55-db91-4cd4-83bd-9e130da6d609 on n-h2-826756-5 Aug 03 05:47:12.838962 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3cc19b2e-81a3-48ac-a239-79d518315a28 req-8092658a-e55d-4411-b5ea-c1ad32790591 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099927 Aug 03 05:47:12.838962 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3802/7610] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:13.801067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:13.801945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 3220ed55-db91-4cd4-83bd-9e130da6d609] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:13.809595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:13.813600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:13.813600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:13.813600 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:13.825407 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] HTTP exception thrown: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Request method failure captured: Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 HTTP/1.1 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6grsxya8-0QE1Q6UzcgENkR07BMxnKk4NlVh17HEclJ2r0YFTyh8c_M0peX_rH2i9GoDzjvND36-P31oBY8ovZM8JXgZzZAeHzjGWmLaYJCuoXodjqowQbiNqLEKf1fk_vRlY6svEfMz4HwUjW3JB-t4rdhxvcJbfCRa6q94yYeHV70 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 65320edfff424b909b52bf8eb3f85396 Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '3220ed55-db91-4cd4-83bd-9e130da6d609'} Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:47:13.826958 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Returning 404 to user: Instance 3220ed55-db91-4cd4-83bd-9e130da6d609 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b506661-9818-43b8-8047-466e16277b48 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609" status: 404 len: 111 microversion: 2.1 time: 0.031976 Aug 03 05:47:13.830990 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3809/7611] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:13 2022] GET /compute/v2.1/servers/3220ed55-db91-4cd4-83bd-9e130da6d609 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:47:13.839011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ab6ebd1d-c2ab-4168-84e4-1e10fc163879 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '.version_select at 0x7fdd473465e0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:13.939915 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ab6ebd1d-c2ab-4168-84e4-1e10fc163879 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2134453395" status: 202 len: 0 microversion: 2.1 time: 0.105844 Aug 03 05:47:13.940574 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3803/7612] 10.222.0.72 () {58 vars in 1272 bytes} [Wed Aug 3 05:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2134453395 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:47:25.167511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-62bb0d9b-1a36-46f9-a384-7a5038793d45 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: .version_select at 0x7fdd54604040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-269532443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG5Rc6JxcYaqLQGqvnaGNlYMQPDoZeVuiQDl6qtEG5O38kHIg207RldCjJ/804lYLVUwoNDPDe4Z30sjefiCgIk2rJaoaOemZ3Tg21ubFx5nHuhzV6w3oFeGBnQsuSi+w=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:25.173701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:25.174347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=44 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:25.186225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-62bb0d9b-1a36-46f9-a384-7a5038793d45 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for project d96f47f8c8a7444c962fff649dfaef96. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:47:25.191381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-62bb0d9b-1a36-46f9-a384-7a5038793d45 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for user 65320edfff424b909b52bf8eb3f85396 and project d96f47f8c8a7444c962fff649dfaef96. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:47:25.310945 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-62bb0d9b-1a36-46f9-a384-7a5038793d45 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.147827 Aug 03 05:47:25.311507 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3810/7613] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:47:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:25.360011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:25.360856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:25.366045 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-307013245", "imageRef": "e1d78cb0-97cc-41c2-8076-b5f22580b7c5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-269532443", "networks": [{"uuid": "97a9df79-33a2-44da-9643-6f12cc92696a"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:25.417773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] validate_networks() for [('97a9df79-33a2-44da-9643-6f12cc92696a', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:47:25.855062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:47:25.855062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:47:25.855062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:47:25.855062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:47:25.855062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:47:25.860990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:25.861532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:25.862357 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:25.862804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:25.881235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for project d96f47f8c8a7444c962fff649dfaef96. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:47:25.886681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Getting quotas for user 65320edfff424b909b52bf8eb3f85396 and project d96f47f8c8a7444c962fff649dfaef96. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:47:25.899782 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:47:25.902521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1d78cb0-97cc-41c2-8076-b5f22580b7c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:47:26.009754 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3df80222-cb73-42b2-8887-3227476930fb tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651624 Aug 03 05:47:26.010458 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3804/7614] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:47:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:47:26.021944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-62b7146c-5f11-44fb-89e6-41fdf03bd59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:26.022745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-62b7146c-5f11-44fb-89e6-41fdf03bd59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:26.079530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-62b7146c-5f11-44fb-89e6-41fdf03bd59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:26.087757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-62b7146c-5f11-44fb-89e6-41fdf03bd59d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1257 microversion: 2.1 time: 0.070576 Aug 03 05:47:26.088448 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3811/7615] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:26 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:27.109351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8bb7ef7b-5494-4661-81f0-f2bea5c569a7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:27.110083 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8bb7ef7b-5494-4661-81f0-f2bea5c569a7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:27.164506 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8bb7ef7b-5494-4661-81f0-f2bea5c569a7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:27.174386 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8bb7ef7b-5494-4661-81f0-f2bea5c569a7 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1257 microversion: 2.1 time: 0.069021 Aug 03 05:47:27.174969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3805/7616] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:27 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:28.195583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:28.196252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:28.203232 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:28.203688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:28.204598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:28.205042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:28.274205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:28.281893 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5e1f2082-6ea3-40b0-9533-27a128379c14 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1261 microversion: 2.1 time: 0.090641 Aug 03 05:47:28.282482 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3812/7617] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:28 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:29.304577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:29.304577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:29.313296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:29.313762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:29.314553 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:29.315126 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:29.409485 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:29.417875 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fb05200f-6934-4217-97fe-2e7c2ed521cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1317 microversion: 2.1 time: 0.118475 Aug 03 05:47:29.418875 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3806/7618] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:29 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1317 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:47:30.444964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:30.447046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:30.456366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:30.456899 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:30.457734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:30.458396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:30.647169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:30.655738 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-de87f93d-be73-41ba-9394-6b51609a5b83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.216532 Aug 03 05:47:30.656356 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3813/7619] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:30 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:31.681555 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:31.682188 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:31.689800 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:31.690560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:31.691573 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:31.692254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:31.838867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:31.846599 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0cf7f7bb-b797-45c2-b907-42da0a343a04 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.169602 Aug 03 05:47:31.847428 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3807/7620] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:31 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:32.868301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:32.869044 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:32.875084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:32.875537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:32.876371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:32.876975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:33.019167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:33.028120 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59ed9985-b0a8-4edd-a202-783d8b1967c2 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.164032 Aug 03 05:47:33.029119 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3814/7621] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:32 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:34.057808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:34.058427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:34.065743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:34.066169 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:34.067043 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:34.067443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:34.229431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:34.237481 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a85d49fa-17d5-47fa-8040-e015652fcb31 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.188930 Aug 03 05:47:34.238207 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3808/7622] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:34 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:35.259952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:35.260623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:35.269327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:35.270348 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:35.271906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:35.273533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:35.416642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:35.424348 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b5698149-bd50-40b4-aa70-d9dc4613d9bd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.169154 Aug 03 05:47:35.424937 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3815/7623] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:35 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:36.445798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:36.446424 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:36.449145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:36.453959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:36.454419 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:36.455220 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:36.455687 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:36.615971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:36.625317 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f88c92e7-0a02-448b-aa99-9195752dfffc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.183972 Aug 03 05:47:36.626086 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3809/7624] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:36 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:37.648647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:37.649326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:37.651361 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:37.657169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:37.659201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:37.659201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:37.659201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:37.790829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:37.798218 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9dc550d-b955-4896-9aa4-0c0a28956425 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.155125 Aug 03 05:47:37.798793 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3816/7625] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:37 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:38.795813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-f75f97ef-a51b-44db-a8b9-5d48bbbd3ac9 req-62683214-aa84-45d3-bc88-08d9c52e7401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:38.800939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=8 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:47:38.807953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f75f97ef-a51b-44db-a8b9-5d48bbbd3ac9 req-62683214-aa84-45d3-bc88-08d9c52e7401 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:38.808444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-f75f97ef-a51b-44db-a8b9-5d48bbbd3ac9 req-62683214-aa84-45d3-bc88-08d9c52e7401 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:38.819311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:38.820335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:38.820503 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-f75f97ef-a51b-44db-a8b9-5d48bbbd3ac9 req-62683214-aa84-45d3-bc88-08d9c52e7401 service nova] Creating event network-changed:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:47:38.826230 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-f75f97ef-a51b-44db-a8b9-5d48bbbd3ac9 req-62683214-aa84-45d3-bc88-08d9c52e7401 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033727 Aug 03 05:47:38.827394 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3810/7626] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:38.827516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:38.828029 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:38.828902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:38.829467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:39.046910 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:39.054970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f883afa7-bf33-4f00-a4e5-65031d78e00e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.239794 Aug 03 05:47:39.055567 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3817/7627] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:38 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:47:40.077752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:40.078484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:40.086587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:40.087049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:40.087822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:40.088298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:40.221832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:40.230295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1aa0bd4b-6e77-4667-bb19-65e16f80bf27 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.156742 Aug 03 05:47:40.230883 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3811/7628] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:40 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:41.251710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:41.252251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:41.259698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:41.260148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:41.260931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:41.261364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:41.390882 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:41.399455 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cfcbc20d-0a36-4257-9795-d82222d13f8b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.151639 Aug 03 05:47:41.400039 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3818/7629] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:41 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:42.420932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:42.421556 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:42.428482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:42.428950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:42.429725 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:42.430173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:42.567111 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:42.574817 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b5d73fd9-d679-4897-b8c4-181b366f897c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.157737 Aug 03 05:47:42.575410 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3812/7630] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:42 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:47:43.607213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:43.607836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:43.614920 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:43.615452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:43.616224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:43.616695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:43.747556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:43.755387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00beb4a1-9fd7-4166-8322-c8ee7054c91d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.152929 Aug 03 05:47:43.755966 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3819/7631] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:43 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:44.777314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:44.777941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:44.785021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:44.785364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:44.786145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:44.786854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:44.925748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:44.933987 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4df3bb27-8b1e-4fc9-b9b4-03a96de3fa37 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.161291 Aug 03 05:47:44.934562 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3813/7632] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:44 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:45.954304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:45.954992 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:45.962695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:45.963146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:45.963908 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:45.964382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:46.093629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:46.101191 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-26e2629f-8d23-47b6-9736-61adf980bad4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.150831 Aug 03 05:47:46.101773 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3820/7633] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:45 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:46.817581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-3b335512-bef4-4871-9a53-92f14808c2ea req-b151e3cc-d2da-4f16-88ea-69722d5cbf97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "name": "network-vif-plugged", "status": "completed", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:46.827712 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3b335512-bef4-4871-9a53-92f14808c2ea req-b151e3cc-d2da-4f16-88ea-69722d5cbf97 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:46.828175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-3b335512-bef4-4871-9a53-92f14808c2ea req-b151e3cc-d2da-4f16-88ea-69722d5cbf97 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:46.839453 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-3b335512-bef4-4871-9a53-92f14808c2ea req-b151e3cc-d2da-4f16-88ea-69722d5cbf97 service nova] Creating event network-vif-plugged:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:47:46.844565 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-3b335512-bef4-4871-9a53-92f14808c2ea req-b151e3cc-d2da-4f16-88ea-69722d5cbf97 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087457 Aug 03 05:47:46.849066 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3814/7634] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:47:47.123329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:47.123856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:47.130841 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:47.131300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:47.132079 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:47.132555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:47.264704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:47.272194 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-70571edf-a91f-46a2-8ae3-6f91b8c414c3 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1357 microversion: 2.1 time: 0.152938 Aug 03 05:47:47.272817 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3821/7635] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:47 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:48.294792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:48.295466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:48.301843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.302315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.303103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.303564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.435923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:48.443538 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-46a93b7f-7873-489c-ac8a-0d053323c888 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1546 microversion: 2.1 time: 0.154225 Aug 03 05:47:48.444285 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3815/7636] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:48 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:48.464504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:48.465474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:48.472056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.472553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.473328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.473769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.610274 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:48.618193 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3951c94-85b4-4494-b651-55fa01b92457 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1546 microversion: 2.1 time: 0.157203 Aug 03 05:47:48.618767 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3822/7637] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:48 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:48.639263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:48.644141 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:48.644968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Searching by: {'deleted': False, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96'} {{(pid=120832) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 05:47:48.650602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.651063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.651873 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.652349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.676732 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.multi_cell_list [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120832) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 05:47:48.704120 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e5025dd-9178-4649-8dbc-a9fc1cd30a2e tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068589 Aug 03 05:47:48.704744 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3816/7638] 10.222.0.72 () {58 vars in 1125 bytes} [Wed Aug 3 05:47:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:47:48.716398 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:47:48.717022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:48.723351 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.723814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.724680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:48.725128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:48.854017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:47:48.861670 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1883d679-9bb9-45cc-8ab7-06c4fe4dac8f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1546 microversion: 2.1 time: 0.149434 Aug 03 05:47:48.862260 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3823/7639] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:47:48 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:47:49.215834 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:47:49.216033 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:47:51.721374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2358960f-edec-4c26-800b-80bb29c6845e"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:47:51.723764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:47:51.731251 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:51.731720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:51.732532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:47:51.732989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:47:52.493959 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5e8f8e2f-1516-4e9c-8694-9d08c30423e4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775342 Aug 03 05:47:52.494631 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3817/7640] 10.222.0.72 () {60 vars in 1323 bytes} [Wed Aug 3 05:47:51 2022] POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:48:04.312374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:04.312977 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:04.315325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:04.315982 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=72 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:04.320688 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:04.321138 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:04.321896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:04.322331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:04.456327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:04.464321 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-28a147a1-71a2-4b4d-917a-35ccd815e866 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1592 microversion: 2.1 time: 0.156472 Aug 03 05:48:04.464891 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3824/7641] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:04 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:06.690308 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-bb7f3eb1-647d-4dde-9296-34d015acb278 req-764566b4-06e4-494f-bdce-ad748c263607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:48:06.701110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:06.701843 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:06.702587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:06.705528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bb7f3eb1-647d-4dde-9296-34d015acb278 req-764566b4-06e4-494f-bdce-ad748c263607 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:06.705733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-bb7f3eb1-647d-4dde-9296-34d015acb278 req-764566b4-06e4-494f-bdce-ad748c263607 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:06.718681 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-bb7f3eb1-647d-4dde-9296-34d015acb278 req-764566b4-06e4-494f-bdce-ad748c263607 service nova] Creating event network-changed:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:48:06.724232 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-bb7f3eb1-647d-4dde-9296-34d015acb278 req-764566b4-06e4-494f-bdce-ad748c263607 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038073 Aug 03 05:48:06.725115 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3818/7642] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:48:09.330010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-520795118"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:48:09.330582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:09.338157 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:09.338678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:09.339492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:09.339964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:09.470548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Adding security group 9132870d-2048-4c9f-86f0-1f24f7edc6a6 to port 9fe4f815-00ee-4327-a729-8826618f3a92 Aug 03 05:48:09.886303 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-82cfbc83-9813-46dd-9720-b54f20173442 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action" status: 202 len: 0 microversion: 2.1 time: 0.560207 Aug 03 05:48:09.891691 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3825/7643] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:48:09 2022] POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:48:09.900756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-960ee483-e199-4583-b213-ecdbb7595ad9 req-37ecd2cf-f435-4172-95c3-b099ec277b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:48:09.905449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:09.906624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:09.921915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:09.922369 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:09.923165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:09.923382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-960ee483-e199-4583-b213-ecdbb7595ad9 req-37ecd2cf-f435-4172-95c3-b099ec277b44 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:09.923829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:09.924007 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-960ee483-e199-4583-b213-ecdbb7595ad9 req-37ecd2cf-f435-4172-95c3-b099ec277b44 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:09.941794 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-960ee483-e199-4583-b213-ecdbb7595ad9 req-37ecd2cf-f435-4172-95c3-b099ec277b44 service nova] Creating event network-changed:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:48:09.947734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-960ee483-e199-4583-b213-ecdbb7595ad9 req-37ecd2cf-f435-4172-95c3-b099ec277b44 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056833 Aug 03 05:48:09.951439 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3819/7644] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:48:10.188506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:10.197345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c44c849-5e3b-4e21-93b4-a057fd27eb3c tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1756 microversion: 2.1 time: 0.302388 Aug 03 05:48:10.198118 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3826/7645] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:09 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1756 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:23.238534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:48:23.240942 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:23.247322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:23.247794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:23.248632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:23.249755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:23.468518 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-60f49732-1212-47b2-8dd1-8c78ffbcf2cc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action" status: 202 len: 0 microversion: 2.1 time: 0.281704 Aug 03 05:48:23.469051 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3820/7646] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:48:23 2022] POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:48:23.477284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:23.480143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:23.481984 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:23.482598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:48:23.486298 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:23.486753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:23.487527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:23.487969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:23.714802 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:23.723559 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4214af6a-ef9c-4ba1-9b6b-bb6332d8950d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1748 microversion: 2.1 time: 0.250232 Aug 03 05:48:23.724085 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3827/7647] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:23 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1748 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:24.753254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:24.753983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:24.760884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:24.761359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:24.762214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:24.762674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:24.908798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:24.917300 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-08c22f1e-00d4-4b5c-b07a-dae97ad21284 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.170038 Aug 03 05:48:24.917867 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3821/7648] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:24 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:25.939791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:25.940457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:25.947502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:25.947962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:25.948787 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:25.949255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:26.095923 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:26.104047 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4256e592-cfa4-4077-a26b-54e12d3cfb83 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.168901 Aug 03 05:48:26.104766 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3828/7649] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:25 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:27.129314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:27.129851 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:27.136836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:27.137309 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:27.138081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:27.138536 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:27.280867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:27.289626 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0b200d0b-1dbe-40c4-8e8c-e10b747e52fa tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.165831 Aug 03 05:48:27.290223 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3822/7650] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:27 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:28.312495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:28.313112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:28.320036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:28.320528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:28.321300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:28.321745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:28.471403 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:28.479868 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb090c6d-8fb8-4fb8-bc6b-ed265753fa36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.171912 Aug 03 05:48:28.480627 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3829/7651] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:28 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:29.502175 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:29.502797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:29.509722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:29.510184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:29.510981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:29.511426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:29.651964 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:29.660345 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b69ac25-553a-42be-8207-9c1852943090 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.162684 Aug 03 05:48:29.660930 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3823/7652] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:29 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:30.682930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:30.683557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:30.690592 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:30.691064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:30.691848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:30.692318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:30.841083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:30.849212 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d0a0de2-99d6-4b3d-94f2-1bf44ece6ebd tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.170234 Aug 03 05:48:30.851957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3830/7653] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:30 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:31.870907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:31.871591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:31.879297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:31.879764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:31.880577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:31.881026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:32.026832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:32.036035 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2c308edb-0bf0-4907-9622-3fd67503bbb4 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.168998 Aug 03 05:48:32.036914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3824/7654] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:31 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:33.058025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:33.058554 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:33.066022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:33.066479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:33.067243 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:33.067684 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:33.210273 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:33.218195 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-06a18654-f1c4-4b6f-9147-5625848022b0 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.164217 Aug 03 05:48:33.218833 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3831/7655] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:33 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:34.241053 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:34.241685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:34.248823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:34.249294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:34.250765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:34.251271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:34.398544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:34.407370 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-89790b01-d95b-4693-ae55-c3820a66c09d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.170161 Aug 03 05:48:34.407951 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3825/7656] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:34 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:35.429152 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:35.429763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:35.436790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:35.437238 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:35.438095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:35.438531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:35.580662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:35.588742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4495c93-1bc5-4523-b332-6e31e51dd83b tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.163418 Aug 03 05:48:35.589323 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3832/7657] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:35 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:36.611154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:36.611832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:36.618734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:36.619202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:36.619976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:36.620470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:36.770988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:36.779083 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b3977dda-d20a-44f3-8679-f8fedc84350d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.171931 Aug 03 05:48:36.779655 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3826/7658] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:36 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:37.801750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:37.802362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:37.809228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:37.809685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:37.810444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:37.810878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:37.960902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:37.969091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6534ea3a-0f5a-47d9-a7d3-0ecefd119847 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.171243 Aug 03 05:48:37.969752 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3833/7659] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:37 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:38.990282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:38.990880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:38.997910 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:38.998377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:38.999156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:38.999660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:39.148202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:39.156424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1d0469bb-512c-4c46-bdf2-87148f9fd3dc tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.169952 Aug 03 05:48:39.156865 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3827/7660] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:38 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:40.178668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:40.179288 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:40.186301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:40.186757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:40.187577 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:40.188028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:40.338306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:40.347339 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51dbc1e5-33e9-40cc-88d9-59ad158ff99d tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1753 microversion: 2.1 time: 0.172605 Aug 03 05:48:40.347859 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3834/7661] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:40 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:48:41.369857 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:48:41.370490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:48:41.378189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:41.378671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:41.379455 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:48:41.379907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:48:41.521927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:48:41.530200 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-092a8e50-6f93-47e9-8ebf-390e3720816a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1756 microversion: 2.1 time: 0.164277 Aug 03 05:48:41.530781 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3828/7662] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:48:41 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:10.098997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-520795118"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:10.099623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:10.101860 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:10.102637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=48 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:10.107407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:10.107894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:10.108698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:10.109145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:10.234742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.network.security_group_api [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Removing security group 9132870d-2048-4c9f-86f0-1f24f7edc6a6 from port 9fe4f815-00ee-4327-a729-8826618f3a92 Aug 03 05:49:10.593030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-105ca6dc-d93f-4faa-a2ba-6c7f4a3df856 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action" status: 202 len: 0 microversion: 2.1 time: 0.497938 Aug 03 05:49:10.597561 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3835/7663] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:49:10 2022] POST /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:49:10.602906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8890cb77-971b-42b0-a996-771d6d5f3c25 req-d43f3f87-8193-4de4-abca-56e20c74296a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:10.609046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:10.609804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:10.624548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8890cb77-971b-42b0-a996-771d6d5f3c25 req-d43f3f87-8193-4de4-abca-56e20c74296a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:10.624811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8890cb77-971b-42b0-a996-771d6d5f3c25 req-d43f3f87-8193-4de4-abca-56e20c74296a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:10.643291 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8890cb77-971b-42b0-a996-771d6d5f3c25 req-d43f3f87-8193-4de4-abca-56e20c74296a service nova] Creating event network-changed:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:49:10.648993 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8890cb77-971b-42b0-a996-771d6d5f3c25 req-d43f3f87-8193-4de4-abca-56e20c74296a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049805 Aug 03 05:49:10.649952 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3829/7664] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:12.179442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:12.180047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:12.180626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8f498220-23fc-4d4f-ae5f-bc0bb3bdc3d0 req-a1ab157b-60c0-4d02-aefb-fa44f6d294ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:12.186041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:12.186490 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:12.187502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:12.187934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:12.193116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8f498220-23fc-4d4f-ae5f-bc0bb3bdc3d0 req-a1ab157b-60c0-4d02-aefb-fa44f6d294ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:12.193788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8f498220-23fc-4d4f-ae5f-bc0bb3bdc3d0 req-a1ab157b-60c0-4d02-aefb-fa44f6d294ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:12.205403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8f498220-23fc-4d4f-ae5f-bc0bb3bdc3d0 req-a1ab157b-60c0-4d02-aefb-fa44f6d294ac service nova] Creating event network-changed:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:49:12.211432 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8f498220-23fc-4d4f-ae5f-bc0bb3bdc3d0 req-a1ab157b-60c0-4d02-aefb-fa44f6d294ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034865 Aug 03 05:49:12.212046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3830/7665] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:12.281907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lazy-loading 'services' on Instance uuid 1a5ee261-8c8d-4677-bf02-cd9a5243b42e {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:49:12.506842 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-71bb116b-58d6-4d2d-9904-636158d20fb6 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments/2358960f-edec-4c26-800b-80bb29c6845e" status: 202 len: 0 microversion: 2.1 time: 0.333265 Aug 03 05:49:12.511819 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3836/7666] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:49:12 2022] DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments/2358960f-edec-4c26-800b-80bb29c6845e => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:49:12.523149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:12.525706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:12.532299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:12.539977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:12.539977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:12.539977 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:12.572989 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9b52bd17-2147-44f9-af43-5d396cf6dff1 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059813 Aug 03 05:49:12.577957 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3831/7667] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:12 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:13.587815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:13.590868 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:13.598607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:13.599307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:13.600295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:13.600911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:13.636028 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-385cdfce-7614-42f4-88f2-6b565baaf770 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053795 Aug 03 05:49:13.640794 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3837/7668] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:13 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:14.649227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:14.651503 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:14.660192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:14.660929 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:14.662010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:14.662474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:14.698808 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d843f582-da81-4a8a-a9f2-55cf80cb8b47 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053631 Aug 03 05:49:14.699458 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3832/7669] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:14 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:15.712213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:15.715098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:15.723251 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:15.723704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:15.724510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:15.724950 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:15.756009 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0dcfadbd-1e9a-49e2-8937-1989712c9ecf tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Aug 03 05:49:15.756831 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3838/7670] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:15 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:16.768582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:16.771464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:16.779394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:16.779394 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:16.779913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:16.780416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:16.812952 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c39c02c1-766c-4288-9a8c-b7084404e9a8 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048329 Aug 03 05:49:16.813538 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3833/7671] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:16 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:17.825405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:17.827626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:17.835628 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:17.836114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:17.836969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:17.837370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:17.868519 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c82bdc6-12b3-43e9-84a4-844496176e6f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047126 Aug 03 05:49:17.869100 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3839/7672] 10.222.0.72 () {58 vars in 1302 bytes} [Wed Aug 3 05:49:17 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 05:49:17.879860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:17.880406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:17.887273 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:17.891756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:17.891756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:17.891756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:17.964980 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] HTTP exception thrown: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e is not attached to volume 2358960f-edec-4c26-800b-80bb29c6845e Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Request method failure captured: Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: request: DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments/2358960f-edec-4c26-800b-80bb29c6845e HTTP/1.1 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6grsxya8-0QE1Q6UzcgENkR07BMxnKk4NlVh17HEclJ2r0YFTyh8c_M0peX_rH2i9GoDzjvND36-P31oBY8ovZM8JXgZzZAeHzjGWmLaYJCuoXodjqowQbiNqLEKf1fk_vRlY6svEfMz4HwUjW3JB-t4rdhxvcJbfCRa6q94yYeHV70 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 65320edfff424b909b52bf8eb3f85396 Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e is not attached to volume 2358960f-edec-4c26-800b-80bb29c6845e Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'server_id': '1a5ee261-8c8d-4677-bf02-cd9a5243b42e', 'id': '2358960f-edec-4c26-800b-80bb29c6845e'} Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2358960f-edec-4c26-800b-80bb29c6845e. Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e is not attached to volume 2358960f-edec-4c26-800b-80bb29c6845e Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:49:17.966650 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e is not attached to volume 2358960f-edec-4c26-800b-80bb29c6845e Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Returning 404 to user: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e is not attached to volume 2358960f-edec-4c26-800b-80bb29c6845e {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-95b0e7b6-32c1-49cb-9156-5f6f0330a281 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments/2358960f-edec-4c26-800b-80bb29c6845e" status: 404 len: 154 microversion: 2.1 time: 0.092709 Aug 03 05:49:17.971194 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3834/7673] 10.222.0.72 () {58 vars in 1416 bytes} [Wed Aug 3 05:49:17 2022] DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e/os-volume_attachments/2358960f-edec-4c26-800b-80bb29c6845e => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:49:21.366993 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:21.367565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:21.374866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:21.375323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:21.376148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:21.376660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:21.405932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:49:21.743798 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6eb3a73d-93e1-4ac8-a141-03a36f358f36 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 204 len: 0 microversion: 2.1 time: 0.380810 Aug 03 05:49:21.744551 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3840/7674] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:49:21 2022] DELETE /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:49:21.760465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:21.760465 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:21.763785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:21.764388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:21.765406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:21.765866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:21.904810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:21.914080 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-16e2502f-528e-43fd-b822-0ad57d10063a tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1552 microversion: 2.1 time: 0.164929 Aug 03 05:49:21.914661 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3835/7675] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:21 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:22.937093 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:22.937785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:22.945216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:22.945668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:22.946428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:22.946861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:23.082595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:23.090564 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1cf70a47-5df2-4dc4-8beb-a13a5f9e256f tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1552 microversion: 2.1 time: 0.157712 Aug 03 05:49:23.091241 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3841/7676] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:22 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:23.963177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-af76b63a-12b8-426e-bd1b-ba9cbf6934d1 req-532baa00-8658-41d9-bae5-ab49da7afeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5ee261-8c8d-4677-bf02-cd9a5243b42e", "name": "network-vif-deleted", "tag": "9fe4f815-00ee-4327-a729-8826618f3a92"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:23.973136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-af76b63a-12b8-426e-bd1b-ba9cbf6934d1 req-532baa00-8658-41d9-bae5-ab49da7afeda service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:23.973596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-af76b63a-12b8-426e-bd1b-ba9cbf6934d1 req-532baa00-8658-41d9-bae5-ab49da7afeda service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:23.984540 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-af76b63a-12b8-426e-bd1b-ba9cbf6934d1 req-532baa00-8658-41d9-bae5-ab49da7afeda service nova] Creating event network-vif-deleted:9fe4f815-00ee-4327-a729-8826618f3a92 for instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e on n-h1-826756-5 Aug 03 05:49:23.991968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-af76b63a-12b8-426e-bd1b-ba9cbf6934d1 req-532baa00-8658-41d9-bae5-ab49da7afeda service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032600 Aug 03 05:49:23.992607 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3836/7677] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:24.114579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:24.115185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:24.123185 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:24.123654 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:24.124543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:24.124990 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:24.193891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65320edfff424b909b52bf8eb3f85396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd96f47f8c8a7444c962fff649dfaef96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:24.202748 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07259cc1-fad6-45a2-8e8e-3080d9664443 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 200 len: 1342 microversion: 2.1 time: 0.094084 Aug 03 05:49:24.204834 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3842/7678] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:24 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 1342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:25.226104 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:25.226829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] [instance: 1a5ee261-8c8d-4677-bf02-cd9a5243b42e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:25.233165 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:25.233636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:25.234425 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:25.234893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:25.248981 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] HTTP exception thrown: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Request method failure captured: Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e HTTP/1.1 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6grsxya8-0QE1Q6UzcgENkR07BMxnKk4NlVh17HEclJ2r0YFTyh8c_M0peX_rH2i9GoDzjvND36-P31oBY8ovZM8JXgZzZAeHzjGWmLaYJCuoXodjqowQbiNqLEKf1fk_vRlY6svEfMz4HwUjW3JB-t4rdhxvcJbfCRa6q94yYeHV70 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/d96f47f8c8a7444c962fff649dfaef96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: d96f47f8c8a7444c962fff649dfaef96 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestMinimumBasicScenario-272779 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: 65320edfff424b909b52bf8eb3f85396 Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestMinimumBasicScenario-272779-project Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': '1a5ee261-8c8d-4677-bf02-cd9a5243b42e'} Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:49:25.250615 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Returning 404 to user: Instance 1a5ee261-8c8d-4677-bf02-cd9a5243b42e could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-915118da-896f-4f74-b759-1a12c587bc93 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e" status: 404 len: 111 microversion: 2.1 time: 0.031575 Aug 03 05:49:25.255976 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3837/7679] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:25 2022] GET /compute/v2.1/servers/1a5ee261-8c8d-4677-bf02-cd9a5243b42e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:49:25.261766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fc353da6-fabc-49de-aa6a-e25508abd818 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] Calling method '.version_select at 0x7fdd5479df70>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:25.336241 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fc353da6-fabc-49de-aa6a-e25508abd818 tempest-TestMinimumBasicScenario-272779 tempest-TestMinimumBasicScenario-272779-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-269532443" status: 202 len: 0 microversion: 2.1 time: 0.078252 Aug 03 05:49:25.336850 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3843/7680] 10.222.0.72 () {58 vars in 1269 bytes} [Wed Aug 3 05:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-269532443 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:49:37.336906 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:37.337673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=38 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:37.503154 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b262503e-a833-4bdd-b479-ee8787203c41 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: .version_select at 0x7fdd47432160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1298069748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMV+r+bmcgbbMdZOh6tJndkn1HHYh4gVohlV9110m/lr2zWpudSqlsREpDemMk8P6eewWTOCA7VcEFNDL2NFihyJ0jpxVf3JBON4HeDRiw6A+S6bRwwHrtup+NpKFFR+Q=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:37.519730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b262503e-a833-4bdd-b479-ee8787203c41 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:49:37.524931 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-b262503e-a833-4bdd-b479-ee8787203c41 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:49:37.624759 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b262503e-a833-4bdd-b479-ee8787203c41 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.293905 Aug 03 05:49:37.625363 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3838/7681] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:49:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:46.426071 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:46.426972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:46.430870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1556216284", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "8d076300-a2d5-4b4c-b08f-a87015a800d5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1298069748", "security_groups": [{"name": "tempest-secgroup-smoke-1739709695"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:46.564966 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] validate_networks() for [('8d076300-a2d5-4b4c-b08f-a87015a800d5', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:49:47.060001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:49:47.060656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:49:47.061228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:49:47.061748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:49:47.062263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:49:47.072521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:47.073097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:47.074160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:47.074721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:47.095092 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:49:47.100875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:49:47.114063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:49:47.116462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:49:47.248352 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6be5ecba-21fc-4663-8450-2596360b8538 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.824261 Aug 03 05:49:47.249026 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3844/7682] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:49:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:49:47.262478 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1a127bb-648b-4fe2-ab6f-dd238d263ca9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:47.263271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1a127bb-648b-4fe2-ab6f-dd238d263ca9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:47.327296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1a127bb-648b-4fe2-ab6f-dd238d263ca9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:47.335262 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1a127bb-648b-4fe2-ab6f-dd238d263ca9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1267 microversion: 2.1 time: 0.077772 Aug 03 05:49:47.335847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3839/7683] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:47 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:48.357027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a24caf5e-29cb-44c2-ab9f-65f178e7ba8f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:48.357659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a24caf5e-29cb-44c2-ab9f-65f178e7ba8f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:48.415940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a24caf5e-29cb-44c2-ab9f-65f178e7ba8f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:48.423112 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a24caf5e-29cb-44c2-ab9f-65f178e7ba8f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1267 microversion: 2.1 time: 0.070024 Aug 03 05:49:48.424721 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3845/7684] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:48 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1267 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:49.444024 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:49.444694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:49.452670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:49.453134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:49.453915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:49.454362 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:49.520471 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:49.528055 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9cca0c6a-f709-4b4a-b195-2aacedd32506 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1319 microversion: 2.1 time: 0.087981 Aug 03 05:49:49.528659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3840/7685] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:49 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:50.558350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:50.559006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:50.567672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:50.568132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:50.568965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:50.569482 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:50.833027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:50.843337 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b39223d9-e5fb-48b8-9032-3e19c7819a71 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.289101 Aug 03 05:49:50.846929 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3846/7686] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:50 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:49:51.343348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-67839625-2802-4c83-9002-a86e01f1a6e0 req-0a38e7bb-fae0-4276-a1b5-2a1231217930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad1afa5-5cbf-4708-a655-999cfec0f5ae", "tag": "a5db208d-e557-40da-ac13-d88ada653fa1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:51.353575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-67839625-2802-4c83-9002-a86e01f1a6e0 req-0a38e7bb-fae0-4276-a1b5-2a1231217930 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:51.354036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-67839625-2802-4c83-9002-a86e01f1a6e0 req-0a38e7bb-fae0-4276-a1b5-2a1231217930 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:51.365902 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-67839625-2802-4c83-9002-a86e01f1a6e0 req-0a38e7bb-fae0-4276-a1b5-2a1231217930 service nova] Creating event network-changed:a5db208d-e557-40da-ac13-d88ada653fa1 for instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae on n-h1-826756-5 Aug 03 05:49:51.370757 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-67839625-2802-4c83-9002-a86e01f1a6e0 req-0a38e7bb-fae0-4276-a1b5-2a1231217930 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Aug 03 05:49:51.371368 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3841/7687] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:51.866722 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:51.867341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:51.874209 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:51.874664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:51.875436 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:51.875875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:52.064880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:52.072240 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91b7714a-6591-4e48-8d99-65021275bc43 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.209430 Aug 03 05:49:52.072837 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3847/7688] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:51 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:53.094524 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:53.095171 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:53.102180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:53.102645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:53.103421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:53.103884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:53.235968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:53.243478 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a1893a44-15f3-4ae1-b372-318e30e21051 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.154239 Aug 03 05:49:53.244041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3842/7689] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:53 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:54.264485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:54.265001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:54.272718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:54.273176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:54.273942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:54.274393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:54.423621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:54.431789 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-77055482-f47b-4f69-8afd-da4a6caa7376 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.171302 Aug 03 05:49:54.432413 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3848/7690] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:54 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:55.452543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:55.453223 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:55.461665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:55.462139 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:55.462928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:55.463385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:55.601733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:55.611546 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a89da72-d028-4224-88ba-bc6fd848d6e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.162911 Aug 03 05:49:55.612076 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3843/7691] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:55 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:56.632094 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:56.632656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:56.639598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:56.640055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:56.640847 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:56.641292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:56.777906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:56.785730 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2356bd45-3477-4425-a81a-ff5cde034268 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.157790 Aug 03 05:49:56.786345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3849/7692] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:56 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:57.459590 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7839f436-70fb-4e0e-91e9-f85551939686 req-e80d572f-87d4-4543-b180-cfb4ba1bec32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad1afa5-5cbf-4708-a655-999cfec0f5ae", "name": "network-vif-plugged", "status": "completed", "tag": "a5db208d-e557-40da-ac13-d88ada653fa1"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:49:57.465647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:57.470959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7839f436-70fb-4e0e-91e9-f85551939686 req-e80d572f-87d4-4543-b180-cfb4ba1bec32 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:57.471418 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7839f436-70fb-4e0e-91e9-f85551939686 req-e80d572f-87d4-4543-b180-cfb4ba1bec32 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:57.487941 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7839f436-70fb-4e0e-91e9-f85551939686 req-e80d572f-87d4-4543-b180-cfb4ba1bec32 service nova] Creating event network-vif-plugged:a5db208d-e557-40da-ac13-d88ada653fa1 for instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae on n-h1-826756-5 Aug 03 05:49:57.488199 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7839f436-70fb-4e0e-91e9-f85551939686 req-e80d572f-87d4-4543-b180-cfb4ba1bec32 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Aug 03 05:49:57.489073 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3844/7693] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:49:57.806434 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:57.807051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:57.809006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:57.815762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:57.817181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:57.819328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:57.820179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:57.953900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:57.962167 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0709d470-1685-4968-8d32-7098757e6d22 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1393 microversion: 2.1 time: 0.159802 Aug 03 05:49:57.962764 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3850/7694] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:57 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:58.984464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:58.985185 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:58.993107 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:58.993577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:58.994582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:58.995041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:59.131850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:59.139479 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-61a80e49-b57a-41d3-b922-f4a948733c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1565 microversion: 2.1 time: 0.160106 Aug 03 05:49:59.140046 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3845/7695] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:58 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:49:59.160158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:49:59.160838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:49:59.163649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:49:59.169472 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:59.169930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:59.170701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:49:59.171143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:49:59.300703 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:49:59.308295 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9484f605-83a4-4093-8807-c61edf1d13b7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1565 microversion: 2.1 time: 0.152063 Aug 03 05:49:59.308903 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3851/7696] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:49:59 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:01.228377 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:01.229022 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:01.234119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-f9f88b01-8109-42f7-82e2-0a65a19027a9 req-70c7d097-21b3-4a4c-9714-2c0324aa1efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad1afa5-5cbf-4708-a655-999cfec0f5ae", "tag": "a5db208d-e557-40da-ac13-d88ada653fa1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:01.244070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:01.244569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:01.245365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:01.245835 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:01.249257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9f88b01-8109-42f7-82e2-0a65a19027a9 req-70c7d097-21b3-4a4c-9714-2c0324aa1efd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:01.249714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-f9f88b01-8109-42f7-82e2-0a65a19027a9 req-70c7d097-21b3-4a4c-9714-2c0324aa1efd service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:01.261615 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-f9f88b01-8109-42f7-82e2-0a65a19027a9 req-70c7d097-21b3-4a4c-9714-2c0324aa1efd service nova] Creating event network-changed:a5db208d-e557-40da-ac13-d88ada653fa1 for instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae on n-h1-826756-5 Aug 03 05:50:01.266838 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-f9f88b01-8109-42f7-82e2-0a65a19027a9 req-70c7d097-21b3-4a4c-9714-2c0324aa1efd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036374 Aug 03 05:50:01.267870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3852/7697] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:50:01.841056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:01.851639 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b590bff-9a81-4cec-87ac-2572d3d277b4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1565 microversion: 2.1 time: 0.625478 Aug 03 05:50:01.851639 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3846/7698] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:01 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1565 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:23.160770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:23.163365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:23.166492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:23.167263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=40 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:23.172228 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:23.172721 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:23.173492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:23.173940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:23.229949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b59e33d5-f752-4ce0-b400-0d189d9ea844 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action" status: 200 len: 24569 microversion: 2.1 time: 0.073397 Aug 03 05:50:23.230612 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3853/7699] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:50:23 2022] POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:50:34.267179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:34.267827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:34.269869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:34.270554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:34.275416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:34.275880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:34.276755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:34.277208 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:34.482125 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-467f63fd-2403-4f32-a5ef-ac2dc9babbde tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.219697 Aug 03 05:50:34.482779 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3847/7700] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:50:34 2022] POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:50:34.493171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:34.493885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:34.502266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:34.505777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:34.505777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:34.505777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:34.643669 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:34.651299 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5cdf418-e3e9-4293-84a0-ccfade0c9dad tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1689 microversion: 2.1 time: 0.163336 Aug 03 05:50:34.651870 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3854/7701] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:34 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:35.674517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:35.675232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:35.681496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:35.681996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:35.682755 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:35.683198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:35.822081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:35.830361 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-215e188f-5286-49c9-9978-b6015fdc1b9a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1669 microversion: 2.1 time: 0.161052 Aug 03 05:50:35.831088 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3848/7702] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:35 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:36.924052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:36.926295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:36.935031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:36.935495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:36.936516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:36.937164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:36.986565 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6548ebb8-2e8e-4798-bea2-2a1b47834dbc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action" status: 200 len: 32638 microversion: 2.1 time: 0.067340 Aug 03 05:50:36.987410 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3855/7703] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:50:36 2022] POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:50:36.998610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:36.999513 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:37.006736 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:37.007205 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:37.007988 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:37.008491 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:37.259216 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e0114ee4-1a4d-4a87-92f6-60e6efe32236 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.264238 Aug 03 05:50:37.259784 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3849/7704] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:50:36 2022] POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:50:37.269173 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:37.271311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:37.277060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:37.277512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:37.278279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:37.278717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:37.419620 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:37.427282 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0ec8cdae-f7f0-4a29-af6e-bcbe7469aec4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1676 microversion: 2.1 time: 0.163042 Aug 03 05:50:37.427855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3856/7705] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:37 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:38.449435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:38.450156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:38.457433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:38.457904 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:38.458671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:38.459150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:38.591480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:38.599543 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a490aebd-f0ed-414a-8095-d9fbe65620af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1684 microversion: 2.1 time: 0.154356 Aug 03 05:50:38.600116 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3850/7706] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:38 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:38.697568 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:38.701166 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:38.710104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:38.710508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:38.711291 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:38.711736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:38.760948 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d33f7c50-6021-4b03-8f9e-9bfbf6796827 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action" status: 200 len: 38390 microversion: 2.1 time: 0.067143 Aug 03 05:50:38.761641 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3857/7707] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:50:38 2022] POST /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae/action => generated 38390 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:50:39.875086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c475bd56-c9c6-486c-9a1d-be429947a48a req-78ac64f5-1d50-4ce7-9719-0894d7bb9e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad1afa5-5cbf-4708-a655-999cfec0f5ae", "tag": "a5db208d-e557-40da-ac13-d88ada653fa1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:39.875722 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:39.876432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:39.883836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:39.884454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:39.885379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:39.885616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c475bd56-c9c6-486c-9a1d-be429947a48a req-78ac64f5-1d50-4ce7-9719-0894d7bb9e16 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:39.885963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:39.886084 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c475bd56-c9c6-486c-9a1d-be429947a48a req-78ac64f5-1d50-4ce7-9719-0894d7bb9e16 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:39.897471 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c475bd56-c9c6-486c-9a1d-be429947a48a req-78ac64f5-1d50-4ce7-9719-0894d7bb9e16 service nova] Creating event network-changed:a5db208d-e557-40da-ac13-d88ada653fa1 for instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae on n-h1-826756-5 Aug 03 05:50:39.903515 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c475bd56-c9c6-486c-9a1d-be429947a48a req-78ac64f5-1d50-4ce7-9719-0894d7bb9e16 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031357 Aug 03 05:50:39.903515 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3858/7708] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:50:39.917760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:50:40.225514 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-24d368d1-252e-418a-9da7-1a95c3876640 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 204 len: 0 microversion: 2.1 time: 0.356858 Aug 03 05:50:40.226455 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3851/7709] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:50:39 2022] DELETE /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:50:40.235478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:40.236184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:40.242441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:40.242891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:40.243659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:40.244099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:40.378445 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:40.386197 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-672b71f8-ebed-4ec1-85f2-227202633881 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1690 microversion: 2.1 time: 0.155439 Aug 03 05:50:40.386775 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3859/7710] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:40 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:50:41.412123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:41.412872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:41.419649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:41.420124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:41.420917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:41.422294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:41.614769 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:41.622544 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c10ce166-86c6-4b74-9a7f-45237fc4bafb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1690 microversion: 2.1 time: 0.215017 Aug 03 05:50:41.623126 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3852/7711] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:41 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:42.257584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fafee87b-e215-4eb2-8c0d-ae66679e9da7 req-151022e0-310d-4e83-9a1f-18065623e5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad1afa5-5cbf-4708-a655-999cfec0f5ae", "name": "network-vif-deleted", "tag": "a5db208d-e557-40da-ac13-d88ada653fa1"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:42.268011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fafee87b-e215-4eb2-8c0d-ae66679e9da7 req-151022e0-310d-4e83-9a1f-18065623e5c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:42.268498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fafee87b-e215-4eb2-8c0d-ae66679e9da7 req-151022e0-310d-4e83-9a1f-18065623e5c3 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:42.279679 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fafee87b-e215-4eb2-8c0d-ae66679e9da7 req-151022e0-310d-4e83-9a1f-18065623e5c3 service nova] Creating event network-vif-deleted:a5db208d-e557-40da-ac13-d88ada653fa1 for instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae on n-h1-826756-5 Aug 03 05:50:42.285417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fafee87b-e215-4eb2-8c0d-ae66679e9da7 req-151022e0-310d-4e83-9a1f-18065623e5c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031453 Aug 03 05:50:42.286094 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3860/7712] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:50:42.643591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:42.644229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:42.651540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:42.655723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:42.655723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:42.655723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:42.686254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:42.686744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:42.687203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lazy-loading 'fault' on Instance uuid 7ad1afa5-5cbf-4708-a655-999cfec0f5ae {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:50:42.730416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:42.738247 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ae671496-e46f-4ff1-815a-1ed66f721bc2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 200 len: 1357 microversion: 2.1 time: 0.099120 Aug 03 05:50:42.738853 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3853/7713] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:42 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:43.761107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:43.762012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 7ad1afa5-5cbf-4708-a655-999cfec0f5ae] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:43.769121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:43.769579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:43.770354 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:43.770799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:43.784599 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] HTTP exception thrown: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Request method failure captured: Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae HTTP/1.1 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gxw5zoSymrFpkXLxP9cN_AyEqVu62RKrj6BTZ0krVlfQpAfRy1ZY0lGKDIgkewEpB3qvBExLHzAj8czNxhMvF6j-Y0SqPxilNgohWjsc6ifCP3SKyD46S8KZXvk376VGvkLblURnbjrzIKZAMoF1Y83S7fZmAGlYv83KNViEYlCd1A Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/892f1ae57800448380d28eed911b30a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f0d17c9906b04e41a48c7bf59a80683f Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '7ad1afa5-5cbf-4708-a655-999cfec0f5ae'} Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:50:43.786410 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Returning 404 to user: Instance 7ad1afa5-5cbf-4708-a655-999cfec0f5ae could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc2e436a-5176-4d96-9058-8620a18aa25e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae" status: 404 len: 111 microversion: 2.1 time: 0.032406 Aug 03 05:50:43.791107 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3861/7714] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:43 2022] GET /compute/v2.1/servers/7ad1afa5-5cbf-4708-a655-999cfec0f5ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:50:47.601883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65e82135-fe2a-4f5a-bdda-7d906e5f3427 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '.version_select at 0x7fdd4753a160>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:47.712684 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65e82135-fe2a-4f5a-bdda-7d906e5f3427 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298069748" status: 202 len: 0 microversion: 2.1 time: 0.114769 Aug 03 05:50:47.714091 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3854/7715] 10.222.0.72 () {58 vars in 1284 bytes} [Wed Aug 3 05:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298069748 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:50:47.740697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3a1b3031-2513-4ddd-b906-d8bc7868ca73 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: .version_select at 0x7fdd47c081f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-172612088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRd/UrizI1+bP25dwqBSxEN2UoXnV/UfWr23dO32IN7kttn/W2jDa6ppVxI01ryuyj8DOeP/oXKXsSJTKurtYwpWBZaPJM+u6auWOWPGMSNP80Lkib1AZhlRdJYlsu+kQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:47.761213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3a1b3031-2513-4ddd-b906-d8bc7868ca73 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:50:47.766517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-3a1b3031-2513-4ddd-b906-d8bc7868ca73 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:50:47.878770 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3a1b3031-2513-4ddd-b906-d8bc7868ca73 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.142319 Aug 03 05:50:47.879396 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3862/7716] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:50:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:50:56.213772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:56.217941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1162412757", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "34af1314-f7f7-4843-8542-75624610d2da"}], "key_name": "tempest-TestNetworkAdvancedServerOps-172612088", "security_groups": [{"name": "tempest-secgroup-smoke-84059393"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:50:56.474062 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] validate_networks() for [('34af1314-f7f7-4843-8542-75624610d2da', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:50:56.872094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:50:56.872558 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:50:56.873046 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:50:56.873468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:50:56.874064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:50:56.884961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:56.885426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:56.886636 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:56.887088 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:56.908972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:50:56.914891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:50:56.927789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:50:56.930381 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:50:57.055734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7c218079-d881-4b10-be65-32170a85cf2f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.843734 Aug 03 05:50:57.062597 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3855/7717] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:50:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:50:57.069271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-37be20fe-7757-4094-874c-daf7648821de tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:57.076516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-37be20fe-7757-4094-874c-daf7648821de tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:57.076516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=36 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:50:57.187012 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-37be20fe-7757-4094-874c-daf7648821de tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:57.195529 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-37be20fe-7757-4094-874c-daf7648821de tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1266 microversion: 2.1 time: 0.131468 Aug 03 05:50:57.196212 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3863/7718] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:57 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:58.218748 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:58.219619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:58.226900 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:58.227379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:58.228193 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:58.228759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:58.314177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:58.323001 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ca74f51a-0833-41b5-9092-baa8852a6ffa tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1270 microversion: 2.1 time: 0.108960 Aug 03 05:50:58.323694 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3856/7719] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:58 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:50:59.345257 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:50:59.346621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:50:59.354428 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:59.354884 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:59.355660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:50:59.356098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:50:59.448202 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:50:59.456986 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e30cd691-2247-441d-8886-e790751055b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1326 microversion: 2.1 time: 0.116513 Aug 03 05:50:59.457624 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3864/7720] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:50:59 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:00.479344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:00.480764 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:00.488934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:00.489410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:00.490249 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:00.491339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:00.709463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:00.717756 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1461ae1b-82ec-470c-bb3a-731794a20a70 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.242586 Aug 03 05:51:00.718346 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3857/7721] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:00 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:01.136723 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-0b5d1007-d5a3-4f7b-bfca-8edd5e4d7716 req-82e1efcc-64cd-48a3-8cbb-9e2d3c3e82ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b185ec14-1429-4658-8162-7c89f0c82a44", "tag": "02084775-b7c5-4bce-abbc-3c496f8ab152"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:51:01.147121 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0b5d1007-d5a3-4f7b-bfca-8edd5e4d7716 req-82e1efcc-64cd-48a3-8cbb-9e2d3c3e82ab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:01.147571 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-0b5d1007-d5a3-4f7b-bfca-8edd5e4d7716 req-82e1efcc-64cd-48a3-8cbb-9e2d3c3e82ab service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:01.159723 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-0b5d1007-d5a3-4f7b-bfca-8edd5e4d7716 req-82e1efcc-64cd-48a3-8cbb-9e2d3c3e82ab service nova] Creating event network-changed:02084775-b7c5-4bce-abbc-3c496f8ab152 for instance b185ec14-1429-4658-8162-7c89f0c82a44 on n-h1-826756-5 Aug 03 05:51:01.165114 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-0b5d1007-d5a3-4f7b-bfca-8edd5e4d7716 req-82e1efcc-64cd-48a3-8cbb-9e2d3c3e82ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032071 Aug 03 05:51:01.165797 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3865/7722] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:51:01.739711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:01.740470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:01.747724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:01.748196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:01.749081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:01.749530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:02.074380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:02.083120 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4bb1592-c656-44af-9046-81783084e223 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.347819 Aug 03 05:51:02.084404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3858/7723] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:01 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:03.106261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:03.106867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:03.113690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:03.114140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:03.114905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:03.115341 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:03.258958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:03.266630 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8724885a-dfe3-4cc5-89ef-406e8aa22c23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.165761 Aug 03 05:51:03.267348 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3866/7724] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:03 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:04.287574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:04.288203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:04.295155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:04.295621 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:04.296442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:04.296897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:04.428826 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:04.436459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e460a28c-5bfe-42ff-a96f-f86737b832af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.153041 Aug 03 05:51:04.437038 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3859/7725] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:04 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:05.458712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:05.459334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:05.462129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:05.466956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:05.467418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:05.468192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:05.468663 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:05.602919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:05.610762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-59f7c2fc-547c-4c99-9eb3-bc0355cf54ef tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.156782 Aug 03 05:51:05.611353 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3867/7726] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:05 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:06.632247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:06.632903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:06.635662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:06.640644 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:06.641058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:06.641901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:06.642440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:06.785063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:06.793297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f4e3788b-f5f1-4c86-9a56-1d785274ecd5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.165036 Aug 03 05:51:06.793871 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3860/7727] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:06 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:07.811794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:07.821279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-36634f93-55f3-4a31-a33d-e18f20aa616c req-051c14c2-cbcc-4b8c-9b01-55e46a717f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b185ec14-1429-4658-8162-7c89f0c82a44", "name": "network-vif-plugged", "status": "completed", "tag": "02084775-b7c5-4bce-abbc-3c496f8ab152"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:51:07.828610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:07.829274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:07.830969 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-36634f93-55f3-4a31-a33d-e18f20aa616c req-051c14c2-cbcc-4b8c-9b01-55e46a717f46 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:07.831522 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-36634f93-55f3-4a31-a33d-e18f20aa616c req-051c14c2-cbcc-4b8c-9b01-55e46a717f46 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:07.832224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:07.832980 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:07.838730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:07.839241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:07.840103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:07.840583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:07.842832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-36634f93-55f3-4a31-a33d-e18f20aa616c req-051c14c2-cbcc-4b8c-9b01-55e46a717f46 service nova] Creating event network-vif-plugged:02084775-b7c5-4bce-abbc-3c496f8ab152 for instance b185ec14-1429-4658-8162-7c89f0c82a44 on n-h1-826756-5 Aug 03 05:51:07.849335 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-36634f93-55f3-4a31-a33d-e18f20aa616c req-051c14c2-cbcc-4b8c-9b01-55e46a717f46 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040778 Aug 03 05:51:07.850324 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3868/7728] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:51:08.040841 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:08.049229 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8a1b8ad5-4bf5-44eb-b263-c6935b25e6a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.228332 Aug 03 05:51:08.049905 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3861/7729] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:07 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:09.072132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:09.072781 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:09.081399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:09.081916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:09.082864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:09.083631 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:09.223163 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:09.230992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6f8d42a3-589a-457a-a7fa-daaeb59014e3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1390 microversion: 2.1 time: 0.163598 Aug 03 05:51:09.231576 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3869/7730] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:09 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:51:10.252887 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:10.253526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:10.260614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:10.261066 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:10.261846 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:10.262300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:10.391031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:10.398606 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-40dfd956-da85-49c1-93c2-094d19d632ae tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1563 microversion: 2.1 time: 0.150549 Aug 03 05:51:10.399184 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3862/7731] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:10 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:10.419520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:10.420137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:10.427819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:10.428300 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:10.429098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:10.429541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:10.566136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:10.573702 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-aceee40e-054f-4f86-b4fa-7f9bc45a7d8e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1563 microversion: 2.1 time: 0.158071 Aug 03 05:51:10.574305 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3870/7732] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:10 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:12.452240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:12.453510 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:12.454552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-9610e15d-4664-487f-945b-009bd4c4a682 req-13c98a55-ff7b-444c-aa90-8bc60e82f851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b185ec14-1429-4658-8162-7c89f0c82a44", "tag": "02084775-b7c5-4bce-abbc-3c496f8ab152"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:51:12.460855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:12.461388 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:12.462441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:12.463167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:12.465190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9610e15d-4664-487f-945b-009bd4c4a682 req-13c98a55-ff7b-444c-aa90-8bc60e82f851 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:12.465880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-9610e15d-4664-487f-945b-009bd4c4a682 req-13c98a55-ff7b-444c-aa90-8bc60e82f851 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:12.478217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-9610e15d-4664-487f-945b-009bd4c4a682 req-13c98a55-ff7b-444c-aa90-8bc60e82f851 service nova] Creating event network-changed:02084775-b7c5-4bce-abbc-3c496f8ab152 for instance b185ec14-1429-4658-8162-7c89f0c82a44 on n-h1-826756-5 Aug 03 05:51:12.483739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-9610e15d-4664-487f-945b-009bd4c4a682 req-13c98a55-ff7b-444c-aa90-8bc60e82f851 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033205 Aug 03 05:51:12.484731 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3871/7733] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:51:12.694358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:12.702986 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9c1f150d-16c4-4587-bd1b-df37960b0100 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1563 microversion: 2.1 time: 0.254768 Aug 03 05:51:12.709659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3863/7734] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:12 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1563 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:33.945985 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=9 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:33.946753 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=36 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:33.950946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:51:33.953290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:33.959896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:33.960710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:33.961487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:33.961938 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:34.014083 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-75e42601-d8f2-44a2-bd31-bad137b523f4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action" status: 200 len: 24572 microversion: 2.1 time: 0.070122 Aug 03 05:51:34.014907 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3872/7735] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:51:33 2022] POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action => generated 24572 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:51:45.114132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:51:45.116570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:45.118747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=7 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:45.119417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=50 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:45.124288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:45.124758 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:45.125551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:45.125983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:45.355333 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3444c807-219a-4e34-ae12-a2607c9c55c8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action" status: 202 len: 0 microversion: 2.1 time: 0.245282 Aug 03 05:51:45.356016 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3864/7736] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:51:45 2022] POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:51:45.364843 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:45.365457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:45.369042 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:51:45.374637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:45.375102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:45.375875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:45.376360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:45.525067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:45.532853 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4464303c-1685-4b61-8ec7-6d82959a6730 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1674 microversion: 2.1 time: 0.172396 Aug 03 05:51:45.533427 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3873/7737] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:45 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:46.557589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:46.558310 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:46.564680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:46.565186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:46.565970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:46.566433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:46.704441 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:46.712074 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-30465b5d-e8fc-48d0-b793-dc593571fe2a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.160723 Aug 03 05:51:46.712674 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3865/7738] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:46 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:47.734842 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:47.735460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:47.742883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:47.743337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:47.744102 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:47.744575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:47.875711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:47.884091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-97303b7c-c22c-4989-ba5d-b2bd723a0c9d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.153258 Aug 03 05:51:47.884704 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3874/7739] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:47 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:48.905856 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:48.906492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:48.914562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:48.915052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:48.915850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:48.916350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:49.052322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:49.060097 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1db5cf37-787e-46c9-a810-f8485cfe7d15 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.158178 Aug 03 05:51:49.060719 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3866/7740] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:48 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:50.081279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:50.081896 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:50.089382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:50.089830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:50.090591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:50.091022 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:50.226678 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:50.234342 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d6508f05-3ba4-4f2d-9b04-f7804306f0a6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.156986 Aug 03 05:51:50.234912 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3875/7741] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:50 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:51.257517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:51.258282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:51.264683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:51.265253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:51.266124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:51.266660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:51.407337 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:51.416164 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8dc825f1-23f8-45aa-ad2b-46347bf73d13 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.163714 Aug 03 05:51:51.416891 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3867/7742] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:51 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:52.438658 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:52.439306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:52.447053 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:52.447505 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:52.448285 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:52.448733 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:52.583096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:52.590812 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-466b10b1-a517-4fe1-8003-79d92cf3954f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.156078 Aug 03 05:51:52.591396 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3876/7743] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:52 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:51:53.612408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:53.613021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:53.619754 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:53.620245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:53.621048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:53.621500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:53.754184 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:53.761904 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8cc8f2de-4f0f-488e-918b-1286e1866b5f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.153470 Aug 03 05:51:53.762476 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3868/7744] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:53 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:54.783337 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:54.783954 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:54.791768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:54.792222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:54.793038 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:54.793477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:54.930613 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:54.938154 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-89d59801-9108-47db-87d8-93ebabef8a65 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.158740 Aug 03 05:51:54.938744 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3877/7745] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:54 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:55.959048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:55.959749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:55.967009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:55.967484 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:55.968288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:55.968773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:56.103946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:56.111529 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cd633926-3aa1-413f-ae29-57c481779256 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.156588 Aug 03 05:51:56.112110 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3869/7746] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:55 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:57.132936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:57.133594 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:57.140864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:57.141325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:57.142095 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:57.142542 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:57.275357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:57.282973 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-fb459aa3-688b-4d20-ad55-caddc90051af tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.154341 Aug 03 05:51:57.283537 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3878/7747] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:57 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:58.304490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:58.305146 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:58.312120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:58.312676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:58.313497 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:58.313954 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:58.459885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:58.467745 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3577a36-2a73-4b86-ac0e-d8aaeb3d558e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.167214 Aug 03 05:51:58.468593 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3870/7748] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:58 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:51:59.490821 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:51:59.491481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:51:59.498438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:59.498886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:59.499647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:51:59.500087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:51:59.630420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:51:59.638517 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f22d965d-ee54-4603-bd6d-1c1d96948c51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.151746 Aug 03 05:51:59.639094 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3879/7749] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:51:59 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:00.660801 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:00.661431 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:00.670866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:00.671336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:00.672128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:00.672623 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:00.807295 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:00.815010 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d0653bbe-c489-4c42-9aa0-d86c198ebe00 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.158122 Aug 03 05:52:00.815592 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3871/7750] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:00 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:01.836582 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:01.837197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:01.843952 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:01.844442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:01.845210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:01.845649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:01.978870 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:01.986675 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2e2832c7-ef51-41de-a434-2491dc5d249d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1679 microversion: 2.1 time: 0.154145 Aug 03 05:52:01.987251 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3880/7751] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:01 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:03.009152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:03.009702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:03.016643 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:03.017112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:03.017894 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:03.018348 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:03.155582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:03.163545 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0a554b55-8c1e-40ae-b9ad-fafdd70239f2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1682 microversion: 2.1 time: 0.158574 Aug 03 05:52:03.164129 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3872/7752] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:03 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:27.349416 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:27.351621 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:27.355176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:27.355837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=52 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:27.360677 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:27.361169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:27.361947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:27.362389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:27.418180 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e04e23e8-031d-4ce7-beb0-04982239b79d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action" status: 200 len: 69342 microversion: 2.1 time: 0.072490 Aug 03 05:52:27.418838 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3881/7753] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:52:27 2022] POST /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44/action => generated 69342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:52:34.578979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:34.579512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:34.582142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=18 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:34.582822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:34.588724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:34.596069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:34.596069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:34.596069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:34.620217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:52:34.658429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-a88acc7d-5639-4fb4-a46a-9503728572ae req-89ae4537-ecbe-4354-9ce2-cca1409bbc66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b185ec14-1429-4658-8162-7c89f0c82a44", "tag": "02084775-b7c5-4bce-abbc-3c496f8ab152"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:34.673135 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a88acc7d-5639-4fb4-a46a-9503728572ae req-89ae4537-ecbe-4354-9ce2-cca1409bbc66 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:34.673964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-a88acc7d-5639-4fb4-a46a-9503728572ae req-89ae4537-ecbe-4354-9ce2-cca1409bbc66 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:34.685778 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-a88acc7d-5639-4fb4-a46a-9503728572ae req-89ae4537-ecbe-4354-9ce2-cca1409bbc66 service nova] Creating event network-changed:02084775-b7c5-4bce-abbc-3c496f8ab152 for instance b185ec14-1429-4658-8162-7c89f0c82a44 on n-h1-826756-5 Aug 03 05:52:34.691435 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-a88acc7d-5639-4fb4-a46a-9503728572ae req-89ae4537-ecbe-4354-9ce2-cca1409bbc66 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113459 Aug 03 05:52:34.693471 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3882/7754] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:52:34.966552 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2fb85548-8088-490b-b797-3fca72b07054 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 204 len: 0 microversion: 2.1 time: 0.390861 Aug 03 05:52:34.967354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3873/7755] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:52:34 2022] DELETE /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:52:34.979124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:34.979124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:34.985579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:34.985579 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:34.986289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:34.986736 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:35.123316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:35.131153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bb546156-d616-4bdd-8fec-bdf834694660 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1688 microversion: 2.1 time: 0.159142 Aug 03 05:52:35.131747 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3883/7756] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:34 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:52:36.155116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:36.155834 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:36.163085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:36.163548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:36.164367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:36.164822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:36.395085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:36.402634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-480e4c1a-4d25-47fb-a888-72bb89013439 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1688 microversion: 2.1 time: 0.252500 Aug 03 05:52:36.403212 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3874/7757] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:36 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:36.949441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-c820ed7f-568d-43bd-8673-b8b166559951 req-d00dd9ec-54cd-4e3c-8f82-a2905eed1e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b185ec14-1429-4658-8162-7c89f0c82a44", "name": "network-vif-deleted", "tag": "02084775-b7c5-4bce-abbc-3c496f8ab152"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:36.960052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c820ed7f-568d-43bd-8673-b8b166559951 req-d00dd9ec-54cd-4e3c-8f82-a2905eed1e6d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:36.962790 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-c820ed7f-568d-43bd-8673-b8b166559951 req-d00dd9ec-54cd-4e3c-8f82-a2905eed1e6d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:36.974185 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-c820ed7f-568d-43bd-8673-b8b166559951 req-d00dd9ec-54cd-4e3c-8f82-a2905eed1e6d service nova] Creating event network-vif-deleted:02084775-b7c5-4bce-abbc-3c496f8ab152 for instance b185ec14-1429-4658-8162-7c89f0c82a44 on n-h1-826756-5 Aug 03 05:52:36.979286 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-c820ed7f-568d-43bd-8673-b8b166559951 req-d00dd9ec-54cd-4e3c-8f82-a2905eed1e6d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 03 05:52:36.979882 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3884/7758] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:52:37.425333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:37.425955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:37.432824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:37.433289 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:37.434068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:37.434516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:37.464912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:37.465287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:37.465750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lazy-loading 'fault' on Instance uuid b185ec14-1429-4658-8162-7c89f0c82a44 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:52:37.507697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:37.515901 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33dd2578-2020-49b1-bbbc-651778933b79 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 200 len: 1356 microversion: 2.1 time: 0.094516 Aug 03 05:52:37.516495 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3875/7759] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:37 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 1356 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:38.539584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:38.540308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: b185ec14-1429-4658-8162-7c89f0c82a44] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:38.547097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:38.547555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:38.548346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:38.548788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:38.562396 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] HTTP exception thrown: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Request method failure captured: Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 HTTP/1.1 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gxw5zoSymrFpkXLxP9cN_AyEqVu62RKrj6BTZ0krVlfQpAfRy1ZY0lGKDIgkewEpB3qvBExLHzAj8czNxhMvF6j-Y0SqPxilNgohWjsc6ifCP3SKyD46S8KZXvk376VGvkLblURnbjrzIKZAMoF1Y83S7fZmAGlYv83KNViEYlCd1A Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/892f1ae57800448380d28eed911b30a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f0d17c9906b04e41a48c7bf59a80683f Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'b185ec14-1429-4658-8162-7c89f0c82a44'} Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:52:38.564010 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Returning 404 to user: Instance b185ec14-1429-4658-8162-7c89f0c82a44 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9ef8c0ed-1fd2-4dcf-98de-0e055064b006 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44" status: 404 len: 111 microversion: 2.1 time: 0.031500 Aug 03 05:52:38.568777 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3885/7760] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:38 2022] GET /compute/v2.1/servers/b185ec14-1429-4658-8162-7c89f0c82a44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:52:42.416241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e5ea9679-9994-4194-9cae-610581b62a23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '.version_select at 0x7fdd47396940>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:42.492409 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e5ea9679-9994-4194-9cae-610581b62a23 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-172612088" status: 202 len: 0 microversion: 2.1 time: 0.080484 Aug 03 05:52:42.492918 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3876/7761] 10.222.0.72 () {58 vars in 1281 bytes} [Wed Aug 3 05:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-172612088 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:52:42.522731 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bc7c7625-d867-49a0-bc5a-1df43de882ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: .version_select at 0x7fdd54973f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1192857796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlKSFz75CZhDUEiFser1r/Vv0ewfqbHg5d4w0qO2T2qXd+vdD0aalcO+jIWVYOui+J24u5SdFLuOYun3hwEt2AaN12py9pt3swro1Ur2QGcSkainDPF2SlP0I3AUFotQQ=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:42.539907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-bc7c7625-d867-49a0-bc5a-1df43de882ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:52:42.546694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-bc7c7625-d867-49a0-bc5a-1df43de882ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:52:42.647088 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bc7c7625-d867-49a0-bc5a-1df43de882ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.128357 Aug 03 05:52:42.647697 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3886/7762] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:52:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:52:49.227597 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:52:49.228733 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:52:50.984161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-153033603", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "3790692e-2b8d-44b2-8bac-710b2eb908e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1192857796", "security_groups": [{"name": "tempest-secgroup-smoke-2084383461"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:51.005496 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:51.133500 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] validate_networks() for [('3790692e-2b8d-44b2-8bac-710b2eb908e9', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:52:51.687134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:52:51.688055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:52:51.689426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:52:51.690338 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:52:51.691298 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:52:51.701030 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:51.702606 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:51.703767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:51.709594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:51.724142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:52:51.730028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:52:51.746137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:52:51.749991 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:52:51.855642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-13a61d41-616e-40a6-b827-f06844bb6f38 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876174 Aug 03 05:52:51.856550 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3877/7763] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:52:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:52:51.865828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:51.869981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a00bd450-badf-4cd9-b0c7-8264c2a2c9ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:51.870607 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a00bd450-badf-4cd9-b0c7-8264c2a2c9ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:51.937839 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a00bd450-badf-4cd9-b0c7-8264c2a2c9ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:51.945256 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a00bd450-badf-4cd9-b0c7-8264c2a2c9ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1266 microversion: 2.1 time: 0.081261 Aug 03 05:52:51.946016 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3887/7764] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:51 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:52:52.968896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a241df54-8470-4601-acc4-741d19770fc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:52.969557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a241df54-8470-4601-acc4-741d19770fc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:53.033366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a241df54-8470-4601-acc4-741d19770fc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:53.042064 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a241df54-8470-4601-acc4-741d19770fc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1266 microversion: 2.1 time: 0.077494 Aug 03 05:52:53.042650 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3878/7765] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:52 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:54.064619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a0a93c0a-cc31-453e-be79-efab6e74f483 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:54.065418 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a0a93c0a-cc31-453e-be79-efab6e74f483 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:54.120876 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a0a93c0a-cc31-453e-be79-efab6e74f483 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:54.127989 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a0a93c0a-cc31-453e-be79-efab6e74f483 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1266 microversion: 2.1 time: 0.068562 Aug 03 05:52:54.128602 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3888/7766] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:54 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:55.149697 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0fff98da-a4a8-44da-b568-ab155a0dc7a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:55.150363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0fff98da-a4a8-44da-b568-ab155a0dc7a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:55.206020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0fff98da-a4a8-44da-b568-ab155a0dc7a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:55.212711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0fff98da-a4a8-44da-b568-ab155a0dc7a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1266 microversion: 2.1 time: 0.066954 Aug 03 05:52:55.213288 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3879/7767] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:55 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:56.237479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:56.238011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:56.245085 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:56.245544 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:56.246320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:56.246769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:56.311292 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:56.319567 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7b5cd90e-9e57-4e8f-89a0-d748cf793aaf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1270 microversion: 2.1 time: 0.088284 Aug 03 05:52:56.320146 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3889/7768] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:56 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:57.340260 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:57.340923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:57.348938 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:57.349416 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:57.350214 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:57.350674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:57.412773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:57.420192 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d91b997b-dd2f-4a9d-a357-f876372112cb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1262 microversion: 2.1 time: 0.083946 Aug 03 05:52:57.420793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3880/7769] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:57 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:58.440820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:58.441439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:58.444137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:52:58.448972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:58.449467 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:58.450244 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:58.450695 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:58.517460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:58.525181 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8dd2819f-b148-424d-8b02-9e3ab60ac924 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1324 microversion: 2.1 time: 0.088621 Aug 03 05:52:58.525769 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3890/7770] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:58 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1324 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:59.549738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:52:59.550470 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:52:59.557676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:59.558423 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:59.559375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:59.559986 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:59.707421 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:52:59.714968 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-af9a406a-8a8f-496d-be46-11f7f267f961 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.169275 Aug 03 05:52:59.715564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3881/7771] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:52:59 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:52:59.803520 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ac70a8c1-2b10-4a60-96a6-b62f2a5cc9e2 req-f4d1d58f-fb49-4b24-9f03-935626c88cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:52:59.814576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ac70a8c1-2b10-4a60-96a6-b62f2a5cc9e2 req-f4d1d58f-fb49-4b24-9f03-935626c88cf5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:52:59.815382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ac70a8c1-2b10-4a60-96a6-b62f2a5cc9e2 req-f4d1d58f-fb49-4b24-9f03-935626c88cf5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:52:59.826228 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ac70a8c1-2b10-4a60-96a6-b62f2a5cc9e2 req-f4d1d58f-fb49-4b24-9f03-935626c88cf5 service nova] Creating event network-changed:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h1-826756-5 Aug 03 05:52:59.831217 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ac70a8c1-2b10-4a60-96a6-b62f2a5cc9e2 req-f4d1d58f-fb49-4b24-9f03-935626c88cf5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031345 Aug 03 05:52:59.832041 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3891/7772] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:53:00.736582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:00.737227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:00.744379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:00.744860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:00.745653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:00.746110 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:00.881587 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:00.889081 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9bba6194-3f0b-4271-9200-7d7d63535b0b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.157197 Aug 03 05:53:00.890456 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3882/7773] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:00 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:01.912459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:01.913287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:01.919595 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:01.920056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:01.920858 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:01.921290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:02.054796 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:02.063226 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-74a24dbf-9d2e-40dd-9f23-36beffe23a03 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.157084 Aug 03 05:53:02.063811 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3892/7774] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:01 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:53:03.084130 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:03.084823 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:03.086684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:03.093241 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:03.093686 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:03.094530 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:03.094944 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:03.235568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:03.243218 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4b5f54d1-210c-4845-bbf5-d0a2113a07ff tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.163055 Aug 03 05:53:03.243843 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3883/7775] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:03 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:04.264362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:04.265031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:04.267813 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:04.272828 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:04.273325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:04.274060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:04.274504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:04.413811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:04.421467 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a571054f-8eef-4dc1-aac7-4ac8271da140 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.161036 Aug 03 05:53:04.422635 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3893/7776] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:04 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:05.443745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:05.444403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:05.447092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=10 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:05.447983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:05.452579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:05.453049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:05.454168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:05.454652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:05.589607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:05.597935 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6fdace0-976f-4577-92da-cd204fef69a2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.158105 Aug 03 05:53:05.598519 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3884/7777] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:05 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:06.358972 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fc863ec3-4482-4b61-b42c-f5763fa52d23 req-859e166b-f95b-49b3-9ecb-6a42861d7410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "name": "network-vif-plugged", "status": "completed", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:53:06.368558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc863ec3-4482-4b61-b42c-f5763fa52d23 req-859e166b-f95b-49b3-9ecb-6a42861d7410 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:06.369008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fc863ec3-4482-4b61-b42c-f5763fa52d23 req-859e166b-f95b-49b3-9ecb-6a42861d7410 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:06.380808 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fc863ec3-4482-4b61-b42c-f5763fa52d23 req-859e166b-f95b-49b3-9ecb-6a42861d7410 service nova] Creating event network-vif-plugged:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h1-826756-5 Aug 03 05:53:06.385719 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fc863ec3-4482-4b61-b42c-f5763fa52d23 req-859e166b-f95b-49b3-9ecb-6a42861d7410 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087398 Aug 03 05:53:06.386315 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3894/7778] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:53:06.619541 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:06.620182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:06.628531 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:06.629008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:06.629797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:06.630255 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:06.764702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:06.772444 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-935a2ac7-b55f-4dd5-8e64-1032536e98d4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1392 microversion: 2.1 time: 0.156761 Aug 03 05:53:06.773030 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3885/7779] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:06 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:07.795412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:07.796119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:07.802726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:07.803190 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:07.803962 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:07.804441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:07.936030 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:07.944830 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7d807ed2-0f07-439c-a6ae-f000b3c6ed89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1564 microversion: 2.1 time: 0.154617 Aug 03 05:53:07.945427 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3895/7780] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:07 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:07.966639 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:07.967197 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:07.974318 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:07.974783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:07.975570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:07.976019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:08.113700 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:08.121520 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-67802049-a368-40b9-8927-d7a6878a14d0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1564 microversion: 2.1 time: 0.159265 Aug 03 05:53:08.122103 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3886/7781] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:07 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:10.132866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:10.133491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:10.141417 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:10.142245 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:10.143141 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:10.143598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:10.195990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b156232d-63e5-4e2b-ada1-71808d5b7fd4 req-0a65b9a9-2e8b-4dcb-9521-02869e96eca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:53:10.205990 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b156232d-63e5-4e2b-ada1-71808d5b7fd4 req-0a65b9a9-2e8b-4dcb-9521-02869e96eca4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:10.206454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b156232d-63e5-4e2b-ada1-71808d5b7fd4 req-0a65b9a9-2e8b-4dcb-9521-02869e96eca4 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:10.217734 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b156232d-63e5-4e2b-ada1-71808d5b7fd4 req-0a65b9a9-2e8b-4dcb-9521-02869e96eca4 service nova] Creating event network-changed:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h1-826756-5 Aug 03 05:53:10.223714 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b156232d-63e5-4e2b-ada1-71808d5b7fd4 req-0a65b9a9-2e8b-4dcb-9521-02869e96eca4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092678 Aug 03 05:53:10.224547 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3887/7782] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:53:10.303483 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:10.311834 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ed58c5cf-9834-48c8-8c11-57c578703601 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1564 microversion: 2.1 time: 0.183187 Aug 03 05:53:10.312473 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3896/7783] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:10 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:33.566451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=7 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:33.567221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=46 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:33.571680 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:53:33.573948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:33.580508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:33.580966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:33.581741 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:33.582192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:33.637366 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a050ace-0fe9-44ed-a4dc-f6d3c68a1e31 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action" status: 200 len: 24568 microversion: 2.1 time: 0.072712 Aug 03 05:53:33.638426 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3888/7784] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:53:33 2022] POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action => generated 24568 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:53:40.028302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:53:40.030564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:40.032887 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:40.033676 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=40 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:53:40.038911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:40.049797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:40.049797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:40.049797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:40.081103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:40.087519 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120831) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 03 05:53:40.093769 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:53:40.094200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:53:40.094683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:53:40.095198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:53:40.095615 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:53:40.309107 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b9c71be6-098a-4cb2-946a-fa6a35989a1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action" status: 202 len: 0 microversion: 2.1 time: 0.284983 Aug 03 05:53:40.310025 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3897/7785] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:53:40 2022] POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:53:40.318915 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:40.319634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:40.326969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:40.327438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:40.328237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:40.328779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:40.464603 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:40.472133 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c1287b2e-9cb8-4d45-be36-1ef54c325bd0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1691 microversion: 2.1 time: 0.157695 Aug 03 05:53:40.472734 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3889/7786] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:40 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:41.494829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:41.499886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:41.502705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:41.503294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:41.503917 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:41.504468 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:41.641072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:41.649638 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-48192431-802c-465c-b412-13475bbdd0a5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1691 microversion: 2.1 time: 0.158785 Aug 03 05:53:41.650213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3898/7787] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:41 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:42.671616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:42.672244 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:42.679257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:42.679723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:42.680526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:42.680974 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:42.813766 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:42.821621 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c6902767-4088-46e3-9a60-f4eb66736eab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1691 microversion: 2.1 time: 0.153823 Aug 03 05:53:42.822404 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3890/7788] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:42 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:43.842885 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:43.843557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:43.851078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:43.851537 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:43.852378 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:43.852822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:43.991743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:43.999358 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b3d89fa7-9605-442e-8653-af603b20f420 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.160363 Aug 03 05:53:43.999933 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3899/7789] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:43 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:45.021735 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:45.022397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:45.029442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:45.029913 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:45.030720 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:45.031177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:45.162665 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:45.170117 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-18722219-b2e3-4c2d-a7b3-77b36a6942d2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.152467 Aug 03 05:53:45.170692 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3891/7790] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:45 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:46.191869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:46.192521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:46.200068 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:46.200562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:46.201327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:46.201766 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:46.336822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:46.344529 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f606b01d-d4f1-4ba6-87c1-7867a926d81a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.156753 Aug 03 05:53:46.345113 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3900/7791] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:46 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:47.367217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:47.367839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:47.374713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:47.375181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:47.375961 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:47.376440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:47.508876 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:47.516424 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3f326d62-5da6-439b-8f22-5d0fe147ebcf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.153399 Aug 03 05:53:47.517005 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3892/7792] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:47 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:48.537612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:48.538227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:48.545205 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:48.545648 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:48.546415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:48.546854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:48.679110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:48.686694 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6e60c5f9-b1ba-4429-804a-35172f1fc041 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.153396 Aug 03 05:53:48.687295 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3901/7793] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:48 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:49.709492 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:49.710134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:49.717174 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:49.717649 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:49.718443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:49.718898 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:49.855891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:49.861447 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25722b93-29f3-40b2-8a50-a477423cb899 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.156343 Aug 03 05:53:49.862019 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3893/7794] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:49 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:50.884107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:50.884751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:50.891690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:50.892144 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:50.892929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:50.893365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:51.023815 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:51.031424 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4e34d34f-9193-46ba-bc48-13b3baa9bfc0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.151483 Aug 03 05:53:51.035632 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3902/7795] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:50 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:52.055572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:52.056949 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:52.064190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:52.064927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:52.065799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:52.066256 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:52.206317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:52.214492 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9f0b76f8-6d55-4eb1-bfa2-f52fa19d55cf tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.164223 Aug 03 05:53:52.215081 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3894/7796] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:52 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:53.235955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:53.236611 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:53.243657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:53.244114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:53.244916 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:53.245360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:53.376212 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:53.384428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9dc88913-1dc8-4a32-9068-4136ff440671 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.152319 Aug 03 05:53:53.385005 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3903/7797] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:53 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:54.406487 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:54.407125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:54.414552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:54.419343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:54.419343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:54.419343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:54.550359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:54.557990 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-11aa5f5e-abf1-4db8-ad4c-f6f92de1cd52 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.155550 Aug 03 05:53:54.561966 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3895/7798] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:54 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:55.580791 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:55.581405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:55.589264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:55.589719 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:55.590521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:55.590963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:55.723637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:55.731296 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9bb6fb2-ace0-4cd1-bffb-1949dbe7d7ac tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.154433 Aug 03 05:53:55.731884 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3904/7799] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:55 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:56.752978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:56.753581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:56.761474 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:56.761936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:56.762707 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:56.763156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:56.897373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:56.905063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2218d41-d8a8-4a8b-8ba9-1a731d69dbc1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.155992 Aug 03 05:53:56.905664 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3896/7800] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:56 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:57.927527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:57.928140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:57.935193 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:57.935639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:57.936442 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:57.936883 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:58.074960 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:58.083622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8eb64cee-8ecf-4cfb-9a99-29e6e0f3b456 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.160089 Aug 03 05:53:58.089200 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3905/7801] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:57 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:53:59.105535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:53:59.106167 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:53:59.113768 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:59.123899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:59.123899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:53:59.123899 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:53:59.250884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:53:59.259168 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5a68c2a2-93b2-41bd-b6a0-f20cd29e7fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.157547 Aug 03 05:53:59.259751 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3897/7802] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:53:59 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:00.281551 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:00.282158 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:00.289399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:00.289850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:00.290612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:00.291046 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:00.428455 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:00.436115 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d03780c2-2f80-4dc9-8d23-a00750c76e05 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1696 microversion: 2.1 time: 0.158431 Aug 03 05:54:00.436830 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3906/7803] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:00 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:01.460068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:01.460797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:01.467771 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:01.468236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:01.469078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:01.469537 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:01.680765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:01.688588 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1e0d8671-4212-4f17-96a4-39b06dc155ea tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1695 microversion: 2.1 time: 0.233324 Aug 03 05:54:01.689349 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3898/7804] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:01 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:01.704574 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "name": "network-vif-unplugged", "status": "completed", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:01.715082 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:01.715469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:01.729969 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] Creating event network-vif-unplugged:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h2-826756-5 Aug 03 05:54:01.735362 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:54:01.746418 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-eb7ff74d-18d0-45bf-8b5b-68470094d949 req-ef7864ad-e429-4c5c-bab4-6912a9aead77 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056545 Aug 03 05:54:01.747025 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3907/7805] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:02.710585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:02.713473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:02.718137 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:02.718597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:02.719391 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:02.719836 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:02.853058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:02.860730 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b37116f-491c-4040-b0f8-94337c2b4d83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1695 microversion: 2.1 time: 0.154495 Aug 03 05:54:02.861243 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3899/7806] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:02 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:03.762555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:03.772308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:03.772760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:03.784252 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] Creating event network-changed:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h2-826756-5 Aug 03 05:54:03.790694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-5', 'n-h2-826756-5'} {{(pid=120831) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5888}} Aug 03 05:54:03.801922 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-56a0b338-f7de-495a-bce8-dd75627004fb req-77cd70f3-978c-4534-8779-9e0da8fcdda2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043530 Aug 03 05:54:03.802687 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3908/7807] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:03.882903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:03.883576 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:03.887749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=25 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:03.891924 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:03.892849 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:03.893998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:03.894463 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:03.899625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=71 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:04.042040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:04.050183 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-27c3acc9-8684-46e2-af8f-b2e6b204d55d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1693 microversion: 2.1 time: 0.171017 Aug 03 05:54:04.050790 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3900/7808] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:03 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:54:05.074963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:05.075697 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:05.081958 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.083113 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.084155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.084644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.215626 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:05.223123 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d32af853-93c2-4a73-9f01-c7a7ef645867 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1690 microversion: 2.1 time: 0.153264 Aug 03 05:54:05.223692 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3909/7809] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:05 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:05.243501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:05.244052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:05.250978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.251444 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.252225 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.252701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.747334 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db6d6b74-3fdd-4cd0-8348-667617cf6ecb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action" status: 204 len: 0 microversion: 2.1 time: 0.507521 Aug 03 05:54:05.747994 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3901/7810] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:54:05 2022] POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:54:05.756979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:05.762955 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:05.763771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.764224 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.765023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.765460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.901627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:05.909289 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9529a75d-26f7-43ea-8649-8564d2954f37 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1690 microversion: 2.1 time: 0.156989 Aug 03 05:54:05.909864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3910/7811] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:05 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:05.931011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:05.931837 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:05.939408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.939881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:05.941231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:05.942327 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:06.085880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:06.093792 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-98aab0f8-a448-4597-b749-32f3041d8247 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1690 microversion: 2.1 time: 0.167075 Aug 03 05:54:06.095838 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3902/7812] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:05 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:07.116935 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:07.117469 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:07.125231 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:07.125693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:07.126470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:07.126906 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:07.361699 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:07.370452 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-907a4199-b67d-49bc-95c8-8cc41d10b8c9 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1690 microversion: 2.1 time: 0.257882 Aug 03 05:54:07.371256 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3911/7813] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:07 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1690 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:08.392189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:08.393614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:08.400872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:08.401376 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:08.402182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:08.402664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:08.481994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2ec26569-ff2e-4d08-b562-19763cfabc97 req-1d007948-7756-4abd-8a1b-b8ea1d79d00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "name": "network-vif-plugged", "status": "completed", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:08.496712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ec26569-ff2e-4d08-b562-19763cfabc97 req-1d007948-7756-4abd-8a1b-b8ea1d79d00d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:08.497160 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2ec26569-ff2e-4d08-b562-19763cfabc97 req-1d007948-7756-4abd-8a1b-b8ea1d79d00d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:08.508731 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2ec26569-ff2e-4d08-b562-19763cfabc97 req-1d007948-7756-4abd-8a1b-b8ea1d79d00d service nova] Creating event network-vif-plugged:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h2-826756-5 Aug 03 05:54:08.513870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2ec26569-ff2e-4d08-b562-19763cfabc97 req-1d007948-7756-4abd-8a1b-b8ea1d79d00d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035768 Aug 03 05:54:08.514540 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3912/7814] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:08.543872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:08.552839 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f8a91c0e-3832-4cbb-b7ca-8780d8e9da14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1682 microversion: 2.1 time: 0.163504 Aug 03 05:54:08.553792 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3903/7815] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:08 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:30.735856 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=36 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:30.736656 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:30.741717 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:30.744067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:30.750948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:30.751407 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:30.752180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:30.752659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:30.807298 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7d316d3-01a1-4366-837e-ae74dfcab39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action" status: 200 len: 24577 microversion: 2.1 time: 0.073087 Aug 03 05:54:30.808213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3913/7816] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:54:30 2022] POST /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:54:37.875215 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=7 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:37.876401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-826750b5-ce74-41f4-9f1e-e62cb1ab230d req-cbb4483d-6232-4307-a2de-643e1a6fd327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:37.876806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:37.890470 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-826750b5-ce74-41f4-9f1e-e62cb1ab230d req-cbb4483d-6232-4307-a2de-643e1a6fd327 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:37.890925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-826750b5-ce74-41f4-9f1e-e62cb1ab230d req-cbb4483d-6232-4307-a2de-643e1a6fd327 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:37.903947 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-826750b5-ce74-41f4-9f1e-e62cb1ab230d req-cbb4483d-6232-4307-a2de-643e1a6fd327 service nova] Creating event network-changed:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h2-826756-5 Aug 03 05:54:37.909876 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-826750b5-ce74-41f4-9f1e-e62cb1ab230d req-cbb4483d-6232-4307-a2de-643e1a6fd327 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037213 Aug 03 05:54:37.912651 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3914/7817] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:37.929128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:37.930518 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:37.936793 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:37.937252 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:37.938050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:37.938512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:37.965300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:54:38.329946 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-070a2e33-7f71-459a-b547-2a1c22a0c644 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 204 len: 0 microversion: 2.1 time: 0.459857 Aug 03 05:54:38.330919 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3904/7818] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:54:37 2022] DELETE /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:54:38.342217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:38.344312 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:38.352179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:38.352760 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:38.353550 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:38.353996 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:38.495639 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:38.503417 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-10248c14-c031-4437-abd1-dbbb14f6c458 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1688 microversion: 2.1 time: 0.168030 Aug 03 05:54:38.508155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3915/7819] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:38 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:39.526854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:39.527617 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:39.535098 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:39.535574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:39.536406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:39.536874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:39.705561 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:39.714642 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d2e9c3ef-6db2-4413-92a3-bb919c6f8d6d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1688 microversion: 2.1 time: 0.193062 Aug 03 05:54:39.715236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3905/7820] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:39 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:40.225716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-1c8fe596-d1e2-4bf8-b358-b6f4a813ddc1 req-c1310f87-bb04-48f7-a9a0-704a6f1ee7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97923f1e-c953-4559-b97d-6bd4d76edf7e", "name": "network-vif-deleted", "tag": "f79ea0d1-e5e9-482b-8aed-492ab87c6ba5"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:40.237239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1c8fe596-d1e2-4bf8-b358-b6f4a813ddc1 req-c1310f87-bb04-48f7-a9a0-704a6f1ee7ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:40.237683 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-1c8fe596-d1e2-4bf8-b358-b6f4a813ddc1 req-c1310f87-bb04-48f7-a9a0-704a6f1ee7ce service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:40.249236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-1c8fe596-d1e2-4bf8-b358-b6f4a813ddc1 req-c1310f87-bb04-48f7-a9a0-704a6f1ee7ce service nova] Creating event network-vif-deleted:f79ea0d1-e5e9-482b-8aed-492ab87c6ba5 for instance 97923f1e-c953-4559-b97d-6bd4d76edf7e on n-h2-826756-5 Aug 03 05:54:40.254056 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-1c8fe596-d1e2-4bf8-b358-b6f4a813ddc1 req-c1310f87-bb04-48f7-a9a0-704a6f1ee7ce service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032126 Aug 03 05:54:40.254664 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3916/7821] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:40.737314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:40.737897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:40.745616 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:40.746049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:40.746848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:40.747313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:40.777939 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:40.778417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:40.778895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lazy-loading 'fault' on Instance uuid 97923f1e-c953-4559-b97d-6bd4d76edf7e {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:54:40.821094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:40.828711 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-634b1254-3ada-4d93-96e5-37185ac587f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 200 len: 1356 microversion: 2.1 time: 0.095367 Aug 03 05:54:40.829277 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3906/7822] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:40 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:41.851365 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:41.852687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 97923f1e-c953-4559-b97d-6bd4d76edf7e] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:41.859148 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:41.859609 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:41.860439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:41.860894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:41.874602 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] HTTP exception thrown: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Request method failure captured: Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e HTTP/1.1 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gxw5zoSymrFpkXLxP9cN_AyEqVu62RKrj6BTZ0krVlfQpAfRy1ZY0lGKDIgkewEpB3qvBExLHzAj8czNxhMvF6j-Y0SqPxilNgohWjsc6ifCP3SKyD46S8KZXvk376VGvkLblURnbjrzIKZAMoF1Y83S7fZmAGlYv83KNViEYlCd1A Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/892f1ae57800448380d28eed911b30a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f0d17c9906b04e41a48c7bf59a80683f Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '97923f1e-c953-4559-b97d-6bd4d76edf7e'} Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:54:41.876225 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Returning 404 to user: Instance 97923f1e-c953-4559-b97d-6bd4d76edf7e could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-27823ab0-32bb-47f6-8fa3-b22d09fd6c48 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e" status: 404 len: 111 microversion: 2.1 time: 0.031672 Aug 03 05:54:41.881155 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3917/7823] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:41 2022] GET /compute/v2.1/servers/97923f1e-c953-4559-b97d-6bd4d76edf7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:54:45.826262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-298c85a2-b1e2-4da9-8554-9e67bbc45c5a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '.version_select at 0x7fdd442c9d30>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:45.897132 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-298c85a2-b1e2-4da9-8554-9e67bbc45c5a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1192857796" status: 202 len: 0 microversion: 2.1 time: 0.074967 Aug 03 05:54:45.897779 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3907/7824] 10.222.0.72 () {58 vars in 1284 bytes} [Wed Aug 3 05:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1192857796 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 05:54:45.928140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c316b62-5199-4436-a03f-0086374d282f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: .version_select at 0x7fdd54a65ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1139194968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfc5elsmI1wCwUTw+Gx44GqRd3eHwKWXtZh4Sv/Tpwj+p+1WnNhuF6yATBRo5vO5/pmg08cwfElLOt9T2f265PSFlz72du8Jo/ynM2HhfAh/2iQD/ult2efJtVRyk9R4g=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:45.945570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5c316b62-5199-4436-a03f-0086374d282f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:54:45.950855 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-5c316b62-5199-4436-a03f-0086374d282f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:54:46.044832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c316b62-5199-4436-a03f-0086374d282f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.120699 Aug 03 05:54:46.045451 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3918/7825] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:54:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:54:54.726136 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1227100584", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "29576c6e-3fe9-44dc-9bda-a8a00e6238c7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1139194968", "security_groups": [{"name": "tempest-secgroup-smoke-1248603486"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:54.738792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:54.842375 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] validate_networks() for [('29576c6e-3fe9-44dc-9bda-a8a00e6238c7', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:54:55.241195 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:54:55.241666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:54:55.242400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:54:55.242973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:54:55.243253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:54:55.252343 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:55.252814 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:55.253631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:55.254085 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:55.271577 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:54:55.277693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:54:55.291224 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:54:55.293564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:54:55.407142 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-94513b84-f0dc-4950-9039-8225b1774533 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685294 Aug 03 05:54:55.414087 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3908/7826] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:54:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:54:55.419597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85f2469d-6881-4ca1-bce1-517f30c6f7f1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:55.420247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85f2469d-6881-4ca1-bce1-517f30c6f7f1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:55.423119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:54:55.496673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85f2469d-6881-4ca1-bce1-517f30c6f7f1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:55.504691 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85f2469d-6881-4ca1-bce1-517f30c6f7f1 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1267 microversion: 2.1 time: 0.089140 Aug 03 05:54:55.505273 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3919/7827] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:55 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:56.527723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:56.528442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:56.535705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:56.536189 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:56.537028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:56.537922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:56.607142 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:56.615249 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8687396-1126-4223-a831-0bd6cba74602 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1271 microversion: 2.1 time: 0.092571 Aug 03 05:54:56.615840 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3909/7828] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:56 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:57.637632 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:57.638355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:57.646266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:57.646818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:57.647750 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:57.648305 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:57.725395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:57.733874 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b308ef79-3b81-4e81-aa4a-2175a7dc7599 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1327 microversion: 2.1 time: 0.100161 Aug 03 05:54:57.734467 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3920/7829] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:57 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:54:58.755322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:54:58.758075 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:54:58.764203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:58.764723 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:58.765528 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:58.766034 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:58.989168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:54:58.999207 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c8a809fd-8554-4416-8025-f0f45472707e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.247787 Aug 03 05:54:59.000367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3910/7830] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:54:58 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:54:59.227727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b70a9bdb-a000-4bca-aa9f-8767f22f489b req-88b108a4-c132-4a91-af93-e1c327881b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27da31-b477-414e-8534-4b231d6fab62", "tag": "00a9b28e-36d9-4ac9-8cc7-3833698b6f3d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:54:59.242504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b70a9bdb-a000-4bca-aa9f-8767f22f489b req-88b108a4-c132-4a91-af93-e1c327881b6a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:54:59.243195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b70a9bdb-a000-4bca-aa9f-8767f22f489b req-88b108a4-c132-4a91-af93-e1c327881b6a service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:54:59.254870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b70a9bdb-a000-4bca-aa9f-8767f22f489b req-88b108a4-c132-4a91-af93-e1c327881b6a service nova] Creating event network-changed:00a9b28e-36d9-4ac9-8cc7-3833698b6f3d for instance 8d27da31-b477-414e-8534-4b231d6fab62 on n-h2-826756-5 Aug 03 05:54:59.260687 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b70a9bdb-a000-4bca-aa9f-8767f22f489b req-88b108a4-c132-4a91-af93-e1c327881b6a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037073 Aug 03 05:54:59.261381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3921/7831] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:55:00.021853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:00.022451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:00.029632 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:00.030115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:00.030941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:00.031479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:00.170914 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:00.178489 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25b77159-a875-45b5-9b78-26dfb84f9b1b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.160885 Aug 03 05:55:00.179958 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3911/7832] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:00 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:01.201714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:01.203004 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:01.205730 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:01.211596 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:01.212050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:01.212854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:01.213295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:01.345963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:01.354050 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9a176653-fbe4-4427-b3b3-1b7dda4beb11 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.157788 Aug 03 05:55:01.354633 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3922/7833] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:01 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:02.375713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:02.376403 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:02.384068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:02.384563 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:02.385352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:02.385810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:02.523795 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:02.531857 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-acf4d717-7c73-4cd4-96f4-f15a76d2f6b5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.160217 Aug 03 05:55:02.532486 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3912/7834] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:02 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:03.553262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:03.553854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:03.561140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:03.561591 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:03.562355 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:03.562792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:03.700973 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:03.708652 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b1790985-4843-4638-96cb-e60309c127b3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.159293 Aug 03 05:55:03.709245 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3923/7835] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:03 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:04.730243 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:04.730890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:04.737610 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:04.738093 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:04.738891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:04.739359 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:04.769754 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-428f4578-c50f-4f8f-8587-9c725fd80964 req-7b70c8b8-044b-4bba-8a53-7fa45cb4f01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27da31-b477-414e-8534-4b231d6fab62", "name": "network-vif-plugged", "status": "completed", "tag": "00a9b28e-36d9-4ac9-8cc7-3833698b6f3d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:55:04.786183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-428f4578-c50f-4f8f-8587-9c725fd80964 req-7b70c8b8-044b-4bba-8a53-7fa45cb4f01f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:04.787623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-428f4578-c50f-4f8f-8587-9c725fd80964 req-7b70c8b8-044b-4bba-8a53-7fa45cb4f01f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:04.799038 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-428f4578-c50f-4f8f-8587-9c725fd80964 req-7b70c8b8-044b-4bba-8a53-7fa45cb4f01f service nova] Creating event network-vif-plugged:00a9b28e-36d9-4ac9-8cc7-3833698b6f3d for instance 8d27da31-b477-414e-8534-4b231d6fab62 on n-h2-826756-5 Aug 03 05:55:04.803854 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-428f4578-c50f-4f8f-8587-9c725fd80964 req-7b70c8b8-044b-4bba-8a53-7fa45cb4f01f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 Aug 03 05:55:04.804608 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3924/7836] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:55:04.895490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:04.904158 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1f3228b6-5aef-4dac-bfd8-fc3df3d71c3b tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.178712 Aug 03 05:55:04.904783 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3913/7837] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:04 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:05.924334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:05.929328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:05.931115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:05.938457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:05.938457 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:05.938869 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:05.939313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:06.076048 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:06.083832 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d9f633b6-efe5-4c34-b2ea-b2dbdf8f225a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1393 microversion: 2.1 time: 0.160478 Aug 03 05:55:06.087074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3925/7838] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:05 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:07.105489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:07.106128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:07.108055 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:07.108778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:07.114512 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:07.114992 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:07.115791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:07.116254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:07.256539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:07.264153 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50a2f41a-4de0-4778-a56a-f6eafa787e64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1566 microversion: 2.1 time: 0.162746 Aug 03 05:55:07.264774 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3914/7839] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:07 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:07.284653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:07.285276 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:07.293540 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:07.294001 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:07.294854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:07.295302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:07.425850 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:07.434131 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a32b891b-2625-4ddc-a9af-abe5571819eb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1566 microversion: 2.1 time: 0.153291 Aug 03 05:55:07.434713 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3926/7840] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:07 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:10.144733 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:10.145825 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-50a1ab86-764e-4a7a-a3cb-aaa59ca61ebb req-bc551173-a6e8-4e62-9a1b-5c2dbe9d2112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27da31-b477-414e-8534-4b231d6fab62", "tag": "00a9b28e-36d9-4ac9-8cc7-3833698b6f3d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:55:10.146762 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:10.155268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:10.157179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:10.157952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:10.158535 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-50a1ab86-764e-4a7a-a3cb-aaa59ca61ebb req-bc551173-a6e8-4e62-9a1b-5c2dbe9d2112 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:10.159060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-50a1ab86-764e-4a7a-a3cb-aaa59ca61ebb req-bc551173-a6e8-4e62-9a1b-5c2dbe9d2112 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:10.160229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:10.161217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:10.173735 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-50a1ab86-764e-4a7a-a3cb-aaa59ca61ebb req-bc551173-a6e8-4e62-9a1b-5c2dbe9d2112 service nova] Creating event network-changed:00a9b28e-36d9-4ac9-8cc7-3833698b6f3d for instance 8d27da31-b477-414e-8534-4b231d6fab62 on n-h2-826756-5 Aug 03 05:55:10.179076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-50a1ab86-764e-4a7a-a3cb-aaa59ca61ebb req-bc551173-a6e8-4e62-9a1b-5c2dbe9d2112 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036914 Aug 03 05:55:10.180722 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3927/7841] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:55:10.452442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:10.465159 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0764478d-9074-49d6-babb-9e52c9c3a124 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1566 microversion: 2.1 time: 0.324746 Aug 03 05:55:10.466327 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3915/7842] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:10 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:33.740892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:55:33.743146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:33.745612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=11 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:33.746988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=36 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:33.751895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:33.752370 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:33.753125 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:33.753559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:33.804041 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d3495347-a761-4ced-a191-d51447ffffdd tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action" status: 200 len: 24564 microversion: 2.1 time: 0.067319 Aug 03 05:55:33.804720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3928/7843] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:55:33 2022] POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action => generated 24564 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:55:44.851847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3692417c-a158-4f95-8963-c92661e9527c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:55:44.854186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:44.854917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=44 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:44.860567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3692417c-a158-4f95-8963-c92661e9527c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:44.861038 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3692417c-a158-4f95-8963-c92661e9527c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:44.883486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3692417c-a158-4f95-8963-c92661e9527c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Going to try to stop instance {{(pid=120832) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 05:55:45.097353 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3692417c-a158-4f95-8963-c92661e9527c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action" status: 202 len: 0 microversion: 2.1 time: 0.249314 Aug 03 05:55:45.098037 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3916/7844] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:55:44 2022] POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:55:45.107642 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:45.108290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:45.111226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:55:45.116340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:45.116800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:45.117584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:45.118027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:45.259940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:45.268172 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a74051dd-51e6-4138-a18e-10143ef3864a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.165345 Aug 03 05:55:45.268774 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3929/7845] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:45 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:46.291981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:46.292797 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:46.301044 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:46.301509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:46.302290 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:46.302747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:46.435709 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:46.443288 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-822dcd9a-3ac8-4d1c-8e28-e95dcd9766b2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.155900 Aug 03 05:55:46.443860 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3917/7846] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:46 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:47.465492 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:47.466116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:47.473096 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:47.473548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:47.474304 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:47.474738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:47.613262 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:47.620764 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4ae8e47e-b89a-4226-a978-9d4d423031fb tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.159234 Aug 03 05:55:47.621360 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3930/7847] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:47 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:48.644186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:48.644905 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:48.655761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:48.656237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:48.657103 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:48.657567 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:48.792124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:48.799973 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e8c594ff-6089-4e3e-8253-8a58f4b9fb93 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.160820 Aug 03 05:55:48.803327 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3918/7848] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:48 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:49.821213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:49.821829 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:49.829449 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:49.829900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:49.830660 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:49.831097 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:49.964131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:49.972363 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c42e35a0-de65-4c39-ab8e-9e1639f8cc51 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.155037 Aug 03 05:55:49.972957 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3931/7849] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:49 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:50.993263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:50.993896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:51.001805 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:51.002473 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:51.003281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:51.003728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:51.139969 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:51.147548 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a967c3cd-01fa-4a23-8c41-8d42d4b31652 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.158242 Aug 03 05:55:51.148125 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3919/7850] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:50 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:52.169099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:52.169745 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:52.176625 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:52.177074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:52.177836 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:52.178270 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:52.309240 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:52.316851 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e4378e3b-1920-448c-afd8-9f9573bb0e89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.152368 Aug 03 05:55:52.317431 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3932/7851] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:52 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:53.338562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:53.339116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:53.346063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:53.346570 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:53.347363 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:53.347830 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:53.484816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:53.492352 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-35b402e3-67f1-43ac-92c9-6ec53dbfd4a0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.158128 Aug 03 05:55:53.492934 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3920/7852] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:53 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:54.513090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:54.513762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:54.520832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:54.521289 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:54.522064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:54.522507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:54.654773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:54.662506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-becee7a9-0a2e-4e1d-a598-32f71e04aca8 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.153562 Aug 03 05:55:54.667212 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3933/7853] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:54 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:55.685997 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:55.686633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:55.693822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:55.694300 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:55.695112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:55.695551 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:55.829882 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:55.837531 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b2a6f069-da95-45ae-81e3-9845a161b371 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.155541 Aug 03 05:55:55.838101 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3921/7854] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:55 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:56.859878 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:56.860521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:56.867617 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:56.868105 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:56.868905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:56.869350 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:57.054831 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:57.065436 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3c5f6fcb-a32f-4df4-9cb3-a5c098ced9e2 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.210139 Aug 03 05:55:57.066037 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3934/7855] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:56 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:58.086930 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:58.087600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:58.094773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:58.095254 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:58.096059 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:58.096660 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:58.276511 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:58.284287 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-df5e258e-f9f1-498d-8ca9-740cea8cd037 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.201353 Aug 03 05:55:58.284872 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3922/7856] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:58 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:55:59.306026 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:55:59.306581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:55:59.313454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:59.313904 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:59.314664 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:55:59.315101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:55:59.449111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:55:59.457537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-644631fa-5204-4955-9cdb-c0954801b0e6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.155484 Aug 03 05:55:59.458110 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3935/7857] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:55:59 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:00.479749 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:00.480440 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:00.487679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:00.488161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:00.488984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:00.489448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:00.624003 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:00.631748 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c2711231-dc95-444e-b144-dfc84d2100c4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1695 microversion: 2.1 time: 0.155968 Aug 03 05:56:00.632263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3923/7858] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:00 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:01.653965 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:01.654581 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:01.661295 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:01.661748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:01.662837 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:01.663290 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:01.800765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:01.808294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2df6df30-51ca-4c61-8653-70f74e91329d tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1672 microversion: 2.1 time: 0.158492 Aug 03 05:56:01.808873 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3936/7859] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:01 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:02.897984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:02.900415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:02.907526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:02.907998 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:02.908812 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:02.909274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:02.959063 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2d78a147-c93b-4dd6-a113-d7e0ae37f093 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action" status: 200 len: 38488 microversion: 2.1 time: 0.064852 Aug 03 05:56:02.959627 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3924/7860] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:56:02 2022] POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action => generated 38488 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:56:02.971335 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-35e199cd-2339-47ab-bc49-acf62b71f448 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:02.978405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35e199cd-2339-47ab-bc49-acf62b71f448 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:02.978866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-35e199cd-2339-47ab-bc49-acf62b71f448 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:03.001963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-35e199cd-2339-47ab-bc49-acf62b71f448 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Going to try to start instance {{(pid=120831) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 05:56:03.176992 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-35e199cd-2339-47ab-bc49-acf62b71f448 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action" status: 202 len: 0 microversion: 2.1 time: 0.209056 Aug 03 05:56:03.177615 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3937/7861] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:56:02 2022] POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:56:03.197523 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:03.198237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:03.205499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:03.205971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:03.206752 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:03.207209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:03.339364 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:03.348057 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1d83116-2f15-4fd7-bcb7-70076f2d1b6c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1681 microversion: 2.1 time: 0.154707 Aug 03 05:56:03.354676 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3925/7862] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:03 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:04.373840 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:04.374590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:04.382017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:04.382476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:04.383249 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:04.383696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:04.521567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:04.529393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e9c46121-3d1c-485d-87d2-48ac5592ea64 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1681 microversion: 2.1 time: 0.160325 Aug 03 05:56:04.529976 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3938/7863] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:04 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:05.553374 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:05.554010 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:05.562239 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:05.562705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:05.563480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:05.563932 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:05.697891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:05.706877 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f291fe26-509f-471f-8206-91c36d6487f6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1685 microversion: 2.1 time: 0.157317 Aug 03 05:56:05.707481 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3926/7864] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:05 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:09.240110 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:56:09.240670 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 05:56:29.898162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:29.900401 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:29.903527 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=20 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:29.904947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:29.910556 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:29.911011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:29.911779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:29.912221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:29.968591 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-50680534-85ee-4f8f-86cf-e36045c64eda tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action" status: 200 len: 63045 microversion: 2.1 time: 0.074177 Aug 03 05:56:29.969280 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3939/7865] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:56:29 2022] POST /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62/action => generated 63045 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:56:37.022246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:37.022831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:37.024707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-721d9394-3c16-4213-8301-67d439134676 req-d099ac35-30f3-436b-a0b2-2f8ae1f47680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d27da31-b477-414e-8534-4b231d6fab62", "tag": "00a9b28e-36d9-4ac9-8cc7-3833698b6f3d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:37.025705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=22 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:37.026597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:37.032679 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:37.033240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:37.034119 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:37.034767 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:37.037487 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-721d9394-3c16-4213-8301-67d439134676 req-d099ac35-30f3-436b-a0b2-2f8ae1f47680 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:37.038198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-721d9394-3c16-4213-8301-67d439134676 req-d099ac35-30f3-436b-a0b2-2f8ae1f47680 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:37.057145 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-721d9394-3c16-4213-8301-67d439134676 req-d099ac35-30f3-436b-a0b2-2f8ae1f47680 service nova] Creating event network-changed:00a9b28e-36d9-4ac9-8cc7-3833698b6f3d for instance 8d27da31-b477-414e-8534-4b231d6fab62 on n-h2-826756-5 Aug 03 05:56:37.062970 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-721d9394-3c16-4213-8301-67d439134676 req-d099ac35-30f3-436b-a0b2-2f8ae1f47680 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042783 Aug 03 05:56:37.063861 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3940/7866] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:56:37.065181 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:56:37.459244 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-911bb24f-1a4c-4f5f-8904-065069861bd7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 204 len: 0 microversion: 2.1 time: 0.441162 Aug 03 05:56:37.460235 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3927/7867] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:56:37 2022] DELETE /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:56:37.469988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:37.470800 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:37.479252 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:37.479854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:37.480756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:37.481278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:37.840729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:37.848491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0365a841-7bf4-4d57-828c-a151ec4f5966 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1691 microversion: 2.1 time: 0.383472 Aug 03 05:56:37.849070 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3941/7868] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:37 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:38.871132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:38.871853 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:38.878891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:38.879366 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:38.880156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:38.880689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:39.084170 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:39.092012 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6cbf05b8-57fe-4f43-9605-03126b1f02ce tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1691 microversion: 2.1 time: 0.225268 Aug 03 05:56:39.092642 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3928/7869] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:38 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:39.599402 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b8c4daf7-2886-4933-b6c5-07832d93a547 req-2d34ac8a-0dd4-4780-ac96-2ad4dd3d105f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d27da31-b477-414e-8534-4b231d6fab62", "name": "network-vif-deleted", "tag": "00a9b28e-36d9-4ac9-8cc7-3833698b6f3d"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:39.610329 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b8c4daf7-2886-4933-b6c5-07832d93a547 req-2d34ac8a-0dd4-4780-ac96-2ad4dd3d105f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:39.610775 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b8c4daf7-2886-4933-b6c5-07832d93a547 req-2d34ac8a-0dd4-4780-ac96-2ad4dd3d105f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:39.622911 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b8c4daf7-2886-4933-b6c5-07832d93a547 req-2d34ac8a-0dd4-4780-ac96-2ad4dd3d105f service nova] Creating event network-vif-deleted:00a9b28e-36d9-4ac9-8cc7-3833698b6f3d for instance 8d27da31-b477-414e-8534-4b231d6fab62 on n-h2-826756-5 Aug 03 05:56:39.629203 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b8c4daf7-2886-4933-b6c5-07832d93a547 req-2d34ac8a-0dd4-4780-ac96-2ad4dd3d105f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Aug 03 05:56:39.629821 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3942/7870] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:56:40.115191 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:40.115708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:40.122708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:40.123180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:40.124009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:40.124489 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:40.153867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:40.154328 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:40.154788 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lazy-loading 'fault' on Instance uuid 8d27da31-b477-414e-8534-4b231d6fab62 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:56:40.196925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:40.204785 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a812ab27-276f-4811-bfaa-2f4a9f651e6a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 200 len: 1357 microversion: 2.1 time: 0.093619 Aug 03 05:56:40.205354 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3929/7871] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:40 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 1357 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:41.227584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:41.228328 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: 8d27da31-b477-414e-8534-4b231d6fab62] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:41.235478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:41.235927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:41.236707 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:41.237145 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:41.251461 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] HTTP exception thrown: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Request method failure captured: Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 HTTP/1.1 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gxw5zoSymrFpkXLxP9cN_AyEqVu62RKrj6BTZ0krVlfQpAfRy1ZY0lGKDIgkewEpB3qvBExLHzAj8czNxhMvF6j-Y0SqPxilNgohWjsc6ifCP3SKyD46S8KZXvk376VGvkLblURnbjrzIKZAMoF1Y83S7fZmAGlYv83KNViEYlCd1A Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/892f1ae57800448380d28eed911b30a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f0d17c9906b04e41a48c7bf59a80683f Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '8d27da31-b477-414e-8534-4b231d6fab62'} Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:56:41.253322 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Returning 404 to user: Instance 8d27da31-b477-414e-8534-4b231d6fab62 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6b3ba243-dd03-4480-9163-eb6f720c4a92 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62" status: 404 len: 111 microversion: 2.1 time: 0.032715 Aug 03 05:56:41.258075 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3943/7872] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:41 2022] GET /compute/v2.1/servers/8d27da31-b477-414e-8534-4b231d6fab62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:56:44.674866 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-022d8ca1-7653-4703-9688-877c0bcfce6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '.version_select at 0x7fdd473a8dc0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:44.779723 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-022d8ca1-7653-4703-9688-877c0bcfce6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139194968" status: 202 len: 0 microversion: 2.1 time: 0.111848 Aug 03 05:56:44.780969 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3930/7873] 10.222.0.72 () {58 vars in 1284 bytes} [Wed Aug 3 05:56:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139194968 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:56:44.815186 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4690b059-b406-4cbb-b418-ff45ccdf5be5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: .version_select at 0x7fdd54089160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-61995205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPArKktv+b3/ioFd4dueh1EP3BS2zWhvn2rTd4Rr3FzJmJ31b1UmEnHIlyQwB4MSkN3sSoKVr25NGI1yU/1rMI6/dkijFFoz/DQUITKM1S3KtrIsZKZ8pA+F579/WOYanw=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:44.835565 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4690b059-b406-4cbb-b418-ff45ccdf5be5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:56:44.840729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4690b059-b406-4cbb-b418-ff45ccdf5be5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:56:44.927975 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4690b059-b406-4cbb-b418-ff45ccdf5be5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.116827 Aug 03 05:56:44.928546 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3944/7874] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:56:44 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:56:53.201319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-146530576", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "networks": [{"uuid": "b9eb4754-2e88-448e-8305-13fdb8eaa4b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-61995205", "security_groups": [{"name": "tempest-secgroup-smoke-1547062959"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:53.213407 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:53.333204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] validate_networks() for [('b9eb4754-2e88-448e-8305-13fdb8eaa4b4', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:56:53.791078 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:56:53.791592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:56:53.792108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:56:53.792572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:56:53.793258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:56:53.805392 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:53.814804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:53.814804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:53.814804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:53.831209 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:56:53.837738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Getting quotas for user f0d17c9906b04e41a48c7bf59a80683f and project 892f1ae57800448380d28eed911b30a3. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:56:53.853791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:56:53.856454 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:56:53.976133 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-acc55352-ecee-444a-8a9b-b4b1e990b683 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779658 Aug 03 05:56:53.981127 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3931/7875] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:56:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 05:56:53.986076 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=16 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:56:53.990099 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3537b2c6-c44c-4693-a58f-8ff2f953427f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:53.990903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3537b2c6-c44c-4693-a58f-8ff2f953427f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:54.057181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3537b2c6-c44c-4693-a58f-8ff2f953427f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:54.065372 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3537b2c6-c44c-4693-a58f-8ff2f953427f tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1264 microversion: 2.1 time: 0.080991 Aug 03 05:56:54.065958 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3945/7876] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:53 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1264 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:55.087962 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:55.088652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:55.098155 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:55.098635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:55.099596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:55.100257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:55.169217 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:55.179178 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-264a6cf7-2eaf-414a-90de-e27364b56355 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1268 microversion: 2.1 time: 0.095635 Aug 03 05:56:55.197492 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3932/7877] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:55 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:56.201098 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:56.203124 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:56.210914 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:56.211379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:56.212164 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:56.212785 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:56.289536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:56.297494 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a2fef31a-aa1d-4cb0-b116-83263bb79f83 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1334 microversion: 2.1 time: 0.100526 Aug 03 05:56:56.298073 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3946/7878] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:56 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:57.325810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:57.326442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:57.333560 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:57.334031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:57.334816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:57.335270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:57.484387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:57.492190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-142029f4-3c36-4473-b7f4-e28680dc65ab tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.170375 Aug 03 05:56:57.492817 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3933/7879] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:57 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:57.786414 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-18374866-1d21-4982-97da-df156b93c4fe req-d7d74c8f-75fd-4d4e-ab69-ac6a1fbd62b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f107b179-6514-4478-b637-741b1c1e7ab3", "tag": "acab9e54-30f0-4b39-8fa0-f72bf8fb5724"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:56:57.797751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18374866-1d21-4982-97da-df156b93c4fe req-d7d74c8f-75fd-4d4e-ab69-ac6a1fbd62b9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:57.798313 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-18374866-1d21-4982-97da-df156b93c4fe req-d7d74c8f-75fd-4d4e-ab69-ac6a1fbd62b9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:57.809579 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-18374866-1d21-4982-97da-df156b93c4fe req-d7d74c8f-75fd-4d4e-ab69-ac6a1fbd62b9 service nova] Creating event network-changed:acab9e54-30f0-4b39-8fa0-f72bf8fb5724 for instance f107b179-6514-4478-b637-741b1c1e7ab3 on n-h1-826756-5 Aug 03 05:56:57.815811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-18374866-1d21-4982-97da-df156b93c4fe req-d7d74c8f-75fd-4d4e-ab69-ac6a1fbd62b9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034706 Aug 03 05:56:57.816458 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3947/7880] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:56:58.513058 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:58.513681 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:58.520721 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:58.521196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:58.521987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:58.522447 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:58.652690 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:58.660746 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8064e640-a682-4c4a-9e31-3405f56a9e02 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.151568 Aug 03 05:56:58.661324 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3934/7881] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:58 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:56:59.682894 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:56:59.684024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:56:59.692197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:59.692689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:59.693477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:56:59.693925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:56:59.831149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:56:59.838547 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c9bfb3bc-a24b-45bc-800d-1eaedb0bb574 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.160024 Aug 03 05:56:59.843776 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3948/7882] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:56:59 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:00.860036 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:00.860761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:00.867780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:00.868258 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:00.869080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:00.869543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:01.002486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:01.010093 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a427a406-9f19-4153-a535-2390cb605fb5 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.154228 Aug 03 05:57:01.010668 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3935/7883] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:00 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:02.033132 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:02.033740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:02.035762 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:02.040892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:02.041346 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:02.042119 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:02.042561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:02.174747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:02.182283 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e7919abe-23da-40bf-93f7-d81647f8d7f0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.153995 Aug 03 05:57:02.182864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3949/7884] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:02 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:03.203648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:03.204384 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:03.211859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:03.212354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:03.215655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:03.215655 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:03.354303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:03.362803 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6a3b6942-01e7-4cbe-aa82-6516d702ea14 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.163317 Aug 03 05:57:03.363614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3936/7885] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:03 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:03.370389 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-84934e73-ee57-40e6-a2b3-18459025ae16 req-33d35e53-fbf9-4dcb-a49c-5c1f189221a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f107b179-6514-4478-b637-741b1c1e7ab3", "name": "network-vif-plugged", "status": "completed", "tag": "acab9e54-30f0-4b39-8fa0-f72bf8fb5724"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:03.382222 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84934e73-ee57-40e6-a2b3-18459025ae16 req-33d35e53-fbf9-4dcb-a49c-5c1f189221a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:03.382674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-84934e73-ee57-40e6-a2b3-18459025ae16 req-33d35e53-fbf9-4dcb-a49c-5c1f189221a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:03.394622 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-84934e73-ee57-40e6-a2b3-18459025ae16 req-33d35e53-fbf9-4dcb-a49c-5c1f189221a5 service nova] Creating event network-vif-plugged:acab9e54-30f0-4b39-8fa0-f72bf8fb5724 for instance f107b179-6514-4478-b637-741b1c1e7ab3 on n-h1-826756-5 Aug 03 05:57:03.399782 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-84934e73-ee57-40e6-a2b3-18459025ae16 req-33d35e53-fbf9-4dcb-a49c-5c1f189221a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040167 Aug 03 05:57:03.400450 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3950/7886] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:57:04.385320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:04.386008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:04.387869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:04.388569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:04.395196 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:04.395670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:04.396501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:04.397068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:04.535796 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:04.543701 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0917ab18-2017-4f3d-9129-090595f5a4c7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1390 microversion: 2.1 time: 0.162541 Aug 03 05:57:04.544287 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3937/7887] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:04 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:05.562941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:05.568122 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:05.568866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:05.575101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:05.575597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:05.576685 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:05.577025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:05.714180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:05.722540 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-eb0b6d09-c072-4f16-a12f-3504a5b92b6e tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1561 microversion: 2.1 time: 0.160812 Aug 03 05:57:05.723119 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3951/7888] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:05 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:05.743703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:05.744417 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:05.751967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:05.752479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:05.753277 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:05.753742 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:05.886125 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:05.894441 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-420b1bf7-9af1-48a2-be1f-6642a84007e7 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1561 microversion: 2.1 time: 0.154647 Aug 03 05:57:05.895014 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3938/7889] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:05 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:08.152229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-43328931-4a20-4739-b9d8-e33c10479433 req-50d00f14-e22f-4d71-8353-bee275483b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f107b179-6514-4478-b637-741b1c1e7ab3", "tag": "acab9e54-30f0-4b39-8fa0-f72bf8fb5724"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:08.154605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:08.155794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:08.166724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:08.169951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:08.170404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:08.171374 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:08.171830 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:08.172907 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-43328931-4a20-4739-b9d8-e33c10479433 req-50d00f14-e22f-4d71-8353-bee275483b91 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:08.173385 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-43328931-4a20-4739-b9d8-e33c10479433 req-50d00f14-e22f-4d71-8353-bee275483b91 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:08.185060 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-43328931-4a20-4739-b9d8-e33c10479433 req-50d00f14-e22f-4d71-8353-bee275483b91 service nova] Creating event network-changed:acab9e54-30f0-4b39-8fa0-f72bf8fb5724 for instance f107b179-6514-4478-b637-741b1c1e7ab3 on n-h1-826756-5 Aug 03 05:57:08.190477 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-43328931-4a20-4739-b9d8-e33c10479433 req-50d00f14-e22f-4d71-8353-bee275483b91 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041848 Aug 03 05:57:08.194767 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3939/7890] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:57:08.319624 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:08.329198 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f4a8745d-97fb-447d-8a11-8bddd6a525bc tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1561 microversion: 2.1 time: 0.184132 Aug 03 05:57:08.340372 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3952/7891] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:08 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:29.566442 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=46 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:29.570884 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:29.574989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:29.580493 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:29.581009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:29.581789 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:29.582270 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:29.642174 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-28a9e789-340d-4176-bc52-ce7fe3d16080 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action" status: 200 len: 24564 microversion: 2.1 time: 0.077783 Aug 03 05:57:29.642871 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3940/7892] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:57:29 2022] POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action => generated 24564 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:57:40.570793 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:40.571382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:40.573706 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=7 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:40.574364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=34 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:40.579514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:40.579970 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:40.580771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:40.581223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:40.606931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lazy-loading 'flavor' on Instance uuid f107b179-6514-4478-b637-741b1c1e7ab3 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 05:57:40.803624 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fcb5680-a9f4-41dd-9787-e9a5bd2697c3 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action" status: 202 len: 0 microversion: 2.1 time: 0.236583 Aug 03 05:57:40.804426 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3953/7893] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:57:40 2022] POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:57:40.814984 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:40.815708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:40.818684 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=4 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:57:40.824535 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:40.824941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:40.825783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:40.826240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:40.969488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:40.977004 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-adea4bc4-ca77-44d1-9dcc-be1353b6fdd6 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1686 microversion: 2.1 time: 0.167209 Aug 03 05:57:40.977573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3941/7894] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:40 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:42.002101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:42.002727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:42.009932 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:42.010488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:42.011266 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:42.011715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:42.145325 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:42.152921 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22a1cbfd-ccbb-443a-a8c9-b5d9d7a4507c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1669 microversion: 2.1 time: 0.157643 Aug 03 05:57:42.153494 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3954/7895] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:41 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:43.249922 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:43.252152 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:43.259326 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.259806 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.260652 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.261115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.310793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc5f6822-fc11-4206-a0b0-7df0a46ea133 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action" status: 200 len: 38417 microversion: 2.1 time: 0.065317 Aug 03 05:57:43.311391 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3942/7896] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:57:43 2022] POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action => generated 38417 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:57:43.323636 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:43.324167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:43.331013 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.331456 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.332206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.332662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.511601 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-03f440ad-f80f-4282-85b1-a1eea32699a4 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action" status: 202 len: 0 microversion: 2.1 time: 0.191600 Aug 03 05:57:43.512255 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3955/7897] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:57:43 2022] POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:57:43.521278 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:43.522092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:43.529464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.529937 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.530774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:43.531233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:43.674794 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:43.682555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-001f26f8-9d2b-44c8-a4ed-0c93fa679770 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1675 microversion: 2.1 time: 0.165546 Aug 03 05:57:43.683322 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3943/7898] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:43 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:44.705178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:44.705902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:44.712180 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:44.712659 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:44.713415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:44.713846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:44.846752 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:44.854251 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-788cef6e-51c7-483c-a236-17f2d46de39a tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1675 microversion: 2.1 time: 0.154871 Aug 03 05:57:44.854826 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3956/7899] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:44 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:45.876845 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:45.877480 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:45.884430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:45.884903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:45.885683 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:45.886166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:46.024804 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:46.032510 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4f76364c-3a89-43ed-8d09-552f13945b69 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1678 microversion: 2.1 time: 0.160305 Aug 03 05:57:46.033109 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3944/7900] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:45 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:57:46.124450 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:46.126710 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:46.133502 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:46.133959 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:46.134724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:46.135165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:46.175075 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3025cb2a-a869-4500-979a-99602905ae9c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action" status: 200 len: 38417 microversion: 2.1 time: 0.054910 Aug 03 05:57:46.175982 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3957/7901] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 05:57:46 2022] POST /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3/action => generated 38417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 05:57:47.240594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:47.241097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:47.248355 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:47.248850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:47.249693 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:47.250284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-4690456c-e930-48a7-9827-38a4dcd80a43 req-5a44c475-5120-4acb-bd6e-afaddcc23e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f107b179-6514-4478-b637-741b1c1e7ab3", "tag": "acab9e54-30f0-4b39-8fa0-f72bf8fb5724"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:47.250719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:47.261115 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4690456c-e930-48a7-9827-38a4dcd80a43 req-5a44c475-5120-4acb-bd6e-afaddcc23e93 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:47.261557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-4690456c-e930-48a7-9827-38a4dcd80a43 req-5a44c475-5120-4acb-bd6e-afaddcc23e93 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:47.275165 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-4690456c-e930-48a7-9827-38a4dcd80a43 req-5a44c475-5120-4acb-bd6e-afaddcc23e93 service nova] Creating event network-changed:acab9e54-30f0-4b39-8fa0-f72bf8fb5724 for instance f107b179-6514-4478-b637-741b1c1e7ab3 on n-h1-826756-5 Aug 03 05:57:47.277672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 05:57:47.281013 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-4690456c-e930-48a7-9827-38a4dcd80a43 req-5a44c475-5120-4acb-bd6e-afaddcc23e93 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034185 Aug 03 05:57:47.281864 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3958/7902] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:57:47.515378 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-db836967-2685-40bf-83a5-1d06806fca35 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 204 len: 0 microversion: 2.1 time: 0.277736 Aug 03 05:57:47.516392 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3945/7903] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 05:57:47 2022] DELETE /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 05:57:47.525413 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:47.526218 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:47.534602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:47.534963 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:47.536234 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:47.536770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:47.674002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:47.681742 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e48b6955-0dfd-4fd1-b401-760b84268b10 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1684 microversion: 2.1 time: 0.161059 Aug 03 05:57:47.688147 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3959/7904] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:47 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:48.706012 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:48.706747 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:48.713883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:48.714365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:48.715168 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:48.715631 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:48.860716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:48.868560 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f03d0eeb-2e5d-4aed-a705-18b25aa7e4b0 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1684 microversion: 2.1 time: 0.167524 Aug 03 05:57:48.869144 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3946/7905] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:48 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:49.713627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e2c87a92-ad5c-4e2c-a9ae-968618151545 req-ec982698-09a7-4985-86dd-5eb212426b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f107b179-6514-4478-b637-741b1c1e7ab3", "name": "network-vif-deleted", "tag": "acab9e54-30f0-4b39-8fa0-f72bf8fb5724"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:57:49.724680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e2c87a92-ad5c-4e2c-a9ae-968618151545 req-ec982698-09a7-4985-86dd-5eb212426b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:49.725128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e2c87a92-ad5c-4e2c-a9ae-968618151545 req-ec982698-09a7-4985-86dd-5eb212426b6c service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:49.736076 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e2c87a92-ad5c-4e2c-a9ae-968618151545 req-ec982698-09a7-4985-86dd-5eb212426b6c service nova] Creating event network-vif-deleted:acab9e54-30f0-4b39-8fa0-f72bf8fb5724 for instance f107b179-6514-4478-b637-741b1c1e7ab3 on n-h1-826756-5 Aug 03 05:57:49.741093 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e2c87a92-ad5c-4e2c-a9ae-968618151545 req-ec982698-09a7-4985-86dd-5eb212426b6c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100951 Aug 03 05:57:49.741689 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3960/7906] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:57:49.889710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:49.890370 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:49.897810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:49.898288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:49.899092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:49.899751 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:49.979515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0d17c9906b04e41a48c7bf59a80683f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f1ae57800448380d28eed911b30a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:57:49.987911 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7f5fe1fd-870a-4680-ac95-22f046dd2811 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 200 len: 1349 microversion: 2.1 time: 0.102072 Aug 03 05:57:49.992335 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3947/7907] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:49 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:57:51.011661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:51.012921 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] [instance: f107b179-6514-4478-b637-741b1c1e7ab3] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:57:51.019751 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:51.020208 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:51.021000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:57:51.021460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:57:51.035528 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] HTTP exception thrown: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Request method failure captured: Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 HTTP/1.1 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6gxw5zoSymrFpkXLxP9cN_AyEqVu62RKrj6BTZ0krVlfQpAfRy1ZY0lGKDIgkewEpB3qvBExLHzAj8czNxhMvF6j-Y0SqPxilNgohWjsc6ifCP3SKyD46S8KZXvk376VGvkLblURnbjrzIKZAMoF1Y83S7fZmAGlYv83KNViEYlCd1A Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_892f1ae57800448380d28eed911b30a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/892f1ae57800448380d28eed911b30a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 892f1ae57800448380d28eed911b30a3 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-206331214 Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: f0d17c9906b04e41a48c7bf59a80683f Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestNetworkAdvancedServerOps-206331214-project Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': 'f107b179-6514-4478-b637-741b1c1e7ab3'} Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:57:51.037200 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Returning 404 to user: Instance f107b179-6514-4478-b637-741b1c1e7ab3 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c2221f61-e9f9-4419-ab86-747f5bad391c tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3" status: 404 len: 111 microversion: 2.1 time: 0.034708 Aug 03 05:57:51.041919 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3961/7908] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:57:51 2022] GET /compute/v2.1/servers/f107b179-6514-4478-b637-741b1c1e7ab3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 05:57:54.549099 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-951e83d7-e69b-4cf3-8a1c-443208ad8d89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] Calling method '.version_select at 0x7fdd47eacee0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:57:54.641592 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-951e83d7-e69b-4cf3-8a1c-443208ad8d89 tempest-TestNetworkAdvancedServerOps-206331214 tempest-TestNetworkAdvancedServerOps-206331214-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-61995205" status: 202 len: 0 microversion: 2.1 time: 0.096894 Aug 03 05:57:54.642105 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3948/7909] 10.222.0.72 () {58 vars in 1278 bytes} [Wed Aug 3 05:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-61995205 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 05:58:10.204927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=18 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:10.205668 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:10.378566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d69589f6-f1f3-4d41-b0e5-003bac1c118e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'create', calling method: .version_select at 0x7fdd4759faf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2029661525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn23+6lW1D2aXu1BAv+1MiXpDnmfN+D6Df2yJSgI/1D4rxnFnaJ6MQGw2foxasJloUcDbWxKZ83rFsAH0qtmJxoP0TX3W1nlcnV5OdMRXOUtPWUSJ5L+7qSwKJX1KB+Mg=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:58:10.394605 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d69589f6-f1f3-4d41-b0e5-003bac1c118e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for project 1013377741a240d78e10e8d61b37c497. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:58:10.399748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-d69589f6-f1f3-4d41-b0e5-003bac1c118e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for user c81076a31bf24ab09e9f17df86955822 and project 1013377741a240d78e10e8d61b37c497. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:58:10.504950 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d69589f6-f1f3-4d41-b0e5-003bac1c118e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.305976 Aug 03 05:58:10.505566 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3962/7910] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 05:58:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:58:13.010635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:13.011542 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:13.015737 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-172703249", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2029661525", "security_groups": [{"name": "tempest-secgroup-smoke-1268764561"}], "networks": [{"uuid": "c7ac81db-cd00-4b52-8ba2-361cd70bc1e3"}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:58:13.169874 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] validate_networks() for [('c7ac81db-cd00-4b52-8ba2-361cd70bc1e3', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 05:58:13.774475 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 05:58:13.774946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 05:58:13.775509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 05:58:13.776112 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 05:58:13.776734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 05:58:13.787386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:13.787892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:13.789048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:13.789508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:13.808019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for project 1013377741a240d78e10e8d61b37c497. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 05:58:13.813716 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for user c81076a31bf24ab09e9f17df86955822 and project 1013377741a240d78e10e8d61b37c497. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 05:58:13.826539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 05:58:13.828959 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 05:58:13.929398 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d8e7c9d4-3e0c-4ec9-9b9c-458997c4f5b8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.920204 Aug 03 05:58:13.930242 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3949/7911] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 05:58:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 05:58:13.942072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b6dd637c-2ac3-4b38-a4af-a43530055fda tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:13.943379 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b6dd637c-2ac3-4b38-a4af-a43530055fda tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:14.024282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b6dd637c-2ac3-4b38-a4af-a43530055fda tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:14.031769 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b6dd637c-2ac3-4b38-a4af-a43530055fda tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1246 microversion: 2.1 time: 0.093804 Aug 03 05:58:14.033343 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3963/7912] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:13 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:15.054505 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:15.055291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:15.067349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:15.067349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:15.067349 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:15.067829 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:15.137386 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:15.145379 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-50d0cd07-2bae-4851-abe9-00a002aeeed7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1250 microversion: 2.1 time: 0.096245 Aug 03 05:58:15.145970 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3950/7913] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:15 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:16.166460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:16.167087 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:16.174405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:16.175405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:16.176254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:16.176844 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:16.242261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:16.250326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-51422431-36d7-480f-aae5-29899dc59c81 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1316 microversion: 2.1 time: 0.088151 Aug 03 05:58:16.250905 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3964/7914] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:16 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:17.274048 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:17.274682 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:17.282302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:17.282773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:17.283569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:17.284237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:17.423040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:17.431865 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9ced48b4-8a83-4d83-8d64-4942f8dbd52a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.161668 Aug 03 05:58:17.432546 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3951/7915] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:17 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:17.610446 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-efd6f279-9fe1-4e3a-bc3e-d41f513184f5 req-134e4ee7-92c8-4904-9fd2-9be4c27646b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:58:17.621771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-efd6f279-9fe1-4e3a-bc3e-d41f513184f5 req-134e4ee7-92c8-4904-9fd2-9be4c27646b9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:17.622223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-efd6f279-9fe1-4e3a-bc3e-d41f513184f5 req-134e4ee7-92c8-4904-9fd2-9be4c27646b9 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:17.633705 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-efd6f279-9fe1-4e3a-bc3e-d41f513184f5 req-134e4ee7-92c8-4904-9fd2-9be4c27646b9 service nova] Creating event network-changed:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 05:58:17.638624 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-efd6f279-9fe1-4e3a-bc3e-d41f513184f5 req-134e4ee7-92c8-4904-9fd2-9be4c27646b9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Aug 03 05:58:17.639397 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3965/7916] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:58:18.454445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:18.455090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:18.462382 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:18.462861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:18.463663 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:18.464123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:18.598187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:18.606067 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-163647f9-11c0-43e2-8c73-8fdedc66e53f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.155781 Aug 03 05:58:18.606646 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3952/7917] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:18 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:19.628444 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:19.629165 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:19.635431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:19.635893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:19.636696 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:19.637143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:19.771047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:19.778600 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-14a80b45-4100-47ba-a6c7-49cae4013c8c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.155300 Aug 03 05:58:19.779113 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3966/7918] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:19 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:20.801552 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:20.802192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:20.809525 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:20.810008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:20.810807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:20.811275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:20.952427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:20.961069 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-e007d124-c5a0-4054-93f5-5757e0411d46 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.164149 Aug 03 05:58:20.961586 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3953/7919] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:20 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:21.982486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:21.983027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:21.990774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:21.991226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:21.992007 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:21.992477 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:22.132206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:22.139793 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-cede51f2-cdd0-4230-ae77-bea2a406643f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.161630 Aug 03 05:58:22.140440 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3967/7920] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:21 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 05:58:23.161517 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:23.162156 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:23.168619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:23.169096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:23.169891 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:23.170352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:23.306685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:23.314273 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f771a48c-8c80-4327-8a88-56fe8f14246a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.157349 Aug 03 05:58:23.314847 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3954/7921] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:23 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:23.782627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-77ebb59a-d536-4f8c-a828-e642c4cedaf3 req-cc215b9a-55f6-4f2f-be49-7795cf6e5c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "name": "network-vif-plugged", "status": "completed", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:58:23.793474 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-77ebb59a-d536-4f8c-a828-e642c4cedaf3 req-cc215b9a-55f6-4f2f-be49-7795cf6e5c23 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:23.793927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-77ebb59a-d536-4f8c-a828-e642c4cedaf3 req-cc215b9a-55f6-4f2f-be49-7795cf6e5c23 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:23.805869 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-77ebb59a-d536-4f8c-a828-e642c4cedaf3 req-cc215b9a-55f6-4f2f-be49-7795cf6e5c23 service nova] Creating event network-vif-plugged:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 05:58:23.811683 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-77ebb59a-d536-4f8c-a828-e642c4cedaf3 req-cc215b9a-55f6-4f2f-be49-7795cf6e5c23 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090960 Aug 03 05:58:23.812213 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3968/7922] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 05:58:24.336131 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:24.336704 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:24.338600 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:24.339406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:24.345190 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:24.348705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:24.348705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:24.348705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:24.485783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:24.493443 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2f552185-e847-4090-b6dd-18fbf04dbb30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1372 microversion: 2.1 time: 0.162124 Aug 03 05:58:24.494029 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3955/7923] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:24 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:25.512541 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 05:58:25.518179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:25.518891 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:25.527250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:25.527743 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:25.528548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:25.528994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:25.663704 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:25.671470 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6113008a-96b2-4cf3-bed2-41744885bbea tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1557 microversion: 2.1 time: 0.159951 Aug 03 05:58:25.672057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3969/7924] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:25 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:25.692408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 05:58:25.693164 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 05:58:25.700466 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:25.701019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:25.701893 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:25.702427 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:25.846778 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 05:58:25.855111 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cdd3b8d4-7949-4d33-beb5-7fd1aaaad8d3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1557 microversion: 2.1 time: 0.166977 Aug 03 05:58:25.855716 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3956/7925] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 05:58:25 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 05:58:28.145572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-92021b41-09ff-490a-ae2e-32ccfd4dc255 req-bb14cc0d-0c56-47c7-9946-77213f8ac2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 05:58:28.155788 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-92021b41-09ff-490a-ae2e-32ccfd4dc255 req-bb14cc0d-0c56-47c7-9946-77213f8ac2b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 05:58:28.156326 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-92021b41-09ff-490a-ae2e-32ccfd4dc255 req-bb14cc0d-0c56-47c7-9946-77213f8ac2b5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 05:58:28.169634 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-92021b41-09ff-490a-ae2e-32ccfd4dc255 req-bb14cc0d-0c56-47c7-9946-77213f8ac2b5 service nova] Creating event network-changed:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 05:58:28.174501 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-92021b41-09ff-490a-ae2e-32ccfd4dc255 req-bb14cc0d-0c56-47c7-9946-77213f8ac2b5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 Aug 03 05:58:28.175853 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3970/7926] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 05:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 05:59:29.249167 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 05:59:29.249825 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 05:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:00:23.216340 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 06:00:23.216928 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:23.218319 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=44 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:23.222320 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:00:23.222872 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:23.228850 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:23.232641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:23.232641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:23.232641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:23.252972 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lazy-loading 'flavor' on Instance uuid 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 06:00:23.741535 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-88dd9d73-9d80-4f80-aa51-2086daaad408 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd/action" status: 202 len: 0 microversion: 2.1 time: 0.527145 Aug 03 06:00:23.742136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3957/7927] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:00:23 2022] POST /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:00:23.750160 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] AMQP server on 10.222.0.72:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 06:00:23.754741 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:00:23.754741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:23.754741 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=30 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:23.756907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:23.757623 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:23.763927 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:23.765178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:23.766000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:23.766532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:23.902172 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:23.910278 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-07fab770-944c-4a29-84c8-42a182663bbc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.163248 Aug 03 06:00:23.910857 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3971/7928] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:23 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:24.934970 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:24.935634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:24.945116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:24.945586 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:24.946373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:24.946820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:24.952371 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 44972. Aug 03 06:00:25.085311 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:25.093664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dffebf67-2618-4391-9e95-8ef9ec5a8bb9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.164157 Aug 03 06:00:25.094236 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3958/7929] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:24 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:26.114675 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:26.115206 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:26.130571 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 44978. Aug 03 06:00:26.133644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:26.134101 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:26.134897 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:26.135334 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:26.142173 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 44976. Aug 03 06:00:26.272771 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:26.281059 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a928a1cc-ef07-4582-95d3-f8796e9e132b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.170693 Aug 03 06:00:26.281649 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3972/7930] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:26 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:27.303135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:27.303776 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:27.310881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:27.311378 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:27.312901 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:27.313448 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:27.446860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:27.455453 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-3e32e7ac-d1fa-48ed-8c9d-6c4dfa6f8f5a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.156169 Aug 03 06:00:27.456027 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3959/7931] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:27 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:28.476147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:28.508826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:28.508826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:28.508826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:28.508826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:28.508826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:28.618481 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:28.626717 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93bf083f-bce9-4c65-b56c-32fd8a49def3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.154505 Aug 03 06:00:28.627276 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3973/7932] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:28 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:29.648828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:29.649482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:29.657020 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:29.657538 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:29.658323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:29.658783 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:29.797462 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:29.805144 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fee0163d-d8aa-4c0a-bde6-721a1b1bb8c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.160304 Aug 03 06:00:29.806659 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3960/7933] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:29 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:30.826811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:30.827423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:30.835056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:30.835504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:30.836260 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:30.836783 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:30.971667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:30.979153 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-92b718e8-50a6-46e1-96ff-6de6017866ef tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.156209 Aug 03 06:00:30.979725 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3974/7934] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:30 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:32.000633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:32.001414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:32.008313 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:32.008781 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:32.009564 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:32.010021 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:32.144602 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:32.152152 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0166dda6-e419-44cb-9ad3-ecf0916c7b77 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.155573 Aug 03 06:00:32.152736 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3961/7935] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:31 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:33.174967 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:33.175586 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:33.182629 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:33.183086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:33.183862 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:33.184327 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:33.323255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:33.331036 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-159f8bb6-a5a3-4780-8f33-70fe2b715272 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.160091 Aug 03 06:00:33.331603 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3975/7936] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:33 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:34.352380 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:34.353039 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:34.360095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:34.361281 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:34.362166 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:34.362634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:34.494543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:34.502459 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4379b2a8-db2c-4d67-a009-733476c8f117 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1701 microversion: 2.1 time: 0.154014 Aug 03 06:00:34.503041 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3962/7937] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:34 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:35.524155 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:35.524792 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:35.531694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:35.532143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:35.533050 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:35.533485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:35.668994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:35.675086 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c0cd3d21-0bde-44e3-ae79-a356ed9bff0d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1701 microversion: 2.1 time: 0.154762 Aug 03 06:00:35.675895 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3976/7938] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:35 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:36.699341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:36.700699 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:36.708985 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:36.709468 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:36.710490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:36.710979 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:36.861694 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:36.870576 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ce987a5f-45f3-4fb7-bd93-dcb70ad48fc4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.177393 Aug 03 06:00:36.871169 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3963/7939] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:36 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:37.894877 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:37.896475 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:37.906051 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:37.906438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:37.907223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:37.907946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:38.077517 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:38.090400 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-85b6e698-92b0-4b5f-a186-db2d084604b1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.199816 Aug 03 06:00:38.101424 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3977/7940] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:37 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:38.261072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-b141bb66-36c2-4644-adf9-58edee4babe4 req-5f1a248e-9eac-4256-ab3b-b82c92c1928d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "name": "network-vif-plugged", "status": "completed", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:00:38.276204 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b141bb66-36c2-4644-adf9-58edee4babe4 req-5f1a248e-9eac-4256-ab3b-b82c92c1928d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:38.276701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-b141bb66-36c2-4644-adf9-58edee4babe4 req-5f1a248e-9eac-4256-ab3b-b82c92c1928d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:38.290977 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-b141bb66-36c2-4644-adf9-58edee4babe4 req-5f1a248e-9eac-4256-ab3b-b82c92c1928d service nova] Creating event network-vif-plugged:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 06:00:38.296664 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-b141bb66-36c2-4644-adf9-58edee4babe4 req-5f1a248e-9eac-4256-ab3b-b82c92c1928d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039105 Aug 03 06:00:38.297499 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3964/7941] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 06:00:39.123311 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:39.123941 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:39.132217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:39.132708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:39.133501 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:39.133948 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:39.289332 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:39.297589 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8780006e-22f3-41fe-b540-fe87ae18232c tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.178245 Aug 03 06:00:39.298862 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3978/7942] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:39 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:40.320147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:40.321031 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:40.328881 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:40.330230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:40.331365 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:40.331885 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:40.475264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:40.483191 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8b2330ae-a6c1-4b73-b0c3-d39e55570995 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.167281 Aug 03 06:00:40.483760 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3965/7943] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:40 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:41.506184 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:41.506794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:41.514649 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:41.515415 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:41.516196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:41.516725 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:41.680507 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:41.688502 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e5182bda-d7aa-449a-9ce1-f8ab102ee53b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.187148 Aug 03 06:00:41.689697 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3979/7944] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:41 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:00:42.713895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:42.714611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:42.722546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:42.724863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:42.724863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:42.724863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:42.873895 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:42.888289 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6249b803-c3d8-44e8-8920-84bc31683826 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.178234 Aug 03 06:00:42.888914 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3966/7945] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:42 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:43.910247 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:43.910983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:43.918991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:43.920627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:43.921907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:43.922344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:44.087832 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:44.098770 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4b346acc-ded9-4b60-9491-b6634539c3ad tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.192448 Aug 03 06:00:44.099504 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3980/7946] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:43 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:45.123367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:45.124018 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:45.132596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:45.133069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:45.133879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:45.134336 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:45.291822 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:45.300419 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-36df9c4d-428e-48c5-9a50-13a8d2a926c2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.181126 Aug 03 06:00:45.301009 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3967/7947] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:45 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:46.323439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:46.324070 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:46.331991 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:46.332489 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:46.333296 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:46.333746 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:46.476503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:46.484527 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1cb7c0be-2844-4883-b024-752048eb2405 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1696 microversion: 2.1 time: 0.165175 Aug 03 06:00:46.496291 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3981/7948] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:46 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:47.506323 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:47.506953 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:47.513630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:47.514094 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:47.514883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:47.515330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:47.653653 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:47.661724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c107f594-bb85-4de1-aa39-cafdd0786e94 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1678 microversion: 2.1 time: 0.159208 Aug 03 06:00:47.662515 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3968/7949] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:47 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:00:48.694979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:48.695715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:48.702833 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:48.709128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:48.709128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:48.709128 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:48.843049 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:48.851007 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-6d776ac5-db00-4d6f-b9db-03748cc1ef26 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1678 microversion: 2.1 time: 0.160000 Aug 03 06:00:48.851582 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3982/7950] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:48 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:49.873091 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:49.873698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:49.881575 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:49.882064 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:49.882848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:49.883305 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.023626 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:50.031393 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b34a9ef0-3bc1-41a6-bf8a-d1943577eb47 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1681 microversion: 2.1 time: 0.162194 Aug 03 06:00:50.032942 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3969/7951] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:49 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:50.053146 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:00:50.053773 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:50.060845 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:50.061301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.062104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:50.062570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.155778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120831) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 06:00:50.259432 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-026dea84-b47f-4ce1-b10d-1823f1f9343c req-91e78387-9624-4729-84b3-f23caa88c5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "name": "network-vif-unplugged", "status": "completed", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:00:50.269275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-026dea84-b47f-4ce1-b10d-1823f1f9343c req-91e78387-9624-4729-84b3-f23caa88c5ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:50.271738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-026dea84-b47f-4ce1-b10d-1823f1f9343c req-91e78387-9624-4729-84b3-f23caa88c5ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.280676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.compute.server_external_events [req-026dea84-b47f-4ce1-b10d-1823f1f9343c req-91e78387-9624-4729-84b3-f23caa88c5ac service nova] Unable to find a host for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd. Dropping event network-vif-unplugged {{(pid=120832) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 06:00:50.281563 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-026dea84-b47f-4ce1-b10d-1823f1f9343c req-91e78387-9624-4729-84b3-f23caa88c5ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026066 Aug 03 06:00:50.282157 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3970/7952] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 03 06:00:50.496537 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5c0565d0-bfe4-4671-9438-2f1b956fd77b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd/action" status: 202 len: 0 microversion: 2.1 time: 0.447949 Aug 03 06:00:50.497084 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3983/7953] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:00:50 2022] POST /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:00:50.505540 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:50.506809 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:50.512257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:50.512757 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.513544 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:50.514000 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:50.648917 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:50.656594 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f1262255-6f8d-4ad9-a5b4-332dc834371b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1629 microversion: 2.1 time: 0.155221 Aug 03 06:00:50.657160 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3971/7954] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:50 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:51.681072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:51.682491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:51.692223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:51.692223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:51.692223 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:51.693338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:51.834287 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:51.841908 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1775554f-ffaa-49b6-abfd-f644071dda31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1629 microversion: 2.1 time: 0.166306 Aug 03 06:00:51.842481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3984/7955] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:51 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1629 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:52.862971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:52.863601 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:52.871646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:52.872124 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:52.872965 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:52.873430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:53.008971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:53.012574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:53.017475 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5d53e92d-c55e-4004-b145-ed8f0869e722 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.157898 Aug 03 06:00:53.018625 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3972/7956] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:52 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:54.045264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:54.046694 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:54.055553 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:54.056385 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:54.057424 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:54.058217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:54.061410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:54.255179 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:54.263645 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-986a342f-69fa-4257-b802-377623fa4601 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.222144 Aug 03 06:00:54.264470 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3985/7957] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:54 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:55.286232 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:55.287179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:55.295958 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=33 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:55.298183 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:55.299605 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:55.300574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:55.301150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:55.446200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:55.453858 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-702e1043-aa5c-4b2e-bbc9-073c8aa5f898 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.172399 Aug 03 06:00:55.454615 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3973/7958] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:55 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:56.476937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:56.477682 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:56.479538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:00:56.484713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:56.491944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:56.491944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:56.491944 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:56.704040 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:56.704040 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a3e028fe-24d2-4b03-9190-fe17f8d8a3e2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.229005 Aug 03 06:00:56.704040 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3986/7959] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:56 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:57.725041 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:57.726975 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:57.732903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:57.733367 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:57.734192 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:57.734642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:57.947710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:57.956426 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-33d1f258-974b-4b3d-9b71-3adf27079b13 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.235888 Aug 03 06:00:57.956947 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3974/7960] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:57 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:00:58.979653 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:00:58.980301 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:00:58.992000 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:58.992486 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:58.993277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:00:58.993716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:00:59.143814 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:00:59.157498 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e4607f8b-06b4-4d92-a8c6-3c606b437cbe tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.183167 Aug 03 06:00:59.159081 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3987/7961] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:00:58 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:00.181740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:00.182408 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:00.189594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:00.190200 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:00.191219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:00.191671 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:00.346591 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:00.346591 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-49dadfdd-b4d5-45a6-bcbd-d246ca4171e9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.166077 Aug 03 06:01:00.346591 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3975/7962] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:00 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:01.367130 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:01.367689 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:01.374819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:01.375275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:01.376189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:01.377521 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:01.508562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:01.516138 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a5d45886-775b-4070-a56c-50a986adf257 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.153215 Aug 03 06:01:01.516755 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3988/7963] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:01 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:02.537641 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:02.538287 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:02.545543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:02.546015 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:02.546799 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:02.547257 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:02.687065 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:02.691793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-7eb2a4de-a239-4dc1-99a8-c39c0fb69286 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.158629 Aug 03 06:01:02.692394 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3976/7964] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:02 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:03.714324 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:03.715107 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:03.722755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:03.723237 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:03.724010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:03.724494 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:03.859557 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:03.870870 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-453367c5-3522-41be-93c0-0f57e362fe4a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.160486 Aug 03 06:01:03.871453 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3989/7965] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:03 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:04.895414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:04.895996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:04.902981 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:04.903467 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:04.904285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:04.904750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:05.037182 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:05.045084 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37f8a3f1-1c36-4b6e-b7e8-69b80f568393 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.154603 Aug 03 06:01:05.046058 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3977/7966] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:04 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:06.067567 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:06.068136 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:06.075081 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:06.075543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:06.076610 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:06.077055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:06.212848 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:06.220628 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-78788317-1d85-45e5-8315-0ec955407bf1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.157400 Aug 03 06:01:06.221481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3990/7967] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:06 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:06.364565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-7a8978f7-8ade-4cb2-8365-1800531b082e req-b0a0d4b8-1ae3-4f5b-aca6-909e06443664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "name": "network-vif-plugged", "status": "completed", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:01:06.374978 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a8978f7-8ade-4cb2-8365-1800531b082e req-b0a0d4b8-1ae3-4f5b-aca6-909e06443664 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:06.375443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-7a8978f7-8ade-4cb2-8365-1800531b082e req-b0a0d4b8-1ae3-4f5b-aca6-909e06443664 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:06.387385 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-7a8978f7-8ade-4cb2-8365-1800531b082e req-b0a0d4b8-1ae3-4f5b-aca6-909e06443664 service nova] Creating event network-vif-plugged:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 06:01:06.392726 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-7a8978f7-8ade-4cb2-8365-1800531b082e req-b0a0d4b8-1ae3-4f5b-aca6-909e06443664 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031953 Aug 03 06:01:06.393389 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3978/7968] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:01:07.242647 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:07.243264 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:07.250278 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:07.250734 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:07.251498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:07.251942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:07.384964 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:07.392811 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8230551d-47b8-4372-9bdd-458e4b57c6c8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.154133 Aug 03 06:01:07.394138 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3991/7969] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:07 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:08.416060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:08.416966 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:08.423390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:08.423860 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:08.424670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:08.425129 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:08.569810 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:08.577576 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0e084478-621f-4b40-a7bf-ef5f7b93a9bb tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1687 microversion: 2.1 time: 0.167138 Aug 03 06:01:08.578171 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3979/7970] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:08 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:08.727006 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:01:08.727217 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:01:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:01:08.825551 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:01:08.825767 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:01:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:01:09.080623 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:01:09.081150 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:01:09.599530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:01:09.600282 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:01:09.607560 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:09.608011 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:09.608880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:01:09.609323 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:01:09.741652 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:01:09.749493 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-125128ef-7117-4346-95f6-dd2a6f26e9db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1674 microversion: 2.1 time: 0.153859 Aug 03 06:01:09.750074 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3992/7971] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:01:09 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:01:41.255601 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:01:41.256891 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:01:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:02:20.587434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=13 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:20.588664 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=38 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:20.591893 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-e01d33d4-b4cd-489c-ac35-ce5fcb42740b req-562310a2-b0c1-4315-8b67-ed4b4f1ccb98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:02:20.592646 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:20.593316 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:20.597940 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:20.599063 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=47 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:20.600198 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:20.604332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:20.604332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:20.604332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:20.605104 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e01d33d4-b4cd-489c-ac35-ce5fcb42740b req-562310a2-b0c1-4315-8b67-ed4b4f1ccb98 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:20.605564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-e01d33d4-b4cd-489c-ac35-ce5fcb42740b req-562310a2-b0c1-4315-8b67-ed4b4f1ccb98 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:20.618256 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-e01d33d4-b4cd-489c-ac35-ce5fcb42740b req-562310a2-b0c1-4315-8b67-ed4b4f1ccb98 service nova] Creating event network-changed:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 06:02:20.625126 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-e01d33d4-b4cd-489c-ac35-ce5fcb42740b req-562310a2-b0c1-4315-8b67-ed4b4f1ccb98 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037660 Aug 03 06:02:20.625751 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3993/7972] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 06:02:20.632878 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 06:02:20.840690 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-10a1b847-fa49-44e9-9c56-209ea1f00da3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "DELETE /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 204 len: 0 microversion: 2.1 time: 0.256338 Aug 03 06:02:20.841289 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3980/7973] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 06:02:20 2022] DELETE /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 06:02:20.850780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:20.851563 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:20.859333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:20.859957 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:20.860779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:20.861226 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:21.008111 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:21.016409 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1b9e445b-3b2b-4dd2-afaf-67ae5fe0f16e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.170408 Aug 03 06:02:21.017137 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3994/7974] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:20 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:02:22.039117 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:22.040100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:22.047228 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:22.047724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:22.048534 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:22.048983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:22.207574 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:22.216761 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4ef8f2ef-bc81-4ef3-9eec-f55ee81258fc tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1680 microversion: 2.1 time: 0.181944 Aug 03 06:02:22.217367 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3981/7975] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:22 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:22.809023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-470527be-2d10-461c-b08e-93cf2e681e99 req-2023e551-91ea-4c6b-b8fd-a529badecc77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "966e6b4c-cfb0-4e4f-aade-aa6207da8ffd", "name": "network-vif-deleted", "tag": "74af0983-4f4b-4922-8ea3-2a706e56ec97"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:02:22.818709 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-470527be-2d10-461c-b08e-93cf2e681e99 req-2023e551-91ea-4c6b-b8fd-a529badecc77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:22.819151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-470527be-2d10-461c-b08e-93cf2e681e99 req-2023e551-91ea-4c6b-b8fd-a529badecc77 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:22.830681 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-470527be-2d10-461c-b08e-93cf2e681e99 req-2023e551-91ea-4c6b-b8fd-a529badecc77 service nova] Creating event network-vif-deleted:74af0983-4f4b-4922-8ea3-2a706e56ec97 for instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd on n-h1-826756-5 Aug 03 06:02:22.835724 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-470527be-2d10-461c-b08e-93cf2e681e99 req-2023e551-91ea-4c6b-b8fd-a529badecc77 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084868 Aug 03 06:02:22.836352 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3995/7976] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:02:23.238710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:23.239341 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:23.246179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:23.246650 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:23.247435 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:23.247892 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:23.278871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:23.279248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:23.279711 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lazy-loading 'fault' on Instance uuid 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 06:02:23.323151 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:23.331082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-25ee6808-6d3b-4cf7-8712-b1463c16b414 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 200 len: 1336 microversion: 2.1 time: 0.096427 Aug 03 06:02:23.331652 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3982/7977] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:23 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:24.354889 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:24.355599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:24.361905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:24.362364 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:24.363131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:24.363576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:24.378236 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] HTTP exception thrown: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Request method failure captured: Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd HTTP/1.1 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6g5rzZjycGF2rLbzN8scXi5V96JCsB4oaZ20aZMJpU42ysJhSoOXGiaiaEA5zW__i8qIQ-F5uHPM6_F6hYQhXC7HVqo3vmA0kcKFF-9CaGNLkBxvQas1RCiAXTMsIJdKHW9JFJCNB9S9pv7gsO4zdxP8Iz2wMvA9d55dUuuAsHEHmbo Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 1013377741a240d78e10e8d61b37c497 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestShelveInstance-924312566 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1013377741a240d78e10e8d61b37c497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1013377741a240d78e10e8d61b37c497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1013377741a240d78e10e8d61b37c497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1013377741a240d78e10e8d61b37c497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestShelveInstance-924312566 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 1013377741a240d78e10e8d61b37c497 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestShelveInstance-924312566 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestShelveInstance-924312566-project Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: c81076a31bf24ab09e9f17df86955822 Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestShelveInstance-924312566-project Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '966e6b4c-cfb0-4e4f-aade-aa6207da8ffd'} Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:02:24.379846 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Returning 404 to user: Instance 966e6b4c-cfb0-4e4f-aade-aa6207da8ffd could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-91555a53-fe03-43c0-a24c-8ea1ac2da822 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd" status: 404 len: 111 microversion: 2.1 time: 0.032068 Aug 03 06:02:24.385371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3996/7978] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:24 2022] GET /compute/v2.1/servers/966e6b4c-cfb0-4e4f-aade-aa6207da8ffd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 06:02:24.614259 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0d6524eb-2027-414b-9e79-116b798cba0f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '.version_select at 0x7fdd474179d0>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:24.693482 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0d6524eb-2027-414b-9e79-116b798cba0f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029661525" status: 202 len: 0 microversion: 2.1 time: 0.086348 Aug 03 06:02:24.694767 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3983/7979] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 3 06:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2029661525 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:02:24.716637 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e433155-0c3d-44e5-bd02-eca8c6db8991 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'create', calling method: .version_select at 0x7fdd47505ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1544412963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZFfCpB+KtVCQLqjVneMgFul9Uk7FVpS6p8zv5Cj4TXN5bDvVXVEhii8+TzkLl/IEBSAhfiQ7HvjMhIRi6ZTZ5SjzE4xiUXsaUntaxGSyg53ilBh1/YHoVgj2X5fJojwA=="}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:02:24.732776 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8e433155-0c3d-44e5-bd02-eca8c6db8991 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for project 1013377741a240d78e10e8d61b37c497. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 06:02:24.737931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-8e433155-0c3d-44e5-bd02-eca8c6db8991 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for user c81076a31bf24ab09e9f17df86955822 and project 1013377741a240d78e10e8d61b37c497. Resources: {'key_pairs'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 06:02:24.876055 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e433155-0c3d-44e5-bd02-eca8c6db8991 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.163305 Aug 03 06:02:24.876631 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3997/7980] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 06:02:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:02:48.200330 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1848145017", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1544412963", "security_groups": [{"name": "tempest-secgroup-smoke-639576985"}], "networks": [{"uuid": "c7ac81db-cd00-4b52-8ba2-361cd70bc1e3"}], "block_device_mapping_v2": [{"uuid": "f407f9e0-4e20-4f84-b659-25fbca7347c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:02:48.211685 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:48.217176 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:48.317144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.network.neutron [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] validate_networks() for [('c7ac81db-cd00-4b52-8ba2-361cd70bc1e3', None, None, None, None, None)] {{(pid=120832) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 06:02:48.686322 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Flavor limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 06:02:48.686774 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Image limits 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 06:02:48.687285 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Flavor pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 06:02:48.687773 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Image pref 0:0:0 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 06:02:48.688211 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.virt.hardware [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120832) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 06:02:48.698339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:48.698896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:48.699734 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:48.700203 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:48.719296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for project 1013377741a240d78e10e8d61b37c497. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 06:02:48.724745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Getting quotas for user c81076a31bf24ab09e9f17df86955822 and project 1013377741a240d78e10e8d61b37c497. Resources: {'instances', 'ram', 'cores'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 06:02:48.786569 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Going to run 1 instances... {{(pid=120832) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 06:02:48.788743 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f407f9e0-4e20-4f84-b659-25fbca7347c4',volume_size=None,volume_type=None)] {{(pid=120832) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 06:02:49.221041 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c4788881-e7ea-4050-9d08-b3bdb684e5ec tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.025340 Aug 03 06:02:49.222078 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3984/7981] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 06:02:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 06:02:49.231189 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=12 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:49.232429 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=4 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:49.233131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:49.237031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-00e7230e-822d-4eb7-9bdb-98f3f5aa7815 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:49.237724 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-00e7230e-822d-4eb7-9bdb-98f3f5aa7815 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:49.297900 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-00e7230e-822d-4eb7-9bdb-98f3f5aa7815 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:49.303752 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-00e7230e-822d-4eb7-9bdb-98f3f5aa7815 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1089 microversion: 2.1 time: 0.074996 Aug 03 06:02:49.304373 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3998/7982] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:49 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:50.325350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:50.328296 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:50.335354 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:50.335832 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:50.336677 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:50.337230 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:50.403740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:50.411415 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-22703f99-9a16-4af3-87fd-b0470f199511 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1139 microversion: 2.1 time: 0.090457 Aug 03 06:02:50.414374 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3985/7983] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:50 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:51.434946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:51.436171 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:51.443864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:51.448570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:51.448570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:51.448570 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:51.510207 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:51.517993 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-188ca7ac-8182-4646-a642-ccd5d9e35e67 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1195 microversion: 2.1 time: 0.088242 Aug 03 06:02:51.518568 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 3999/7984] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:51 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:52.539579 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:52.540674 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:52.547926 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:52.548450 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:52.549253 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:52.549724 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:52.697443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:52.708634 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d51ab11f-bb56-4c9e-ac85-e8dbb5851f7e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1272 microversion: 2.1 time: 0.172586 Aug 03 06:02:52.709436 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3986/7985] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:52 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:53.233395 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3d7b15dc-4a85-4b50-b937-1f6527b53f91 req-38d6b2a8-a94c-4258-9b62-3f7798403b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:02:53.242867 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3d7b15dc-4a85-4b50-b937-1f6527b53f91 req-38d6b2a8-a94c-4258-9b62-3f7798403b14 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:53.243317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3d7b15dc-4a85-4b50-b937-1f6527b53f91 req-38d6b2a8-a94c-4258-9b62-3f7798403b14 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:53.255294 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3d7b15dc-4a85-4b50-b937-1f6527b53f91 req-38d6b2a8-a94c-4258-9b62-3f7798403b14 service nova] Creating event network-changed:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h2-826756-5 Aug 03 06:02:53.260794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3d7b15dc-4a85-4b50-b937-1f6527b53f91 req-38d6b2a8-a94c-4258-9b62-3f7798403b14 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102649 Aug 03 06:02:53.261720 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4000/7986] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:02:53.731400 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:53.732054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:53.739315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:53.739862 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:53.740951 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:53.741630 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:53.890011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:53.898438 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4701ed6c-1b01-4b63-82d9-1f3a38cbf929 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1272 microversion: 2.1 time: 0.171320 Aug 03 06:02:53.899269 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3987/7987] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:53 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:54.922911 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:54.923618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:54.930052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:54.930504 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:54.931272 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:54.931711 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:55.064945 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:55.072528 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2107b50e-e406-4423-8e6b-f2d4c877069a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1272 microversion: 2.1 time: 0.155404 Aug 03 06:02:55.073103 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4001/7988] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:54 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:56.094351 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:56.094987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:56.101994 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:56.102464 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:56.103282 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:56.103847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:56.243780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:56.251614 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-57dca3e0-2571-4619-8ffd-538cd4d929e3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1272 microversion: 2.1 time: 0.161397 Aug 03 06:02:56.252224 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3988/7989] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:56 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:57.272680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:57.273319 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:57.279872 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:57.280357 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:57.281123 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:57.281555 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:57.416241 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:57.424367 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f7b409bd-f744-4249-a27c-3f0f62fb7768 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.155525 Aug 03 06:02:57.424950 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4002/7990] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:57 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:58.446231 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:58.446864 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:58.453963 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:58.454430 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:58.455213 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:58.455668 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:58.584738 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:58.592815 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6e66862d-9fd6-4d8f-955a-ac74ba76a945 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.150586 Aug 03 06:02:58.593390 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3989/7991] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:58 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:02:59.613691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:02:59.614308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:02:59.617196 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:02:59.622665 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:59.627478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:59.627478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:02:59.627478 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:02:59.773701 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:02:59.782267 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-b59831a5-6137-40c8-8d53-a5b17d685a97 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.172540 Aug 03 06:02:59.782855 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4003/7992] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:02:59 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:00.803813 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:00.804482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:00.806390 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=2 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:03:00.807068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:03:00.813863 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:00.814339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:00.815134 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:00.815594 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:00.953158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:00.960698 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d776c908-6aaa-4218-9bc2-5e73824b46bf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.160856 Aug 03 06:03:00.961276 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3990/7993] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:00 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:01.981864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:01.982421 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:01.989367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:01.989818 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:01.990584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:01.991024 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:02.129047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:02.137562 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f1f4d2d3-ccb0-4b8f-962d-2beabf075a8d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.159145 Aug 03 06:03:02.138159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4004/7994] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:01 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:03.159317 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:03.159960 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:03.167549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:03.168719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:03.169607 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:03.170070 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:03.300494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:03.308082 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f187d0d6-1408-4f7a-9261-a8a9159d15e7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.152834 Aug 03 06:03:03.308850 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3991/7995] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:03 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:04.329408 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:04.329949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:04.337114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:04.337572 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:04.338373 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:04.338810 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:04.466886 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:04.474349 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0f9d1287-173b-4bfa-be97-fbd81f2cd108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.148937 Aug 03 06:03:04.474914 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4005/7996] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:04 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:05.496549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:05.497263 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:05.503995 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:05.504508 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:05.505306 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:05.505761 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:05.641033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:05.648736 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-edfdf33d-9aac-4a42-8518-f7b89dae7be1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.157322 Aug 03 06:03:05.649570 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3992/7997] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:05 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:06.670687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:06.671307 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:06.678510 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:06.679025 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:06.679812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:06.680254 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:06.815366 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:06.823205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-697269ec-9bda-4cde-9fa9-b5aeb28c2a5d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.157145 Aug 03 06:03:06.824077 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4006/7998] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:06 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:07.008019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-2d5acf08-6af8-4897-91dc-ede58178e221 req-50d90bd7-53de-4d62-b917-935702faec27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "name": "network-vif-plugged", "status": "completed", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:03:07.018967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2d5acf08-6af8-4897-91dc-ede58178e221 req-50d90bd7-53de-4d62-b917-935702faec27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:07.019437 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-2d5acf08-6af8-4897-91dc-ede58178e221 req-50d90bd7-53de-4d62-b917-935702faec27 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:07.031636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-2d5acf08-6af8-4897-91dc-ede58178e221 req-50d90bd7-53de-4d62-b917-935702faec27 service nova] Creating event network-vif-plugged:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h2-826756-5 Aug 03 06:03:07.036801 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-2d5acf08-6af8-4897-91dc-ede58178e221 req-50d90bd7-53de-4d62-b917-935702faec27 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Aug 03 06:03:07.037707 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3993/7999] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:03:07.845315 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:07.845934 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:07.853072 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:07.853531 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:07.854302 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:07.854748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:07.986797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:07.994298 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2fc43f2a-d9fe-48bb-80ea-877cedeb97d9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1260 microversion: 2.1 time: 0.152932 Aug 03 06:03:07.994871 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4007/8000] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:07 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:09.016504 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:09.017180 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:09.024460 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:09.024936 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:09.025739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:09.026199 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:09.161672 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:09.170208 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-0baf227a-1197-4303-b6ce-6d236db659a6 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1445 microversion: 2.1 time: 0.158690 Aug 03 06:03:09.170789 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3994/8001] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:09 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:09.191020 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:03:09.191645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:03:09.198548 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:09.199009 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:09.200903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:09.201708 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:09.333340 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:03:09.341101 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bef90d8e-2a1a-4e18-8fd7-c51e81abc9fa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1445 microversion: 2.1 time: 0.153961 Aug 03 06:03:09.341675 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4008/8002] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:03:09 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:03:11.230968 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-132cbd62-d07e-434f-a6b7-8098febc0de2 req-e4e06528-cd42-4031-b5ee-a3228f24d482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:03:11.241775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-132cbd62-d07e-434f-a6b7-8098febc0de2 req-e4e06528-cd42-4031-b5ee-a3228f24d482 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:03:11.242248 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-132cbd62-d07e-434f-a6b7-8098febc0de2 req-e4e06528-cd42-4031-b5ee-a3228f24d482 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:03:11.253798 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-132cbd62-d07e-434f-a6b7-8098febc0de2 req-e4e06528-cd42-4031-b5ee-a3228f24d482 service nova] Creating event network-changed:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h2-826756-5 Aug 03 06:03:11.258885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-132cbd62-d07e-434f-a6b7-8098febc0de2 req-e4e06528-cd42-4031-b5ee-a3228f24d482 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031838 Aug 03 06:03:11.259483 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3995/8003] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:05:36.466735 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 06:05:36.467852 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 06:05:36.468420 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=24 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:05:36.469162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=56 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:05:36.527861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:05:36.528248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:36.534225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:36.534672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:36.536075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:36.536780 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:36.559864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lazy-loading 'flavor' on Instance uuid f51c49d6-0651-4870-b4f1-91091e9fbe79 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 06:05:37.035806 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9f0441cf-3a69-41b0-9954-5247b5711782 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79/action" status: 202 len: 0 microversion: 2.1 time: 0.570576 Aug 03 06:05:37.036762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4009/8004] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:05:36 2022] POST /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:05:37.043852 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:05:37.044822 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:05:37.045434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:05:37.046614 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=60 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:05:37.051056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:37.052177 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:37.059501 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:37.059983 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:37.060827 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:37.061288 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:37.200206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:37.207985 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-44f5d501-25bd-4706-a538-44a15638fa76 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.166029 Aug 03 06:05:37.208599 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3996/8005] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:37 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:05:38.232221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:38.232936 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:38.241931 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:38.242377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:38.243133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:38.243597 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:38.250846 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 45538. Aug 03 06:05:38.251536 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 45540. Aug 03 06:05:38.381462 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:38.389067 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-5ce9803e-f973-45d7-aa3c-720487600860 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.162576 Aug 03 06:05:38.392038 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4010/8006] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:38 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:39.412145 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:39.412807 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:39.425006 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:39.425472 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:39.426941 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:39.427461 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:39.435689 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 45544. Aug 03 06:05:39.447240 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 45546. Aug 03 06:05:39.564715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:39.573013 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b70f577d-de7f-43cb-9991-7be2156bc95f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.165441 Aug 03 06:05:39.573601 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3997/8007] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:39 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:40.595066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:40.595687 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:40.602939 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:40.603399 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:40.604168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:40.604645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:40.737901 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:40.746243 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a42a4de2-ce4c-4fad-a3b7-c830a5efcce2 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.155096 Aug 03 06:05:40.746828 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4011/8008] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:40 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:41.767147 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:41.767808 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:41.775708 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:41.776222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:41.777063 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:41.777516 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:41.911302 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:41.919233 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-363a0b44-7b21-4475-9374-3f4654ec255d tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.156166 Aug 03 06:05:41.919807 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3998/8009] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:41 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:42.941460 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:42.942854 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:42.949915 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:42.950377 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:42.951147 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:42.951589 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:43.082178 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:43.090245 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9edaa964-0348-4029-a177-a84dcf3d6509 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.152765 Aug 03 06:05:43.090812 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4012/8010] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:42 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:44.112562 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:44.113114 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:44.121344 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:44.121820 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:44.122750 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:44.123221 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:44.259301 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:44.266947 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9a4fd159-b95a-4af4-905f-54218423fa30 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.158458 Aug 03 06:05:44.267525 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 3999/8011] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:44 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:45.291705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:45.292393 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:45.300585 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:45.301067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:45.301903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:45.302347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:45.442317 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:45.450326 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a7cee3fe-b192-4ee0-a223-acae4a8b6d17 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.165315 Aug 03 06:05:45.450910 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4013/8012] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:45 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:46.472415 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:46.473061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:46.480477 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:46.480952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:46.481745 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:46.482202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:46.613297 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:46.621636 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-8f7c0590-e629-43a5-a944-a0e36bb817cd tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.153250 Aug 03 06:05:46.622213 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4000/8013] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:46 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:47.642690 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:47.643338 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:47.650306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:47.650763 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:47.651533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:47.651974 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:47.789516 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:47.798757 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f5e5f07f-8946-44b0-a554-8cebc0a0a40b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.159960 Aug 03 06:05:47.799481 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4014/8014] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:47 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:48.821333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:48.821869 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:48.829009 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:48.829479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:48.830264 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:48.830715 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:48.960293 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:48.967909 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5b4a56df-7c2c-4988-af9c-50f57448c26a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.151467 Aug 03 06:05:48.968505 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4001/8015] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:48 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:49.990002 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:49.990618 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:49.998284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:49.998650 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:49.999426 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:49.999866 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:50.141922 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:50.149851 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e4f1060f-df11-4d40-81a2-cdcac445ba73 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.163810 Aug 03 06:05:50.150439 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4015/8016] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:49 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:51.171299 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:51.172028 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:51.179728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:51.180237 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:51.181089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:51.181549 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:51.318445 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:51.326187 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-4eacf135-bafb-4d61-bd9c-ba2f6675b71f tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.158828 Aug 03 06:05:51.326772 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4002/8017] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:51 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:52.347925 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:52.348558 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:52.355712 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:52.356162 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:52.357031 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:52.357464 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:52.751056 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:52.759513 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4abd2219-222b-4064-96f5-e35438302275 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1511 microversion: 2.1 time: 0.415760 Aug 03 06:05:52.760096 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4016/8018] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:52 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:52.781756 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:05:52.782387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:52.789609 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:52.790081 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:52.790879 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:52.791592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:52.880054 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120832) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 06:05:53.160838 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [6e4df73f-999b-4219-a698-15d77c5be4ba] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:05:53.786423 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ca5a8228-f43f-4508-956a-6a453094f8a9 req-d5125409-614f-4678-84a9-88ea23dc7e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "name": "network-vif-unplugged", "status": "completed", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:05:53.797112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ca5a8228-f43f-4508-956a-6a453094f8a9 req-d5125409-614f-4678-84a9-88ea23dc7e9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:53.797566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ca5a8228-f43f-4508-956a-6a453094f8a9 req-d5125409-614f-4678-84a9-88ea23dc7e9b service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:53.808767 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.compute.server_external_events [req-ca5a8228-f43f-4508-956a-6a453094f8a9 req-d5125409-614f-4678-84a9-88ea23dc7e9b service nova] Unable to find a host for instance f51c49d6-0651-4870-b4f1-91091e9fbe79. Dropping event network-vif-unplugged {{(pid=120831) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 06:05:53.809641 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ca5a8228-f43f-4508-956a-6a453094f8a9 req-d5125409-614f-4678-84a9-88ea23dc7e9b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.076529 Aug 03 06:05:53.810418 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4017/8019] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 78 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 03 06:05:54.168736 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [6e4df73f-999b-4219-a698-15d77c5be4ba] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 45582. Aug 03 06:05:54.172918 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ee36dc98-4f38-4d1c-be28-b0942d32bb12 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "POST /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79/action" status: 202 len: 0 microversion: 2.1 time: 1.395235 Aug 03 06:05:54.173782 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4003/8020] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:05:52 2022] POST /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79/action => generated 0 bytes in 1397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:05:54.182503 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:54.183110 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:54.189066 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:54.189514 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:54.190279 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:54.190716 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:54.339528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:54.347104 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f02a2aa0-f843-4201-b212-c0d4f425c108 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1519 microversion: 2.1 time: 0.168949 Aug 03 06:05:54.347673 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4018/8021] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:54 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:05:55.370187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:55.370828 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:55.378178 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:55.378654 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:55.379456 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:55.379916 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:55.568867 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:55.577922 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2a4dba2c-34c9-4f1b-b96b-cb5d4777e907 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1519 microversion: 2.1 time: 0.213177 Aug 03 06:05:55.578493 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4004/8022] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:55 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:56.600067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:56.601197 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:56.608074 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:56.608562 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:56.609333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:56.609770 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:56.791294 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:56.799039 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-69133106-5584-46db-8d34-aae8cbaa10a8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1519 microversion: 2.1 time: 0.202972 Aug 03 06:05:56.799663 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4019/8023] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:56 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:57.821482 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:57.822219 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:57.829286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:57.829760 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:57.830554 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:57.831013 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:58.023791 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:58.031503 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1b0b0e3a-fe4d-4bd0-b672-5d36ba6f69aa tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1519 microversion: 2.1 time: 0.214880 Aug 03 06:05:58.032104 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4005/8024] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:57 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:05:59.054116 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:05:59.054797 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:05:59.062156 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:59.066246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:59.066246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:05:59.066246 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:05:59.196430 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:05:59.204093 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-addaacec-2d9f-4de2-a6e6-215b2163bddf tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1519 microversion: 2.1 time: 0.154697 Aug 03 06:05:59.204697 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4020/8025] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:05:59 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:00.226207 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:00.226840 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:00.234097 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:00.234583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:00.235406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:00.235855 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:00.369903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:00.377544 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d353f98f-eace-4187-935a-4be9e87a580e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1521 microversion: 2.1 time: 0.155835 Aug 03 06:06:00.378119 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4006/8026] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:00 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:01.400019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:01.400705 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:01.407738 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:01.408198 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:01.409008 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:01.409454 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:01.550261 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:01.558965 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-08488e82-0f16-47ca-95ee-65ebbcd705f1 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1521 microversion: 2.1 time: 0.163766 Aug 03 06:06:01.559538 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4021/8027] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:01 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:02.581128 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:02.581765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:02.589486 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:02.589948 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:02.592434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:02.592434 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:02.728571 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:02.736297 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b1f1bfda-6e33-4d53-93ea-52778f519407 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1521 microversion: 2.1 time: 0.159073 Aug 03 06:06:02.736892 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4007/8028] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:02 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:03.761347 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:03.762010 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:03.769023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:03.769488 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:03.770277 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:03.770726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:03.907895 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:03.915749 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-65d5757f-4d17-43ca-afa7-a848ac569f33 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1521 microversion: 2.1 time: 0.158496 Aug 03 06:06:03.916610 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4022/8029] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:03 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:04.938116 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:04.938792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:04.946242 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:04.946739 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:04.947521 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:04.947971 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:05.081283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:05.089887 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a2f2c999-ce11-4cd6-acd7-7414ab9173e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1521 microversion: 2.1 time: 0.155738 Aug 03 06:06:05.090564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4008/8030] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:04 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:06.111153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:06.111765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:06.119176 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:06.119627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:06.121169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:06.121169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:06.305564 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:06.313506 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-208c825b-07ad-4af2-802d-4cdb27b77b31 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.206366 Aug 03 06:06:06.314105 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4023/8031] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:06 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:06.786710 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-9116918c-0267-4ace-b439-567406dd70cf req-1e783a68-ef47-4a74-98d6-dcd1ae497d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:06:06.799629 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9116918c-0267-4ace-b439-567406dd70cf req-1e783a68-ef47-4a74-98d6-dcd1ae497d97 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:06.800106 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-9116918c-0267-4ace-b439-567406dd70cf req-1e783a68-ef47-4a74-98d6-dcd1ae497d97 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:06.812483 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-9116918c-0267-4ace-b439-567406dd70cf req-1e783a68-ef47-4a74-98d6-dcd1ae497d97 service nova] Creating event network-changed:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h1-826756-5 Aug 03 06:06:06.817856 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-9116918c-0267-4ace-b439-567406dd70cf req-1e783a68-ef47-4a74-98d6-dcd1ae497d97 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035017 Aug 03 06:06:06.818614 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4009/8032] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 06:06:07.337667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:07.337667 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:07.340394 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=31 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:06:07.345154 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:07.345608 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:07.346380 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:07.346822 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:07.351363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:06:07.484405 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:07.490608 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-76709d34-be85-4a18-9b17-f1b9c87a2aa4 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.158785 Aug 03 06:06:07.491191 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4024/8033] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:07 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:08.514613 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:08.515332 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:08.517314 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:06:08.522371 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:08.522816 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:08.523635 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:08.524090 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:08.526703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:06:08.657052 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:08.664779 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-c3437347-f278-4b46-a6fd-581d010684db tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.155237 Aug 03 06:06:08.665355 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4010/8034] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:08 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:09.266375 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:06:09.266962 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:06:09.686463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:09.687073 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:09.694320 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:09.695383 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:09.699376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:09.699376 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:09.837459 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:09.845091 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3e92af1c-bd75-4a28-b0b9-27bfbcad02e0 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.162600 Aug 03 06:06:09.845680 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4025/8035] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:09 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:10.866896 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:10.867634 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:10.874266 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:10.874740 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:10.875548 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:10.875987 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:11.008056 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:11.015724 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6ec106a5-9d89-471c-8e2b-93aa855d4f9a tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.153292 Aug 03 06:06:11.016320 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4011/8036] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:10 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:12.037103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:12.037819 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:12.045820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:12.046284 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:12.047061 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:12.047530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:12.181599 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:12.189528 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-c77bde0e-490b-403e-ba1d-181d7f1a4f8e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.156488 Aug 03 06:06:12.190095 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4026/8037] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:12 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:13.211545 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:13.212096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:13.219240 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:13.219718 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:13.220546 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:13.221092 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:13.362993 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:13.371587 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-542b7402-2759-4058-b9d7-0a89efc6edc7 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.164330 Aug 03 06:06:13.372180 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4012/8038] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:13 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:14.393200 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:14.393824 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:14.401735 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:14.402229 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:14.403035 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:14.403479 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:14.536590 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:14.545428 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7257ea68-d9ec-4a67-9203-3adc30d7859b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.156113 Aug 03 06:06:14.545949 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4027/8039] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:14 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:15.566490 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:15.567428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:15.574811 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:15.575286 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:15.576074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:15.576568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:15.716952 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:15.724559 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a9dd8c0b-3d2a-4903-b1b2-de17542769f9 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.162059 Aug 03 06:06:15.725139 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4013/8040] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:15 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:16.746768 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:16.747528 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:16.754619 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:16.755078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:16.755861 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:16.756396 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:16.885561 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:16.893284 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d93a5834-51c7-49ae-b135-e74afb5efaab tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.150388 Aug 03 06:06:16.893875 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4028/8041] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:16 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:17.915387 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:17.920488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:17.920757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-fdc93381-e341-4a3f-a8a0-1493e28ff5e5 req-35175d17-0c6d-40c8-8d71-dc774d1b4c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "name": "network-vif-plugged", "status": "completed", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:06:17.924428 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:17.924912 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:17.925713 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:17.926173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:17.930275 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fdc93381-e341-4a3f-a8a0-1493e28ff5e5 req-35175d17-0c6d-40c8-8d71-dc774d1b4c0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:17.930930 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-fdc93381-e341-4a3f-a8a0-1493e28ff5e5 req-35175d17-0c6d-40c8-8d71-dc774d1b4c0f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:17.944542 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-fdc93381-e341-4a3f-a8a0-1493e28ff5e5 req-35175d17-0c6d-40c8-8d71-dc774d1b4c0f service nova] Creating event network-vif-plugged:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h1-826756-5 Aug 03 06:06:17.950243 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-fdc93381-e341-4a3f-a8a0-1493e28ff5e5 req-35175d17-0c6d-40c8-8d71-dc774d1b4c0f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Aug 03 06:06:17.954836 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4029/8042] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:06:18.084903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:18.093442 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fc906fd0-11f1-400f-b814-eb9f4c11c477 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.182185 Aug 03 06:06:18.095260 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4014/8043] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:17 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:19.117100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:19.117820 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:19.124512 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:19.124975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:19.125749 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:19.126195 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:19.269485 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:19.277920 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-34c5758f-7bba-4f9d-875c-8ee6896451b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1577 microversion: 2.1 time: 0.166042 Aug 03 06:06:19.278549 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4030/8044] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:19 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:06:20.299596 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:06:20.300236 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:06:20.307619 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:20.308089 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:20.308920 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:06:20.309373 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:06:20.446049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:06:20.453693 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-d4b18fd9-c10b-49e5-89dc-e767b03fef65 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1564 microversion: 2.1 time: 0.158046 Aug 03 06:06:20.454266 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4015/8045] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:06:20 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:07:48.739777 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:07:48.740561 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:07:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:07:49.092712 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:07:49.093290 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:07:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:07:57.753863 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=13 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:07:57.754714 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=37 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:07:57.759400 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:07:57.759946 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:07:57.761222 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=11 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:07:57.762138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=35 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:07:57.769023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:57.769023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:57.769023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:57.769023 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:57.798956 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 06:07:57.859656 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8ad0f291-6b1d-4058-96f9-b5a453086ec8 req-e109b5f6-55f4-4972-8411-11f3bee95e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:07:57.869315 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8ad0f291-6b1d-4058-96f9-b5a453086ec8 req-e109b5f6-55f4-4972-8411-11f3bee95e87 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:57.869803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8ad0f291-6b1d-4058-96f9-b5a453086ec8 req-e109b5f6-55f4-4972-8411-11f3bee95e87 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:57.883488 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8ad0f291-6b1d-4058-96f9-b5a453086ec8 req-e109b5f6-55f4-4972-8411-11f3bee95e87 service nova] Creating event network-changed:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h1-826756-5 Aug 03 06:07:57.888942 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8ad0f291-6b1d-4058-96f9-b5a453086ec8 req-e109b5f6-55f4-4972-8411-11f3bee95e87 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134537 Aug 03 06:07:57.889568 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4016/8046] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:07:58.204205 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-761f4986-731b-477a-8f07-c1b53ce028ee tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 204 len: 0 microversion: 2.1 time: 0.452237 Aug 03 06:07:58.208111 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4031/8047] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 06:07:57 2022] DELETE /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 06:07:58.215049 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:07:58.216821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:07:58.222785 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:58.223247 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:58.224026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:58.224597 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:58.359821 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:07:58.368100 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-03ace14b-042a-47f6-bfc4-5488c6509d95 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.158375 Aug 03 06:07:58.368715 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4017/8048] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:07:58 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:07:59.390976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:07:59.391673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:07:59.399078 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:59.399530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:59.400318 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:07:59.400757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:07:59.555756 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:07:59.563590 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8d508e81-6f3a-4026-95d9-ae864292be79 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1570 microversion: 2.1 time: 0.177015 Aug 03 06:07:59.564196 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4032/8049] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:07:59 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:00.318638 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-8084c9cd-44c8-4472-aafb-f3076393206c req-dee606c4-e567-4d67-ba62-d243e6d533f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51c49d6-0651-4870-b4f1-91091e9fbe79", "name": "network-vif-deleted", "tag": "957f1b0b-8e3c-44d0-936c-ed3cab2a76cc"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:00.328583 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8084c9cd-44c8-4472-aafb-f3076393206c req-dee606c4-e567-4d67-ba62-d243e6d533f8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:00.329161 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-8084c9cd-44c8-4472-aafb-f3076393206c req-dee606c4-e567-4d67-ba62-d243e6d533f8 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:00.341042 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-8084c9cd-44c8-4472-aafb-f3076393206c req-dee606c4-e567-4d67-ba62-d243e6d533f8 service nova] Creating event network-vif-deleted:957f1b0b-8e3c-44d0-936c-ed3cab2a76cc for instance f51c49d6-0651-4870-b4f1-91091e9fbe79 on n-h1-826756-5 Aug 03 06:08:00.346190 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-8084c9cd-44c8-4472-aafb-f3076393206c req-dee606c4-e567-4d67-ba62-d243e6d533f8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108873 Aug 03 06:08:00.346793 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4018/8050] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:08:00.586851 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:00.588191 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:00.597496 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:00.598060 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:00.598983 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:00.599530 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:00.670090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:00.678664 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-bbbc7e2c-ba59-4cc6-af7e-34a9faaef837 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1220 microversion: 2.1 time: 0.096754 Aug 03 06:08:00.679345 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4033/8051] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:00 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:01.700202 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:01.700947 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:01.708592 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:01.709138 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:01.709973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:01.710519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:01.778705 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:01.786403 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-eff6d96d-65a4-4a91-8644-14ef51cf301e tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1220 microversion: 2.1 time: 0.090588 Aug 03 06:08:01.786972 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4019/8052] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:01 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:02.808533 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:02.809151 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:02.816382 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:02.816864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:02.817672 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:02.818103 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:02.884028 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:02.891794 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-56c4d17f-087b-471d-963a-813c8423c6b3 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1220 microversion: 2.1 time: 0.087372 Aug 03 06:08:02.892381 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4034/8053] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:02 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:03.913458 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:03.914108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:03.921397 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:03.921861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:03.922642 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:03.923100 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:03.987976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:03.996633 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2022ac8f-c678-4cdd-93e6-1a288f988c22 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1220 microversion: 2.1 time: 0.087734 Aug 03 06:08:03.997208 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4020/8054] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:03 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:05.017976 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:05.018779 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:05.026331 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:05.026799 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:05.027612 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:05.028086 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:05.067137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:05.067137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:05.067137 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.objects.instance [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lazy-loading 'fault' on Instance uuid f51c49d6-0651-4870-b4f1-91091e9fbe79 {{(pid=120831) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 06:08:05.108112 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81076a31bf24ab09e9f17df86955822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1013377741a240d78e10e8d61b37c497', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:05.115727 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-22d0e469-b8f8-41d9-a969-17b7a2c20e5b tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 200 len: 1225 microversion: 2.1 time: 0.101748 Aug 03 06:08:05.116409 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4035/8055] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:05 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:06.138572 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:06.139153 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] [instance: f51c49d6-0651-4870-b4f1-91091e9fbe79] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:06.146438 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:06.147262 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:06.148069 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:06.148550 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:06.163388 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.wsgi [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] HTTP exception thrown: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Request method failure captured: Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: request: GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 HTTP/1.1 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Accept: application/json Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Accept-Encoding: identity Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Connection: close Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Content-Length: 0 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Content-Type: application/json Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Host: 10.222.0.72 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: Openstack-System-Scope: None Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: User-Agent: python-urllib3/1.26.10 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Auth-Token: gAAAAABi6g5rzZjycGF2rLbzN8scXi5V96JCsB4oaZ20aZMJpU42ysJhSoOXGiaiaEA5zW__i8qIQ-F5uHPM6_F6hYQhXC7HVqo3vmA0kcKFF-9CaGNLkBxvQas1RCiAXTMsIJdKHW9JFJCNB9S9pv7gsO4zdxP8Iz2wMvA9d55dUuuAsHEHmbo Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Id: None Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Domain-Name: None Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Identity-Status: Confirmed Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Is-Admin-Project: True Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Id: default Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Domain-Name: Default Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Id: 1013377741a240d78e10e8d61b37c497 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Project-Name: tempest-TestShelveInstance-924312566 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Role: reader,member Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Roles: reader,member Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1013377741a240d78e10e8d61b37c497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1013377741a240d78e10e8d61b37c497"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1013377741a240d78e10e8d61b37c497"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1013377741a240d78e10e8d61b37c497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant: tempest-TestShelveInstance-924312566 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Id: 1013377741a240d78e10e8d61b37c497 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-Tenant-Name: tempest-TestShelveInstance-924312566 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-User: tempest-TestShelveInstance-924312566-project Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Id: default Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-User-Domain-Name: Default Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-User-Id: c81076a31bf24ab09e9f17df86955822 Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: X-User-Name: tempest-TestShelveInstance-924312566-project Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: method: > Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: exception: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: action_args: {'id': 'f51c49d6-0651-4870-b4f1-91091e9fbe79'} Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:08:06.194229 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: ERROR nova.api.openstack.wsgi Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Returning 404 to user: Instance f51c49d6-0651-4870-b4f1-91091e9fbe79 could not be found. {{(pid=120832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-04939222-9d48-416a-969b-645de3507336 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79" status: 404 len: 111 microversion: 2.1 time: 0.032471 Aug 03 06:08:06.199499 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4021/8056] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:06 2022] GET /compute/v2.1/servers/f51c49d6-0651-4870-b4f1-91091e9fbe79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 06:08:06.406547 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ab275b7f-46f7-43ba-bd1d-57653fcd3de8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] Calling method '.version_select at 0x7fdd47e2d430>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:06.493983 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ab275b7f-46f7-43ba-bd1d-57653fcd3de8 tempest-TestShelveInstance-924312566 tempest-TestShelveInstance-924312566-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1544412963" status: 202 len: 0 microversion: 2.1 time: 0.091558 Aug 03 06:08:06.494618 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4036/8057] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 3 06:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1544412963 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:08:29.603060 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=12 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:29.604096 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=24 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:29.822414 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-02cceb75-1333-4050-95b0-bac5ce145603 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Action: 'create', calling method: .version_select at 0x7fdd47417040>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-679932625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIz6/2eT9Ty6lyI3ymjqXU/hGdauIsurYr+whYwcuQAR7NyzZImhvv+OUo1J47ZJWl3XF5ESGHU7rs67/DXwasWA7Ph9QgyqDorKiMB1EJmcrtmxkF9YFMKFetpWJ4cTQ=="}} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:29.839934 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-02cceb75-1333-4050-95b0-bac5ce145603 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 06:08:29.845779 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.quota [None req-02cceb75-1333-4050-95b0-bac5ce145603 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for user 68da90ae49e74c15b6a43833c31b451a and project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'key_pairs'} {{(pid=120832) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 06:08:29.970324 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-02cceb75-1333-4050-95b0-bac5ce145603 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.373371 Aug 03 06:08:29.970945 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4022/8058] 10.222.0.72 () {60 vars in 1159 bytes} [Wed Aug 3 06:08:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:08:32.591381 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:32.592167 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:32.596133 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1295126773", "imageRef": "f43e106e-5d11-4960-8ca7-6f17956e0464", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-679932625", "security_groups": [{"name": "tempest-secgroup-smoke-1605726921"}], "networks": [{"uuid": "978f8226-6991-49a0-8849-3fdf2eb7cb16"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:32.712816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] validate_networks() for [('978f8226-6991-49a0-8849-3fdf2eb7cb16', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 06:08:33.211075 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 06:08:33.211543 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 06:08:33.212055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 06:08:33.212536 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 06:08:33.212951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 06:08:33.222169 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:33.222602 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:33.223443 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:33.223888 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:33.242907 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 06:08:33.248220 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for user 68da90ae49e74c15b6a43833c31b451a and project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 06:08:33.260859 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 06:08:33.263131 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f43e106e-5d11-4960-8ca7-6f17956e0464',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 06:08:33.383186 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-86481595-db67-403e-8e1c-4dcc123352b9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.793612 Aug 03 06:08:33.383832 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4037/8059] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 06:08:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 06:08:33.394775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-b286b512-d3f7-455e-8a57-0e83ebf453fa tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:33.395433 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-b286b512-d3f7-455e-8a57-0e83ebf453fa tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:33.465019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-b286b512-d3f7-455e-8a57-0e83ebf453fa tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:33.473295 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-b286b512-d3f7-455e-8a57-0e83ebf453fa tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1248 microversion: 2.1 time: 0.082368 Aug 03 06:08:33.474624 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4023/8060] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:33 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:34.495686 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:34.496339 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:34.502988 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:34.503438 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:34.504199 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:34.504661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:34.574552 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:34.582311 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-05e499ce-081a-4037-82e5-a3f5dc7664d5 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1252 microversion: 2.1 time: 0.091418 Aug 03 06:08:34.582883 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4038/8061] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:34 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1252 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:35.603393 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:35.604042 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:35.614071 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:35.614547 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:35.615352 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:35.615847 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:35.686514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:35.696260 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6b3a2241-a317-4110-bdef-f80e7d3f48b1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1318 microversion: 2.1 time: 0.097035 Aug 03 06:08:35.709136 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4024/8062] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:35 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:36.718129 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:36.718747 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:36.726221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:36.726729 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:36.727499 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:36.727942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:36.949216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:36.957030 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e9eb5d0-b8b1-42a4-beed-951fcdb3ea07 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.242761 Aug 03 06:08:36.957623 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4039/8063] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:36 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:37.139651 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-aa16a331-f0de-49d9-9311-3f73e3abcee4 req-9e766cc3-9e3d-40ce-804c-f02b65d1c9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:37.151883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-aa16a331-f0de-49d9-9311-3f73e3abcee4 req-9e766cc3-9e3d-40ce-804c-f02b65d1c9d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:37.152443 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-aa16a331-f0de-49d9-9311-3f73e3abcee4 req-9e766cc3-9e3d-40ce-804c-f02b65d1c9d5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:37.164620 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-aa16a331-f0de-49d9-9311-3f73e3abcee4 req-9e766cc3-9e3d-40ce-804c-f02b65d1c9d5 service nova] Creating event network-changed:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:08:37.170367 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-aa16a331-f0de-49d9-9311-3f73e3abcee4 req-9e766cc3-9e3d-40ce-804c-f02b65d1c9d5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034780 Aug 03 06:08:37.170981 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4025/8064] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:08:37.978634 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:37.979363 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:37.986583 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:37.987039 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:37.987811 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:37.988255 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:38.126662 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:38.134763 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-dd987fa7-e09a-4936-a378-6abaa8d7b494 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.160194 Aug 03 06:08:38.135335 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4040/8065] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:37 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:39.155946 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:39.156730 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:39.164792 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:39.165274 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:39.166074 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:39.166585 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:39.300068 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:39.308200 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-bb05853e-2ed9-458f-ab0a-7aacebd1d5ac tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.156777 Aug 03 06:08:39.308806 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4026/8066] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:39 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:40.329584 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:40.334216 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:40.344360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:40.344826 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:40.345598 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:40.349892 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:40.488036 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:40.496568 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-93e5382b-fe4a-48e8-86c9-15a542da1e21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.171396 Aug 03 06:08:40.497158 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4041/8067] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:40 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:41.518019 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:41.518780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:41.525859 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:41.526339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:41.527135 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:41.527622 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:41.663383 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:41.672395 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-52744ff6-5960-4f62-a316-0125719f1c0f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.158380 Aug 03 06:08:41.672971 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4027/8068] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:41 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:42.657268 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2236bc38-5938-43b5-a92c-715c14955ba8 req-253b872e-76f3-4658-a8b3-19701b3a4046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "name": "network-vif-plugged", "status": "completed", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:42.669181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2236bc38-5938-43b5-a92c-715c14955ba8 req-253b872e-76f3-4658-a8b3-19701b3a4046 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:42.669638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2236bc38-5938-43b5-a92c-715c14955ba8 req-253b872e-76f3-4658-a8b3-19701b3a4046 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:42.681387 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2236bc38-5938-43b5-a92c-715c14955ba8 req-253b872e-76f3-4658-a8b3-19701b3a4046 service nova] Creating event network-vif-plugged:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:08:42.686467 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2236bc38-5938-43b5-a92c-715c14955ba8 req-253b872e-76f3-4658-a8b3-19701b3a4046 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Aug 03 06:08:42.687057 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4042/8069] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:08:42.693903 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:42.694880 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:42.703539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:42.703539 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:42.704406 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:42.705132 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:42.906271 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:42.914647 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6712232f-ea64-452f-972b-6c0b7904bf3f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.224104 Aug 03 06:08:42.915701 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4028/8070] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:42 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:08:43.934221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:43.935014 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=6 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:43.939987 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:43.940757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:43.947740 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:43.948203 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:43.949017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:43.949466 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:44.089027 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:44.096767 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-41b8ad7b-2364-4301-90e4-9dc805bb99d8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1374 microversion: 2.1 time: 0.163518 Aug 03 06:08:44.097356 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4043/8071] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:43 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:45.117615 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:45.118201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:45.120927 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:08:45.126706 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:45.127227 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:45.128011 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:45.128488 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:45.261775 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:45.269484 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-01d3c527-1956-4c87-8bb2-eb5373b6dcf4 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1560 microversion: 2.1 time: 0.155862 Aug 03 06:08:45.270100 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4029/8072] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:45 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:45.290143 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:08:45.290765 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:08:45.298726 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:45.299182 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:45.299951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:45.300431 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:45.433227 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:08:45.440829 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a522f855-28f6-4855-b0c8-d0a25ecffe30 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1560 microversion: 2.1 time: 0.154620 Aug 03 06:08:45.441404 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4044/8073] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:08:45 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:08:47.689008 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-e2c1a5b0-78ab-4111-a67d-3a97e43a5891 req-23f87400-47d1-41f2-95d2-8a9f8ac08c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:08:47.705514 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2c1a5b0-78ab-4111-a67d-3a97e43a5891 req-23f87400-47d1-41f2-95d2-8a9f8ac08c9f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:08:47.706080 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-e2c1a5b0-78ab-4111-a67d-3a97e43a5891 req-23f87400-47d1-41f2-95d2-8a9f8ac08c9f service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:08:47.717502 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-e2c1a5b0-78ab-4111-a67d-3a97e43a5891 req-23f87400-47d1-41f2-95d2-8a9f8ac08c9f service nova] Creating event network-changed:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:08:47.722555 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-e2c1a5b0-78ab-4111-a67d-3a97e43a5891 req-23f87400-47d1-41f2-95d2-8a9f8ac08c9f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Aug 03 06:08:47.723176 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4030/8074] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:10:41.904739 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 06:10:41.905652 n-d-826756-5 devstack@n-api.service[120831]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 06:10:41.907183 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:41.908114 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=40 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:41.912120 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-426040759"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:10:41.914500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:10:41.924575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:10:41.924575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:10:41.924575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:10:41.924575 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:10:42.296895 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4201bbbd-8c51-47c9-ba2f-73716dd65a04 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "POST /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47/action" status: 202 len: 0 microversion: 2.1 time: 0.393666 Aug 03 06:10:42.297466 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4045/8075] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:10:41 2022] POST /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 06:10:49.196401 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:10:49.197733 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 06:10:49.198429 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:49.198731 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=34 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:49.203759 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-21ed9b1f-7a3b-4553-9100-c87669b194f7 req-5d9479b4-96ef-4c01-bc2e-70504e9887a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "name": "network-vif-plugged", "status": "completed", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:10:49.215206 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21ed9b1f-7a3b-4553-9100-c87669b194f7 req-5d9479b4-96ef-4c01-bc2e-70504e9887a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:10:49.220702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-21ed9b1f-7a3b-4553-9100-c87669b194f7 req-5d9479b4-96ef-4c01-bc2e-70504e9887a5 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:10:49.227495 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-21ed9b1f-7a3b-4553-9100-c87669b194f7 req-5d9479b4-96ef-4c01-bc2e-70504e9887a5 service nova] Creating event network-vif-plugged:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:10:49.232954 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-21ed9b1f-7a3b-4553-9100-c87669b194f7 req-5d9479b4-96ef-4c01-bc2e-70504e9887a5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038397 Aug 03 06:10:49.234254 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4031/8076] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:10:57.961739 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:57.962506 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:10:57.966644 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-925917013", "imageRef": "5d40b1d2-45a9-424e-a18f-56b2296565da", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-679932625", "security_groups": [{"name": "tempest-secgroup-smoke-1605726921"}], "networks": [{"uuid": "978f8226-6991-49a0-8849-3fdf2eb7cb16"}]}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:10:57.992512 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd486ced-833a-4ad7-bc4b-54d25cbc57e6] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46100. Aug 03 06:10:57.993332 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] [2173a78b-d00e-4158-a71c-906af153bf3c] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46098. Aug 03 06:10:58.270748 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.network.neutron [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] validate_networks() for [('978f8226-6991-49a0-8849-3fdf2eb7cb16', None, None, None, None, None)] {{(pid=120831) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 06:10:58.637755 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Flavor limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 06:10:58.638188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Image limits 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 06:10:58.638673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Flavor pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 06:10:58.639088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Image pref 0:0:0 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 06:10:58.639508 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.virt.hardware [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120831) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 06:10:58.649168 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:10:58.649622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:10:58.650422 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:10:58.650864 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:10:58.668017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 06:10:58.673559 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.quota [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Getting quotas for user 68da90ae49e74c15b6a43833c31b451a and project 9c758bdfdea84e1b92e34bc58792ffad. Resources: {'instances', 'ram', 'cores'} {{(pid=120831) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 06:10:58.686498 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Going to run 1 instances... {{(pid=120831) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 06:10:58.689017 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d40b1d2-45a9-424e-a18f-56b2296565da',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120831) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 06:10:58.813316 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4f2e9b18-f83e-493c-9d0b-0aeb471c2c4d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.853565 Aug 03 06:10:58.813910 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4046/8077] 10.222.0.72 () {60 vars in 1147 bytes} [Wed Aug 3 06:10:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 06:10:58.826201 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dc5aeef5-1376-4493-9260-3cf315d2f304 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:10:58.826935 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dc5aeef5-1376-4493-9260-3cf315d2f304 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:10:58.859474 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46116. Aug 03 06:10:58.860340 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46118. Aug 03 06:10:58.942719 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dc5aeef5-1376-4493-9260-3cf315d2f304 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:10:58.950089 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dc5aeef5-1376-4493-9260-3cf315d2f304 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1247 microversion: 2.1 time: 0.128166 Aug 03 06:10:58.950650 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4032/8078] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:10:58 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1247 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:10:59.971838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-d4b56875-b747-43e4-90e8-5ae27cbdc0e1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:10:59.973221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-d4b56875-b747-43e4-90e8-5ae27cbdc0e1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:00.029902 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-d4b56875-b747-43e4-90e8-5ae27cbdc0e1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:00.037399 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-d4b56875-b747-43e4-90e8-5ae27cbdc0e1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1247 microversion: 2.1 time: 0.070004 Aug 03 06:11:00.037975 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4047/8079] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:10:59 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:01.058509 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a6cc9c11-541f-43b4-87c9-e1b0876bad6f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:01.059150 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a6cc9c11-541f-43b4-87c9-e1b0876bad6f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:01.114047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a6cc9c11-541f-43b4-87c9-e1b0876bad6f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:01.120844 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a6cc9c11-541f-43b4-87c9-e1b0876bad6f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1247 microversion: 2.1 time: 0.066236 Aug 03 06:11:01.121412 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4033/8080] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:01 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1247 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:01.233981 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-2002f7ae-40a4-447c-a902-0348483a5405 req-16cc63cf-d968-46a9-880c-4fda29e11cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "name": "network-vif-unplugged", "status": "completed", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:11:01.246645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2002f7ae-40a4-447c-a902-0348483a5405 req-16cc63cf-d968-46a9-880c-4fda29e11cae service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:01.246645 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-2002f7ae-40a4-447c-a902-0348483a5405 req-16cc63cf-d968-46a9-880c-4fda29e11cae service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:01.257382 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-2002f7ae-40a4-447c-a902-0348483a5405 req-16cc63cf-d968-46a9-880c-4fda29e11cae service nova] Creating event network-vif-unplugged:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:11:01.262393 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-2002f7ae-40a4-447c-a902-0348483a5405 req-16cc63cf-d968-46a9-880c-4fda29e11cae service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091275 Aug 03 06:11:01.262985 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4048/8081] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:11:02.142897 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-fecc96aa-f24a-48eb-8aaa-b9a7e735a74d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:02.143451 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-fecc96aa-f24a-48eb-8aaa-b9a7e735a74d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:02.200890 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-fecc96aa-f24a-48eb-8aaa-b9a7e735a74d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:02.209121 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-fecc96aa-f24a-48eb-8aaa-b9a7e735a74d tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1247 microversion: 2.1 time: 0.070219 Aug 03 06:11:02.209725 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4034/8082] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:02 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:03.231067 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:03.231871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:03.238316 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:03.238774 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:03.240047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:03.240511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:03.303524 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:03.310937 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-1ae06ee9-c032-400c-87ce-4dd5182a2dbf tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1251 microversion: 2.1 time: 0.084989 Aug 03 06:11:03.311513 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4049/8083] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:03 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1251 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:04.334291 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:04.334967 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:04.342329 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:04.342798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:04.343582 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:04.344728 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:04.407033 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:04.414678 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-f5355b82-160e-43a8-8f71-3f01a6d16220 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1243 microversion: 2.1 time: 0.086361 Aug 03 06:11:04.415263 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4035/8084] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:04 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:05.436997 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:05.437392 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:05.445500 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:05.446065 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:05.446975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:05.447495 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:05.523758 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:05.532565 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0c80696b-2c21-4eed-9aac-fcf2bc9b8af0 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1305 microversion: 2.1 time: 0.100404 Aug 03 06:11:05.533159 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4050/8085] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:05 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:06.555703 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:06.557095 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:06.564625 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:06.565420 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:06.566294 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:06.566848 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:06.716235 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:06.727223 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-dde9fe3e-a7bd-4d95-8cd8-733fa04dd61c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.175383 Aug 03 06:11:06.728585 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4036/8086] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:06 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 06:11:07.749674 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:07.750239 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:07.757994 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:07.758452 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:07.759439 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:07.760718 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:07.914463 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:07.923156 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-7086b47d-7182-4ff4-8da3-688a779417c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.177323 Aug 03 06:11:07.938273 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4051/8087] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:07 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:08.748025 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:11:08.748719 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:11:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:11:08.839869 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:11:08.840096 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:11:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:11:08.947494 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:08.948233 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:08.959645 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:08.960120 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:08.961158 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:08.961689 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:09.101202 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:11:09.101785 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:11:09.113109 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:09.121571 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-1eff1f75-dc58-4506-ae49-e3f6eb533863 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.178413 Aug 03 06:11:09.122168 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4037/8088] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:08 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:10.142673 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:10.143267 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:10.145153 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:11:10.147221 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell0:SELECT=8 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:11:10.152149 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:10.152641 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:10.153404 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:10.153838 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:10.306041 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:10.314621 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-3581e024-5e71-4cc5-8e8c-d2c8468be4a2 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.175729 Aug 03 06:11:10.319537 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4052/8089] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:10 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:11.352870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:11.563839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:11.575758 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-6fee85c7-5181-42b1-a314-efea0b01c97f tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.243151 Aug 03 06:11:11.576706 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4038/8090] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:11 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:12.604491 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:12.605248 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:12.612225 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:12.619578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:12.619578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:12.619578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:12.772905 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:12.781066 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-4feff79e-e6da-4d60-b452-b6c6c28b284e tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.181505 Aug 03 06:11:12.781938 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4053/8091] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:12 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:13.809950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:13.809950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:13.809950 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell0:SELECT=6 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:11:13.814179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:13.814861 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:13.815662 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:13.816123 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:13.969004 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:13.978793 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a80e1bb2-eae5-4da1-aa03-449781ce5066 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.180218 Aug 03 06:11:13.993081 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4039/8092] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:13 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:14.540465 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-45483fd4-44c3-425f-9bf2-66404d456812 req-d0d4e53d-09ba-4b2e-a103-419c44a9e783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:11:14.551968 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-45483fd4-44c3-425f-9bf2-66404d456812 req-d0d4e53d-09ba-4b2e-a103-419c44a9e783 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:14.555159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-45483fd4-44c3-425f-9bf2-66404d456812 req-d0d4e53d-09ba-4b2e-a103-419c44a9e783 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:14.564451 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-45483fd4-44c3-425f-9bf2-66404d456812 req-d0d4e53d-09ba-4b2e-a103-419c44a9e783 service nova] Creating event network-changed:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:11:14.570491 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-45483fd4-44c3-425f-9bf2-66404d456812 req-d0d4e53d-09ba-4b2e-a103-419c44a9e783 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034344 Aug 03 06:11:14.576314 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4054/8093] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:11:15.001410 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:15.002670 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:15.010404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:15.010871 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:15.011659 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:15.012108 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:15.150666 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:15.159559 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-edcc0564-1474-4672-8a44-11d531f7a323 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.162012 Aug 03 06:11:15.160573 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4040/8094] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:14 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:16.182090 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:16.182816 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:16.189064 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:16.189515 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:16.190271 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:16.190713 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:16.323511 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:16.330999 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-a4c1b5e9-710b-43d8-be35-6ac60af22015 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.154077 Aug 03 06:11:16.331570 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4055/8095] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:16 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:17.352996 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:17.353532 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:17.360557 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:17.361035 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:17.361824 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:17.362283 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:17.498673 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:17.506566 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-65a31f10-73ca-4e1b-bdb8-fe7861364952 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.158520 Aug 03 06:11:17.507148 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4041/8096] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:17 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:18.528159 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:18.528812 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:18.535698 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:18.540951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:18.540951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:18.540951 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:18.675680 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:18.683773 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f8b121f0-0404-4819-ad28-ef4a17d92076 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.159562 Aug 03 06:11:18.684420 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4056/8097] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:18 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:19.705479 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:19.706144 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:19.714050 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:19.714526 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:19.715335 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:19.715854 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:19.849453 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:19.857347 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-37187360-07cd-4e70-960c-b3089e26ecfc tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.155774 Aug 03 06:11:19.857932 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4042/8098] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:19 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:20.878975 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:20.879627 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:20.887412 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:20.887903 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:20.888737 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:20.889181 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:21.025188 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:21.032816 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-0cea1b4d-30c4-49fd-9818-7c34657863c1 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.157727 Aug 03 06:11:21.033402 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4057/8099] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:20 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:21.185839 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-fff1d588-8b8a-45ea-8ce8-ab0d5b461fc5 req-b0ea9dff-3ba7-400f-a26c-3b72564b6d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "name": "network-vif-plugged", "status": "completed", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:11:21.197268 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fff1d588-8b8a-45ea-8ce8-ab0d5b461fc5 req-b0ea9dff-3ba7-400f-a26c-3b72564b6d8e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:21.197744 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-fff1d588-8b8a-45ea-8ce8-ab0d5b461fc5 req-b0ea9dff-3ba7-400f-a26c-3b72564b6d8e service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:21.208722 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-fff1d588-8b8a-45ea-8ce8-ab0d5b461fc5 req-b0ea9dff-3ba7-400f-a26c-3b72564b6d8e service nova] Creating event network-vif-plugged:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:11:21.217438 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-fff1d588-8b8a-45ea-8ce8-ab0d5b461fc5 req-b0ea9dff-3ba7-400f-a26c-3b72564b6d8e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Aug 03 06:11:21.217438 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4043/8100] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:11:22.053865 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:22.054715 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:22.061947 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:22.062410 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:22.063192 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:22.063638 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:22.193391 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:22.201553 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-8e91316c-8aac-465c-aaea-f1199c8b666c tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1373 microversion: 2.1 time: 0.151625 Aug 03 06:11:22.202132 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4058/8101] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:22 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:23.224404 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:23.225051 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:23.231581 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:23.232061 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:23.232883 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:23.233350 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:23.371676 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:23.384137 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-cbe3a946-bd43-42fe-85f8-0c420da534c8 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1558 microversion: 2.1 time: 0.164975 Aug 03 06:11:23.384761 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4044/8102] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:23 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:23.404532 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:11:23.405150 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:11:23.412052 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:23.412538 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:23.413306 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:23.414367 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:23.545201 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:11:23.552853 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-709dbba4-219e-4c1f-b7d9-a55a129d6d81 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1558 microversion: 2.1 time: 0.152233 Aug 03 06:11:23.553429 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4059/8103] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:11:23 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:11:25.825870 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-4e40f958-daa2-4d78-ba47-451ed014fc94 req-f11e31e4-3da7-4359-997e-fef1f28d46a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:11:25.836648 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4e40f958-daa2-4d78-ba47-451ed014fc94 req-f11e31e4-3da7-4359-997e-fef1f28d46a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:11:25.837115 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-4e40f958-daa2-4d78-ba47-451ed014fc94 req-f11e31e4-3da7-4359-997e-fef1f28d46a2 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:11:25.849310 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-4e40f958-daa2-4d78-ba47-451ed014fc94 req-f11e31e4-3da7-4359-997e-fef1f28d46a2 service nova] Creating event network-changed:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:11:25.855922 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-4e40f958-daa2-4d78-ba47-451ed014fc94 req-f11e31e4-3da7-4359-997e-fef1f28d46a2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033698 Aug 03 06:11:25.856686 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4045/8104] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:13:04.432083 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:04.432875 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=66 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:04.436937 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-22466166"}} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:04.439263 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:04.445576 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:04.447476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:04.447476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:04.447476 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:04.894863 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-9e8529a0-8437-41d1-8a47-e5db3eb39a21 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "POST /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28/action" status: 202 len: 0 microversion: 2.1 time: 0.464726 Aug 03 06:13:04.895530 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4060/8105] 10.222.0.72 () {60 vars in 1278 bytes} [Wed Aug 3 06:13:04 2022] POST /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 03 06:13:09.949631 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] AMQP server on 10.222.0.72:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 06:13:09.953411 n-d-826756-5 devstack@n-api.service[120832]: ERROR oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] AMQP server on 10.222.0.72:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 03 06:13:09.954379 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_api:SELECT=36 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:09.955402 n-d-826756-5 devstack@n-api.service[120832]: DEBUG dbcounter [-] [120832] Writing DB stats nova_cell1:SELECT=60 {{(pid=120832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:09.960187 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-de26fe9f-9dec-4360-b26c-c1a68db52e09 req-10b16ef1-3a1e-44cd-8979-2d87fec915ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "name": "network-vif-plugged", "status": "completed", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:09.981515 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-de26fe9f-9dec-4360-b26c-c1a68db52e09 req-10b16ef1-3a1e-44cd-8979-2d87fec915ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:09.982275 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-de26fe9f-9dec-4360-b26c-c1a68db52e09 req-10b16ef1-3a1e-44cd-8979-2d87fec915ac service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:09.998259 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-de26fe9f-9dec-4360-b26c-c1a68db52e09 req-10b16ef1-3a1e-44cd-8979-2d87fec915ac service nova] Creating event network-vif-plugged:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:13:10.004419 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-de26fe9f-9dec-4360-b26c-c1a68db52e09 req-10b16ef1-3a1e-44cd-8979-2d87fec915ac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059470 Aug 03 06:13:10.005246 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4046/8106] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:13:20.420333 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:20.424019 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:20.424140 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_api:SELECT=2 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:20.424834 n-d-826756-5 devstack@n-api.service[120831]: DEBUG dbcounter [-] [120831] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 06:13:20.436100 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:20.436871 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:20.437691 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:20.438308 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:20.444620 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [2836fbc1-af53-4f5e-bcff-c8c55dc7c2dd] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46446. Aug 03 06:13:20.455788 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] [135e2cbc-a896-42c1-8d91-cff5c2ad7ab7] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 46448. Aug 03 06:13:20.467778 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Going to try to terminate instance {{(pid=120831) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 06:13:20.495831 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [req-11b468be-116a-4fc2-9a03-55437a025787 req-b40f9589-8b5c-4b9e-998d-1bf1d1993946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:20.507234 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-11b468be-116a-4fc2-9a03-55437a025787 req-b40f9589-8b5c-4b9e-998d-1bf1d1993946 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:20.507875 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [req-11b468be-116a-4fc2-9a03-55437a025787 req-b40f9589-8b5c-4b9e-998d-1bf1d1993946 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:20.521302 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.compute.server_external_events [req-11b468be-116a-4fc2-9a03-55437a025787 req-b40f9589-8b5c-4b9e-998d-1bf1d1993946 service nova] Creating event network-changed:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:13:20.526885 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [req-11b468be-116a-4fc2-9a03-55437a025787 req-b40f9589-8b5c-4b9e-998d-1bf1d1993946 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108990 Aug 03 06:13:20.527810 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4047/8107] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 06:13:20.803274 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-e29c70b0-9505-40d8-8d74-89a144affb74 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 204 len: 0 microversion: 2.1 time: 0.388690 Aug 03 06:13:20.803880 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4061/8108] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 06:13:20 2022] DELETE /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 06:13:20.813179 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:20.813911 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:20.820519 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:20.820989 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:20.821787 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:20.822246 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:20.965026 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:20.973255 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9be567a4-daba-4816-9b7b-ef7ed208ebc7 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1683 microversion: 2.1 time: 0.164702 Aug 03 06:13:20.979576 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4048/8109] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:20 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:21.790055 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-b29fd476-7242-4d4b-9b3d-93cf2c5bc675 req-1191a840-1e3e-4d8c-84f7-72b66d1c8d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "name": "network-vif-unplugged", "status": "completed", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:21.800757 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b29fd476-7242-4d4b-9b3d-93cf2c5bc675 req-1191a840-1e3e-4d8c-84f7-72b66d1c8d00 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:21.801210 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-b29fd476-7242-4d4b-9b3d-93cf2c5bc675 req-1191a840-1e3e-4d8c-84f7-72b66d1c8d00 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:21.812966 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-b29fd476-7242-4d4b-9b3d-93cf2c5bc675 req-1191a840-1e3e-4d8c-84f7-72b66d1c8d00 service nova] Creating event network-vif-unplugged:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:13:21.817762 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-b29fd476-7242-4d4b-9b3d-93cf2c5bc675 req-1191a840-1e3e-4d8c-84f7-72b66d1c8d00 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032008 Aug 03 06:13:21.818344 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4062/8110] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:13:21.996973 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:21.997611 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:22.005105 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:22.015955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:22.015955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:22.015955 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:22.158647 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:22.158647 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-5df76a65-c7de-4457-bf4b-90213bfe2c19 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1683 microversion: 2.1 time: 0.161889 Aug 03 06:13:22.158647 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4049/8111] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:21 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:22.997578 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-ad9b5d9f-a350-411a-bd05-ef223aebfeaa req-5d74515e-8784-4ded-b369-b7f84b296353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc4147a-6139-41a0-b7b7-babafa144e28", "name": "network-vif-deleted", "tag": "fcf1f68b-ea16-4c40-8369-d4e4003e923a"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:23.007453 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ad9b5d9f-a350-411a-bd05-ef223aebfeaa req-5d74515e-8784-4ded-b369-b7f84b296353 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:23.007929 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-ad9b5d9f-a350-411a-bd05-ef223aebfeaa req-5d74515e-8784-4ded-b369-b7f84b296353 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:23.021038 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-ad9b5d9f-a350-411a-bd05-ef223aebfeaa req-5d74515e-8784-4ded-b369-b7f84b296353 service nova] Creating event network-vif-deleted:fcf1f68b-ea16-4c40-8369-d4e4003e923a for instance 2fc4147a-6139-41a0-b7b7-babafa144e28 on n-h2-826756-5 Aug 03 06:13:23.026548 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-ad9b5d9f-a350-411a-bd05-ef223aebfeaa req-5d74515e-8784-4ded-b369-b7f84b296353 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086851 Aug 03 06:13:23.027253 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4063/8112] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:13:23.175245 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:23.176543 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:23.183589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:23.184072 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:23.184923 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:23.185339 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:23.259772 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:23.267872 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-9eaa1abf-6274-4f3f-b58d-dec9156d5e71 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 200 len: 1332 microversion: 2.1 time: 0.096440 Aug 03 06:13:23.268492 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4050/8113] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:23 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:24.291880 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:24.292622 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 2fc4147a-6139-41a0-b7b7-babafa144e28] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:24.299942 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:24.300440 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:24.301217 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:24.301661 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:24.315431 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] HTTP exception thrown: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Request method failure captured: Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 HTTP/1.1 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6hDW81eCd223JEwj0v0ey5gaLUprG20uNvRxEZrJxLaTIFF8KqB3sRBu37klzQbAv7TXoQxWQAwx9mIjTvs8Z14yKx1a-MimUm1nmkjKXZn9Prtw99aAnfIQa3unP-4DW58pLz2pCmRiRKKpBFjvgVM-jN6D83tgfyizSSiiuFsrtfM Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9c758bdfdea84e1b92e34bc58792ffad Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9c758bdfdea84e1b92e34bc58792ffad Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestSnapshotPattern-964014899-project Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 68da90ae49e74c15b6a43833c31b451a Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestSnapshotPattern-964014899-project Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '2fc4147a-6139-41a0-b7b7-babafa144e28'} Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:13:24.317088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Returning 404 to user: Instance 2fc4147a-6139-41a0-b7b7-babafa144e28 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-ee9cac41-b8de-45b7-9338-f269259659e3 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 03 06:13:24.322088 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4064/8114] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:24 2022] GET /compute/v2.1/servers/2fc4147a-6139-41a0-b7b7-babafa144e28 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 06:13:26.631803 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:26.632358 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:26.636427 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-5fc11be7-f20d-48be-a1c9-13ed4446d3f2 req-464d24e8-7997-4dd1-83b2-dfba47a29903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:26.640303 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:26.640780 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:26.641589 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:26.642047 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:26.648806 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5fc11be7-f20d-48be-a1c9-13ed4446d3f2 req-464d24e8-7997-4dd1-83b2-dfba47a29903 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:26.649360 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-5fc11be7-f20d-48be-a1c9-13ed4446d3f2 req-464d24e8-7997-4dd1-83b2-dfba47a29903 service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:26.660146 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-5fc11be7-f20d-48be-a1c9-13ed4446d3f2 req-464d24e8-7997-4dd1-83b2-dfba47a29903 service nova] Creating event network-changed:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:13:26.666739 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-5fc11be7-f20d-48be-a1c9-13ed4446d3f2 req-464d24e8-7997-4dd1-83b2-dfba47a29903 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Aug 03 06:13:26.667371 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4065/8115] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 06:13:26.676426 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Going to try to terminate instance {{(pid=120832) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 06:13:27.008933 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a21e68f8-0609-4a35-ab46-e386078d51fe tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "DELETE /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 204 len: 0 microversion: 2.1 time: 0.380110 Aug 03 06:13:27.009771 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4051/8116] 10.222.0.72 () {58 vars in 1239 bytes} [Wed Aug 3 06:13:26 2022] DELETE /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 06:13:27.019006 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:27.019727 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:27.026657 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:27.027118 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:27.027961 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:27.028441 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:27.172250 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.policy [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120831) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:27.180132 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-2ab33d0f-2d5d-4e94-95cb-c27f01793ab9 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1685 microversion: 2.1 time: 0.165381 Aug 03 06:13:27.181762 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4066/8117] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:27 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:28.203040 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:28.203765 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:28.210701 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:28.211173 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:28.212678 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:28.213149 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:28.405698 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:28.413523 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-a7f3aa02-8849-4209-85d9-2be1acdb754b tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1685 microversion: 2.1 time: 0.214843 Aug 03 06:13:28.414095 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4052/8118] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:28 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1685 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:29.104213 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [req-3cee7b6a-7659-49c5-948e-3b6467e4d19c req-7ce1dee6-54a4-4c57-8039-43e908b9870d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa9e3d9-ad72-4483-898c-61fa28c16a47", "name": "network-vif-deleted", "tag": "454fdc3f-69f3-4a67-b941-fcb59a1cd13c"}]} {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 06:13:29.115170 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3cee7b6a-7659-49c5-948e-3b6467e4d19c req-7ce1dee6-54a4-4c57-8039-43e908b9870d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:29.115633 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [req-3cee7b6a-7659-49c5-948e-3b6467e4d19c req-7ce1dee6-54a4-4c57-8039-43e908b9870d service nova] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:29.127345 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.compute.server_external_events [req-3cee7b6a-7659-49c5-948e-3b6467e4d19c req-7ce1dee6-54a4-4c57-8039-43e908b9870d service nova] Creating event network-vif-deleted:454fdc3f-69f3-4a67-b941-fcb59a1cd13c for instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 on n-h1-826756-5 Aug 03 06:13:29.132386 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [req-3cee7b6a-7659-49c5-948e-3b6467e4d19c req-7ce1dee6-54a4-4c57-8039-43e908b9870d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Aug 03 06:13:29.132986 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4067/8119] 10.222.0.72 () {64 vars in 1317 bytes} [Wed Aug 3 06:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 06:13:29.488925 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:29.489566 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.compute.api [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120832) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:29.498976 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:29.499565 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:29.500633 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:29.501186 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:29.549868 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:29.550333 n-d-826756-5 devstack@n-api.service[120832]: DEBUG oslo_concurrency.lockutils [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:29.550798 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.objects.instance [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lazy-loading 'fault' on Instance uuid 1fa9e3d9-ad72-4483-898c-61fa28c16a47 {{(pid=120832) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 06:13:29.592568 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.policy [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68da90ae49e74c15b6a43833c31b451a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c758bdfdea84e1b92e34bc58792ffad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120832) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 06:13:29.599955 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-ed3caecb-67ac-485c-987b-ab4ba772f909 tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 200 len: 1338 microversion: 2.1 time: 0.168750 Aug 03 06:13:29.600564 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4053/8120] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:29 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 06:13:30.622979 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '>' {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:30.623693 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.compute.api [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] [instance: 1fa9e3d9-ad72-4483-898c-61fa28c16a47] Fetching instance by UUID {{(pid=120831) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 06:13:30.630047 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:30.630566 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:30.631344 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 06:13:30.631794 n-d-826756-5 devstack@n-api.service[120831]: DEBUG oslo_concurrency.lockutils [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Lock "88ed4435-a3db-44bd-a042-900e396de7ba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 06:13:30.645914 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.wsgi [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] HTTP exception thrown: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Request method failure captured: Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: request: GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 HTTP/1.1 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Accept: application/json Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Accept-Encoding: identity Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Connection: close Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Content-Length: 0 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Content-Type: application/json Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Host: 10.222.0.72 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: Openstack-System-Scope: None Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: User-Agent: python-urllib3/1.26.10 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Auth-Token: gAAAAABi6hDW81eCd223JEwj0v0ey5gaLUprG20uNvRxEZrJxLaTIFF8KqB3sRBu37klzQbAv7TXoQxWQAwx9mIjTvs8Z14yKx1a-MimUm1nmkjKXZn9Prtw99aAnfIQa3unP-4DW58pLz2pCmRiRKKpBFjvgVM-jN6D83tgfyizSSiiuFsrtfM Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Id: None Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Domain-Name: None Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Identity-Status: Confirmed Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Is-Admin-Project: True Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Id: default Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Domain-Name: Default Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Id: 9c758bdfdea84e1b92e34bc58792ffad Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Project-Name: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Role: reader,member Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Roles: reader,member Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.72:8080", "publicURL": "http://10.222.0.72:8080/v1/AUTH_9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/9c758bdfdea84e1b92e34bc58792ffad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}] Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Id: 9c758bdfdea84e1b92e34bc58792ffad Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-Tenant-Name: tempest-TestSnapshotPattern-964014899 Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-User: tempest-TestSnapshotPattern-964014899-project Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Id: default Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Domain-Name: Default Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Id: 68da90ae49e74c15b6a43833c31b451a Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: X-User-Name: tempest-TestSnapshotPattern-964014899-project Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: method: > Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: exception: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: action_args: {'id': '1fa9e3d9-ad72-4483-898c-61fa28c16a47'} Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: {{(pid=120831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 06:13:30.647616 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: ERROR nova.api.openstack.wsgi Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: DEBUG nova.api.openstack.wsgi [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Returning 404 to user: Instance 1fa9e3d9-ad72-4483-898c-61fa28c16a47 could not be found. {{(pid=120831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: INFO nova.api.openstack.requestlog [None req-f11fa20d-aff5-4b27-b8a4-0d4bded686ef tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47" status: 404 len: 111 microversion: 2.1 time: 0.031638 Aug 03 06:13:30.652949 n-d-826756-5 devstack@n-api.service[120831]: [pid: 120831|app: 0|req: 4068/8121] 10.222.0.72 () {58 vars in 1236 bytes} [Wed Aug 3 06:13:30 2022] GET /compute/v2.1/servers/1fa9e3d9-ad72-4483-898c-61fa28c16a47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 06:13:30.905702 n-d-826756-5 devstack@n-api.service[120832]: DEBUG nova.api.openstack.wsgi [None req-2e01786d-ecb7-4223-88bb-390127cf69ee tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] Calling method '.version_select at 0x7fdd59cd8670>' {{(pid=120832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 06:13:31.004485 n-d-826756-5 devstack@n-api.service[120832]: INFO nova.api.openstack.requestlog [None req-2e01786d-ecb7-4223-88bb-390127cf69ee tempest-TestSnapshotPattern-964014899 tempest-TestSnapshotPattern-964014899-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-679932625" status: 202 len: 0 microversion: 2.1 time: 0.103721 Aug 03 06:13:31.005103 n-d-826756-5 devstack@n-api.service[120832]: [pid: 120832|app: 0|req: 4054/8122] 10.222.0.72 () {58 vars in 1254 bytes} [Wed Aug 3 06:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-679932625 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 06:14:28.847675 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:14:28.848417 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:14:29.113105 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:14:29.113669 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:16:08.767103 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:16:08.767882 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:16:09.281342 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:16:09.281913 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:16:31.402298 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:16:31.402896 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:16:41.278070 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:16:41.278722 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:17:48.857298 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:17:48.857928 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:17:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:17:49.121827 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:17:49.122455 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:19:28.776105 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:19:28.776744 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:19:29.289669 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:19:29.290237 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:19:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:19:51.410750 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:19:51.411284 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:19:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:20:01.287974 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:20:01.288599 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:21:08.865965 n-d-826756-5 devstack@n-api.service[120832]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:21:08.866626 n-d-826756-5 devstack@n-api.service[120832]: Wed Aug 3 06:21:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 06:21:09.135935 n-d-826756-5 devstack@n-api.service[120831]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 06:21:09.136522 n-d-826756-5 devstack@n-api.service[120831]: Wed Aug 3 06:21:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!